I found I also had to add these redirectors to the [CoreRedirects] section
+ClassRedirects=(OldName="/Script/OldPluginName.",NewName="/Script/NewPluginName.",MatchSubstring=true)
+StructRedirects=(OldName="/Script/OldPluginName.",NewName="/Script/NewPluginName.",MatchSubstring=true)