I’ve found a good work around to the issues I was having by removing instances using there location which is the same on both server and client and it seams to be working well.
The main issue I was having was that the instance index was different on the server and client as well as having different instance static mesh components.