What I’m doing is very simple: I’m adding instances to the instanced mesh component using AddInstance, then later removing them using GetInstancesOverlappingSphere/Box and RemoveInstances.
At first it works, removing all overlapping instances, but then it starts to miss more and more.
I’ve put together a simple project to demonstrate: