'Update Instance Transform' / 'Remove Instance' == big performance hit even if used only on 1 instance

Is there a way to solve this problem? Too many tree instances have good fps, but cutting down trees will cause FPS to drop lot by 1 second.