Greetings @NotPenguYT
Welcome to the Unreal Engine Community. I had the same thing happen using Chaos a while back. I felt like it was a bug at that point. Take a peek at this thread. Is this the same issue? Lag when attaching actor to component (Also which version of UE are you running and are you using Chaos?)