How to fix actor detaching from scenecomponent only once

I see you did not take our recommendation regarding storing references to heart at all :stuck_out_tongue_winking_eye:

It would be something closer to this:

Avoid using Get (All) of Class nodes if you can. They have a very specific use case scenarios, this is not one of them.