Movement of actor on a floating actor

I have tried to make a floating actor, that have physics that I can have other actors on, and also walk with my character. However, when I walk on said actor and push another actor that is also on the floating actor the floating actor starts to accelerate. This seems like a bug because you shouldn’t be able push the actor that you are located on (laws of physics?). But have someone had this problem and worked around it?

Thanks for any help!