Hello RO10,
I believe this is a bug and have reported it as such. It is possible however that Simulating Physics off and on at runtime is something that is not supported at this time. It will be discussed and I’ll update this post when any updates have been made. For your reference, the bug number is UE-22350.
Have a nice day!