I had this same question back in May and the solution went unanswered. I think it’s just a bug or limitation of UEFN right now.
https://forums.unrealengine.com/t/looking-to-add-collision-to-object-moving-with-level-sequence/
Now if I want something to push a player I always attach a device such as a bouncer or mushroom to it to cause a collision.