Hello,
Here is a screenshot of my setup in the Level Blueprint:
The only setting I changed was on the cube mesh, I changed Collision Complexity to Use Complex Collision as Simple.
When I used this method, I didn’t see any issues occurring. Are you using Sweep at all when you are moving your elevator?