In case somebody encounter the same issue, according to the reply at answer hub:
ue4 physic isn’t using a fixed time step, which causes physics behave different under different frame rate. The answer suggest tweaking physic substep in the project settings.