How to bypass the VR offset from the mesh?

Whenever I use VR in Preview mode, if I am below certain height from the surface of the imported mesh, I can not use teleportation mode in VR. If I am above it, I can not touch the surface, and instead I am floating high in the air, but I can move and teleport in VR. The problem occurs in both 5.1.1 and 5.2 Preview only with that imported geometry. If I will create a terrain in UE, no problem. Does anyone has an idea why this happens?