VRPawn colliding with invisible wall or object

Hi!
I can move freely in the world with the VRPawn, but when I reach a certain place it seems that the VRPawn is colliding with something invisible. I have used “Player Collision” and “Visibility Collisions” view modes but there’s no collision there or hidden object. I have moved the entire world, rebuilt geometry and navigation with no luck at all.
Any ideas?
I’m using UE5.2.1 on Windows 10 Pro