I share the sentiment almost entirely.
That doesn’t mean that the VR template was just neglected and has some basic missing stuff to it potentially - like sub step settings or bad collision settings on the boxes it uses.
Project Settings > Engine > Physics.
Physics is also tied to the running frame rate unless you do enable sub-stepping. And because the rendering engine seemed to be performing like trash for me - 1000 simulating engine boxes, 16fps at 2k??? - it could very well be that in VR (rendering 2 eyes) you are running into timing issues.