Going from non VR mode to VR mode having bad performance

I am still getting the same problem after 4.16.

Is anyone else switching between non-vr and vr and having troubles? Anyone got any insight?