Was noticing this in my own project and assumed it was me, and was going to investigate later. However, I can now confirm that I’m seeing the same cause and effect.
I get the lag/swimming when using Camera Component on my Pawn. You can see that the world doesn’t follow along as it should compared to the Chaperon. You can get quite ill while looking at this discrepancy.
If I either stop the Pawn’s Camera Component from auto activating, or turn off the Player Controller’s Auto Manage Active Camera Target, then the world in VR is locked compared to the Chaperon, as expected. The world is solid again.
This is very serious, and no VR project can be shipped in this state.