Editor slow after exiting VR Preview 4.27

I am testing the Valve Index in 4.27 with the VR Template.
After exiting the VR Preview the Editor starts lagging extremly.

I believe the problem is that the VR Goggles keep running. They are running this steam VR lounge room thingy which is usually for selecting games and things like that. This presumably eats resources and slows the editor.

Back in 4.26 when exiting the VR Preview you would be placed into a black environment with a “pause” symbol text displaying “waiting” and a couple of blinking lines. This of course does not waste resources.

Does anybody know a solution do this problem?