Changing from a NON VR map to a VR map performance drop

When the VR level is loaded first I get 90 fps, if not I am getting around 40-50 on a GTX 1080. I originally did have the same level for VR and non VR but because of the dynamic lighting (time of day feature) in our non vr map we optimised and used static lighting.