Guidelines really state the importance of not overriding the field of view to a VR HMD, as this can result in simulation sickness. See: Virtual Reality Best Practices | Unreal Engine (VR and Simulation Sickness)
Perhaps this might help you come up with a different solution. The Nest (Sniper VR)