Hey Ga.rheault,
Your drivers and system look up to the task of handling VR in UE4. Have you tried to see what performance is like when using the Showdown demo? If not please download and run that then let us know how it performs or if you experience any lag. Also what project were you using when you ran into these problems?