General bad Oculus Rift performance in Unreal Engine 4

Have you tried restarting the rift? Once I change HMD I have to restart it to make it work, that or not run it in direct HMD mode, which also gives me better FPS for some reason.