Line trace with HMD

am working on a project where am moving a hand in front the camera using leap motion, and i have to select stuff with the hand, this works perfectly if am not using HMD, the problem is that when am using the HMD the line trace is not forward to the camera anymore, i guess this is because there is two cameras now. the hit position is shifted from the hand location. so is there a solution for that??

Where are you line trace starting from and going to? Are they tracing from fingertips ? Can you post a picture or video to demonstrate the issue ?