Hmm try getting the world rotation from the camera, that might take the look angle into consideration too!