I realize this is a late answer. But I’ll leave it here for future generations. I solved this problem in this way: I find delta vector between controller and camera.
