How to control objects movement using hand movement and a webcam?

Development Platform & Builds XR Development
1

My supervisor decided to use the normal webcam to track hand movement and then make user interaction to move objects in the game via hand movement ,i downloaded a plugin to play the webcam in unreal 4 ,any suggestions for functions to track if the hand moved right the object follow it and move right and vice versa? Thanks a lot.

2

That sounds difficult to implement. If you are lucky there is some third party solution you can use. But considering how complicated hand tracking is even with dedicated hardware (Kinect, Leap) I wouldn’t expect too much from an ordinary webcam.

(Also, this do not seem like a VR or AR issue.)

3

That sounds difficult to implement. If you are lucky there is some third party solution you can use. But considering how complicated hand tracking is even with dedicated hardware (Kinect, Leap) I wouldn’t expect too much from an ordinary webcam.

(Also, this do not seem like a VR or AR issue.)
[/QUOTE]

Thanks a lot