# Mocap for live player input (Gameplay)

**URL:** <https://forums.unrealengine.com/t/mocap-for-live-player-input-gameplay/227138>\
**Category:** Game Development\
**Tags:** unreal-engine\
**Created:** [April 29, 2021, 7:48pm UTC](https://forums.unrealengine.com/t/mocap-for-live-player-input-gameplay/227138 "2021-04-29T19:48:38Z")\
**Posts on this page:** 1\
**Page:** 1

<div class="post-metadata">

**Author:** ![PoseAI](https://d3kjluh73b9h9o.cloudfront.net/original/4X/2/8/5/28502927f1d97ba1051b3b47ccfe17233bf41ef0.png) [@PoseAI](https://forums.unrealengine.com/u/PoseAI)\
**Post date:** [April 29, 2021, 7:48pm UTC](https://forums.unrealengine.com/t/mocap-for-live-player-input-gameplay/227138/1 "2021-04-29T19:48:38Z")

</div>

While there are several tools for capturing animations as part of game _development_, we are working on player-input motion capture at game _time_ using only the ubiquitous smartphone as additional hardware. This will hopefully enable a variety of alternative game types such as rhythm games, sweaty real-motion brawlers or perhaps player driven live emoting.

I thought I would share our Unreal Engine development demo where we stream from the normal camera of an iPhone to animate a character live in game. Our motion capture software is fully running on the phone in real-time - no server or desktop resources used (receiving a UDP stream from the phone). We also only use a normal video stream from the camera - no LIDAR or depth camera requirement.

[Initial demo video on YouTube](https://youtu.be/xqPhU871Yps)

The video has a sneak peak of the app in test deployment as well as used against some YouTube clips.

Constructive feedback always welcome!
