Vive Mocap Kit - Support

Community Marketplace
#1

Link: Vive Mocap Kit in Code Plugins - UE Marketplace

For support, please contact me via e-mail [EMAIL=“ykaczc@gmail.com”]ykasczc@gmail.com

VIve Mocap Kit - Demo 2 - YouTube [TABLE=“border: 1, cellpadding: 1, width: 500”]

		**Documentation**
		**Last Update**
	
	
		[PDF](https://drive.google.com/file/d/0B6s-2uvAvszmLVRPOUFhTnVXTE0/view)
		09/2019

Videos [TABLE=“border: 1, cellpadding: 1”]

		Demo video #1 (4 trackers)
		https://www.youtube.com/watch?v=Zf7DGlj5vE8
	
	
		Demo video #2 (4 trackers)
		https://www.youtube.com/watch?v=rotTd9Yx6qA
	
	
		Demo video #3 (4 trackers)
		https://www.youtube.com/watch?v=Qa_wmv4i9n4
	
	
		Capture without VR headset
		https://www.youtube.com/watch?v=wVmbuz3y7GE
	
	
		Setup custom skeletal mesh to capture
		https://www.youtube.com/watch?v=hf6zMCP8Gwc
	
	
		Setup in blank project
		https://www.youtube.com/watch?v=DodWPWWcjlo
	
	
		**New:** Capture without VR headset in UE4 viewport
		https://www.youtube.com/watch?v=ltFaKA16jzs

ViveMocap Demo projects [TABLE=“border: 1, cellpadding: 1”]

		**Version**
		**Link**
	
	
		4.18
		https://drive.google.com/file/d/1KOSP9H6Wxk0HTN5TynhMIhBIm6A33rDD
	
	
		4.19
		https://drive.google.com/file/d/1zPT9tC3NB86iJoJ2cz6xEMPuAJl6oMVd
	
	
		4.20
		https://drive.google.com/file/d/1QzGWihX3FGrMvUi7rLsHiiu3vYBt-Wlh
	
	
		4.21
		https://drive.google.com/file/d/18wWlxogitsq1Zu-P2J8GqL3uk83aZKdS
	
	
		4.22 for [Valve SteamVR Input for Unreal](https://www.unrealengine.com/marketplace/en-US/slug/steamvr-input-for-unreal)
		plugin (required), also demonstrating fingers animation
		https://drive.google.com/file/d/12PXjcHWPyiIg6YQr2RpNuyjtni0JsLJK/view
	
	
		4.22 with replication
		https://drive.google.com/file/d/1SnF7AeCjsoXEjMbnBbShd42Y0EGWYTjz/view
		And the same project for 4.27 (other aspects not updated)
		https://drive.google.com/file/d/1iaG2qXw_8ngDpDQ3JnM-IA0wjzu662Ai/view?usp=sharing
	
	
		4.23
		https://drive.google.com/open?id=1SeZxqoThlxhUWjN9fqDs0RXGLAQT-wxB
		https://drive.google.com/file/d/12xd__7Xdekd4OIAov4eo1gLhdwQ54m15
	
	
		4.23 for Valve SteamVR Input for Unreal plugin.
		Non-HMD map fixed
		https://drive.google.com/open?id=1jklEdbh86P-csrIU6kmeiv2m_8aE88r0
	
	
		4.24
		https://drive.google.com/file/d/1r5KYwRXHpviSDEDWwdng9heN24vEs5F3/view
	
	
		4.25
		https://drive.google.com/file/d/1Sy2K9T0vY7ahjjK9_R2z5SMOZ2Xhsuj4/view
	
	
		4.26
		https://drive.google.com/file/d/1jHurkoyF7kMlYl9TdnRTZfs7Gfqv5a9e/view?usp=sharing

SteamVRTrackingLib Plugin

SteamVRTrackingLib is a helper plugin with additional functions used in the ViveMocap demo project. ViveMocapKit doesn’t need this plugin to work, but not vice versa. In particular, SteamVRTrackingLib serves to track SteamVR devices in UE4 viewport and to bind Vive Trackers to static names. Read about SteamVRTrackingLib features here: https://antiyuri.medium.com/extendin…r-1507eb07eff3

If you owned ViveMocapKit plugin, just download latest ViveMocap project on the Marketplace page. SteamVRTrackingLib is inside of the ViveMocap/Plugins folder.

There is a version of SteamVRTrackingLib which doesn’t include a class for mocap in editor viewport. It doesn’t need ViveMocapKit plugin to work, and you can find it here: Google Drive].

image_143730.jpg
image_143730.jpg1920×1080 129 KB

#2

I’m starting. I see many devs buy it to create player’s avatar in a games, not for motion capture. First small note: don’t forget to reset UseForMotionCapture check box (it’s enabled by default) in the component’s settings to keep skeletal mesh scaled to player’s height. The plugin was developed mostly for motion capture, so please write me if you face any troubles or something works just not exactly as you want.

Secondly: if you use it for motion capture (like me personally), do you need some video tutorials about importing custom meshes, animation export and processing?

2 Likes
#3

This looks great. I need to grab a vive now and some trackers. Looking forward to this. Perhaps you could give us animator noobs a bit of a “high-level” overview on a usage scenario for creating an animation for an NCP with an animation. I subbed to your youtube channel and see the demo character animation, but how you set that up would be of interest.

#4

I’m noob in animation too, so it’s possible that I do a lot of things wrong. I also know Maya is more suitable for animation, but I only know 3ds max. And I use the follow rig:

  1. At first, I imported a version of my mesh skinned to CAT skeleton to VMK project. It isn’t necessary, I could capture animation at the default UE4 Mannequin and then retarget it in Motion Builder or Maya. But this step allow me to avoid additional retargeting. Retargeting can be painful, especially if you use root motion, because retarget tool from Autodesc doesn’t retarget root bone.
  2. At seconds, I just capture animation (like on video above) and export it to fbx.
  3. Then I import fbx to 3ds max as a parallel skeleton and do retargeting to my CAT (menu Animation - CAT - Catpure Animation). I don’t retarget limb bones, only IK targets.

At this stage I have normal captured animation 100% ready for editing. So I can clear up frames I don’t like, remove noise from feet targets, adjust hands positions etc.
Then I do layers collapsing with some step (default 5 frames step works good for simple animations) to smooth animation and reexport it back to UE4 via fbx.

#5

The version is pending approval and isn’t available via launcher yet (2017/11/6).

Version 1.0.3

Bug fix: root bone translation and rotation. You can enable/disable root motion in Setup menu. If root motion is disabled, root bone is always in (0, 0, 0).

Update only affects version for UE4.18. Don’t forget to update project files please.

#6

Is Network Replication on your schedule? If so , when will it be released? I’m really concerned about it.

#7

Unfortunately, I can’t give you any date. I’ll make it when i need it for my job. Definitly not in December.

#8

Well thanks anyway , it’s a great plugin that will make developers’ life easier :slight_smile:

#9

Update 1.0.4

Bug fix: root bone rotation (if root motion capture is enabled)
Bug fix: skeletal mesh scaling (when using for VR avatar, not for animation capture)
Bug fix: inaccurate hands positions when scaling is enabled
Bug fix: improved support for custom skeletons
Bug fix: crashes on start if bones map has invalid names

New feature: motion controllers can be used to track other bones then hands
New feature: logging

Don’t forget to update project files.

#10

Thank you for the great plugin! I have been following the instructions in the pdf for adding a new skeletal mesh and ran into an issue where my elbow and knee joints bend opposite of how they normally would. Do you know of a way to fix this? I tried it with two different skeletal meshes.

#11

Are limb twisted or just bended wrong side? If you send me your skeletal mesh (to ykasczc@gmail.com), it would make debugging easier.

#12

The limbs are not twisted, they are just bending backward. I cannot share the skeletal mesh as it is a purchased asset.

#13

1.0.5 Update info

New settings:
(bool) CaptureDevice::InvertElbows
(bool) CaptureDevice::InvertKnees

In some cases elbows or/and knees could be bended backward. This settings allow to fix this bug manually.

Next update will include support for skeletons without root bone (like Mixamo) and universal limbs rotators (which makes InvertElbows and InvertKnees unneccesary).

#14

Is there any workaround for the 60 second limitation?

#15

It’s possible to capture animation asset using sequencer instead of console command, and I believe sequencer doesn’t have this limit (but I never tried it). And it can’t be turned on and off at runtime.

For me it’s not a big issure. I usually simply reactivate animation capture when it stopts and get a set of 60-seconds animation sequences.

https://docs.unrealengine.com/latest/INT/Engine/Sequencer/HowTo/SequenceRecorder/

#16

Update 5/4

  1. New scaling system: separate scaling factors for arms and height.
  2. Scaling flag moved to animation blueprint (now can be changed in runtime).

  1. Networking replication (wasn’t tested yet).
  2. Bug fix: shoulders animation
#17

Update 5/16 (1.0.7)

  • knees orientation fix (when knees aren’t tracked)
  • improvements for using in games (calibration)

Basic Game Template: https://drive.google.com/open?id=16d…l0QmPzR7IddLU1

Update 5/18 (1.0.8)

  • networking optimization
  • input from scene components
#18

Hello,

We are having trouble packaging out our project using the The Vive Mocap Kit 4.18. We downloaded the sample project just to see if that was working and we received packaging errors when packaging for windows 64. Attached please find the error code. Any Help would be much appreciated!

:slight_smile:

#19

@LeviathanHawke

Do you have a C++ or clear blueprint project?

For a future communication, could you write me at e-mail (ykasczc@gmail.com)? Unfortunately, forum sometimes doesn’t send notifications about new messages in my topics.

#20

Hi Yurinik,

I purchased your plugin, and am having issues with using 4 lighthouses with my vive pros. It’s a similar issue to the issue you resolved with the patch for more than 3 trackers as the lighthouses just count as additional devices, and the patch works for me in editor launches, but i’m not able to get the patch working in a packaged game. I get an assertion failed key is invalid error.
Hoping you know what would be needed to get it working in packaged game as well.

I posted the details in your patch forum page, but wanted to include a link here in case you check this one more often.
https://forums.unrealengine.com/development-discussion/vr-ar-development/1436515-patch-for-vive-trackers-support/page2

I also sent correspondence to those I know at Epic to see if the pull request can be expedited at all. Hope it helps.

Thanks for the patch btw!