Imported VR-Template in Project but the Controller just glitching

Hey there. I imported the VR-Template in my first (but Existing) Project in UE5.3 to make it a VR Game. I use the Standard VRPawn and i can move the Head around without an issue. However the Hands stuck in one Place and the Fingers are moving very fast (just like i would Press the Buttons really fast. What can I do to solve this? I use the HTC Vive Cosmos.

When i use the VR-Template directly, there are no issues with movement, tracking or anything