Unreal Engine VR | There seems to be a conflict when I grab and when I move forward using the motion controlle

So I made It where you can walk around using the motion controller, and It works perfectly fine! Well that Is until you hold down either one of the grab buttons, when you hold either grab button and try to walk It will make you go in one direction. Holding the right grab button will make you move to the right, and holding the left will make you go backwards. Any help Is appreciated ^^