As you can see here some of the bones move even though they do not have any keyframes in blender. This glitch only happens on the right hand of the rig. I also noticed that this only happens when the hand is rotating.
These are the export settings I am using: