Controller Jitter after grabbing object

Hello, I have an issue in VR where when i grab an object with 2 hands (Cue Stick for pool game)
the controller shakes vigurously.
I altered the grab component of the VRTemplate project.
At first i worked with sockets; and it was horrible experience.
Then i used physics constraints and physics handles but i’m not getting the results i want where my right controller moves the Cue in the forward axis of the cue and my left controller to aim, it still shakes
Ps: I also altered the collision of the cue stick since i thought it was an issue with collision.
Is there a way to reduce that jitter effect?