You’re not using the right vector correctly. Use the entire vector. And use the vector of the camera, not the vector of the ball.
The ball is rolling so its right vector is all over the place unless you unrotate the transform.
Example using Right of the springarm:
Also, it may be difficult to replicate this movement with torque only, you may need to add impulses as well (or instead!) and / or set up physical materials to boot. Check this excellent post out: