Physics Mass Scale - Launching Ball


I’m having this problem where this ball doesn’t launch with the same intensity when it is moving or not moving.

Video 1 the ball is moving, I can launch it with the proper intensity.

Video 2 the ball is not moving, I can launch it with way less intensity.

I’m using a value of 0.05 of mass scale to launch the ball.

I want to be able to launch the ball with the same intensity at all times. Any workaround for this? Thanks!