Kinda of unclear until I get some screenshots but, some things that might not be suitable but tryable are while assuming you have physics enabled are increasing the mass of the ball. Which should be the solution inside character movement component.
Another thing which should not be a final solution but depends on your view is to add a box collision on the elevator so that when the player enters it his gravity scale increases and when he exits the scale returns back to normal.