In the end I figured out it was because I had a lot of mobile lights for flickering and such. I’m guess the lights were taking up all the processing power causing the physics to take a back seat then it would register them and when it would the ball was clipped through the table and launching it off into space as a result. I’ve learned a lot since then so I know I wont make mistake again. 