Managed to solve it by animating the anchors instead of the transform!
Thanks though Everynone (interesting name lol)