I had changed the root component of the parent projectile blueprint from the static mesh component to a scene component and made the static mesh component (Which has the simple collision on it) a child to the root scene component.
When I put the static mesh component back to being the root and removed the scene competent it worked.