Is your pivot point a point in space, or another actor? Does the pivot point move over time? The way i do it is i set the root component of the actor that i want to return to the pivot point, and instead move the component i want to rotate around, not the actor.