Optimize rotation of an actor with thousands of actors attached on it

I’m facing the same issue right now. Thought attached components do not update, as it would.be enough to have the relative transform and calc the world transform on request. But I gues the world Transform is required for rendering and thus musst be calculated anyway each frame?