How do I get only the static mesh to rotate not box collision?

This is indeed the right way.