I do not understand how will this solve my issues? If the ladder is lifted, I need it to rotate when I press shift + rotate the mouse, and whether it’s a physics object or not, I don’t think it makes a difference. Also to answer your question, no, the player won’t be able to move it while it isn’t lifted.
Edit : The simulating physics part is mainly to set the object aside of all the other objects in my game (used it in the branch before the pick-up works). This is my only simulate physics object, so the game knows I can pick it up that way.