My example Blueprint (UE4.26): [Constraint_Drawer_BP][2]
Use the “Set Constraint Reference Frame” node to move the center of the linear limit. Let’s say in the physics constraint Component1 is your drawer and Component2 is your furniture, then you need to set Frame2 in the “Set Constraint Reference Frame”.