Just configure FAttachmentTransformRules for your case (FAttachmentTransformRules | Unreal Engine Documentation)