I have also noticed that according to previous screenshot in comments, when the RTS was set to Component, I had all of the settings in AttachToComponent set to Keep Relative, but after I changed it to Snap to Target, which solved the issue with item appearing in wrong place the teleporting/rubber banding issue appeared again, and then when I tried to play with Transform Space of Socket Transform again, none of the Transform Spaces worked.