How do I stop the editor from moving the duplicated object?

Hmm then switch to rotation, alt+drag in rotation mode it will have same position just different rotation.