Attach to Process is not working after project is recompiled

Whenever I try to debug a running game using Visual Studio attach to process it works only if project is build when Editor was not running.
If I rebuild project after Editor was run all breakpoints became invalid and Visual Studio complain that source files are different.
I think that is somehow connected to live reloading of game dll files. Is it possible to fix that behavior somehow?