UE4 Editor often starts the previous game version instead of the latest compile

This happens with UE4.22 (had this in 4.21 too, did not try 4.23 yet): no matter if I compile from VS or via “Recompile and build” from UE4 editor, after compiling the new version, PIE sometimes (!) starts the previous version instead of the latest build. I then need to re-compile to make UE4 editor aware of the newer build. Hot reload is activated.