Nope, it’s not a bug. I’m no expert but I believe it’s to do with the way UE4 handles version control (someone better versed with this could explain it better).
To have UE4 remove the duplicate files in a particular asset folder, r-click on it and select “Fix Up Redirectors in Folder”. Do not under any circumstances delete the files manually from your file manager.