What remains in the old folder are “redirectors”, which are temporary files that help resolve the broken references caused by the renaming. The solution is simple: In the Content Browser, right-click the remaining old folder, then click “Fix all redirectors in folder”. Then, you should re-save all files and your are free to delete the old folder. Done.
Hope this helps!