had same problem , UE5.1 ! PIE was ok but Attach To Process did not load project’s PDBs at all.
- removed intermediate, saved, binaries, …
- removed GameplayDebugger and some other plugins from .uproject and .Build.cs
- removed recently installed Rust compiler toolchain
- restarted my PC and waited a little to cooldown
finally worked but I don’t know how.