Hi,
Had same problem. Go into your project folder. Mine is in MyDocuments on my Windows machine.
You should see that folder you are trying to get rid of in there.
Delete it.
Now launch your Unreal engine again, open your project in it and it should be gone 