Why is VRAM so high and how to find out what's using it?

I understand task manager shows this across all of Windows, but most of the usage is coming from Unreal.

0.4GB with Unreal closed
1.9GB in a pretty much empty project and no level open
4.5GB in main project and no level open