Are you using hard references in the data table? This is a bad practice that often wastes resources unnecessarily.
Make soft references for assets in the data table (sounds, textures, meshes) and load them where you need them.
But when using soft references, this volume will be reduced to several kilobytes.
Besides when you change levels, the memory requirements for both levels add up (not counting the shared resources for both cards), so with these costs, you can go over budget.