Is Too Many Sounds Virtualized Bad?

I think there are scenarios where a manager will do a better job of populating a level procedurally with sound than placing a ton of Ambient Sound Actors everywhere. The question is do you need them to stick around? Are you tracking their playback?