How can I exclude certain objects from being black and white?

That stops the effect of colored building in desaturated world. So confusing!