Thank you Nick, this sounds great!
How will shadows behave?
Say you have an object A casting a shadow on an object B. We have 2 cameras and each of them is hiding a different object (A or B). Will B still get the shadow of A?
If not is there a reasonable way to do that?
Thank for your answers they are very helpful.