The ability to control visibility of an object between primary and other secondary views is limited. I’m not sure I follow on why that is essential to scale. The few places this exists are, scene capture actors can control hidden or showonly lists of objects for their view, there are some controls for visibility to an owners camera for use in first person weapons and third person bodies that should only show up in cameras from those perspectives, and lastly closer to what you are asking there is the ability to flag something as only drawing in shadows, ie casts shadows but not otherwise visible. That combined with disabled shadow casting gives you the ability to have mutually exclusive objects between primary and shadow drawing.
I think there are some visibility flags for reflection captures as well but AFAIK nothing for Lumen indirect. It actually is problematic to do something like that because of our use of screen space traces. Any difference between primary and secondary causes conflicts in what screen space rays pick up so exposing such a thing is dangerous and problematic.