A way to exclude rendering of objects between viewports?

So SceneCaptures have a handy feature that allow lists of hidden objects to be accumulated and actors have bOwnerNoSee that allows certain elements to be hidden from only the player perspective viewport.

Is there a generalized way to hide certain objects between arbitrary viewports? Specifically we’re trying to make certain objects hidden only to people in VR (where a non-VR spectator viewport has them visible).

Is this possible without an engine modification?