If you Spawn a Replicated Actor set to “Only Relevant to Owner” and while spawning it setting the owner to a specific Player then only this player will receive any updates to this Actor.
The PlayerController works like this and prevents anyone else from getting any updates besides the Owner and the Server.