Figured out a way to do it.
Basically when a player selects a character in their UI I store their playerID (in this case name) in a string
Character Icon UI
This string variable is taken all the way to the freshly spawned character
Where the local PlayerID is compared to the PlayerID of the client who selected a character, then I just hide/show the actors based on if they are the same client or not
A bit hacky solution I suppose, but it works 