You might want to try using IsLocalPlayerController. It will only be true for the client that owns that controller.