Make mesh unclickable just for player who can't see it

Hi, i’m having trouble with click events and visiblity: in my multiplayer card game i have in the same position 2 cards, the one seen by the player (visible only by him) and the one seen just by enemy. I want the last one (invisible for me) not to block the player mouse click event (but only the enemy ones)