Client pitch ignored on dedicated/out of view of host

So to go more in-depth with this question, I am creating a First Person Shooter. Issue #1: If I host a listen server lets call the host of this game “HOME” and the client connected “VISITOR”. While both HOME and VISITOR can run around and they can both aim up/down and left and right. When HOME fires his weapon, everything works normally his bullets go where he is aiming regardless of his position in the world and rotational values. When VISITOR fires his weapon, the bullet goes where he is aiming regardless of his rotation and pitch… That is until he is out of the view of HOME if HOME can not see VISITOR, then VISITOR still shoots the direction VISITOR is facing but his pitch is now ignored. VISITOR can still look up and down but regardless if he is aiming at the floor or at the sky his bullets still go to whatever height he was looking when he left HOME’s sight. Issue#2: Basically the same as Issue #1 except now Neither player can shoot up or down because there is no host to be in sight of, so both clients can aim in circles and run/look around normally but their bullet pitch is ignored.