Actors unintenionally destroyed on client

I have a simple multiplayer project. When I move the pawns ( set actor location or set actor transform) they are destroyed on the client. Sometimes other actors are destroyed too. Im at a loss for whats going on.

I think I figured out whats going on. Net Cull Distance was culling the actors as everything moved around. Setting them to be always relevant seems to have fixed the issue. If anyone has any other info or best practices for these kinda situations be appreciated