Found workaround for this fatal error. It was OverrideMaterial property on StaticMesh in child actor of our Pawns. We were creating dynamic material instance and assigning it to static mesh. Now we just destroy our pawn before ServerTravel cause we dont need them. This page doesnt says that pawns are preserved on ServerTravel.