If I read you right you have 4 phone, therefor each device should have it’s own player controller that don’t get jumbled once they are in the session.
found this a while back on the net, think it will help you out on your project
https://cedric-neukirchen.net/Downloads/Compendium/UE4_Network_Compendium_by_Cedric_eXi_Neukirchen.pdf