In theory there are no hard connection limits using P2P so you could have as many players as you need in the same server. You will find EOS_P2P_MAX_CONNECTIONS which may look like it is limiting you to 32, but this number is for how many unique SocketId values (which map to unique packet queues)…
https://dev.epicgames.com/community/learning/knowledge-base/19DjL/epic-online-services-what-is-the-p2p-connection-limit