If you’re letting one of the players be the host then it’s free, depends on the gameplay you want and if it’s possible for a player to host the game, for example a battle royale type would not be suitable as the host might die and leave the game
Another thing you can do is to let people host their own dedicated servers