With 2-6 players you should be fine with P2P, using the Advanced Sessions Plugin. There are quite a few UE4 games that use only P2P(Deep Rock Galactic, Friday 13th, Dead by Daylight).
If your game is not competitive, you could probably save the game world locally on the players(server and client) computer and allow to load an existing game when hosting.