How can I hide my session from search once in game? (So no one else can join it)

You can’t do that with the current Blueprint nodes but you can disconnect the pleyer when it joins the session. There is a Blueprint node in the game mode called “PostLogin” wuich you can use for this.