If im not mistaken all you need to do is register enable Steam Online Subsystem and register the session as well as making other join the Steam session, once you got sessions working friend list should automatically support joining session. Either way you need to set up sessions first if you didn’t do it yet, as far as i know this does not require C++
There also plugin that people use offering more options that default Steam online subsystem does not give to blueprint