Hey, I only got it to work with a development build.
The tooltip of the “Enable by default” setting mentions:
In shipping builds, ALLOW_UDP_MESSAGING_SHIPPING=1 must also be defined in TargetRules for messaging to be available with or without this setting.
Which I tried but did not get to work.