I recently ran into this same problem with my multiplayer VR project, I have a simple solution. As far as I understand the problem with the 3D widget is that it conflicts with all clients that have the ability to interact with the widget.
Solution: I deactivated by default the Widget interaction component, and activate it during game start, only for the local player. This way all remote clients in your local game will have no effect on the widget.
