How do I make an HP bar appear for other players in Multiplayer?

You should still use a widget component. And then on your pawn begin play create the widget and use the set widget node for that component, and pass the created widget. In my last picture, Health Bar is the name of the widget component on my pawn.