Basically you add widgets inside the master component. Any widget or UMG you created should be available to select from the list of items under the “custom” (or something similar) tab.
If you expose the correct variables - and the widget itself uses them within the creation event/function - then you can change those variables on the fly like you would with any button.