I finally found what I was looking for, though the documentation was of no help.
It’s under this tiny button, then selecting Open level Blueprint. These buttons need to be bigger or at least have some sort of text on them to tell you what they are for. Mousing over it, it says “List of world Blueprints available to the user for editing or creation.” which I thought was for just adding new blueprints based on defaults already created (as the other two buttons next to it are strictly just for that, creating new stuff). It took me actually looking in there reading everything before I found the mention of “Open Level Blueprint”