In Unreal Engine 5.4.4 I noticed this was happening.
So I tired switching the widget over to the show/hide method of displaying widgets. Create it once, then only change the visibility. As opposed to creating the widget every time. That ended up just created more headaches.
After some more searching I finally happened across a post that mentioned a “garbage collection” node.
So after switching everything back to using the “create widget” method. I added one as follows and everything is working.
I still usually see at least one (no slate widget), but I’m okay with that. As opposed to the pile up that was happening. My entire project is dialogue so I figure this would have been a disaster eventually. Can’t be sure as I couldn’t find any details on “(No Slate Widget)”, and didn’t want to assume. I may not be any good but I do try to practice good garbage collection when I know I need to.
Also I don’t know if this is because of something I accidentally did somewhere or not. But from what I could tell my modifications to the blueprints only change cosmetic things when compared to the “DemoDialogueWidget”.
Hope this helps people from the future.