Never mind, I’m an idiot.
You do it pretty much the EXACT same way as you would create an instance of a Material. Right click the Actor Blueprint, right at the top of the list is an option: “Create Child Blueprint”, does exactly what I am looking for. Hahaha.