Ah, I’ve come across this before: Packaging UE4 for distributing internally - Pipeline & Plugins - Epic Developer Community Forums
Relevant part is that you need to add:
Samples/
Templates/
to UE4Games.uprojectdirs then the automation tool will be able to find the sample projects. They’re not in there by default so that they don’t show up in your visual studio projects.