Starting new project prompts me to open VS leading to a command prompt window that does nothing

Go to your visual studio installer. Pick modify => Individual components
type in msvc.

Make sure you have the checkbox next to latest selected (x64/x86 build tools)


(I have some extra due to having multiple versions of unreal installed, as you can see I also have 14.38 checked)