So, an update
DebugGame (not Debug_Game) appears to work without the above error.
I also think a bit of the problem may be related to the fact that the active project was set to Engine->UE4 and not Games->TestBed (my current project).
Going to try that out in other build settings to ensure my suspicion was correct.