My issue was that I was trying to comment out multiple lines, instead of removing the text from the .uproject file.
; This is a comment. It does not work in the .uproject file...DELETE THIS FULL LINE!
It seems it does not have the same behavior as a .ini file, and commenting out text doesn’t work.The fix was to remove the comment from the file.