Alternatives to VS Express?

UE only creates .sln for your convenience. You could just open the source files in Notepad if you wanted to. You can basically ignore the solution file.

Did you try to use Eclipse? I’m not sure how it references source files, but I’ve found a few articles on how to open .sln files with eclipse just by googling it.