Why do my project build times skyrocket after 4.1?

Don’t put every .h file at the beginning of every .cpp file. Reference headers of only those classes that are used. Plus the problem with compilation could be somewhere in your code. I got rid of private/classes folders and have everything organized the way I like and it works with bFasterWithoutUnity = true.