I guess the only way to get rid of all those plugins and additional is really using a source release and not compile the plugins.
Do you know how I can achieve that?
If you disable the plugins for the project from the editor are they getting included too?
Yes, I uncheck the plugins in the Plugins Browser (Window → Plugins) and check if they are disabled in my uproject file, too. Still they get included.