Exlude APEX and PhysX libraries

I’m currently adding Linux support to my game and I was wondering why the linux build is much larger than my windows build. Then I came upon the third party libraries: PhysX3 libraries where added, including APEX libraries. I’m not even using PhysX or APEX and APEX is also disabled with bCompileAPEX = false. Is there anything else I can do to exclude APEX and PhysX libraries? When deleting them the linux wouldn’t start, but the windows build does without the APEX libraries.