No, both collisions are important in their own right. Though you need to explicitly state during trace when you want to trace against complex collision (trace complex checkbox).
By default, all collision in the project is traced against the simple collision. Additionally, you will want to reduce the tri count of those meshes you are using, it is way too much to be efficient. Game ready assets are very lightweight. These look like archviz assets