How to Add complex collision to a Static Mesh?

can you show the collisions in the viewport (press alt+c)?
Maybe your chair has no collision at all…
Have you tested the trace against the same BP but with one of the engine content meshes?