is it possible to create a destructible mesh with accurate collision by using a mesh that have inner space ( empty on inside ) ?

[chinccw]

i have a house static mesh that i wanted to make it destructible but the character should be able to walk into the house too.
however, after i convert the mesh to geometry collection , the collision is like a big box, my character can no longer enter the house.
i tried to change collision settings in the geometry collection asset but with no success at all.

this is how the house look and it’s empty inside. before i convert it to Geometry collection ,my character can walk into the house. and i was using uniform method for fracturing.

any help or suggestion is much appreciated !