UE 4.23.1 - Chaos & Geometry Collection - Divers Problems

Not sure it helps, remove chaos, go back to physx which actually works - particularly in .23 - and create your own class for geometry collections that does what you need it to.
Its essentially just a mesh swap system - from one mesh to many mesh pieces that are pre-fractured/baked.

Then, you fracture your assets in a DCC and import the fractured parts. Making the process entierly out of engine ensures things (like UVs and mesh caps) work right.

The fracture tool may have gotten slightly updated in later versions, but the chaos performance got worse and worse up to an 80% performance loss compared to physx in 4.27.