I just tried this as well and couldn’t do it. It seems like it would need to be set on the EmbeddedGeometryComponents which are private.
But as a workaround I made a separate StaticMeshComponent with the undestroyed mesh and collision, while the GeometryCollectionComponent is invisible at the start and doesn’t have pawn collision. When I destroy the object I remove the StaticMeshComponent and make the GeometryCollectionComponent visible.