Never mind I found an example in the Unreal Content Examples Project from Epic 
You need to enable “Notify Breaks” in the Geometry Collection (GC). Then Pass the GC to the blueprint you want to get notified and register for the notification there “Bind Event to On Chaos Break Event”. Then it works like charm. No need for the “Chaos Destruction Listener”.