How do I attach a physics constraint to geometry collection particles? (Chaos)

I am currently using FConstraintInstance struct to create a constraint.

I create a kinematic handle for 1 side of the constraint, and grab a physics object via GeoCollection->GetPhysicsObjectById(MyPBD_RigidClusteredParticleHandle->Parent->ParticleIdx) for the other side.

Constraint is being created and its valid, has valid references as well, but simply doesnt work. Has zero affection. Any possible solutions? Maybe i dont understand how constraints work on a lower level?

by the way, this constraint works with physics objects of normal primitives, it doesnt only with geometry collection