Hm… Everything looks ok, however it’s clearly not being passed to crowd agents since they still have problems with ignoring others.
Can you add another line after all group setters have been called?
Cast<USHCrowdFollowingComponent>(Cast<AShadowHeroesUnitAIController>(this->Controller)->PathFollowingComponent)->UpdateCrowdAgentParams();
It should refresh agent params in detour crowd simulation.