Chaos debris and weird character collision

Hi, we need breakable objects(covers, pillars, walls, etc) for our game. But the problem is when I destruct the meshes using chaos, small fragments blocking the player character and give me jittery non-smooth movement on debris. What I want is to after the object breaks, my character should be able to push small and mid-sized debris easily. I tried disabling the capsule component’s collision for destructible objects but this also results as an instant destruction when my character touches the cover which is an undesirable result for me. I couldn’t be able to diagnose the problem in the first place. So any help will be appreciated. Thanks.