You can always adjust the large chunk threshold in the details panel for the for the DM. This will directly control how the DMs collision works with the player. The default value is 25, meaning that any chunk that is above that threshold will block the player. So if you raise the value to 50 (arbitrary number, just tweak until you get results you like). The balance here is still having some of the chunks above the threshold block the player and the ones below not block the player, preventing gameplay progression.
^This is one good workaround.
But if you want the destructible chunks to ignore other channels than Pawn, it does not work.
Here is what I’ve done: I set the preset of the destructible collision to ignore the channels I’d like.
Then I added a Box Collision component to my Destructible with a collision presets that blocks all the channels I’d like it to block.
Then I simply destroyed that box before destroying the destructible to chunks.
Just wanted to point out another workaround.