Actor batch with independent physics?

Hi,
I am trying to achive a pile of debris. For now i am doing it by spawning every single element in game and let it be affected by physics so it falls naturaly and form pile.

Now, i batch all those fragments into one actor but i would like to still be able to enable physics to that fragments independantly when some changes happens like interaction from player. Is that possible?
I want player to be able to get something from that pile and enable physics for a short duration so the pile would collaps.

Thanks for answers in advance!