How to change a collision to blocked without messing up physics

Is there a way to change a collision to blocked so that all the physics objects that currently overlap the collision get not shot away?