Collision and performance

My game uses ccd on a physics object. I’m wondering if collision on mesh outside the play area decreases performance.

Would one want to remove collision on anything that doesn’t effect play to help optimize to prevent unneeded physics calculations .

For instance a ccd object is heading to a wall and behind that wall is more objects that are unreachable.

Is the engine calculating it’s collision because it’s there?