Colliders don't work if I don't move

Does your skeletal mesh have a Physics Asset with a collider in it? Your animated obstacle may be missing a collider.

280334-animatedcollision-smaller.gif