Collision breaks down

I used addForce for one frame to move an actor component, and sometimes that object just passes through the wall, even in low velocities. I tried to use addImpulse instead and got the same results. Is there a way of fixing it without lowering the force too much?
Thanks a lot, Idan