Why is Line Trace still detecting objects in a position, after they've moved away?

have you already tried the debug mode of the ray cast? it makes the ray and the target it hits visible and should help you to find the invisible boxes you are hitting.