I honestly cannot think of anything that would produce an effect like you demonstrated unless we actively moved the box in relative space. This just does not happen
Do you ever attempt to move or adjust this box in any way? Its extents perhaps? Anything else?