FYI: we have now UE 5.03 and the issue is still present. The easiest fix I could come up with was to add empty image widget to the grid, set its opacity to zero and layer to -1, so it would be always invisible and under other grid items. Then when I initiate or change grid size I move this to the bottom right corner of the grid.
Silly bug.