Hi
I was able to reproduce this on my end and have entered a bug report, UE-9875 to be assessed by the development staff. As a workaround for this, after recreating the collision, immediately use the visibility sculpting tool to paint a bit of hole material onto your landscape (it can be the same spot the original hole is located and does not need to be a visible alteration). This will reset the hole to remove collision again.