Character stuck in invisible terrain

So I’ve setup my terrain and tried to make a cave entrance. So I managed to setup the material to be able to use the Visibility tool on it. I removed some terain and made an entrance. But whenever I’m trying to pass through; the terrain seems to still have some kind of collision and makes the character stuck and unable to move even though there’s no visible terrain. I can still shoot through the hole without a problem.

I’ve even tried to only have a texture and the Landscape Visibility Mask node on the material, and the same problem still persists. Is there some setting or node which I’m missing?
The terrain is set to Block All.