Actor collision with landscape not working

I have a kind of boat actor consisting of several pieces of collision shapes and a player pawn that can walk on said boat. The boat is being moved by SetActorLocation() every frame. The collision is set to block everything except the pawn but when it collides with anything it just goes through it. I can get around collision with actors when it comes to other actors but not landscapes.
In the SetActorLocation() when I have it set to “Teleport”, it moves like it should, but the collision does not work. When I set it to “Sweep” it either doesn’twork at all or the move is stuttering.
Every other actor seem to move fine on the ladscape so it’s probably not the issues with that.
Anyone has any guesses on how to at least detect an overlap?