The building you downloaded probably doesn’t have appropriate collision, show collision in the asset viewer to see if it’s just a box or something else. You could try to regenerate a complex collision.
The default pawn is also taller than it looks, you might have to reduce the height of the player’s capsule collision.