The characters are not interacting with each other on a skeletal mesh basis. Your collisions are probably based on the capsule collider around the characters.
You would probably need to switch to a per mesh collision disabling the capsule’s collision while in mid-air or make the capsule smaller while jumping to make the feet line up with the collision.