I finally tracked down the issue. Its not collision as i thought. When Attaching and possessing the character to the ship you need to disable movement on character movement component.
