After several days (!) of troubleshooting and recreating the issue I was finally able to fix it.
For a border or a button using an image (UI material from texture), the brush of the border must not have a null alpha (aka fully transparent). A very small value for the alpha of the brush for the border or button containing the image will do the trick and properly display on mobile platform.
That would be a defect.