Other settings, such as default start map, input mappings and so on, are at least not properly applied in a shipping build unless you set-as-default, so I presume the same thing goes for icons and splash graphics.
The key question though, is if it worked as expected when you clicked that?