Same problem here. The behavior seems very inconsistent.
Setting a custom main icon sometimes works in the editor, but not in game. To get the preview working in the editor I have to toggle “Use Alt Display Icon” on and off and that works well with the “Key and Icon” alternating visual, although it does not change the exclamation mark on top left.