I found out the hard way that if your file path to your .ico file has a SPACE, this will break it and UE will revert back to the default icon. Also, uncommon characters such as an exclamation point breaks it to. Underscores work.
So make sure you have no SPACES or SPECIAL CHARACTERS in the file path to the .ico file.