The game icon set in the project properties, and which lives in ProjectDirectory/Build/Windows/Application.ico, is not used in Windows packaged builds for the game binary.
It is used correctly for the bootstrap executable that is in the packaged games root folder, but not the platform binary in ProjectName/Binaries/Win64/ProjectName-Platform-Config.exe
Engine build is 4.19.2