Hidden actor gets visible on startup

Thats exacted behavior. The eye icon in the outliner is only for hiding stuff during editing.
if you want to hide a actor permanently select “Actor Hidden In Game” or in its primitive component uncheck “Visible”