You are right! I needed a delay on my gamemode before I spawn in players, because gamemode is trying to spawn its own player system im assuming, and that was getting in the way of adding input mapping.
Love it when spending 10 hours trying to find the cause of the issue, was just a delay needed XD