Someone pointed out that I had my player controller connected to the wrong node on the Enable Input, I changed it to this and it works now:
It was a simple error, but I looked at it over and over and missed that.