Controller question

When even I cast a spell with my mouse it goes in the direction I’m clicking towards but when I have my controller plugged in and I cast it always goes on the same direction not towards where I want it to go anyone have an idea on this ?