If anybody else is having the same issue and found this question, I finally fixed it, I found a setup guide on the Pico developer website here:
It was missing some input mappings and I had no idea how to set them up using the enhanced input system, this guide explains how to set up the correct mappings.
Cheers!