Is there a way to view the physics/primitive capsule whilst in play mode in the editor? I would like to see where exactly I am colliding with things for debugging purposes.

You can view the PhysX collision capsule by using the console command > “PXVIS Collision”.