Ok, so I figure this out. In the FPS sample/starter content they never tied forward movement in with pitch. You need pitch to be able to swim up and down. Just add pitch in and you’re fine.
In the C++ project you can find this in the character class in the MoveForward method.