Here’s a screen capture with red marks to indicate where to find these things.
I saw the comment and the answer, but didn’t know where I was looking so hopefully this will help someone out too.
Step by step instructions:
-
Open up the character
-
Go to the Viewport Tab
-
Click on Character Movement component at the bottom of the components tab
-
In details, scroll down to Character Movement:Jumping/falling
-
Set your air control to a numerical value.