I was struggling with this tonight and figured out the problem.
When you reference the Physics Volume through the Character Movement Component you are referencing whatever physics volume the character is in. If you have not placed a physics volume in the level you will be referencing the default volume that encompasses the entire level!