Physics materials don’t affect non-physics enabled objects in the same way. Since the character class isn’t using physics to move, you’ll need to adjust the ground friction, acceleration and deceleration when you come in contact with that physics material. This video does something similar but not quite as well as described:
Disclaimer: One or more of these links are unaffiliated with Epic Games. Epic Games is not liable for anything that may occur outside of this Unreal Engine domain. Please exercise your best judgment when following links outside of the forums.