The Character Movement Component has some granularity when it comes to player-physics interaction. See here for an example:
The Standing Downward Force Scale controls how much force in Z axis is applied to physically simulated meshes. Definitely experiment with the component’s settings.