Player pushes the boat from inside

Or you can refer to this link:

The Character Movement Component has some granularity when it comes to player-physics interaction. See here for an example:

The Standing Downward Force Scale controls how much force in Z axis is applied to physically simulated meshes. Definitely experiment with the component’s settings.

Answered by @Everyone