When an Object (with correct collision) is moving, it will just pass through the Character.
If the Character and the Object are moving, the Character will be pushed correctly.
Now there should be a simple solution to have the 2nd behavior also applied when the Character (or any Pawn in general) is not moving. I understand that this may be disabled by default for Performance reasons, but it should be easily enabled and not require insane workarounds.