I believe you’ll need to turn on AutoKey in order for the change in the world to stick.
Sequencer keyframing doesn’t operate on the selected keyframes. It might appear to work that way because the default is to snap the current time to the selected keyframes. And the current time is what the keying goes to.