If you isolate your vehicle to its own scene, then it won’t be able to interact with anything else. Probably not what you want.
Why not just save a snapshot history for all dynamic objects in the scene? Then you’re rewinding & replaying everything together and won’t have any fast forward issues.
If you want your predictions to be accurate, it’s better to think about saving snapshots of the entire world state rather than just one or two actors.