Archviz Sequencer Issues: Audio Syncing with Video

Hi, I am new to Sequencer and trying to put together an Archviz fly through of an interior house with many different shots.

I have laid down a long song over the scene and cut between shots, syncing with the song. (Ie one video shot cuts to another shot when the music becomes quieter etc).

I am having mayor issues when with syncing the music to my video. The music doesn’t sync with my video when I try cut it together. When I stop the sequence and try restart at the same place the music always starts at the beginning of the song instead of where it was just playing, which means everytime I want to sync a video cut with the change in music I have to play the entire sequence from the beginning and try sync it that way.

Any help would be great. Thanks.