One silly question. Are you waiting for the Full 5 sec to go by? If you ever interrupt the blend before it finishes, the return will not work correctly. The blend does not store camera location during transition.
Could you test it by giving it enough time to finish the transition?