My Fix action:
Hope this makes sense. In the final steps of retargeting, I exported all the animations to my chosen character.
Then I placed that same character back in as the source.
So now I have 2 of the same character in the retargeter.
For whatever reason, the character tries to take on the form of whatever skeleton is in the source, so why not replace it with your own character.