How do you make a rotation on a texture work without stretching if your texture is not tiling with a square aspect ratio?

Yes, If the texture shifts aspect ratio while you rotate. You have done something wrong.