Is the UV of this cloth on it’s own separate unwrap, or is it in the same UV space as your character?
What you will want to do is unwrap your cloth object so it has its own UV map, so when you apply a material to the cloth object it displays correctly.
Cheers,