I found the issue. sRGB was unchecked in the texture. After checking sRGB, nothing changes in the texture, but if you look at the sprite or UI, the colors match.