Scaling Texture UVs does not scale Pixel in space (HELP)

I am creating a game of planets in full size, I imported a simple sphere with 36k of UV resolution light map and I just had to scale the texture size of the material to 2 only, but it turns out when I move the camera next to the sphere the material starts to get extremely agitated and I start to see giant square pixels. The material I’m using is Desert with textures in 4k resolution. Help how do I reduce the Pixel so that it follows the size of the mesh and the material to make everything with high quality?
See the pictures: