When I add the lightmap into the material as the emissive, it changes the outer appearance of the whole material, acting like its the diffuse