Skylight flickering on the edges of a frame

So I have that problem caused somehow by Skylight that when the mesh is touching the edges of the frame then that edge starts flickering. Tried everything like adding stronger lights but the only thing that helps is deleting Skylight. Any suggestions, did you have similar problems?