Putting object on directional vector from world origin to sun/sky bloom at distance from origin

You also have to invert all values, or it will point to the shadow of the object: