If anybody stumbles across this: Set the HDR size to an extremely large scale, so that the entire level is inside of it