Alright, I looked around in my settings and compared them with new projects and it looks like I wasn’t allowing static lighting which skipped the light building.
In case anyone has the same problem in the future, reactivating Allow Static Lighting fixed the issue.
You can find that setting under:
Project Settings > Lighting > Allow Static Lighting