That will make your scene unrealistic. Tricks people use to avoid places from being too dark:
- Add other lights inside the building
- Add a weak light in the player character, so wherever he goes will always be a little lit without affecting the scene from far away(e.g. Dark Souls)
- Put a very small amount of emission in the materials, but that tends to look a little weird