I added a Post Process Volume and played with the settings. The only difference I can make is when I enable Metering Mode and set it to Basic. This helps a bit but it doesn’t disable it.
Edit:
I was able to disable it by setting the Min/Max Brightness values to the same. Thank you.