I think i found the issue finally! I had to turn down all these values in the material to 0 for the bloom to work properly.