So I tested trace channel 3 and it is indeed my InteractTrace. I am assuming using trace channel 2 resulted in some undefined/weird behavior, which caused that changing response to object channel changed response to that trace channel.
Anyway, thank you for help, now I am always going to test if my trace channel matches.