How to limit what Colour Vision Deficiency Type affects?

I’m trying to incorporate colour blindness-friendly experience and absolutely love the Set Colour Vision Deficiency Type-node in Blueprints as it automagically fixes Widgets for me. It also affects the rendered 3D world which is wonderful as distinguishing colours is important for gameplay reasons. However, I would like to be able to disable the effect for certain Actors or Materials which are part of the background environment (as them being colour corrected makes things look wrong). No help from documentation or searching elsewhere - what can I do?