It seems like this is a bug in the engine that was fixed in 4.15 and somehow reappeared in 4.18p2 and I still have it in 4.21 [Unreal Engine Issues and Bug Tracker (UE-35531)][1]
As a (temporary) workaround you can manually add the correct gamma correction into your retainer material. e.g. like this:
