How do I layer animation with Control Rig layers on a face?

I was hoping to use the lip sync from Metahuman Performance (from Audio) with hand-keyed animation on the Control Rig inside a Sequence. I attempted this, but it still appears that the lip sync animation is blending with the Control Rig and it’s “flattening” the lip sync animation. Is there a way I can turn off the lip tracks on the Layered Control Rig so I get the full animation on the lips? Or is there a way to increase the Weight of the animation so that it counteracts this squashing effect? I tried increasing the weight number but it doesn’t appear to change anything. I’d love to be able to hand animation the eyes and brows alongside the lip sync animation track.