Instead of using the Envelope Follower Source Effect, you can use the Envelope Follower Delegate that is available on each Audio Component. Your two characters just need to be speaking on separate Audio Components. For lip-flap implementation, you can just put an Audio Component on the head/face/mouth of each of your characters and use that Audio Component to drive your lip-flap. Then just make sure you play all your dialog sounds on that Audio Component.