EOS does not currently offer out-of-the-box support for text chat. If you want to implement this yourself, the NAT P2P interface can be adapted to do so as demonstrated in the sample here.
https://dev.epicgames.com/community/learning/knowledge-base/rykO5/epic-online-services-does-eos-offer-lobby-based-text-chat