No, the requirement is that your game supports cross-store multiplayer. One way to achieve this requirement is to use our Social Overlay. With the Social Overlay, players can invite their Epic friends across storefronts to play in a multiplayer match.
https://dev.epicgames.com/community/learning/knowledge-base/bLRWe/epic-online-services-is-it-required-for-your-game-to-support-steam-invites-on-the-epic-games-store