How do Epic Games Store users join server?
Epic Games Store users can connect to the server through the in-game server listing.

They need to wait until the server appear in this listing and sometimes it can take some time. But currently it is the only way to join dedicated server for them.