Anyway, based on the flow explained in this article, your Security appliance (ex: FGT here) should be configured the Remote IP as the IP address of GWLB and not GWLBE. One GWLB can be connected to many GWLBEs.
Not sure if this clarifies your questions. If not please open a case with Fortinet Support for additional help.
The Fortinet Security Fabric brings together the concepts of convergence and consolidation to provide comprehensive cybersecurity protection for all users, devices, and applications and across all network edges.