7.2 version ADVPN on Hybrid underlay scenarios
Hi,
We have 1 hub and 2 branches in our setup. All these 3 location has one internet link and one MPLS link (Hybrid underlays) We are having BGP on loopback overlay setup
We have requirement of ADVPN between Spoke 1 to Spoke2, with the help of SDWAN rule we are steering this ADVPN traffic through internet link (And MPLS as second member order) and could see child tunnel (inet_0) formed in Spoke 1 and Spoke2. Traffic originating from Spoke 1 to Spoke2. Everything works fine in normal scenario. We could see that Routes for spoke 2 (192.168.3.0/24) is learning through inet shortcut tunnel and MPLS parent tunnel tunnel in Spoke1.
When Spoke 2 internet link goes down, this causes Inet child tunnel goes out of SLA, as per SDWAN rule member order next member MPLS parent tunnel is created and then child tunnel gets formed in MPLS (MPLS_0) at both branches Spoke 1 and spoke2. Until this point, its working fine. Till this point, at Spoke1 - spoke2 route will learn through inet1_0 and MPLS_0 (Child tunnels), once inet1_0 at spoke 1 detects tunnel failure by DPD failure due to spoke 2 inet being down, route for spoke 2 at spoke 1 will learn through inet 1 and MPLS_0. Now traffic from spoke 1 takes inet1 and goes to hub, hub then forwards the traffic to MPLS tunnel to spoke2. This traffic reaches spoke2 , but in spoke 2 we will have MPLS_0 child tunnel only , the parent tunnel at spoke 2 will be masked since we have routes learnt through MPLS_0. This is now causing RPF , since spoke 2 receives this traffic in MPLS but doesnt have return route on the MPLS parent tunnel interface (Return route is only available through MPLS_0 child tunnel). MPLS parent tunnel doesn't have any other routes (Like default route).
This is causing an outage for the traffic originating from spoke1 to spoke 2.. Is this the expected behavior?.. As per fortinet documentation, traffic should take MPLS from spoke 1, reach Hub and then forward to spoke 2 in MPLS. But as per fortinet document this works and this is being highlighted as limitation where traffic need to be routed in the longest path which is now getting avoided in ADVPN2.0
One option I could think of is to have default route for parent MPLS interface at spoke 2 which could avoid RPF failure. Anyways in hybrid use cases like this (Inet + MPLS) we might need default route in overlay as backup for internet traffic (Remote internet breakout)
Regards
Rajamanickam