SD-WAN and PPPoE

[alex_buric]

I have Fortigate 60D with FortiOS 6.06 First ISP - static IP

Second ISP - PPPoE

When I add both of them to SD-WAN and make a static route 0.0.0.0/0.0.0.0 to SD-WAN interface in routing table appear two line:

Routing table for VRF=0
S* 0.0.0.0/0 [1/0] via 193.200.32.2, ppp1
                   [1/0] via 31.128.69.193, wan2

But after few seconds (5-6) line with ppp1 interface disappearing

[emnoc]

I had that same problem and had to update my  FortiOS. Have you done this? BUt the ppp interface should be in the route table. Also , do you have any  SDWAN link checkers enabled? Very bad outcomes can happen with ping/http status checks on SDWAN interfaces. Do keep us updated and what fortiOS version you are running.

[Dave_Hall]

Had a similar issue with a DSL (pppoe) connection that was part of a zone (load-balancing) connection - this was running on 5.4 and the interface kept dropping until I have enabled dynamic-gateway (via static route) for the interface. 

[alex_buric]

emnoc wrote:

I had that same problem and had to update my  FortiOS. Have you done this? BUt the ppp interface should be in the route table. Also , do you have any  SDWAN link checkers enabled? Very bad outcomes can happen with ping/http status checks on SDWAN interfaces. Do keep us updated and what fortiOS version you are running.

I have Fortigate 60D with FortiOS 6.0.7

[alex_buric]

Debug from PPPoE

=~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2019.11.29 09:42:51 =~=~=~=~=~=~=~=~=~=~=~=
2019-11-29 09:43:32 update_interfaces()-499: New PPPoE interface wan1
2019-11-29 09:43:32 update_interfaces()-584: PPPoE parameters of wan1 changed.
2019-11-29 09:43:32 pppoed_main()-812: Start PPPoE interface wan1
2019-11-29 09:43:32 pppoed_main()-815: PID of wan1 is 365
2019-11-29 09:43:32 parameters passed to pppd:
2019-11-29 09:43:32 pppd 2019-11-29 09:43:32 0 2019-11-29 09:43:32 pppoed 2019-11-29 09:43:32 wan1 2019-11-29 09:43:32 2019-11-29 09:43:32 2019-11-29 09:43:32 2019-11-29 09:43:32 2019-11-29 09:43:32 2019-11-29 09:43:32 nopersist 2019-11-29 09:43:32 noipdefault 2019-11-29 09:43:32 noauth 2019-11-29 09:43:32 defaultroute 2019-11-29 09:43:32 default-asyncmap 2019-11-29 09:43:32 hide-password 2019-11-29 09:43:32 nodetach 2019-11-29 09:43:32 mtu 2019-11-29 09:43:32 1492 2019-11-29 09:43:32 mru 2019-11-29 09:43:32 1492 2019-11-29 09:43:32 noaccomp 2019-11-29 09:43:32 noccp 2019-11-29 09:43:32 nobsdcomp 2019-11-29 09:43:32 nodeflate 2019-11-29 09:43:32 nopcomp 2019-11-29 09:43:32 novj 2019-11-29 09:43:32 novjccomp 2019-11-29 09:43:32 user 2019-11-29 09:43:32 t01205 2019-11-29 09:43:32 lcp-echo-interval 2019-11-29 09:43:32 5 2019-11-29 09:43:32 lcp-echo-failure 2019-11-29 09:43:32 3 2019-11-29 09:43:32 sync 2019-11-29 09:43:32 plugin 2019-11-29 09:43:32 /bin/pppoe.so 2019-11-29 09:43:32 2019-11-29 09:43:32 2019-11-29 09:43:32 2019-11-29 09:43:32 2019-11-29 09:43:32 pppoe_retry_time 2019-11-29 09:43:32 1 2019-11-29 09:43:32 pppoe_padt_time 2019-11-29 09:43:32 1 2019-11-29 09:43:32 pppoe_srv_name 2019-11-29 09:43:32 2019-11-29 09:43:32 pppoe_ac_name 2019-11-29 09:43:32 2019-11-29 09:43:32 pppoe_hostuniq 2019-11-29 09:43:32 4a25300 2019-11-29 09:43:32 pppoe_sock2parent 2019-11-29 09:43:32 12 2019-11-29 09:43:32 wan1 2019-11-29 09:43:32 ipunnumbered 2019-11-29 09:43:32 0.0.0.0 2019-11-29 09:43:32 idle 2019-11-29 09:43:32 0 2019-11-29 09:43:32 unnumbered-negotiate 2019-11-29 09:43:32 enable 2019-11-29 09:43:32 2019-11-29 09:43:32 2019-11-29 09:43:32 2019-11-29 09:43:32 
2019-11-29 09:43:33 using channel 5
2019-11-29 09:43:33 Using interface ppp1
2019-11-29 09:43:33 Connect: ppp1 <--> wan1
2019-11-29 09:43:33 Parent: pppoed

2019-11-29 09:43:33 PPP send: LCP Configure_Request id(1) len(14) [Maximum_Received_Unit 1492] [Magic_Number 554216F6] 
2019-11-29 09:43:33 PPP recv: LCP Configure_Ack id(1) len(14) [Maximum_Received_Unit 1492] [Magic_Number 554216F6] 
2019-11-29 09:43:35 PPP recv: LCP Configure_Request id(2) len(19) [Maximum_Received_Unit 1492] [Magic_Number 67BB0C30] [Authentication_Protocol CHAP algorithm=MSCHAPv2] 
2019-11-29 09:43:35 PPP send: LCP Configure_Ack id(2) len(19) [Maximum_Received_Unit 1492] [Magic_Number 67BB0C30] [Authentication_Protocol CHAP algorithm=MSCHAPv2] 
2019-11-29 09:43:35 PPP send: LCP Echo_Request id(0) len(8) [Magic_Number 554216f6]
2019-11-29 09:43:35 PPP recv: CHAP Challenge id(1) 
2019-11-29 09:43:35 PPP send: CHAP Response id(1) 
2019-11-29 09:43:35 PPP recv: LCP Echo_Reply id(0) len(8) [Magic_Number 67bb0c30]
2019-11-29 09:43:35 PPP recv: CHAP Success id(1) msg(S=24F43E47D3D90AC528178CDC551B6FCE3876D125)
2019-11-29 09:43:35 Remote message: S=24F43E47D3D90AC528178CDC551B6FCE3876D125
2019-11-29 09:43:35 PPP send: IPCP Configure_Request id(1) [IP_Address 0.0.0.0] [Primary_DNS_IP_Address 0.0.0.0] [Secondary_DNS_IP_Address 0.0.0.0] 
2019-11-29 09:43:35 PPP recv: IPCP Configure_Request id(1) [IP_Address 193.200.32.2] [IP_Compression_Protocol Van Jacobson] 
2019-11-29 09:43:35 PPP send: IPCP Configure_Reject id(1) [IP_Compression_Protocol Van Jacobson] 
2019-11-29 09:43:35 PPP recv: IPCP Configure_Nak id(1) [IP_Address YYY.YYY.YYY.YYY] [Primary_DNS_IP_Address 8.8.8.8] [Secondary_DNS_IP_Address 193.200.32.5] 
2019-11-29 09:43:35 PPP send: IPCP Configure_Request id(2) [IP_Address YYY.YYY.YYY.YYY] [Primary_DNS_IP_Address 8.8.8.8] [Secondary_DNS_IP_Address 193.200.32.5] 
2019-11-29 09:43:35 PPP recv: IPCP Configure_Request id(2) [IP_Address 193.200.32.2] 
2019-11-29 09:43:35 PPP send: IPCP Configure_Ack id(2) [IP_Address 193.200.32.2] 
2019-11-29 09:43:35 PPP recv: IPCP Configure_Ack id(2) [IP_Address YYY.YYY.YYY.YYY] [Primary_DNS_IP_Address 8.8.8.8] [Secondary_DNS_IP_Address 193.200.32.5] 
2019-11-29 09:43:35 pppoe_read_intf_link_sock()-424: interface=ppp1 event=3
2019-11-29 09:43:35 update_interfaces()-443: Update PPPoE interfaces
2019-11-29 09:43:35 update_interfaces()-447: Invalidate PPPoE interface wan1
2019-11-29 09:43:35 update_interfaces()-501: Found PPPoE interface wan1
2019-11-29 09:43:35 update_interfaces()-584: PPPoE parameters of wan1 unchanged.
2019-11-29 09:43:35 send_vip_arp: vd root master 1 intf wan2 ip XXX.XXX.XXX.XXX
2019-11-29 09:43:35 send_vip_arp: vd root master 1 intf wan1 ip YYY.YYY.YYY.YYY
2019-11-29 09:43:35 local IP address YYY.YYY.YYY.YYY
2019-11-29 09:43:35 remote IP address 193.200.32.2
2019-11-29 09:43:35 primary DNS address 8.8.8.8
2019-11-29 09:43:35 secondary DNS address 193.200.32.5
2019-11-29 09:43:40 PPP send: LCP Echo_Request id(1) len(8) [Magic_Number 554216f6]
2019-11-29 09:43:40 PPP recv: LCP Echo_Reply id(1) len(8) [Magic_Number 67bb0c30]
2019-11-29 09:43:45 PPP send: LCP Echo_Request id(2) len(8) [Magic_Number 554216f6]
2019-11-29 09:43:45 PPP recv: LCP Echo_Reply id(2) len(8) [Magic_Number 67bb0c30]

Routing table log

=~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2019.11.29 09:43:00 =~=~=~=~=~=~=~=~=~=~=~=

p1fg # get router info routing-table static
Routing table for VRF=0
S* 0.0.0.0/0 [1/0] via 31.128.69.193, wan2

p1fg # get router info routing-table static
Routing table for VRF=0
S* 0.0.0.0/0 [1/0] via 193.200.32.2, wan1
                  [1/0] via 31.128.69.193, wan2

p1fg # get router info routing-table static
Routing table for VRF=0
S* 0.0.0.0/0 [1/0] via 193.200.32.2, wan1
                  [1/0] via 31.128.69.193, wan2

p1fg # get router info routing-table static
Routing table for VRF=0
S* 0.0.0.0/0 [1/0] via 193.200.32.2, wan1
                  [1/0] via 31.128.69.193, wan2

p1fg # get router info routing-table static
Routing table for VRF=0
S* 0.0.0.0/0 [1/0] via 193.200.32.2, wan1
                  [1/0] via 31.128.69.193, wan2

p1fg # get router info routing-table static
Routing table for VRF=0
S* 0.0.0.0/0 [1/0] via 193.200.32.2, ppp1
                  [1/0] via 31.128.69.193, wan2

p1fg # get router info routing-table static
Routing table for VRF=0
S* 0.0.0.0/0 [1/0] via 31.128.69.193, wan2