Troubleshooting Tip: FortiGate 6000 Series FPC dead state issue due to BIOS mismatch
Description
This article describes how to troubleshoot FortiGate 6000 Series FPC Dead State Issue Due to BIOS Mismatch.
Scope
FortiGate 6000 Series Chassis.
Solution
Where FPCs are displaying a DEAD status with the error message: 'BIOS mismatch, please reset FPC7.' To address this, a flash formatting process of the affected FPCs has been implemented successfully.
Issue logs:
FortiGate-6000F (global) # diagnose load-balance status
========================================================================
MBD SN: F6KF01T0xxxx
Primary FPC Blade: slot-1
Slot 1: FPC6KFT0xxxx
Status:Working Function:Active
Link: Base: Up Fabric: Up
Heartbeat: Management: Good Data: Good
Status Message:"Running"
Slot 2: FPC6KFT0xxxx
Status:Working Function:Active
Link: Base: Up Fabric: Up
Heartbeat: Management: Good Data: Good
Status Message:"Running"
Slot 3: FPC6KFT0xxxx
Status:Working Function:Active
Link: Base: Up Fabric: Up
Heartbeat: Management: Good Data: Good
Status Message:"Running"
Slot 4:
Status:Dead Function:Active
Link: Base: Up Fabric: Down
Heartbeat: Management: Failed Data: Failed
Status Message:"BIOS mismatch, please reset FPC4." <---------
Slot 5:
Status:Dead Function:Active
Link: Base: Up Fabric: Down
Heartbeat: Management: Failed Data: Failed
Status Message:"BIOS mismatch, please reset FPC5." <---------
Below is a detailed overview of the procedure followed:
Step-by-Step Process for Flash Formatting and Image Deployment:
Upload the Firmware Image to the Firewall via TFTP.
1. Network Configuration:
Connect an Ethernet patch cable to the MGMT1 port on the firewall.
Assign the IP address 192.168.1.154 to the MGMT1 interface.
The firewall’s MGMT1 interface IP was configured as 192.168.1.99.
2. Image Upload Command :
Syntax:
FortiGate-6000F (global) # execute upload image tftp <image-file> <comment> <tftp-server-address>Example:
FortiGate-6000F (global) # execute upload image tftp FGT_6000F-v7.6.6.M-build3652-FORTINET.out comment 192.168.1.154
(Ensure the FortiGate can communicate with the external TFTP server at this address)2. Verify Internal TFTP Server IP:
FortiGate-6000F (global) # fnsysctl ifconfig base-tftp
Reboot and Flash Format the Affected FPC.
1. Reboot Command.
Note: If not able to execute commands after establishing a console connection to the FPC, attempt to reboot the respective FPC via the MBD.
FortiGate-6000F (global) # execute load-balance slot reboot <slot-number>(Replace <slot-number> with the specific FPC slot number).
2. Connect to the Console:
After the reboot, connect to the respective FPC by running below command:
FortiGate-6000F (global) # execute system console-server connect <slot-number>3. Monitor Boot and Enter Formatting Menu:
During the reboot, observe the console output.
When prompted, press any key to interrupt the boot process.
Example :
Enter P,D,I,S,G,V,T,F,E,R,N,Q or H:
[C]: Configure TFTP parameters.
[R]: Review TFTP parameters.
[T]: Initiate TFTP firmware transfer.
[F]: Format boot device.
[B]: Boot with backup firmware and set as default.
[I]: System configuration and information.
[Q]: Quit menu and continue to boot.
[H]: Display this list of options.4. Format Boot Device:
Select option F to format the boot device.
Confirm the action when prompted.
Wait for the formatting process to complete.
Example:
Enter C,R,T,F,B,I,Q,or H:
All data will be erased, continue:[Y/N]?
Formatting boot device...
..............................
Format boot device completed.Install Firmware Image on the FPC.
1. Configure TFTP Parameters:
After formatting, press C to configure the image download port and network settings.
Set parameters such as:
Image download port: MGMT1.
Local IP address: e.g., 169.254.255.2.
Subnet mask, gateway, and TFTP server IP (validate with #fnsysctl ifconfig base-tftp).
Firmware image filename: image.out.
Example:
Enter C,R,T,F,B,I,Q,or H:
[P]: Set image download port.
[D]: Set DHCP mode.
[I]: Set local IP address.
[S]: Set local subnet mask.
[G]: Set local gateway.
[V]: Set local VLAN ID.
[T]: Set remote TFTP server IP address.
[F]: Set firmware image file name.
[E]: Reset TFTP parameters to factory defaults.
[R]: Review TFTP parameters.
[N]: Diagnose networking (ping).
[Q]: Quit this menu.
[H]: Display this list of options.
Image download port: MGMT1
DHCP status: disabled
Local VLAN ID: none
Local IP address: 169.254.255.2
Local subnet mask: 255.255.255.0
Local gateway: 169.254.255.1
TFTP server IP address: 169.254.255.1
Firmware file name: image.out2. Initiate Firmware Transfer:
Exit the configuration menu by pressing Q.
Start the transfer by pressing T.
Monitor the transfer progress and verify integrity.
Enter C,R,T,F,B,I,Q,or H:
Please connect TFTP server to Ethernet port "MGMT1".
MAC: E8:CC:D6:AA:BB:AA
#############################################################################################################################
Total 131464435 bytes data downloaded.
Verifying the integrity of the firmware image.
This firmware image is certified.
Total 262144kB unzipped.3. Set Firmware as Default:
After successful upload, press D to set the new image as the default.
The system will verify files and start the firewall.
Save as Default firmware/Backup firmware/Run image without saving:[D/B/R]?D
Programming the boot device now.
.............................................................................................................................................................
Verifying the integrity of system files.
Reading boot image 3432477 bytes.
Initializing firewall...
System is starting..Once the FPC successfully boots, exit the console connection with Ctrl + X.
Validate FPC Status.
Check Connection Status:
FortiGate-6000F (global) # diagnose load-balance status
==========================================================================
MBD SN: F6KF01T0xxxx
Primary FPC Blade: slot-1
Slot 1: FPC6KFT0xxxx
Status:Working Function:Active
Link: Base: Up Fabric: Up
Heartbeat: Management: Good Data: Good
Status Message:"Running"
Slot 2: FPC6KFT0xxxx
Status:Working Function:Active
Link: Base: Up Fabric: Up
Heartbeat: Management: Good Data: Good
Status Message:"Running"
Slot 3: FPC6KFT0xxxx
Status:Working Function:Active
Link: Base: Up Fabric: Up
Heartbeat: Management: Good Data: Good
Status Message:"Running"
Slot 4: FPC6KFT0xxxx
Status:Working Function:Active
Link: Base: Up Fabric: Up
Heartbeat: Management: Good Data: Good
Status Message:"Running"
Slot 5: FPC6KFT0xxxx
Status:Working Function:Active
Link: Base: Up Fabric: Up
Heartbeat: Management: Good Data: Good
Status Message:"Running"Confirm all FPCs show as 'Working' with 'Running' status messages.