Created on ‎10-06-2016 04:21 PM Edited on ‎12-24-2024 01:13 AM By Anthony_E
Description
This article describes troubleshooting with built-in FortiOS hardware diagnostic commands.
Scope
FortiGate with built-in diagnostic commands (E-Series and newer).
For older hardware that requires a dedicated HQIP test image, follow this article:
Technical Tip: RMA - HQIP test (with hardware test image).
Solution
HQIP can perform tests on a number of hardware elements.
While it does not detect all hardware malfunctions, tests for the most common hardware problems are performed.
Note:
To prove that the hardware is faulty, additional objective proof may be requested (photos, videos, of the test performed), especially when there is no other proof that the unit is indeed faulty (i.e. for checking the power adapter).
Traditionally, hardware diagnostics require users to download the HQIP image, and then load the image on the device before the tests can be performed. Starting in FortiOS 5.4 with FortiGate E-Series models, HQIP tests are built into FortiOS itself. This allows users the convenience of performing hardware diagnostics without needing to find the HQIP image and reloading the firmware image.
Note:
No HQIP images will be produced for FortiGate E-Series and above that support built-in HQIP commands. Conversely, for units that require an HQIP image, continue using their designated HQIP images. See the "Running an HQIP Test" attachment to the related article 'RMA Note: HQIP - Hardware Quick Inspection Package' article for details.
Precautions and Preparations:
- Some tests in HQIP will incur downtime. It is strongly recommended to run the HQIP test during a maintenance window.
- Plan to be local to the firewall to perform this test. Console access is recommended, and select tests require the use of loopback cables and re-cabling of the current device.
- Make sure to have a good backup of the configuration file.
- Have a backup of the current firmware image in case a full recovery of the system is required.
- Perform a factory reset before running the test if possible to get the most accurate results ('execute factoryreset').
- Reboot is required if the unit is factory reset config with some uptime.
- Make sure the device no longer handling production traffic and the CPU and memory is low before performing the test.
- Enable logging of the console output before the test begins
- The 'Running an HQIP Test' attachment to the related article 'RMA Note: HQIP - Hardware Quick Inspection Package' article has information about wiring the device, console connection, hardware, TFTP server, and connecting to the device. Reference the link if unfamiliar with the aforementioned operations.
What can be tested:
From the CLI, run the following command to list all the hardware test items supported on the device. This command does not execute the actual tests:
Typically, the output will show test cases under these categories:
- BIOS.
- System.
- USB.
- Button.
- CPU.
- Memory.
- Network.
- Disk.
- LED.
- WiFi.
What the HQIP test does not do:
- Detect all hardware malfunctions. Tests for the most common hardware problems are performed.
- Diagnose issues that cause a device to reboot or be unstable.
- Detect software configuration errors, OS bugs, or OS Kernel Crash issues (one type of OS bug).
- Diagnose devices with multiple Hard Drives.
There will be interactive prompts throughout the test, so users are advised to remain at the console during the duration of the test. To run the test suite:
Note:
Please connect ethernet cables:
[WAN - Any of PORT1...PORT4] <- This means no other cables should be connected.
Continue with the rest of the test cases and monitor the console for interactive prompts.
When the test is complete, a Test Report will be displayed, showing cases that Passed, Failed, or Skipped (N/A). Save this output for reference.
Running one test category or a single test case:
When running a test category, simply input the chosen category and select enter. For example, to test the System:
========================= Fortinet Hardware Test Report =========================
SYSTEM
CPU Configuration Check....................................... PASS
Memory Configuration Check.................................... PASS
Storage Configuration Check................................... PASS
Network Configuration Check................................... PASS
========================= Fortinet Hardware Test PASSED ========================
To test the self-loopback test:
FortiGate # diagnose hardware test network loopback
Network Interface Loopback Test
Please connect ethernet/SFP cables:
[MGMT1 - MGMT2] [HA1 - HA2] [PORT1 - PORT2] [PORT3 - PORT4]
Do you want to continue this test? (y/n) (default is n) y
Test Begin at UTC Time Thu Jul 11 05:53:44 2024
==============Fortinet Hardware Test Report=======
SYSTEM
CPU Configuration check................................ PASS
=======Fortinet Hardware Test PASSED ===============
Common requests and issues:
A non-interactive mode for running the test suite:
Tests overwriting disk data:
Explaining the PCBA, stress, and rack-burn-in options when running the 'diagnose hardware test suite':
Note:
To proceed with an RMA process for the replacement of a device or chassis, specific supporting evidence is typically required. As part of the process, it is important to provide a video or image where the serial number of the device is clearly visible. This step is mandatory and ensures that the necessary verification can be completed.
For those unfamiliar with the process, it’s important to note that the image or video serves as crucial evidence to confirm the details of the device. Without this, the RMA request cannot move forward. Please ensure that the serial number is legible in the media provided, as this is a standard requirement to comply with internal procedures for the RMA process and will be requested by the TAC engineer: RMA NOTE: Finding-the-unit-serial-number-on-a-FortiGate-chassis
Related article: