Fortigate 1500D Kernel panic - not syncing: Fatal exception in interrupt

saniy91 · ‎01-16-2018

Hi all, i have an issue with my office fortigate 1500D which appear on console when power on the appliance and keep rebooting. Here the issues:

------------[ cut here ]------------ kernel BUG at kernel/watchdog.c:232! invalid opcode: 0000 [#1] SMP CPU 11 Modules linked in: Pid: 50, comm: migration/11 Not tainted 3.2.16 #2 RIP: 0010:[<ffffffff8026f63a>] [<ffffffff8026f63a>] watch_lockup_crash+0x7a/0x80 RSP: 0000:ffff88043fd63e78 EFLAGS: 00010046 RAX: 000000000000000c RBX: ffff88042e211d48 RCX: 00000000000000d5 RDX: 00000000000000c9 RSI: 0000000000000092 RDI: ffffffff807c34d4 RBP: 0000000000000000 R08: 000000000000000b R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000000 R12: ffff88042e211d48 R13: 0000000000000001 R14: ffff88042e73bea8 R15: ffff88043fd6cdd0 FS: 0000000000000000(0000) GS:ffff88043fd60000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 0000000000000000 CR3: 00000000006e1000 CR4: 00000000001406a0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process migration/11 (pid: 50, threadinfo ffff88042e210000, task ffff88042e1e83c0) Stack: ffff88043fd6cf40 ffffffff8026f830 0000000000000002 ffff88043fd6cf40 ffff88043fd6cdc0 ffff88043fd6cdd0 ffff88043fd6cdc0 ffffffff802544e9 ffff88042e21d420 000000003fd63ec0 000000005a5eefb8 00000000068e7782 ffffffffa5a11095 0000000000000000 0000000000000000 0000000000000000 0000000000000001 ffff88042e1e83c0 0000000000000000 000000000000000b 0000000000000286 ffff88042e73bea8 ffff88042e73be30 ffffffff80242519 0000000000000000 ffffffff80242565 ffff88043fd6c840 ffff88043fd6c840 000000000000000b ffffffff8025cb77 0000000000000046 ffffffff8025cc38 ffff88043fd6c840 0000000000000000 ffffffff8026ed01 ffffffff80213a03 ffff88042e243fd8 ffff88042e73bea8 0000000000000001 ffffffff805a628b ffff88042e211d68 <EOI> 0000000000000001 ffff88042e1e83c0 0000000000000001 0000000000000001 0000000000000000 ffff88042e210000 0000000000000000 ffff88043fd6ce00 0000000000000001 ffff88042e1e83c0 ffff88042e73bea8 ffffffffffffff10 ffffffff8026ee40 0000000000000010 0000000000000293 ffff88042e211df0 0000000000000000 ffffffff8026ea90 ffff88043fd6cec0 ffff88042e1e83c0 ffffffff8026ede0 ffff88042e1e83c0 ffffffff8026eb35 0000000000000000 ffff88042e211fd8 0000000000000000 0000000000000000 0000000000000000 0000000000000001 ffff88042e73be20 ffff88042e73be08 0000000000000000 0000000000000003 ffff88042e211ec0 ffffffff802279f5 0000000000000000 0000000000000000 0000000000000000 ffff88042e73be18 ffff88042e73be10 0000000000000282 0000000000000000 0000000000000000 ffff88042e211ef0 ffff88042e73bdf0 ffff88043fd6cec0 ffffffff8026ea90 0000000000000000 0000000000000000 0000000000000000 ffffffff8025069e 0000000000000000 ffff88043fd6cec0 ffff880400000000 ffffffff806f0000 ffff88042e211f20 ffff88042e211f20 0000000000000000 0000000000000000 0000000000000000 ffffffff805a6db4 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 0000000000000000 ffffffff80250620 ffff88042e73bdf0 ffffffffffffffff ffffffff805a6db0 0000000000000010 0000000000000202 ffff88042e211f58 0000000000000018 Call Trace: <IRQ> [<ffffffff8026f830>] ? watchdog_timer_fn+0xe0/0x240 [<ffffffff802544e9>] ? hrtimer_run_queues+0xa9/0x230 [<ffffffff80242519>] ? run_local_timers+0x9/0x20 [<ffffffff80242565>] ? update_process_times+0x35/0x80 [<ffffffff8025cb77>] ? tick_periodic+0x27/0x80 [<ffffffff8025cc38>] ? tick_handle_periodic+0x18/0x60 [<ffffffff8026ed01>] ? cpu_stop_queue_work+0x61/0x80 [<ffffffff80213a03>] ? smp_apic_timer_interrupt+0x63/0xa0 [<ffffffff805a628b>] ? apic_timer_interrupt+0x6b/0x70 <EOI> [<ffffffff8026ee40>] ? stop_machine_cpu_stop+0x60/0xc0 [<ffffffff8026ea90>] ? cpu_stop_signal_done+0x30/0x30 [<ffffffff8026ede0>] ? queue_stop_cpus_work+0xc0/0xc0 [<ffffffff8026eb35>] ? cpu_stopper_thread+0xa5/0x150 [<ffffffff802279f5>] ? __wake_up_common+0x55/0x90 [<ffffffff8026ea90>] ? cpu_stop_signal_done+0x30/0x30 [<ffffffff8025069e>] ? kthread+0x7e/0x90 [<ffffffff805a6db4>] ? kernel_thread_helper+0x4/0x10 [<ffffffff80250620>] ? kthread_worker_fn+0x120/0x120 [<ffffffff805a6db0>] ? gs_change+0xb/0xb Code: 8d 95 f9 ff 31 c0 48 c7 c7 1b 04 67 80 e8 2e 05 33 00 8b 05 91 a8 57 00 83 c0 01 3b 05 d8 6d 4c 00 89 05 82 a8 57 00 74 02 5b c3 <0f> 0b 0f 1f 40 00 44 8b 15 69 a8 57 00 45 85 d2 75 54 65 8a 04 RIP [<ffffffff8026f63a>] watch_lockup_crash+0x7a/0x80 RSP <ffff88043fd63e78> ---[ end trace ce92efdf0a6162f8 ]--- Kernel panic - not syncing: Fatal exception in interrupt Pid: 50, comm: migration/11 Tainted: G D 3.2.16 #2 Call Trace: <IRQ> [<ffffffff8059fa50>] ? panic+0x95/0x194 [<ffffffff80204d13>] ? oops_end+0x93/0xa0 [<ffffffff802024a5>] ? do_invalid_op+0x85/0x90 [<ffffffff8026f63a>] ? watch_lockup_crash+0x7a/0x80 [<ffffffff80265b35>] ? is_module_text_address+0x5/0x10 [<ffffffff805a6c35>] ? invalid_op+0x15/0x20 [<ffffffff8026f63a>] ? watch_lockup_crash+0x7a/0x80 [<ffffffff8026f621>] ? watch_lockup_crash+0x61/0x80 [<ffffffff8026f830>] ? watchdog_timer_fn+0xe0/0x240 [<ffffffff802544e9>] ? hrtimer_run_queues+0xa9/0x230 [<ffffffff80242519>] ? run_local_timers+0x9/0x20 [<ffffffff80242565>] ? update_process_times+0x35/0x80 [<ffffffff8025cb77>] ? tick_periodic+0x27/0x80 [<ffffffff8025cc38>] ? tick_handle_periodic+0x18/0x60 [<ffffffff8026ed01>] ? cpu_stop_queue_work+0x61/0x80 [<ffffffff80213a03>] ? smp_apic_timer_interrupt+0x63/0xa0 [<ffffffff805a628b>] ? apic_timer_interrupt+0x6b/0x70 <EOI> [<ffffffff8026ee40>] ? stop_machine_cpu_stop+0x60/0xc0 [<ffffffff8026ea90>] ? cpu_stop_signal_done+0x30/0x30 [<ffffffff8026ede0>] ? queue_stop_cpus_work+0xc0/0xc0 [<ffffffff8026eb35>] ? cpu_stopper_thread+0xa5/0x150 [<ffffffff802279f5>] ? __wake_up_common+0x55/0x90 [<ffffffff8026ea90>] ? cpu_stop_signal_done+0x30/0x30 [<ffffffff8025069e>] ? kthread+0x7e/0x90 [<ffffffff805a6db4>] ? kernel_thread_helper+0x4/0x10 [<ffffffff80250620>] ? kthread_worker_fn+0x120/0x120 [<ffffffff805a6db0>] ? gs_change+0xb/0xb Rebooting in 5 seconds..FortiGate-1500D (17:06-10.20.2015)

any idea how to fix this? or some solution. btw i tried to format the boot image using firmware 5.4.5 on 1500D appliance but still going into this issue .

roberto_araujo · ‎04-23-2025

I have a similar sinthom.

After power on, may be during boot, or after finish starting system, sudenly reboots with kernel panic.

Tried 7.2.11 and 6.2.5 as backup firmware. Try again formating boot device and uploading firmware again from TFTP.

Thanks for all who has any helping information

roberto_araujo · ‎04-24-2025

Here is message presented to me

Reading boot image 2957608 bytes.

Initializing firewall...BUG: unable to handle kernel paging request at ffffff008069651d

IP: [<ffffffff803914f4>] strcmp+0x4/0x30

PGD 0

Oops: 0000 [#1] SMP

CPU 0

Modules linked in:

Pid: 1, comm: swapper/0 Not tainted 3.2.16 #2

RIP: 0010:[<ffffffff803914f4>] [<ffffffff803914f4>] strcmp+0x4/0x30

RSP: 0018:ffff88042ebdfe78 EFLAGS: 00010286

RAX: ffff88002e107658 RBX: ffffffff806863a6 RCX: ffffffff80717ea0

RDX: ffff88042e107600 RSI: ffffffff806863a6 RDI: ffffff008069651e

RBP: ffffffff8071a600 R08: 0000000000000000 R09: ffff8804296a96c0

R10: 0000000000000001 R11: 00000000000130f8 R12: ffff88042e107658

R13: ffff88042e107658 R14: 0000000000000000 R15: ffff88002e1076e8

FS: 0000000000000000(0000) GS:ffff88043fc00000(0000) knlGS:0000000000000000

CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b

CR2: ffffff008069651d CR3: 0000000000707000 CR4: 00000000000406b0

DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000

DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400

Process swapper/0 (pid: 1, threadinfo ffff88042ebdc000, task ffff88042ebdb690)

Stack:

ffffffff80267579 0000000000000202 0000000000000000 ffff88042e107600

ffff8804296a96c0 ffff88002e107658 ffffffff80717f10 ffffffff8071a600

ffff8804296a96c8 0000000000000000 ffffffff807b0618 0000000000000000

0000000000000000 ffffffff80782c4c 0000000000000000 0000000000000000

ffffffff80782c59 ffff88042ebdffd8 ffffffff802001bd ffffffff807b02f8

ffffffff807b0618 0000000000000000 0000000000000000 0000000000000000

ffffffff80772b6b 0000000000000000 ffffffff805c3774 0000000000000000

0000000000000000 0000000000000000 0000000000000000 0000000000000000

0000000000000000 ffffffff80772aca 0000000000000000 ffffffffffffffff

ffffffff805c3770 0000000000000010 0000000000000202 ffff88042ebdff58

0000000000000018

Call Trace:

[<ffffffff80267579>] ? __register_sysctl_paths+0x209/0x330

[<ffffffff80782c4c>] ? rcu_init+0xa6/0xa6

[<ffffffff80782c59>] ? utsname_sysctl_init+0xd/0x11

[<ffffffff802001bd>] ? do_one_initcall+0x2d/0x160

[<ffffffff80772b6b>] ? kernel_init+0xa1/0x114

[<ffffffff805c3774>] ? kernel_thread_helper+0x4/0x10

[<ffffffff80772aca>] ? start_kernel+0x37e/0x37e

[<ffffffff805c3770>] ? gs_change+0xb/0xb

Code: 0f 1f 80 00 00 00 00 48 83 c6 01 0f b6 4e ff 48 83 c2 01 84 c9 88 4a ff 75 ed f3 c3 90 66 2e 0f 1f 84 00 00 00 00 00 48 83 c7 01 <0f> b6 47 ff 48 83 c6 01 3a 46 ff 75 0f 84 c0 75 eb 31 c0 c3 0f

RIP [<ffffffff803914f4>] strcmp+0x4/0x30

RSP <ffff88042ebdfe78>

CR2: ffffff008069651d

---[ end trace 82bc736bb33fe366 ]---

Kernel panic - not syncing: Fatal exception

Pid: 1, comm: swapper/0 Tainted: G D 3.2.16 #2

Call Trace:

[<ffffffff805bde49>] ? panic+0xa2/0x19e

[<ffffffff80204c83>] ? oops_end+0x93/0xa0

[<ffffffff80218a18>] ? no_context+0xf8/0x1e0

[<ffffffff802191fe>] ? do_page_fault+0x24e/0x450

[<ffffffff802199b0>] ? fixup_exception+0x10/0x60

[<ffffffff802ce360>] ? kmem_cache_size+0x10/0x10

[<ffffffff80213524>] ? native_send_call_func_ipi+0x84/0x90

[<ffffffff8028d1d1>] ? smp_call_function_many+0x1a1/0x250