開発日記/2009-12-29
RackSpaceのサーバでkernel panic †
なんか時々反応が遅くなって、監視サーバからアラートがガンガン来る現象が・・・
ssh使用としてもタイムアウトして接続できない。
kernelのバクだったのかな〜。。。。。 yumアップデートでカーネル関係も全部アップして、再起動してからは現象が起こらなくなった。
対処 †
# yum update
環境 †
- RackSpace
- CentOS 5.4
こんなエラー †
Dec 27 22:44:13 dns kernel: [40681.019000] INFO: task kjournald:1729 blocked for more than 120 seconds. Dec 27 22:44:14 dns kernel: [40681.019018] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message. Dec 27 22:44:14 dns kernel: [40681.019025] kjournald D ffffffff802076a0 0 1729 2 0x00000000 Dec 27 22:44:14 dns kernel: [40681.019031] ffff880004379c80 0000000000000246 ffff880000000539 ffff880004379c00 Dec 27 22:44:14 dns kernel: [40681.019043] 0000000000000012 ffff880004379c48 000000000000a380 ffff880003b68ca8 Dec 27 22:44:14 dns kernel: [40681.019052] 000000000000a380 ffff880004379c30 000000000000a380 000000000000a380 Dec 27 22:44:14 dns kernel: [40681.019061] Call Trace: Dec 27 22:44:14 dns kernel: [40681.019074] [<ffffffff8043f5ed>] ? do_blkif_request+0xdd/0xf0 Dec 27 22:44:14 dns kernel: [40681.019083] [<ffffffff802076a0>] ? sync_buffer+0x0/0x50 Dec 27 22:44:14 dns kernel: [40681.019091] [<ffffffff803bafdd>] ? __generic_unplug_device+0x2d/0x40 Dec 27 22:44:14 dns kernel: [40681.019097] [<ffffffff802076a0>] ? sync_buffer+0x0/0x50 Dec 27 22:44:14 dns kernel: [40681.019105] [<ffffffff805357d8>] io_schedule+0x28/0x40 Dec 27 22:44:14 dns kernel: [40681.019110] [<ffffffff802076db>] sync_buffer+0x3b/0x50 Dec 27 22:44:14 dns kernel: [40681.019116] [<ffffffff80535c97>] __wait_on_bit+0x57/0x80 Dec 27 22:44:14 dns kernel: [40681.019121] [<ffffffff802076a0>] ? sync_buffer+0x0/0x50 Dec 27 22:44:15 dns kernel: [40681.019127] [<ffffffff80535d33>] out_of_line_wait_on_bit+0x73/0x90 Dec 27 22:44:15 dns kernel: [40681.019135] [<ffffffff80155290>] ? wake_bit_function+0x0/0x40 Dec 27 22:44:15 dns kernel: [40681.019141] [<ffffffff80207696>] __wait_on_buffer+0x26/0x30 Dec 27 22:44:15 dns kernel: [40681.019148] [<ffffffff802b5b59>] journal_commit_transaction+0x4c9/0xee0 Dec 27 22:44:15 dns kernel: [40681.019155] [<ffffffff80147597>] ? try_to_del_timer_sync+0x57/0x70 Dec 27 22:44:15 dns kernel: [40681.019162] [<ffffffff802b9af0>] kjournald+0x100/0x2b0 Dec 27 22:44:16 dns kernel: [40681.019168] [<ffffffff80155250>] ? autoremove_wake_function+0x0/0x40 Dec 27 22:44:16 dns kernel: [40681.019174] [<ffffffff802b99f0>] ? kjournald+0x0/0x2b0 Dec 27 22:44:16 dns kernel: [40681.019180] [<ffffffff80154ca6>] kthread+0xa6/0xb0 Dec 27 22:44:17 dns kernel: [40681.019189] [<ffffffff8010a57a>] child_rip+0xa/0x20 Dec 27 22:44:17 dns kernel: [40681.019195] [<ffffffff80154c00>] ? kthread+0x0/0xb0 Dec 27 22:44:18 dns kernel: [40681.019200] [<ffffffff8010a570>] ? child_rip+0x0/0x20
