Re: [vserver] 3.0.9-vs2.3.2.1 now in repo

From: Jean Weisbuch <jean_at_phpnet.org>
Date: Fri 23 Dec 2011 - 04:29:54 GMT
Message-ID: <4EF403C2.8030608@phpnet.org>

Le 23/11/2011 13:48, Herbert Poetzl a écrit :
> On Tue, Nov 22, 2011 at 07:45:30PM +0100, Jean Weisbuch wrote:
>> Le 22/11/2011 18:35, Herbert Poetzl a écrit :
>>> On Tue, Nov 22, 2011 at 04:02:34PM +0100, Jean Weisbuch wrote:
>>>> Le 22/11/2011 13:01, Ben Green a écrit :
>>>>> A new kernel: 3.0.9-vs2.3.2.1 is now available on repo.psand.net.
>>>>> Util-vserver also updated to pre3000. Enjoy.
>>>>> Cheers,
>>>>> ==
>>>>> From Ben Green
>>>> Hello,
>>>> Its a good news, do you know if this kernel is still vulnerable
>>>> to the pivot root bug because we still have problems with the
>>>> 3.0.7 kernel?
>>> pardon my ignorance, but what is 'the pivot root bug'?
>>> TIA,
>>> Herbert
>>>> Regards.
>> Hello,
>> Its the problem described in here :
>> http://list.linux-vserver.org/archive?mss:5420:201110:mdaibmimlbgoligkjdma
>> and here
>> http://list.linux-vserver.org/archive?mss:5377:201109:jdhnnpplpaabpkjoiind
> well, that was speculation and handwaving and we have no
> indication that the problem is actually related to the
> locking mechanisms used and changed in pivot_root
>
>> Maybe the problem we are encountering lately is different
>> but few month ago when i checked it was verry similar to the
>> pivot_root problem on vanilla kernel.
> while this is entirely possible (i.e. that this was the
> issue caused by the pivot_root locking scheme) it has been
> fixed (by mainline) so it shouldn't happen with recent
> kernels anymore
>
>> Lately, crashes happens often when some php scripts that are
>> handling mutexes are executed and it seems that 3.0.7 from
>> psand repo is more prone to crash than 3.0.5, i upgraded one
>> of the nodes to the 3.0.9 from psand, i will try to get more
>> informations next time i encounter a problem.
> do you have any panic/stack trace from those 'crashes'
> to look at? maybe we can figure out what the issue is ...
>
> best,
> Herbert
>
>> Regards.
Hello,

We havent got any issue yet with the 3.0.9 kernels but we had a new
crash on one of the last running 2.6.38 today.

I first thought that the patch from last week on the mailing list ("Fix
process lockup on a loop device") might be the solution to the bug but
after analysing it, it only seems to adapt the VServer patch for the new
loop.c from 3.1 kernel without doing anything really differently as
before (i might be wrong).

Here is the log produced on kern.log (not even sure these errors are
related but i usually got some of these before a process crashes, there
are only kernel BUGS, since the 20nov (no logs before)) :

    Dec 13 09:53:50 prem7 kernel: [9043406.097373] BUG: unable to handle
    kernel paging request at 000000077dc5d1d0
    Dec 13 09:53:50 prem7 kernel: [9043406.097424] IP:
    [<ffffffff81035366>] task_rq_lock+0x37/0x7a
    Dec 13 09:53:50 prem7 kernel: [9043406.097461] PGD 1652ce067 PUD 0
    Dec 13 09:53:50 prem7 kernel: [9043406.097493] Oops: 0000 [#2] SMP
    Dec 13 09:53:50 prem7 kernel: [9043406.097525] last sysfs file:
    /sys/module/ip_tables/initstate
    Dec 13 09:53:50 prem7 kernel: [9043406.097557] CPU 5
    Dec 13 09:53:50 prem7 kernel: [9043406.097568] Modules linked in:
    joydev ipmi_devintf sg btrfs zlib_deflate crc32c libcrc32c qnx4
    hfsplus hfs minix ntfs vfat msdos fat jfs xfs exportfs reiserfs ext2
    dm_mod xt_multiport iptable_filter ip_tables x_tables acpi_cpufreq
    mperf cpufreq_userspace cpufreq_stats cpufreq_conservative
    cpufreq_powersave bonding ext3 jbd w83627ehf hwmon_vid coretemp
    ipmi_si ipmi_msghandler loop tpm_tis snd_pcm tpm i7core_edac psmouse
    snd_timer snd soundcore snd_page_alloc processor i2c_i801 i2c_core
    ioatdma edac_core pcspkr tpm_bios button thermal_sys serio_raw evdev
    dca ext4 mbcache jbd2 crc16 raid1 raid0 md_mod sd_mod crc_t10dif
    usbhid hid uhci_hcd ahci libahci libata ehci_hcd scsi_mod usbcore
    nls_base e1000e [last unloaded: scsi_wait_scan]
    Dec 13 09:53:50 prem7 kernel: [9043406.098059]
    Dec 13 09:53:50 prem7 kernel: [9043406.098085] Pid: 9987, comm:
    apache2 Tainted: G D 2.6.38.8-vs2.3.0.37-rc17-beng #1
    Supermicro X8STi/X8STi
    Dec 13 09:53:50 prem7 kernel: [9043406.098153] RIP:
    0010:[<ffffffff81035366>] [<ffffffff81035366>] task_rq_lock+0x37/0x7a
    Dec 13 09:53:50 prem7 kernel: [9043406.098212] RSP:
    0000:ffff8801f42cbd58 EFLAGS: 00010092
    Dec 13 09:53:50 prem7 kernel: [9043406.098244] RAX: 00000000ff8e3b40
    RBX: 0000000000011b80 RCX: 0000000000000220
    Dec 13 09:53:50 prem7 kernel: [9043406.098293] RDX: 0000000000000292
    RSI: ffff8801f42cbd90 RDI: ffff8803fff37dc0
    Dec 13 09:53:50 prem7 kernel: [9043406.098339] RBP: ffff8801f42cbd90
    R08: ffff8801d3274660 R09: dead000000100100
    Dec 13 09:53:50 prem7 kernel: [9043406.098388] R10: ffff8801f42cbed8
    R11: ffff8801d3274648 R12: ffff8803fff37dc0
    Dec 13 09:53:50 prem7 kernel: [9043406.098437] R13: 0000000000011b80
    R14: 000000000000000f R15: ffff8801f42cbed8
    Dec 13 09:53:50 prem7 kernel: [9043406.098487] FS:
    0000000000000000(0000) GS:ffff8800df4a0000(0063) knlGS:00000000f74a1970
    Dec 13 09:53:50 prem7 kernel: [9043406.098538] CS: 0010 DS: 002b
    ES: 002b CR0: 000000008005003b
    Dec 13 09:53:50 prem7 kernel: [9043406.098571] CR2: 000000077dc5d1d0
    CR3: 00000003fc3de000 CR4: 00000000000006e0
    Dec 13 09:53:50 prem7 kernel: [9043406.098621] DR0: 0000000000000000
    DR1: 0000000000000000 DR2: 0000000000000000
    Dec 13 09:53:50 prem7 kernel: [9043406.098671] DR3: 0000000000000000
    DR6: 00000000ffff0ff0 DR7: 0000000000000400
    Dec 13 09:53:50 prem7 kernel: [9043406.098721] Process apache2 (pid:
    9987, threadinfo ffff8801f42ca000, task ffff880165380f00)
    Dec 13 09:53:50 prem7 kernel: [9043406.098772] Stack:
    Dec 13 09:53:50 prem7 kernel: [9043406.098797] ffff8801d3274648
    ffff8801d3274610 ffff8803fff37dc0 0000000000000000
    Dec 13 09:53:50 prem7 kernel: [9043406.098861] 0000000000000000
    ffffffff8103a16c 00000001a3e16065 0000000000000292
    Dec 13 09:53:50 prem7 kernel: [9043406.098921] 00000003068b8d56
    ffff8801d3274610 ffff88015e1c5200 ffff8800113f7ec8
    Dec 13 09:53:50 prem7 kernel: [9043406.098981] Call Trace:
    Dec 13 09:53:50 prem7 kernel: [9043406.099010] [<ffffffff8103a16c>]
    ? try_to_wake_up+0x24/0x17b
    Dec 13 09:53:50 prem7 kernel: [9043406.099043] [<ffffffff8114f320>]
    ? freeary+0x1a6/0x224
    Dec 13 09:53:50 prem7 kernel: [9043406.099074] [<ffffffff8114ff71>]
    ? T.637+0x7d/0xb1
    Dec 13 09:53:50 prem7 kernel: [9043406.099106] [<ffffffff81026ee8>]
    ? do_page_fault+0x2ad/0x2e5
    Dec 13 09:53:50 prem7 kernel: [9043406.099140] [<ffffffff8111e55e>]
    ? fsnotify+0x24b/0x278
    Dec 13 09:53:50 prem7 kernel: [9043406.099171] [<ffffffff8115065a>]
    ? sys_semctl+0x74/0x82
    Dec 13 09:53:50 prem7 kernel: [9043406.099203] [<ffffffff8114cb70>]
    ? compat_sys_semctl+0x2ea/0x30d
    Dec 13 09:53:50 prem7 kernel: [9043406.099237] [<ffffffff8102b833>]
    ? ia32_sysret+0x0/0x5
    Dec 13 09:53:50 prem7 kernel: [9043406.099267] Code: 48 c7 c3 80 1b
    01 00 48 83 ec 08 9c 58 0f 1f 44 00 00 48 89 c2 fa 66 0f 1f 44 00 00
    48 89 55 00 49 8b 44 24 08 49 89 dd 8b 40 18 <4c> 03 2c c5 d0 f7 53
    81 4c 89 ef e8 5b bd 2e 00 49 8b 44 24 08
    Dec 13 09:53:50 prem7 kernel: [9043406.099486] RIP
    [<ffffffff81035366>] task_rq_lock+0x37/0x7a
    Dec 13 09:53:50 prem7 kernel: [9043406.099524] RSP <ffff8801f42cbd58>
    Dec 13 09:53:50 prem7 kernel: [9043406.099551] CR2: 000000077dc5d1d0
    Dec 13 09:53:50 prem7 kernel: [9043406.099850] ---[ end trace
    3962b66abbf85317 ]---

    Dec 18 02:46:27 prem7 kernel: [9448665.376340] BUG: unable to handle
    kernel NULL pointer dereference at 0000000000000008
    Dec 18 02:46:27 prem7 kernel: [9448665.376402] IP:
    [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
    Dec 18 02:46:27 prem7 kernel: [9448665.376438] PGD 12cb09067 PUD 0
    Dec 18 02:46:27 prem7 kernel: [9448665.376472] Oops: 0000 [#3] SMP
    Dec 18 02:46:27 prem7 kernel: [9448665.376500] last sysfs file:
    /sys/module/ip_tables/initstate
    Dec 18 02:46:27 prem7 kernel: [9448665.376530] CPU 5
    Dec 18 02:46:27 prem7 kernel: [9448665.376541] Modules linked in:
    joydev ipmi_devintf sg btrfs zlib_deflate crc32c libcrc32c qnx4
    hfsplus hfs minix ntfs vfat msdos fat jfs xfs exportfs reiserfs ext2
    dm_mod xt_multiport iptable_filter ip_tables x_tables acpi_cpufreq
    mperf cpufreq_userspace cpufreq_stats cpufreq_conservative
    cpufreq_powersave bonding ext3 jbd w83627ehf hwmon_vid coretemp
    ipmi_si ipmi_msghandler loop tpm_tis snd_pcm tpm i7core_edac psmouse
    snd_timer snd soundcore snd_page_alloc processor i2c_i801 i2c_core
    ioatdma edac_core pcspkr tpm_bios button thermal_sys serio_raw evdev
    dca ext4 mbcache jbd2 crc16 raid1 raid0 md_mod sd_mod crc_t10dif
    usbhid hid uhci_hcd ahci libahci libata ehci_hcd scsi_mod usbcore
    nls_base e1000e [last unloaded: scsi_wait_scan]
    Dec 18 02:46:27 prem7 kernel: [9448665.377027]
    Dec 18 02:46:27 prem7 kernel: [9448665.377049] Pid: 9493, comm:
    apache2 Tainted: G M D 2.6.38.8-vs2.3.0.37-rc17-beng #1
    Supermicro X8STi/X8STi
    Dec 18 02:46:27 prem7 kernel: [9448665.377116] RIP:
    0010:[<ffffffff8103535b>] [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
    Dec 18 02:46:27 prem7 kernel: [9448665.377175] RSP:
    0000:ffff88015e0ebd58 EFLAGS: 00010092
    Dec 18 02:46:27 prem7 kernel: [9448665.377207] RAX: 0000000000000292
    RBX: 0000000000011b80 RCX: ffff88012aa94f40
    Dec 18 02:46:27 prem7 kernel: [9448665.377256] RDX: 0000000000000292
    RSI: ffff88015e0ebd90 RDI: 0000000000000000
    Dec 18 02:46:27 prem7 kernel: [9448665.377305] RBP: ffff88015e0ebd90
    R08: ffffffff81331cd0 R09: 0000000000000000
    Dec 18 02:46:27 prem7 kernel: [9448665.377354] R10: ffff88015e0ebed8
    R11: ffff880188f71888 R12: 0000000000000000
    Dec 18 02:46:27 prem7 kernel: [9448665.377404] R13: 0000000000000000
    R14: 000000000000000f R15: ffff88015e0ebed8
    Dec 18 02:46:27 prem7 kernel: [9448665.377449] FS:
    0000000000000000(0000) GS:ffff8800df4a0000(0063) knlGS:00000000f749c970
    Dec 18 02:46:27 prem7 kernel: [9448665.383148] CS: 0010 DS: 002b
    ES: 002b CR0: 000000008005003b
    Dec 18 02:46:27 prem7 kernel: [9448665.383180] CR2: 0000000000000008
    CR3: 0000000147265000 CR4: 00000000000006e0
    Dec 18 02:46:27 prem7 kernel: [9448665.383228] DR0: 0000000000000000
    DR1: 0000000000000000 DR2: 0000000000000000
    Dec 18 02:46:27 prem7 kernel: [9448665.383276] DR3: 0000000000000000
    DR6: 00000000ffff0ff0 DR7: 0000000000000400
    Dec 18 02:46:27 prem7 kernel: [9448665.383325] Process apache2 (pid:
    9493, threadinfo ffff88015e0ea000, task ffff8801a75be700)
    Dec 18 02:46:27 prem7 kernel: [9448665.383375] Stack:
    Dec 18 02:46:27 prem7 kernel: [9448665.383399] ffff88012aa94f40
    ffff880188f71850 0000000000000000 0000000000000000
    Dec 18 02:46:27 prem7 kernel: [9448665.383461] 0000000000000000
    ffffffff8103a16c 0000000374aeb065 0000000000000292
    Dec 18 02:46:27 prem7 kernel: [9448665.383518] 0000000f00000000
    ffff880188f71850 ffff88027f686c00 ffff880114181ec8
    Dec 18 02:46:27 prem7 kernel: [9448665.383575] Call Trace:
    Dec 18 02:46:27 prem7 kernel: [9448665.383603] [<ffffffff8103a16c>]
    ? try_to_wake_up+0x24/0x17b
    Dec 18 02:46:27 prem7 kernel: [9448665.383637] [<ffffffff8114f320>]
    ? freeary+0x1a6/0x224
    Dec 18 02:46:27 prem7 kernel: [9448665.383668] [<ffffffff8114ff71>]
    ? T.637+0x7d/0xb1
    Dec 18 02:46:27 prem7 kernel: [9448665.383700] [<ffffffff81026ee8>]
    ? do_page_fault+0x2ad/0x2e5
    Dec 18 02:46:27 prem7 kernel: [9448665.383733] [<ffffffff8111e55e>]
    ? fsnotify+0x24b/0x278
    Dec 18 02:46:27 prem7 kernel: [9448665.383765] [<ffffffff8115065a>]
    ? sys_semctl+0x74/0x82
    Dec 18 02:46:27 prem7 kernel: [9448665.383796] [<ffffffff8114cb70>]
    ? compat_sys_semctl+0x2ea/0x30d
    Dec 18 02:46:27 prem7 kernel: [9448665.383829] [<ffffffff8102b833>]
    ? ia32_sysret+0x0/0x5
    Dec 18 02:46:27 prem7 kernel: [9448665.383858] Code: 55 41 54 49 89
    fc 55 48 89 f5 53 48 c7 c3 80 1b 01 00 48 83 ec 08 9c 58 0f 1f 44 00
    00 48 89 c2 fa 66 0f 1f 44 00 00 48 89 55 00 <49> 8b 44 24 08 49 89
    dd 8b 40 18 4c 03 2c c5 d0 f7 53 81 4c 89
    Dec 18 02:46:27 prem7 kernel: [9448665.384078] RIP
    [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
    Dec 18 02:46:27 prem7 kernel: [9448665.384116] RSP <ffff88015e0ebd58>
    Dec 18 02:46:27 prem7 kernel: [9448665.384143] CR2: 0000000000000008
    Dec 18 02:46:27 prem7 kernel: [9448665.384433] ---[ end trace
    3962b66abbf85318 ]---

    Dec 22 14:52:17 prem7 kernel: [9836764.154178] BUG: unable to handle
    kernel NULL pointer dereference at 0000000000000008
    Dec 22 14:52:17 prem7 kernel: [9836764.154238] IP:
    [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
    Dec 22 14:52:17 prem7 kernel: [9836764.154280] PGD 1aa576067 PUD 0
    Dec 22 14:52:17 prem7 kernel: [9836764.154313] Oops: 0000 [#4] SMP
    Dec 22 14:52:17 prem7 kernel: [9836764.154345] last sysfs file:
    /sys/module/ip_tables/initstate
    Dec 22 14:52:17 prem7 kernel: [9836764.154379] CPU 0
    Dec 22 14:52:17 prem7 kernel: [9836764.154390] Modules linked in:
    joydev ipmi_devintf sg btrfs zlib_deflate crc32c libcrc32c qnx4
    hfsplus hfs minix ntfs vfat msdos fat jfs xfs exportfs reiserfs ext2
    dm_mod xt_multiport iptable_filter ip_tables x_tables acpi_cpufreq
    mperf cpufreq_userspace cpufreq_stats cpufreq_conservative
    cpufreq_powersave bonding ext3 jbd w83627ehf hwmon_vid coretemp
    ipmi_si ipmi_msghandler loop tpm_tis snd_pcm tpm i7core_edac psmouse
    snd_timer snd soundcore snd_page_alloc processor i2c_i801 i2c_core
    ioatdma edac_core pcspkr tpm_bios button thermal_sys serio_raw evdev
    dca ext4 mbcache jbd2 crc16 raid1 raid0 md_mod sd_mod crc_t10dif
    usbhid hid uhci_hcd ahci libahci libata ehci_hcd scsi_mod usbcore
    nls_base e1000e [last unloaded: scsi_wait_scan]
    Dec 22 14:52:17 prem7 kernel: [9836764.154898]
    Dec 22 14:52:17 prem7 kernel: [9836764.154924] Pid: 22398, comm:
    apache2 Tainted: G M D 2.6.38.8-vs2.3.0.37-rc17-beng #1
    Supermicro X8STi/X8STi
    Dec 22 14:52:17 prem7 kernel: [9836764.154996] RIP:
    0010:[<ffffffff8103535b>] [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
    Dec 22 14:52:17 prem7 kernel: [9836764.155056] RSP:
    0000:ffff88014c80dd58 EFLAGS: 00010092
    Dec 22 14:52:17 prem7 kernel: [9836764.155089] RAX: 0000000000000292
    RBX: 0000000000011b80 RCX: ffff8801042d5500
    Dec 22 14:52:17 prem7 kernel: [9836764.155139] RDX: 0000000000000292
    RSI: ffff88014c80dd90 RDI: 0000000000000000
    Dec 22 14:52:17 prem7 kernel: [9836764.155190] RBP: ffff88014c80dd90
    R08: ffffffff81331cd0 R09: 0022f27c2125d3c3
    Dec 22 14:52:17 prem7 kernel: [9836764.155240] R10: ffff88014c80ded8
    R11: ffff8801042d5500 R12: 0000000000000000
    Dec 22 14:52:17 prem7 kernel: [9836764.155286] R13: 0000000000000000
    R14: 000000000000000f R15: ffff88014c80ded8
    Dec 22 14:52:17 prem7 kernel: [9836764.155338] FS:
    0000000000000000(0000) GS:ffff8800df400000(0063) knlGS:00000000f7520970
    Dec 22 14:52:17 prem7 kernel: [9836764.155390] CS: 0010 DS: 002b
    ES: 002b CR0: 000000008005003b
    Dec 22 14:52:17 prem7 kernel: [9836764.155423] CR2: 0000000000000008
    CR3: 000000014fe13000 CR4: 00000000000006f0
    Dec 22 14:52:17 prem7 kernel: [9836764.155474] DR0: 0000000000000000
    DR1: 0000000000000000 DR2: 0000000000000000
    Dec 22 14:52:17 prem7 kernel: [9836764.155524] DR3: 0000000000000000
    DR6: 00000000ffff0ff0 DR7: 0000000000000400
    Dec 22 14:52:17 prem7 kernel: [9836764.155573] Process apache2 (pid:
    22398, threadinfo ffff88014c80c000, task ffff88012640c4c0)
    Dec 22 14:52:17 prem7 kernel: [9836764.155626] Stack:
    Dec 22 14:52:17 prem7 kernel: [9836764.155651] ffff8801042d5500
    ffff88037cc38310 0000000000000000 0000000000000000
    Dec 22 14:52:17 prem7 kernel: [9836764.155713] 0000000000000000
    ffffffff8103a16c 0000000299979065 0000000000000292
    Dec 22 14:52:17 prem7 kernel: [9836764.155770] 0000000000000000
    ffff88037cc38310 ffff88039461b000 ffff88015f23bec8
    Dec 22 14:52:17 prem7 kernel: [9836764.155834] Call Trace:
    Dec 22 14:52:17 prem7 kernel: [9836764.155864] [<ffffffff8103a16c>]
    ? try_to_wake_up+0x24/0x17b
    Dec 22 14:52:17 prem7 kernel: [9836764.155900] [<ffffffff8114f320>]
    ? freeary+0x1a6/0x224
    Dec 22 14:52:17 prem7 kernel: [9836764.155933] [<ffffffff8114ff71>]
    ? T.637+0x7d/0xb1
    Dec 22 14:52:17 prem7 kernel: [9836764.155967] [<ffffffff81026ee8>]
    ? do_page_fault+0x2ad/0x2e5
    Dec 22 14:52:17 prem7 kernel: [9836764.156003] [<ffffffff8111e55e>]
    ? fsnotify+0x24b/0x278
    Dec 22 14:52:17 prem7 kernel: [9836764.156035] [<ffffffff8115065a>]
    ? sys_semctl+0x74/0x82
    Dec 22 14:52:17 prem7 kernel: [9836764.156068] [<ffffffff8114cb70>]
    ? compat_sys_semctl+0x2ea/0x30d
    Dec 22 14:52:17 prem7 kernel: [9836764.156104] [<ffffffff8102b833>]
    ? ia32_sysret+0x0/0x5
    Dec 22 14:52:17 prem7 kernel: [9836764.156136] Code: 55 41 54 49 89
    fc 55 48 89 f5 53 48 c7 c3 80 1b 01 00 48 83 ec 08 9c 58 0f 1f 44 00
    00 48 89 c2 fa 66 0f 1f 44 00 00 48 89 55 00 <49> 8b 44 24 08 49 89
    dd 8b 40 18 4c 03 2c c5 d0 f7 53 81 4c 89
    Dec 22 14:52:17 prem7 kernel: [9836764.156382] RIP
    [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
    Dec 22 14:52:17 prem7 kernel: [9836764.156418] RSP <ffff88014c80dd58>
    Dec 22 14:52:17 prem7 kernel: [9836764.156446] CR2: 0000000000000008
    Dec 22 14:52:17 prem7 kernel: [9836764.156746] ---[ end trace
    3962b66abbf85319 ]---

    Dec 23 00:21:45 prem7 kernel: [9870839.738497] BUG: unable to handle
    kernel paging request at 0000000080000007
    Dec 23 00:21:45 prem7 kernel: [9870839.738544] IP:
    [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
    Dec 23 00:21:45 prem7 kernel: [9870839.738582] PGD 136c47067 PUD 0
    Dec 23 00:21:45 prem7 kernel: [9870839.738614] Oops: 0000 [#5] SMP
    Dec 23 00:21:45 prem7 kernel: [9870839.738646] last sysfs file:
    /sys/module/ip_tables/initstate
    Dec 23 00:21:45 prem7 kernel: [9870839.738680] CPU 5
    Dec 23 00:21:45 prem7 kernel: [9870839.738690] Modules linked in:
    joydev ipmi_devintf sg btrfs zlib_deflate crc32c libcrc32c qnx4
    hfsplus hfs minix ntfs vfat msdos fat jfs xfs exportfs reiserfs ext2
    dm_mod xt_multiport iptable_filter ip_tables x_tables acpi_cpufreq
    mperf cpufreq_userspace cpufreq_stats cpufreq_conservative
    cpufreq_powersave bonding ext3 jbd w83627ehf hwmon_vid coretemp
    ipmi_si ipmi_msghandler loop tpm_tis snd_pcm tpm i7core_edac psmouse
    snd_timer snd soundcore snd_page_alloc processor i2c_i801 i2c_core
    ioatdma edac_core pcspkr tpm_bios button thermal_sys serio_raw evdev
    dca ext4 mbcache jbd2 crc16 raid1 raid0 md_mod sd_mod crc_t10dif
    usbhid hid uhci_hcd ahci libahci libata ehci_hcd scsi_mod usbcore
    nls_base e1000e [last unloaded: scsi_wait_scan]
    Dec 23 00:21:45 prem7 kernel: [9870839.739178]
    Dec 23 00:21:45 prem7 kernel: [9870839.739204] Pid: 4448, comm:
    apache2 Tainted: G M D 2.6.38.8-vs2.3.0.37-rc17-beng #1
    Supermicro X8STi/X8STi
    Dec 23 00:21:45 prem7 kernel: [9870839.739272] RIP:
    0010:[<ffffffff8103535b>] [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
    Dec 23 00:21:45 prem7 kernel: [9870839.739331] RSP:
    0000:ffff880005001d58 EFLAGS: 00010092
    Dec 23 00:21:45 prem7 kernel: [9870839.744937] RAX: 0000000000000292
    RBX: 0000000000011b80 RCX: 0000000000000220
    Dec 23 00:21:45 prem7 kernel: [9870839.744987] RDX: 0000000000000292
    RSI: ffff880005001d90 RDI: 000000007fffffff
    Dec 23 00:21:45 prem7 kernel: [9870839.745036] RBP: ffff880005001d90
    R08: ffff8803905ad120 R09: dead000000100100
    Dec 23 00:21:45 prem7 kernel: [9870839.745085] R10: ffff880005001ed8
    R11: ffff8803905ad108 R12: 000000007fffffff
    Dec 23 00:21:45 prem7 kernel: [9870839.745134] R13: 0000000000000000
    R14: 000000000000000f R15: ffff880005001ed8
    Dec 23 00:21:45 prem7 kernel: [9870839.745184] FS:
    0000000000000000(0000) GS:ffff8800df4a0000(0063) knlGS:00000000f7525970
    Dec 23 00:21:45 prem7 kernel: [9870839.745236] CS: 0010 DS: 002b
    ES: 002b CR0: 000000008005003b
    Dec 23 00:21:45 prem7 kernel: [9870839.745269] CR2: 0000000080000007
    CR3: 000000012251e000 CR4: 00000000000006e0
    Dec 23 00:21:45 prem7 kernel: [9870839.745321] DR0: 0000000000000000
    DR1: 0000000000000000 DR2: 0000000000000000
    Dec 23 00:21:45 prem7 kernel: [9870839.745373] DR3: 0000000000000000
    DR6: 00000000ffff0ff0 DR7: 0000000000000400
    Dec 23 00:21:45 prem7 kernel: [9870839.745424] Process apache2 (pid:
    4448, threadinfo ffff880005000000, task ffff880162070b00)
    Dec 23 00:21:45 prem7 kernel: [9870839.745476] Stack:
    Dec 23 00:21:45 prem7 kernel: [9870839.745502] ffff8803905ad108
    ffff8803905ad0d0 000000007fffffff 0000000000000000
    Dec 23 00:21:45 prem7 kernel: [9870839.745567] 0000000000000000
    ffffffff8103a16c 00000002c7b72065 0000000000000292
    Dec 23 00:21:45 prem7 kernel: [9870839.745631] 0000000049000ea0
    ffff8803905ad0d0 ffff8803fb9e7200 ffff880100ce5ec8
    Dec 23 00:21:45 prem7 kernel: [9870839.745691] Call Trace:
    Dec 23 00:21:45 prem7 kernel: [9870839.745723] [<ffffffff8103a16c>]
    ? try_to_wake_up+0x24/0x17b
    Dec 23 00:21:45 prem7 kernel: [9870839.745758] [<ffffffff8114f320>]
    ? freeary+0x1a6/0x224
    Dec 23 00:21:45 prem7 kernel: [9870839.745791] [<ffffffff8114ff71>]
    ? T.637+0x7d/0xb1
    Dec 23 00:21:45 prem7 kernel: [9870839.745825] [<ffffffff81026ee8>]
    ? do_page_fault+0x2ad/0x2e5
    Dec 23 00:21:45 prem7 kernel: [9870839.745860] [<ffffffff8111e55e>]
    ? fsnotify+0x24b/0x278
    Dec 23 00:21:45 prem7 kernel: [9870839.745892] [<ffffffff8115065a>]
    ? sys_semctl+0x74/0x82
    Dec 23 00:21:45 prem7 kernel: [9870839.745925] [<ffffffff8114cb70>]
    ? compat_sys_semctl+0x2ea/0x30d
    Dec 23 00:21:45 prem7 kernel: [9870839.745959] [<ffffffff8102b833>]
    ? ia32_sysret+0x0/0x5
    Dec 23 00:21:45 prem7 kernel: [9870839.745990] Code: 55 41 54 49 89
    fc 55 48 89 f5 53 48 c7 c3 80 1b 01 00 48 83 ec 08 9c 58 0f 1f 44 00
    00 48 89 c2 fa 66 0f 1f 44 00 00 48 89 55 00 <49> 8b 44 24 08 49 89
    dd 8b 40 18 4c 03 2c c5 d0 f7 53 81 4c 89
    Dec 23 00:21:45 prem7 kernel: [9870839.746216] RIP
    [<ffffffff8103535b>] task_rq_lock+0x2c/0x7a
    Dec 23 00:21:45 prem7 kernel: [9870839.746251] RSP <ffff880005001d58>
    Dec 23 00:21:45 prem7 kernel: [9870839.746279] CR2: 0000000080000007
    Dec 23 00:21:45 prem7 kernel: [9870839.746574] ---[ end trace
    3962b66abbf8531a ]---

    root@prem7:~# vps aux|egrep '4448|22398|p1096'
    root 21290 1096 p1096 0.0 0.0 11524 3316 ?
    Ds 01:42 0:00 /usr/sbin/apache2 -k restart
    www-data 21291 1096 p1096 0.0 0.0 0 0 ?
    Z 01:42 0:00 [apache2] <defunct>

    root@prem7:~# uname -a
    Linux prem7 2.6.38.8-vs2.3.0.37-rc17-beng #1 SMP Wed Jun 15 11:06:07
    BST 2011 x86_64 GNU/Linux

    root@prem7:~# uptime
      05:17:34 up 114 days, 18:15, 3 users, load average: 6.24, 6.20, 6.25

If i try to attach the process in gdb from the host it says "Operation
not permitted" for both processes, here is what i got from the guest (as
root) :

    (gdb) attach 21291
    Attaching to process 21291
    ptrace: Operation not permitted.

    (gdb) attach 21290
    Attaching to process 21290
    ^C^C^C^C

It seems to lock gdb (^C are my control break attemps btw), if i do a
kill (to the gdb process) from another terminal :

    ^C^C^C^C/build/buildd/gdb-6.8/gdb/linux-nat.c:1072: internal-error:
    linux_nat_detach: Assertion `num_lwps == 1' failed.
    A problem internal to GDB has been detected,
    further debugging may prove unreliable.
    Quit this debugging session? (y or n)

If you would need some other informations next time i encounter one of
those, could you tell me what else i could check?

ps: guests are on Debian 5.0 i386 and hosts are on Debian 6.0 amd64.

Regards.
Received on Fri Dec 23 04:30:14 2011

[Next/Previous Months] [Main vserver Project Homepage] [Howto Subscribe/Unsubscribe] [Paul Sladen's vserver stuff]
Generated on Fri 23 Dec 2011 - 04:30:14 GMT by hypermail 2.1.8