[Gluster-devel] FUSE Crash ...

Sat Dec 29 12:31:37 UTC 2007

Sorry .. 2.7.2 (cvs)

Earlier packages cause the entire machine to freeze under glusterfs write load ...
(although 2.7.2 has not entirely fixed the problem, it's less frequent)

.. it's amazing how many applications use mmap and refuse to run on gluster .. :(

(slapd is the worst .. I'm getting crashed on postfix and mysql that I'm hoping to fix or work around ...)

----- Original Message -----
From: "Marian Marinov" <mm at yuhu.biz>
To: gluster-devel at nongnu.org
Sent: Saturday, December 29, 2007 11:52:46 AM (GMT) Europe/London
Subject: Re: [Gluster-devel] FUSE Crash ...

On Saturday 29 December 2007 13:36:59 Gareth Bult wrote:
> Hi,
>
> I know this is fuse, but it's glusterfs that's bearing the brunt ...
>
> Dec 29 11:33:45 zimbra postfix/postfix-script[5036]: warning: not owned by
> root: /opt/zimbra/postfix-2.4.3.3z/conf/main.cf [ 1616.501207] Unable to
> handle kernel NULL pointer dereference at 0000000000000008 RIP: [
> 1616.501442] [<ffffffff88016ad2>] :fuse:fuse_setattr+0x1e2/0x380 [
> 1616.501880] PGD 160e2067 PUD 10e83067 PMD 0
> [ 1616.502479] Oops: 0000 [1] SMP
> [ 1616.502879] CPU 0
> [ 1616.503148] Modules linked in: ipv6 evdev ext3 jbd mbcache dm_mirror
> dm_snapshot dm_mod fuse apparmor commoncap [ 1616.504920] Pid: 5051, comm:
> master Not tainted 2.6.22-14-xen #1 [ 1616.505061] RIP:
> e030:[<ffffffff88016ad2>] [<ffffffff88016ad2>]
> :fuse:fuse_setattr+0x1e2/0x380 [ 1616.505340] RSP: e02b:ffff88001316bd78
> EFLAGS: 00210206
> [ 1616.505478] RAX: 0000000000000000 RBX: ffff88001142dbc0 RCX:
> 0000000000000000 [ 1616.505618] RDX: 0000000000002041 RSI: 0000000000000000
> RDI: ffff88001316be40 [ 1616.505758] RBP: ffff88001316bef8 R08:
> 0000000000000000 R09: ffff88001316bde8 [ 1616.505904] R10: ffff88001316a000
> R11: 0000000000000000 R12: ffff88001316bde8 [ 1616.506049] R13:
> ffff88000ff75c80 R14: ffff88001fe76c00 R15: 0000000000000000 [ 1616.506191]
> FS: 0000000000000000(0000) GS:ffffffff80575000(0063) knlGS:0000000000000000
> [ 1616.506487] CS: e033 DS: 002b ES: 002b
> [ 1616.506625] Process master (pid: 5051, threadinfo ffff88001316a000, task
> ffff8800119f4dc0) [ 1616.506808] Stack: ffffffff805c9380 0000000000000450
> 0000000000000000 ffff88001881b450 [ 1616.507611] 00000000f7a8a570
> 0000000000000000 0000000004af1025 ffffffff80278a80 [ 1616.508294]
> 0000000100000000 ffff88000f7a7000 0000000000000000 ffff88000f0d61f8 [
> 1616.508833] Call Trace:
> [ 1616.509107] [<ffffffff80278a80>] __handle_mm_fault+0xd40/0x13f0
> [ 1616.509281] [<ffffffff802343cb>] current_fs_time+0x3b/0x40
> [ 1616.509425] [<ffffffff802a7600>] notify_change+0x300/0x3d0
> [ 1616.509568] [<ffffffff8028e6b8>] sys_fchmod+0xe8/0x110
> [ 1616.509711] [<ffffffff8021d039>] ia32_sysret+0x0/0xa
> [ 1616.509851]
> [ 1616.509999]
> [ 1616.510000] Code: 48 8b 40 08 48 89 44 24 78 e9 e6 fe ff ff 83 4c 24 70
> 08 48 [ 1616.513074] RIP [<ffffffff88016ad2>]
> :fuse:fuse_setattr+0x1e2/0x380 [ 1616.513352] RSP <ffff88001316bd78>
> [ 1616.513488] CR2: 0000000000000008
>
> ==> /var/log/kern.log <==
> Dec 29 11:33:46 zimbra kernel: [ 1616.501207] Unable to handle kernel NULL
> pointer dereference at 0000000000000008 RIP: Dec 29 11:33:46 zimbra kernel:
> [ 1616.501442] [<ffffffff88016ad2>] :fuse:fuse_setattr+0x1e2/0x380 Dec 29
> 11:33:46 zimbra kernel: [ 1616.501880] PGD 160e2067 PUD 10e83067 PMD 0 Dec
> 29 11:33:46 zimbra kernel: [ 1616.502479] Oops: 0000 [1] SMP
> Dec 29 11:33:46 zimbra kernel: [ 1616.502879] CPU 0
> Dec 29 11:33:46 zimbra kernel: [ 1616.503148] Modules linked in: ipv6 evdev
> ext3 jbd mbcache dm_mirror dm_snapshot dm_mod fuse apparmor commoncap Dec
> 29 11:33:46 zimbra kernel: [ 1616.504920] Pid: 5051, comm: master Not
> tainted 2.6.22-14-xen #1 Dec 29 11:33:46 zimbra kernel: [ 1616.505061] RIP:
> e030:[<ffffffff88016ad2>] [<ffffffff88016ad2>]
> :fuse:fuse_setattr+0x1e2/0x380 Dec 29 11:33:46 zimbra kernel: [
> 1616.505340] RSP: e02b:ffff88001316bd78 EFLAGS: 00210206 Dec 29 11:33:46
> zimbra kernel: [ 1616.505478] RAX: 0000000000000000 RBX: ffff88001142dbc0
> RCX: 0000000000000000 Dec 29 11:33:46 zimbra kernel: [ 1616.505618] RDX:
> 0000000000002041 RSI: 0000000000000000 RDI: ffff88001316be40 Dec 29
> 11:33:46 zimbra kernel: [ 1616.505758] RBP: ffff88001316bef8 R08:
> 0000000000000000 R09: ffff88001316bde8 Dec 29 11:33:46 zimbra kernel: [
> 1616.505904] R10: ffff88001316a000 R11: 0000000000000000 R12:
> ffff88001316bde8 Dec 29 11:33:46 zimbra kernel: [ 1616.506049] R13:
> ffff88000ff75c80 R14: ffff88001fe76c00 R15: 0000000000000000 Dec 29
> 11:33:46 zimbra kernel: [ 1616.506191] FS: 0000000000000000(0000)
> GS:ffffffff80575000(0063) knlGS:0000000000000000 Dec 29 11:33:46 zimbra
> kernel: [ 1616.506487] CS: e033 DS: 002b ES: 002b Dec 29 11:33:46 zimbra
> kernel: [ 1616.506625] Process master (pid: 5051, threadinfo
> ffff88001316a000, task ffff8800119f4dc0) Dec 29 11:33:46 zimbra kernel: [
> 1616.506808] Stack: ffffffff805c9380 0000000000000450 0000000000000000
> ffff88001881b450 Dec 29 11:33:46 zimbra kernel: [ 1616.507611]
> 00000000f7a8a570 0000000000000000 0000000004af1025 ffffffff80278a80 Dec 29
> 11:33:46 zimbra kernel: [ 1616.508294] 0000000100000000 ffff88000f7a7000
> 0000000000000000 ffff88000f0d61f8 Dec 29 11:33:46 zimbra kernel: [
> 1616.508833] Call Trace:
> Dec 29 11:33:46 zimbra kernel: [ 1616.509107] [<ffffffff80278a80>]
> __handle_mm_fault+0xd40/0x13f0 Dec 29 11:33:46 zimbra kernel: [
> 1616.509281] [<ffffffff802343cb>] current_fs_time+0x3b/0x40 Dec 29 11:33:46
> zimbra kernel: [ 1616.509425] [<ffffffff802a7600>]
> notify_change+0x300/0x3d0 Dec 29 11:33:46 zimbra kernel: [ 1616.509568]
> [<ffffffff8028e6b8>] sys_fchmod+0xe8/0x110 Dec 29 11:33:46 zimbra kernel: [
> 1616.509711] [<ffffffff8021d039>] ia32_sysret+0x0/0xa Dec 29 11:33:46
> zimbra kernel: [ 1616.509851]
> Dec 29 11:33:46 zimbra kernel: [ 1616.509999]
> Dec 29 11:33:46 zimbra kernel: [ 1616.510000] Code: 48 8b 40 08 48 89 44 24
> 78 e9 e6 fe ff ff 83 4c 24 70 08 48 Dec 29 11:33:46 zimbra kernel: [
> 1616.513074] RIP [<ffffffff88016ad2>] :fuse:fuse_setattr+0x1e2/0x380 Dec 29
> 11:33:46 zimbra kernel: [ 1616.513352] RSP <ffff88001316bd78> Dec 29
> 11:33:46 zimbra kernel: [ 1616.513488] CR2: 0000000000000008
>
I see that you use 2.6.22-14-xen kernel, but what version of FUSE you are 
using?

Marian

_______________________________________________
Gluster-devel mailing list
Gluster-devel at nongnu.org
http://lists.nongnu.org/mailman/listinfo/gluster-devel