[Gluster-devel] client crash

[Rhesa Rozendaal]

after about 17 hours of continuous operation, my glusterfs client crashed with 
the following log:

2007-07-07 04:52:23 C [common-utils.c:208:gf_print_trace] debug-backtrace: Got 
signal (6), printing backtrace
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/usr/local/lib/libglusterfs.so.0(gf_print_trace+0x26) [0x18c956]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/lib/tls/libc.so.6 [0x5dd898]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/lib/tls/libc.so.6(abort+0xe9) [0x5df209]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/lib/tls/libc.so.6 [0x61171a]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/lib/tls/libc.so.6 [0x61899c]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/lib/tls/libc.so.6(calloc+0xd6) [0x61a176]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
[glusterfs] [0x804e81c]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/usr/local/lib/libglusterfs.so.0(transport_notify+0x34) [0x18d930]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/usr/local/lib/libglusterfs.so.0(sys_epoll_iteration+0xc1) [0x18df45]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/usr/local/lib/libglusterfs.so.0(poll_iteration+0x1b) [0x18dacf]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
[glusterfs] [0x804a3ab]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
/lib/tls/libc.so.6(__libc_start_main+0xd3) [0x5cade3]
2007-07-07 04:52:23 C [common-utils.c:210:gf_print_trace] debug-backtrace: 
[glusterfs] [0x8049dc9]


gdb backtrace:

#0  0x005987a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x0073b6f4 in raise () from /lib/tls/libpthread.so.0
#2  0x0018ca0a in gf_print_trace (signum=6) at 
../../../libglusterfs/src/common-utils.c:214
#3  <signal handler called>
#4  0x005987a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#5  0x005dd7a5 in raise () from /lib/tls/libc.so.6
#6  0x005df209 in abort () from /lib/tls/libc.so.6
#7  0x0061171a in __libc_message () from /lib/tls/libc.so.6
#8  0x0061899c in _int_malloc () from /lib/tls/libc.so.6
#9  0x0061a176 in calloc () from /lib/tls/libc.so.6
#10 0x0804e81c in fuse_transport_notify (xl=0x8a95420, event=2, 
data=0x8a955f0) at ../../../glusterfs-fuse/src/fuse-bridge.c:1938
#11 0x0018d930 in transport_notify (this=0x8a955f0, event=1) at 
../../../libglusterfs/src/transport.c:152
#12 0x0018df45 in sys_epoll_iteration (ctx=0xbff98da0) at 
../../../libglusterfs/src/epoll.c:54
#13 0x0018dacf in poll_iteration (ctx=0xbff98da0) at 
../../../libglusterfs/src/transport.c:260
#14 0x0804a3ab in main (argc=8, argv=0xbff98e74) at 
../../../glusterfs-fuse/src/glusterfs.c:348

client spec:

volume ns
   type protocol/client
   option transport-type tcp/client
   option remote-host nfs-deb-03
   option remote-subvolume ns
end-volume

volume client01
   type protocol/client
   option transport-type tcp/client
   option remote-host nfs-deb-03
   option remote-subvolume brick01
end-volume

volume client02
   type protocol/client
   option transport-type tcp/client
   option remote-host nfs-deb-03
   option remote-subvolume brick02
end-volume

volume client03
   type protocol/client
   option transport-type tcp/client
   option remote-host nfs-deb-03
   option remote-subvolume brick03
end-volume

volume client31
   type protocol/client
   option transport-type tcp/client
   option remote-host nfs-deb-03
   option remote-subvolume brick31
end-volume

volume export
   type cluster/unify
   subvolumes client01 client02 client03 client31
   option namespace ns
   option scheduler alu
   option alu.limits.min-free-disk 1GB
   option alu.order 
disk-usage:read-usage:write-usage:open-files-usage:disk-speed-usage
end-volume

volume iothreads
   type performance/io-threads
   option thread-count 4
   option cache-size 16MB
   subvolumes export
end-volume

volume readahead
   type performance/read-ahead
   option page-size 4096
   option page-count 16
   subvolumes iothreads
end-volume

volume writeback
   type performance/write-behind
   option aggregate-size 131072
   option flush-behind on
   subvolumes readahead
end-volume



Any idea what could be wrong?

Rhesa