[Gluster-users] Error : gluster2.0.0 with fuse2.8 inkernel2.6.30

eagleeyes eagleeyes at 126.com
Tue Jul 7 05:33:08 UTC 2009


[root at localhost /]# uname  -a 
Linux localhost.localdomain 2.6.30 #2 SMP Mon Jul 6 15:35:46 CST 2009 i686 i686 i386 GNU/Linux

[root at localhost /]# glusterfs -V
glusterfs 2.0.3 built on Jul  7 2009 13:17:27
Repository revision: v2.0.3
Copyright (c) 2006-2009 Z RESEARCH Inc. <http://www.zresearch.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU General Public License.

dmesg  |grep fuse  
fuse init (API version 7.11)

[root at localhost /]# grep -i FUSE_MINOR_VERSION /usr/local/include/fuse/fuse_common.h            
#define FUSE_MINOR_VERSION 8
#define FUSE_VERSION FUSE_MAKE_VERSION(FUSE_MAJOR_VERSION, FUSE_MINOR_VERSION)
#    undef FUSE_MINOR_VERSION
#        define FUSE_MINOR_VERSION 5
#        define FUSE_MINOR_VERSION 4
#        define FUSE_MINOR_VERSION 1
#        define FUSE_MINOR_VERSION 1

[root at localhost /]# cat /var/log/glusterfs/glusterfsd-sever.vol.log 
================================================================================
Version      : glusterfs 2.0.3 built on Jul  7 2009 13:17:27
TLA Revision : v2.0.3
Starting Time: 2009-07-07 13:20:50
Command line : glusterfsd -f glusterfsd-sever.vol 
PID          : 20516
System name  : Linux
Nodename     : localhost.localdomain
Kernel Release : 2.6.30
Hardware Identifier: i686
Given volfile:
+------------------------------------------------------------------------------+
  1: 
  2: 
  3: volume posix1
  4:   type storage/posix                   # POSIX FS translator
  5:   option directory /opt/data1        # Export this directory
  6: end-volume
  7: 
  8: volume posix2
  9:   type storage/posix                   # POSIX FS translator
 10:   option directory /opt/data2        # Export this directory
 11: end-volume
 12: 
 13: volume posix3
 14:   type storage/posix                   # POSIX FS translator
 15:   option directory /opt/data3        # Export this directory
 16: end-volume
 17: 
 18: volume posix4
 19:   type storage/posix                   # POSIX FS translator
 20:   option directory /opt/data4        # Export this directory
 21: end-volume
 22: 
 23: volume brick1
 24:   type features/posix-locks
 25:   option mandatory-locks on          # enables mandatory locking on all files
 26:   subvolumes posix1
 27: end-volume
 28: 
 29: volume brick2
 30:   type features/posix-locks
 31:   option mandatory-locks on          # enables mandatory locking on all files
 32:   subvolumes posix2
 33: end-volume
 34: 
 35: volume brick3
 36:   type features/posix-locks
 37:   option mandatory-locks on          # enables mandatory locking on all files
 38:   subvolumes posix3
 39: end-volume
 40: 
 41: volume brick4
 42:   type features/posix-locks
 43:   option mandatory-locks on          # enables mandatory locking on all files
 44:   subvolumes posix4
 45: end-volume
 46: 
 47: 
 48: ### Add network serving capability to above brick.
 49: volume server
 50:   type protocol/server
 51:   option transport-type tcp
 52:   option transport.socket.bind-address 172.16.36.46     # Default is to listen on all interfaces
 53:   option transport.socket.listen-port 6996              # Default is 6996
 54:   subvolumes brick1 brick2 brick3 brick4 
 55:   option auth.addr.brick1.allow * # Allow access to "brick" volume
 56:   option auth.addr.brick2.allow * # Allow access to "brick" volume
 57:   option auth.addr.brick3.allow * # Allow access to "brick" volume
 58:   option auth.addr.brick4.allow * # Allow access to "brick" volume
 59: end-volume
+------------------------------------------------------------------------------+
[2009-07-07 13:20:50] N [glusterfsd.c:1224:main] glusterfs: Successfully started
[2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1023
[2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1022
[2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1021
[2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1020
[2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1019
[2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1018
[2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1017
[2009-07-07 13:21:54] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 172.16.36.46:1016
[2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1023 disconnected
[2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1022 disconnected
[2009-07-07 13:22:17] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of localhost.localdomain-20523-2009/07/07-13:21:54:191189-client1
[2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1021 disconnected
[2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1020 disconnected
[2009-07-07 13:22:17] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of localhost.localdomain-20523-2009/07/07-13:21:54:191189-client2
[2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1019 disconnected
[2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1018 disconnected
[2009-07-07 13:22:17] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of localhost.localdomain-20523-2009/07/07-13:21:54:191189-client4
[2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1017 disconnected
[2009-07-07 13:22:17] N [server-protocol.c:7815:notify] server: 172.16.36.46:1016 disconnected
[2009-07-07 13:22:17] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of localhost.localdomain-20523-2009/07/07-13:21:54:191189-client3

[root at localhost /]#   cat /var/log/glusterfs/mnt.log 
================================================================================
Version      : glusterfs 2.0.3 built on Jul  7 2009 13:17:27
TLA Revision : v2.0.3
Starting Time: 2009-07-07 13:21:54
Command line : glusterfs -f glusterfs-client.vol.nio /mnt 
PID          : 20524
System name  : Linux
Nodename     : localhost.localdomain
Kernel Release : 2.6.30
Hardware Identifier: i686
Given volfile:
+------------------------------------------------------------------------------+
  1: ### Add client feature and attach to remote subvolume
  2: volume client1
  3:   type protocol/client
  4:   option transport-type tcp
  5:   option remote-host 172.16.36.46         # IP address of the remote io
  6:   option remote-port 6996              # default server port is 6996
  7:   option remote-subvolume brick1        # name of the remote volume
  8: end-volume
  9: 
 10: volume client2
 11:   type protocol/client
 12:   option transport-type tcp
 13:   option remote-host 172.16.36.46         # IP address of the remote io
 14:   option remote-port 6996              # default server port is 6996
 15:   option remote-subvolume brick2        # name of the remote volume
 16: end-volume
 17: 
 18: volume client3
 19:   type protocol/client
 20:   option transport-type tcp
 21:   option remote-host 172.16.36.46         # IP address of the remote io
 22:   option remote-port 6996              # default server port is 6996
 23:   option remote-subvolume brick3        # name of the remote volume
 24: end-volume
 25: 
 26: 
 27: volume client4
 28:   type protocol/client
 29:   option transport-type tcp
 30:   option remote-host 172.16.36.46         # IP address of the remote io
 31:   option remote-port 6996              # default server port is 6996
 32:   option remote-subvolume brick4       # name of the remote volume
 33: end-volume
 34: 
 35:  
 36: 
 37: #volume afr2
 38: #  type cluster/afr
 39: #  subvolumes client2 client4
 40: #end-volume
 41: 
 42: volume   dht
 43:   type cluster/dht
 44:   option min-free-disk 20%
 45:   subvolumes client1 client2 
 46: end-volume
 47: 
 48: 
 49: 
 50: ### Add readahead feature
 51: volume readahead
 52:   type performance/read-ahead
 53:   option page-count 16        # cache per file  = (page-count x page-size)
 54:   subvolumes dht 
 55: end-volume
 56: 
 57: ### Add IO-Cache feature
 58: volume iocache
 59:   type performance/io-cache
 60:   option page-size 256KB
 61:   subvolumes readahead 
 62: end-volume
 63: 
 64: ### Add writeback feature
 65: volume writeback
 66:  type performance/write-behind
 67:   option cache-size 32MB
 68:   option flush-behind on
 69:   subvolumes iocache   
 70: end-volume
+------------------------------------------------------------------------------+
[2009-07-07 13:21:54] W [client-protocol.c:5935:init] client4: Volume is dangling. 
[2009-07-07 13:21:54] W [client-protocol.c:5935:init] client3: Volume is dangling. 
[2009-07-07 13:21:54] W [glusterfsd.c:470:_log_if_option_is_invalid] iocache: option 'page-size' is not recognized
[2009-07-07 13:21:54] N [glusterfsd.c:1224:main] glusterfs: Successfully started
[2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client1: Connected to 172.16.36.46:6996, attached to remote volume 'brick1'.
[2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client1: Connected to 172.16.36.46:6996, attached to remote volume 'brick1'.
[2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client2: Connected to 172.16.36.46:6996, attached to remote volume 'brick2'.
[2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client2: Connected to 172.16.36.46:6996, attached to remote volume 'brick2'.
[2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client4: Connected to 172.16.36.46:6996, attached to remote volume 'brick4'.
[2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client4: Connected to 172.16.36.46:6996, attached to remote volume 'brick4'.
[2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client3: Connected to 172.16.36.46:6996, attached to remote volume 'brick3'.
[2009-07-07 13:21:54] N [client-protocol.c:5559:client_setvolume_cbk] client3: Connected to 172.16.36.46:6996, attached to remote volume 'brick3'.
pending frames:
frame : type(1) op(READ)
frame : type(1) op(READ)
frame : type(1) op(READ)
patchset: v2.0.3
signal received: 11
configuration details:argp 1
backtrace 1
dlfcn 1
fdatasync 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs 2.0.3
[0xffffe400]
/usr/local/lib/libfuse.so.2(fuse_session_process+0x17)[0xb779725f]
/lib/glusterfs/2.0.3/xlator/mount/fuse.so[0xb77c5e8a]
/lib/tls/libpthread.so.0[0x8bc341]
/lib/tls/libc.so.6(__clone+0x5e)[0x74e6fe]
---------


[root at localhost /]# gdb glusterfs core.20524 
GNU gdb Red Hat Linux (6.3.0.0-1.63rh)
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i386-redhat-linux-gnu"...Using host libthread_db library "/lib/tls/libthread_db.so.1".
Reading symbols from shared object read from target memory...done.
Loaded system supplied DSO at 0xffffe000
Core was generated by `glusterfs -f glusterfs-client.vol.nio /mnt'.
Program terminated with signal 11, Segmentation fault.
warning: svr4_current_sos: Can't read pathname for load map: 输入/输出错误
Reading symbols from /lib/libglusterfs.so.0...done.
Loaded symbols for /lib/libglusterfs.so.0
Reading symbols from /lib/libdl.so.2...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/tls/libpthread.so.0...done.
Loaded symbols for /lib/tls/libpthread.so.0
Reading symbols from /lib/tls/libc.so.6...done.
Loaded symbols for /lib/tls/libc.so.6
Reading symbols from /lib/ld-linux.so.2...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/glusterfs/2.0.3/xlator/protocol/client.so...done.
Loaded symbols for /lib/glusterfs/2.0.3/xlator/protocol/client.so
Reading symbols from /lib/glusterfs/2.0.3/xlator/cluster/dht.so...done.
Loaded symbols for /lib/glusterfs/2.0.3/xlator/cluster/dht.so
Reading symbols from /lib/glusterfs/2.0.3/xlator/performance/read-ahead.so...done.
Loaded symbols for /lib/glusterfs/2.0.3/xlator/performance/read-ahead.so
Reading symbols from /lib/glusterfs/2.0.3/xlator/performance/io-cache.so...done.
Loaded symbols for /lib/glusterfs/2.0.3/xlator/performance/io-cache.so
Reading symbols from /lib/glusterfs/2.0.3/xlator/performance/write-behind.so...done.
Loaded symbols for /lib/glusterfs/2.0.3/xlator/performance/write-behind.so
Reading symbols from /lib/glusterfs/2.0.3/xlator/mount/fuse.so...done.
Loaded symbols for /lib/glusterfs/2.0.3/xlator/mount/fuse.so
Reading symbols from /usr/local/lib/libfuse.so.2...done.
Loaded symbols for /usr/local/lib/libfuse.so.2
Reading symbols from /lib/tls/librt.so.1...done.
Loaded symbols for /lib/tls/librt.so.1
Reading symbols from /lib/glusterfs/2.0.3/transport/socket.so...done.
Loaded symbols for /lib/glusterfs/2.0.3/transport/socket.so
Reading symbols from /lib/libnss_files.so.2...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /lib/libgcc_s.so.1...done.
Loaded symbols for /lib/libgcc_s.so.1
#0  0xb7795c73 in fuse_ll_process (data=0x80591d0, buf=0xb801f000 "8", len=56, ch=0xb6600718) at fuse_lowlevel.c:1049
1049                    if (curr->u.i.unique == req->unique) {
(gdb) bg
Undefined command: "bg".  Try "help".
(gdb) bt
#0  0xb7795c73 in fuse_ll_process (data=0x80591d0, buf=0xb801f000 "8", len=56, ch=0xb6600718) at fuse_lowlevel.c:1049
#1  0xb779725f in fuse_session_process (se=0xb6600718, buf=0xb801f000 "8", len=56, ch=0x8058e98) at fuse_session.c:80
#2  0xb77c5e8a in fuse_thread_proc (data=0x804fd18) at fuse-bridge.c:2480
#3  0x008bc341 in start_thread () from /lib/tls/libpthread.so.0
#4  0x0074e6fe in clone () from /lib/tls/libc.so.6

The error  seem  only happened  "read" operation ,i write files into gluster no error .

2009-07-07 



eagleeyes 



发件人: Harshavardhana 
发送时间: 2009-07-07  13:08:43 
收件人: eagleeyes 
抄送: Anand Avati; gluster-users 
主题: Re: [Gluster-users] Error : gluster2.0.0 with fuse2.8 inkernel2.6.30 
 
Eagleeyes,

     Please install the latest 2.0.3 release.  From the log file i see glusterfs version under use is 2.0.0 which is not supported for fuse 2.8.0 and it will segfault as shown. 

Regards
--
Harshavardhana
Z Research Inc http://www.zresearch.com/



On Tue, Jul 7, 2009 at 9:43 AM, eagleeyes <eagleeyes at 126.com> wrote:

gluster2.0.3rc2 ,kernel 2.6.30 in  SUSE Linux Enterprise Server 10 SP1 (i586) 

fuse init (API version 7.11)
 FUSE_MINOR_VERSION 8 

gfs1:/ # gdb glusterfs core 
GNU gdb 6.6
Copyright (C) 2006 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i586-suse-linux"...
Using host libthread_db library "/lib/libthread_db.so.1".
warning: Can't read pathname for load map: Input/output error.
Reading symbols from /lib/libglusterfs.so.0...done.
Loaded symbols for /lib/libglusterfs.so.0
Reading symbols from /lib/libdl.so.2...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/libpthread.so.0...done.
Loaded symbols for /lib/libpthread.so.0
Reading symbols from /lib/libc.so.6...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux.so.2...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/protocol/client.so...done.
Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/protocol/client.so
Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/cluster/dht.so...done.
Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/cluster/dht.so
Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/performance/read-ahead.so...done.
Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/performance/read-ahead.so
Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/performance/io-cache.so...done.
Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/performance/io-cache.so
Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/performance/write-behind.so...done.
Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/performance/write-behind.so
Reading symbols from /lib/glusterfs/2.0.3rc2/xlator/mount/fuse.so...done.
Loaded symbols for /lib/glusterfs/2.0.3rc2/xlator/mount/fuse.so
Reading symbols from /usr/local/lib/libfuse.so.2...done.
Loaded symbols for /usr/local/lib/libfuse.so.2
Reading symbols from /lib/librt.so.1...done.
Loaded symbols for /lib/librt.so.1
Reading symbols from /lib/glusterfs/2.0.3rc2/transport/socket.so...done.
Loaded symbols for /lib/glusterfs/2.0.3rc2/transport/socket.so
Reading symbols from /lib/libnss_files.so.2...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /lib/libgcc_s.so.1...done.
Loaded symbols for /lib/libgcc_s.so.1
Core was generated by `glusterfs -f /etc/glusterfs/glusterfs-client.vol.dht --disable-direct-io-mode /'.
Program terminated with signal 11, Segmentation fault.
#0  0xb7584d38 in fuse_ll_process (data=0x805b6a8, buf=0xb7cae000 "Y?", len=16217, ch=0x805b348) at fuse_lowlevel.c:1049
1049                    if (curr->u.i.unique == req->unique) {
(gdb) bt
#0  0xb7584d38 in fuse_ll_process (data=0x805b6a8, buf=0xb7cae000 "Y?", len=16217, ch=0x805b348) at fuse_lowlevel.c:1049
#1  0xb7587b56 in fuse_session_process (se=0x805b540, buf=0xb7cae000 "Y?", len=16217, ch=0x805b348) at fuse_session.c:80
#2  0xb75b5e25 in fuse_thread_proc (data=0x804fd18) at fuse-bridge.c:2480
#3  0xb7f652ab in start_thread () from /lib/libpthread.so.0
#4  0xb7efca4e in clone () from /lib/libc.so.6
(gdb)  exit


2009-07-07 



eagleeyes 



发件人: Anand Avati 
发送时间: 2009-07-07  11:44:28 
收件人: eagleeyes 
抄送: gluster-users 
主题: Re: [Gluster-users] Error : gluster2.0.0 with fuse2.8 inkernel2.6.30 
> 
> I want to use java nio with mmap ,so had to updata kernel 2.6.27 or
> newer . The fuse in kernel 2.6.30 is api 7.11 .
> 
> How can i give your details with gdb? what should i do ?
Do you have a file in your system / with a name like /core.XXXX ? If you do, run this command -
sh$ gdb glusterfs /core.XXX
...
(gdb) bt
and give us the output.
Thanks,
Avati

_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20090707/f0d09916/attachment.html>


More information about the Gluster-users mailing list