[Gluster-users] Fedora 17 GlusterFS 3.3.0 problmes

Nathan Stratton nathan at robotics.net
Fri Jun 22 14:49:59 UTC 2012


When I do a NFS mount and do a ls I get:

[root at ovirt share]# ls
ls: reading directory .: Too many levels of symbolic links

[root at ovirt share]# ls -fl
ls: reading directory .: Too many levels of symbolic links
total 3636
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .
dr-xr-xr-x. 21 root root  4096 Jun 21 19:29 ..
drwxr-xr-x   3 root root 16384 Jun 21 19:34 .

{and so on}

When I try a fuse mount I get: [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-0: Server and Client lk-version numbers are not same, reopening 
the fds

I have tried the fedora 16 RPMs and also built new fedora 17 RPMs.

Full Log:

[2012-06-21 19:24:35.633510] I [glusterfsd.c:1666:main] 0-/usr/sbin/glusterfs: 
Started running /usr/sbin/glusterfs version 3.3.0
[2012-06-21 19:24:35.646832] I [io-cache.c:1549:check_cache_size_ok] 
0-share-quick-read: Max cache size is 16825450496
[2012-06-21 19:24:35.646916] I [io-cache.c:1549:check_cache_size_ok] 
0-share-io-cache: Max cache size is 16825450496
[2012-06-21 19:24:35.660807] I [client.c:2142:notify] 0-share-client-0: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.664026] I [client.c:2142:notify] 0-share-client-1: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.666801] I [client.c:2142:notify] 0-share-client-2: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.669385] I [client.c:2142:notify] 0-share-client-3: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.671951] I [client.c:2142:notify] 0-share-client-4: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.674514] I [client.c:2142:notify] 0-share-client-5: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.677093] I [client.c:2142:notify] 0-share-client-6: parent 
translators are ready, attempting connect on transport
[2012-06-21 19:24:35.679652] I [client.c:2142:notify] 0-share-client-7: parent 
translators are ready, attempting connect on transport
Given volfile:
+------------------------------------------------------------------------------+
   1: volume share-client-0
   2:     type protocol/client
   3:     option remote-host virt01.casabi.net
   4:     option remote-subvolume /export
   5:     option transport-type tcp
   6:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
   7:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
   8: end-volume
   9:
  10: volume share-client-1
  11:     type protocol/client
  12:     option remote-host virt02.casabi.net
  13:     option remote-subvolume /export
  14:     option transport-type tcp
  15:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
  16:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
  17: end-volume
  18:
  19: volume share-client-2
  20:     type protocol/client
  21:     option remote-host virt03.casabi.net
  22:     option remote-subvolume /export
  23:     option transport-type tcp
  24:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
  25:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
  26: end-volume
  27:
  28: volume share-client-3
  29:     type protocol/client
  30:     option remote-host virt04.casabi.net
  31:     option remote-subvolume /export
  32:     option transport-type tcp
  33:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
  34:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
  35: end-volume
  36:
  37: volume share-client-4
  38:     type protocol/client
  39:     option remote-host virt05.casabi.net
  40:     option remote-subvolume /export
  41:     option transport-type tcp
  42:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
  43:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
  44: end-volume
  45:
  46: volume share-client-5
  47:     type protocol/client
  48:     option remote-host virt06.casabi.net
  49:     option remote-subvolume /export
  50:     option transport-type tcp
  51:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
  52:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
  53: end-volume
  54:
  55: volume share-client-6
  56:     type protocol/client
  57:     option remote-host virt07.casabi.net
  58:     option remote-subvolume /export
  59:     option transport-type tcp
  60:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
  61:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
  62: end-volume
  63:
  64: volume share-client-7
  65:     type protocol/client
  66:     option remote-host virt08.casabi.net
  67:     option remote-subvolume /export
  68:     option transport-type tcp
  69:     option username f0a71b3a-1cb2-4a38-8620-f3853aa90798
  70:     option password 9641cac2-de93-4621-b94b-9320ada20fd7
  71: end-volume
  72:
  73: volume share-replicate-0
  74:     type cluster/replicate
  75:     subvolumes share-client-0 share-client-1
  76: end-volume
  77:
  78: volume share-replicate-1
  79:     type cluster/replicate
  80:     subvolumes share-client-2 share-client-3
  81: end-volume
  82:
  83: volume share-replicate-2
  84:     type cluster/replicate
  85:     subvolumes share-client-4 share-client-5
  86: end-volume
  87:
  88: volume share-replicate-3
  89:     type cluster/replicate
  90:     subvolumes share-client-6 share-client-7
  91: end-volume
  92:
  93: volume share-dht
  94:     type cluster/distribute
  95:     subvolumes share-replicate-0 share-replicate-1 share-replicate-2 
share-replicate-3
  96: end-volume
  97:
  98: volume share-write-behind
  99:     type performance/write-behind
100:     subvolumes share-dht
101: end-volume
102:
103: volume share-read-ahead
104:     type performance/read-ahead
105:     subvolumes share-write-behind
106: end-volume
107:
108: volume share-io-cache
109:     type performance/io-cache
110:     subvolumes share-read-ahead
111: end-volume
112:
113: volume share-quick-read
114:     type performance/quick-read
115:     subvolumes share-io-cache
116: end-volume
117:
118: volume share-md-cache
119:     type performance/md-cache
120:     subvolumes share-quick-read
121: end-volume
122:
123: volume share
124:     type debug/io-stats
125:     option latency-measurement off
126:     option count-fop-hits off
127:     subvolumes share-md-cache
128: end-volume

+------------------------------------------------------------------------------+
[2012-06-21 19:24:35.682819] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 
0-share-client-0: changing port to 24009 (from 0)
[2012-06-21 19:24:35.682973] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 
0-share-client-1: changing port to 24010 (from 0)
[2012-06-21 19:24:35.683014] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 
0-share-client-2: changing port to 24010 (from 0)
[2012-06-21 19:24:35.683039] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 
0-share-client-3: changing port to 24010 (from 0)
[2012-06-21 19:24:35.683121] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 
0-share-client-5: changing port to 24010 (from 0)
[2012-06-21 19:24:35.683162] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 
0-share-client-4: changing port to 24010 (from 0)
[2012-06-21 19:24:35.683206] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 
0-share-client-7: changing port to 24010 (from 0)
[2012-06-21 19:24:35.683246] I [rpc-clnt.c:1660:rpc_clnt_reconfig] 
0-share-client-6: changing port to 24010 (from 0)
[2012-06-21 19:24:39.644198] I 
[client-handshake.c:1636:select_server_supported_programs] 0-share-client-0: 
Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-21 19:24:39.644493] I [client-handshake.c:1433:client_setvolume_cbk] 
0-share-client-0: Connected to 10.59.0.11:24009, attached to remote volume 
'/export'.
[2012-06-21 19:24:39.644512] I [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-0: Server and Client lk-version numbers are not same, reopening 
the fds
[2012-06-21 19:24:39.644579] I [afr-common.c:3627:afr_notify] 
0-share-replicate-0: Subvolume 'share-client-0' came back up; going online.
[2012-06-21 19:24:39.644621] I 
[client-handshake.c:453:client_set_lk_version_cbk] 0-share-client-0: Server lk 
version = 1
[2012-06-21 19:24:39.646923] I 
[client-handshake.c:1636:select_server_supported_programs] 0-share-client-1: 
Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-21 19:24:39.647207] I [client-handshake.c:1433:client_setvolume_cbk] 
0-share-client-1: Connected to 10.59.0.12:24010, attached to remote volume 
'/export'.
[2012-06-21 19:24:39.647227] I [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-1: Server and Client lk-version numbers are not same, reopening 
the fds
[2012-06-21 19:24:39.647371] I 
[client-handshake.c:453:client_set_lk_version_cbk] 0-share-client-1: Server lk 
version = 1
[2012-06-21 19:24:39.649587] I 
[client-handshake.c:1636:select_server_supported_programs] 0-share-client-2: 
Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-21 19:24:39.649806] I [client-handshake.c:1433:client_setvolume_cbk] 
0-share-client-2: Connected to 10.59.0.13:24010, attached to remote volume 
'/export'.
[2012-06-21 19:24:39.649826] I [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-2: Server and Client lk-version numbers are not same, reopening 
the fds
[2012-06-21 19:24:39.649865] I [afr-common.c:3627:afr_notify] 
0-share-replicate-1: Subvolume 'share-client-2' came back up; going online.
[2012-06-21 19:24:39.649935] I 
[client-handshake.c:453:client_set_lk_version_cbk] 0-share-client-2: Server lk 
version = 1
[2012-06-21 19:24:39.652192] I 
[client-handshake.c:1636:select_server_supported_programs] 0-share-client-3: 
Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-21 19:24:39.652428] I [client-handshake.c:1433:client_setvolume_cbk] 
0-share-client-3: Connected to 10.59.0.14:24010, attached to remote volume 
'/export'.
[2012-06-21 19:24:39.652448] I [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-3: Server and Client lk-version numbers are not same, reopening 
the fds
[2012-06-21 19:24:39.652566] I 
[client-handshake.c:453:client_set_lk_version_cbk] 0-share-client-3: Server lk 
version = 1
[2012-06-21 19:24:39.654706] I 
[client-handshake.c:1636:select_server_supported_programs] 0-share-client-5: 
Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-21 19:24:39.654910] I [client-handshake.c:1433:client_setvolume_cbk] 
0-share-client-5: Connected to 10.59.0.16:24010, attached to remote volume 
'/export'.
[2012-06-21 19:24:39.654926] I [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-5: Server and Client lk-version numbers are not same, reopening 
the fds
[2012-06-21 19:24:39.654961] I [afr-common.c:3627:afr_notify] 
0-share-replicate-2: Subvolume 'share-client-5' came back up; going online.
[2012-06-21 19:24:39.655035] I 
[client-handshake.c:453:client_set_lk_version_cbk] 0-share-client-5: Server lk 
version = 1
[2012-06-21 19:24:39.657289] I 
[client-handshake.c:1636:select_server_supported_programs] 0-share-client-4: 
Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-21 19:24:39.657511] I [client-handshake.c:1433:client_setvolume_cbk] 
0-share-client-4: Connected to 10.59.0.15:24010, attached to remote volume 
'/export'.
[2012-06-21 19:24:39.657526] I [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-4: Server and Client lk-version numbers are not same, reopening 
the fds
[2012-06-21 19:24:39.657646] I 
[client-handshake.c:453:client_set_lk_version_cbk] 0-share-client-4: Server lk 
version = 1
[2012-06-21 19:24:39.659884] I 
[client-handshake.c:1636:select_server_supported_programs] 0-share-client-7: 
Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-21 19:24:39.660075] I [client-handshake.c:1433:client_setvolume_cbk] 
0-share-client-7: Connected to 10.59.0.18:24010, attached to remote volume 
'/export'.
[2012-06-21 19:24:39.660091] I [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-7: Server and Client lk-version numbers are not same, reopening 
the fds
[2012-06-21 19:24:39.660127] I [afr-common.c:3627:afr_notify] 
0-share-replicate-3: Subvolume 'share-client-7' came back up; going online.
[2012-06-21 19:24:39.660202] I 
[client-handshake.c:453:client_set_lk_version_cbk] 0-share-client-7: Server lk 
version = 1
[2012-06-21 19:24:39.662579] I 
[client-handshake.c:1636:select_server_supported_programs] 0-share-client-6: 
Using Program GlusterFS 3.3.0, Num (1298437), Version (330)
[2012-06-21 19:24:39.662908] I [client-handshake.c:1433:client_setvolume_cbk] 
0-share-client-6: Connected to 10.59.0.17:24010, attached to remote volume 
'/export'.
[2012-06-21 19:24:39.662931] I [client-handshake.c:1445:client_setvolume_cbk] 
0-share-client-6: Server and Client lk-version numbers are not same, reopening 
the fds
[2012-06-21 19:24:39.668028] I [fuse-bridge.c:4193:fuse_graph_setup] 0-fuse: 
switched to graph 0
[2012-06-21 19:24:39.668234] I 
[client-handshake.c:453:client_set_lk_version_cbk] 0-share-client-6: Server lk 
version = 1
[2012-06-21 19:24:39.668287] I [fuse-bridge.c:3376:fuse_init] 0-glusterfs-fuse: 
FUSE inited with protocol versions: glusterfs 7.13 kernel 7.18
[2012-06-21 19:24:39.668739] I 
[afr-common.c:1964:afr_set_root_inode_on_first_lookup] 0-share-replicate-0: 
added root inode
[2012-06-21 19:24:39.669232] I 
[afr-common.c:1964:afr_set_root_inode_on_first_lookup] 0-share-replicate-1: 
added root inode
[2012-06-21 19:24:39.669321] I 
[afr-common.c:1964:afr_set_root_inode_on_first_lookup] 0-share-replicate-2: 
added root inode
[2012-06-21 19:24:39.669379] I 
[afr-common.c:1964:afr_set_root_inode_on_first_lookup] 0-share-replicate-3: 
added root inode



> <>
Nathan Stratton
nathan at robotics.net
http://www.robotics.net



More information about the Gluster-users mailing list