[Gluster-users] gluster start but do not connect

Pierre Léonard pleonard at jouy.inra.fr
Fri Dec 5 12:59:44 UTC 2014 

Hi  Kaushal and everybody,
> You're welcome Pierre. I'm happy I could help you.
>
> ~kaushal
>
I am back wiath my node. glusterd start ok. The files in 
/var/lib/glusterfs/peers seems ok. Il have 14 nodes and 13 files in that 
directory, the node itself, seems logical.
But there is not connection :
[root at xstoocky06 glusterfs]# gluster volume  status gvscratch
Status of volume: gvscratch
Gluster process Port    Online  Pid
------------------------------------------------------------------------------
Brick xstoocky06:/mnt/gvscratch/brick2 N/A     N       N/A
NFS Server on localhost N/A     N       N/A

Task Status of Volume gvscratch
------------------------------------------------------------------------------
There are no active volume tasks

On that node there is the latest release : -3.6.1-1.el6.x86_64.rpm
on the other nodes the : -3.6.0-1.el6.x86_64.rpm

could it be a problem N
I am not confiden with that. The log file : etc-glusterfs-glusterd.vol.log
Is growning very fastly :

[root at xstoocky06 glusterfs]# tail etc-glusterfs-glusterd.vol.log
[2014-12-05 12:41:58.295716] E 
[glusterd-handshake.c:875:gd_validate_cluster_op_version] 0-management: 
cannot reduce operating version to 2 from current version 30600 as 
volumes exist (as per peer request from 138.102.172.123:809)
[2014-12-05 12:41:58.519058] E 
[glusterd-handshake.c:875:gd_validate_cluster_op_version] 0-management: 
cannot reduce operating version to 2 from current version 30600 as 
volumes exist (as per peer request from 138.102.172.118:995)
[2014-12-05 12:41:58.627626] E 
[glusterd-handshake.c:875:gd_validate_cluster_op_version] 0-management: 
cannot reduce operating version to 2 from current version 30600 as 
volumes exist (as per peer request from 138.102.172.120:828)
[2014-12-05 12:41:58.723389] E 
[glusterd-handshake.c:875:gd_validate_cluster_op_version] 0-management: 
cannot reduce operating version to 2 from current version 30600 as 
volumes exist (as per peer request from 138.102.172.122:774)
[2014-12-05 12:41:58.765614] E 
[glusterd-handshake.c:875:gd_validate_cluster_op_version] 0-management: 
cannot reduce operating version to 2 from current version 30600 as 
volumes exist (as per peer request from 138.102.172.116:1003)
[2014-12-05 12:41:57.773113] I [MSGID: 106004] 
[glusterd-handler.c:4365:__glusterd_peer_rpc_notify] 0-management: Peer 
9df5d38b-d5bd-432a-869f-ea5574b6ba9a, in Peer in Cluster state, has 
disconnected from glusterd.
The message "I [MSGID: 106004] 
[glusterd-handler.c:4365:__glusterd_peer_rpc_notify] 0-management: Peer 
dae6974f-2522-47fa-bb3d-c173f02a6707, in Peer in Cluster state, has 
disconnected from glusterd." repeated 2 times between [2014-12-05 
12:41:51.619614] and [2014-12-05 12:41:57.779295]
[2014-12-05 12:41:58.940707] E 
[glusterd-handshake.c:875:gd_validate_cluster_op_version] 0-management: 
cannot reduce operating version to 2 from current version 30600 as 
volumes exist (as per peer request from 138.102.172.110:1021)
[2014-12-05 12:41:58.990931] E 
[glusterd-handshake.c:875:gd_validate_cluster_op_version] 0-management: 
cannot reduce operating version to 2 from current version 30600 as 
volumes exist (as per peer request from 138.102.172.117:801)
[2014-12-05 12:41:59.205720] E 
[glusterd-handshake.c:875:gd_validate_cluster_op_version] 0-management: 
cannot reduce operating version to 2 from current version 30600 as 
volumes exist (as per peer request from 138.102.172.111:913)


I talk about : cannot reduce operating version to 2 from current version 
30600 as volumes exist

The difference is very importante.

Ans I have also that :

[2014-12-05 12:45:48.672551] W [rpc-clnt-ping.c:145:rpc_clnt_ping_cbk] 
0-management: socket or ib related error
[2014-12-05 12:45:48.672638] E 
[glusterd-handshake.c:1654:__glusterd_mgmt_hndsk_version_cbk] 
0-management: failed to validate the operating version of peer (xstoocky10)
[2014-12-05 12:45:48.672700] I [MSGID: 106004] 
[glusterd-handler.c:4365:__glusterd_peer_rpc_notify] 0-management: Peer 
dae6974f-2522-47fa-bb3d-c173f02a6707, in Peer in Cluster state, has 
disconnected from glusterd.
[2014-12-05 12:45:48.673088] W 
[glusterd-locks.c:647:glusterd_mgmt_v3_unlock] (--> 
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x3ccc620420] (--> 
/usr/lib64/glusterfs/3.6.1/xlator/mgmt/glusterd.so(glusterd_mgmt_v3_unlock+0x428)[0x7ffddc717228] 
(--> 
/usr/lib64/glusterfs/3.6.1/xlator/mgmt/glusterd.so(__glusterd_peer_rpc_notify+0x262)[0x7ffddc68c1c2] 
(--> 
/usr/lib64/glusterfs/3.6.1/xlator/mgmt/glusterd.so(glusterd_big_locked_notify+0x60)[0x7ffddc677980] 
(--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x1a1)[0x3ccca0ff11] ))))) 
0-management: Lock for vol gvrepli not held
[2014-12-05 12:45:48.673423] W 
[glusterd-locks.c:647:glusterd_mgmt_v3_unlock] (--> 
/usr/lib64/libglusterfs.so.0(_gf_log_callingfn+0x1e0)[0x3ccc620420] (--> 
/usr/lib64/glusterfs/3.6.1/xlator/mgmt/glusterd.so(glusterd_mgmt_v3_unlock+0x428)[0x7ffddc717228] 
(--> 
/usr/lib64/glusterfs/3.6.1/xlator/mgmt/glusterd.so(__glusterd_peer_rpc_notify+0x262)[0x7ffddc68c1c2] 
(--> 
/usr/lib64/glusterfs/3.6.1/xlator/mgmt/glusterd.so(glusterd_big_locked_notify+0x60)[0x7ffddc677980] 
(--> /usr/lib64/libgfrpc.so.0(rpc_clnt_notify+0x1a1)[0x3ccca0ff11] ))))) 
0-management: Lock for vol gvscratch not held


I have also that :

[root at xstoocky07 peers]# gluster --remote-host=xstoocky06 peer status
peer status: failed


So the administration guide is to light for that kind of problem.

I you could help, you're welcom .

Sincerely

-- 
Signature electronique
INRA <http://www.inra.fr>
*Pierre Léonard*
*Senior IT Manager*
*MetaGenoPolis*
Pierre.Leonard at jouy.inra.fr <mailto:Pierre.Leonard at jouy.inra.fr>
Tél. : +33 (0)1 34 65 29 78

Centre de recherche INRA
Domaine de Vilvert – Bât. 325 R+1
78 352 Jouy-en-Josas CEDEX
France
www.mgps.eu <http://www.mgps.eu>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20141205/7db8efe3/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: logo-INRA2013.gif
Type: image/gif
Size: 2560 bytes
Desc: http://www.inra.fr/
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20141205/7db8efe3/attachment.gif>

More information about the Gluster-users mailing list