[Gluster-users] Trouble to add brick
Burnash, James
jburnash at knight.com
Mon May 23 18:08:53 UTC 2011
What is the output of:
# ls /etc/glusterd/peers
39bd607b-b355-4e0d-80ae-ef507e0dbabe 4583d8b7-f724-4017-b549-9aa9e27dd50f a70858c6-cac3-43fa-b743-4d2226f8a433
Above output is mine.
If you cat each of these files, there should be one for each peer OTHER than the host that your are logged into), and hostnames each files, like this:
# cat /etc/glusterd/peers/*
uuid=39bd607b-b355-4e0d-80ae-ef507e0dbabe
state=3
hostname1=jc1letgfs15-pfs1
uuid=4583d8b7-f724-4017-b549-9aa9e27dd50f
state=3
hostname1=jc1letgfs18-pfs1
uuid=a70858c6-cac3-43fa-b743-4d2226f8a433
state=3
hostname1=jc1letgfs14-pfs1
Here is a listing of all the peer files on all four nodes of my GlusterFS servers - I created this configuration in the same way you did - two servers, then add two servers:
jc1letgfs14
/etc/glusterd/peers/39bd607b-b355-4e0d-80ae-ef507e0dbabe
uuid=39bd607b-b355-4e0d-80ae-ef507e0dbabe
state=3
hostname1=jc1letgfs15-pfs1
/etc/glusterd/peers/4583d8b7-f724-4017-b549-9aa9e27dd50f
uuid=4583d8b7-f724-4017-b549-9aa9e27dd50f
state=3
hostname1=jc1letgfs18-pfs1
/etc/glusterd/peers/94f28f8c-8958-435b-80e4-3bd6d4fc5156
uuid=94f28f8c-8958-435b-80e4-3bd6d4fc5156
state=3
hostname1=10.20.72.191
jc1letgfs15
/etc/glusterd/peers/4583d8b7-f724-4017-b549-9aa9e27dd50f
uuid=4583d8b7-f724-4017-b549-9aa9e27dd50f
state=3
hostname1=jc1letgfs18-pfs1
/etc/glusterd/peers/94f28f8c-8958-435b-80e4-3bd6d4fc5156
uuid=94f28f8c-8958-435b-80e4-3bd6d4fc5156
state=3
hostname1=10.20.72.191
/etc/glusterd/peers/a70858c6-cac3-43fa-b743-4d2226f8a433
uuid=a70858c6-cac3-43fa-b743-4d2226f8a433
state=3
hostname1=jc1letgfs14-pfs1
jc1letgfs17
/etc/glusterd/peers/39bd607b-b355-4e0d-80ae-ef507e0dbabe
uuid=39bd607b-b355-4e0d-80ae-ef507e0dbabe
state=3
hostname1=jc1letgfs15-pfs1
/etc/glusterd/peers/4583d8b7-f724-4017-b549-9aa9e27dd50f
uuid=4583d8b7-f724-4017-b549-9aa9e27dd50f
state=3
hostname1=jc1letgfs18-pfs1
/etc/glusterd/peers/a70858c6-cac3-43fa-b743-4d2226f8a433
uuid=a70858c6-cac3-43fa-b743-4d2226f8a433
state=3
hostname1=jc1letgfs14-pfs1
jc1letgfs18
/etc/glusterd/peers/39bd607b-b355-4e0d-80ae-ef507e0dbabe
uuid=39bd607b-b355-4e0d-80ae-ef507e0dbabe
state=3
hostname1=jc1letgfs15-pfs1
/etc/glusterd/peers/94f28f8c-8958-435b-80e4-3bd6d4fc5156
uuid=94f28f8c-8958-435b-80e4-3bd6d4fc5156
state=3
hostname1=10.20.72.191
/etc/glusterd/peers/a70858c6-cac3-43fa-b743-4d2226f8a433
uuid=a70858c6-cac3-43fa-b743-4d2226f8a433
state=3
hostname1=jc1letgfs14-pfs1
I hope this is of some help.
James Burnash
Unix Engineer
-----Original Message-----
From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at gluster.org] On Behalf Of Karim Latouche
Sent: Monday, May 23, 2011 1:02 PM
To: Mohit Anchlia
Cc: gluster-users at gluster.org
Subject: Re: [Gluster-users] Trouble to add brick
hi
Here is the output of gluster peer status command of the four nodes
mysqldccbackup mysqldccbackupmirror are the two first nodes
I got issues when I tried to add gfsbrick1 and two to the already working cluster
> [root at gfsbrick1 ~]# gluster peer status
> Number of Peers: 1
>
> Hostname: 10.0.4.225
> Uuid: 00000000-0000-0000-0000-000000000000
> State: Establishing Connection (Connected)
> [root at gfsbrick2 ~]# gluster peer status
> Number of Peers: 2
>
> Hostname: 10.0.4.225
> Uuid: 2f4a1869-8c7e-49ea-a7b1-d9b2d364e5d6
> State: Peer in Cluster (Connected)
>
> Hostname: mysqldccbackupmirror
> Uuid: 0961e0d2-e2e8-497d-9c51-4b96c061f939
> State: Peer Rejected (Connected)
> [root at mysqldccbackup ~]# gluster peer status
> Number of Peers: 3
>
> Hostname: mysqldccbackupmirror
> Uuid: 0961e0d2-e2e8-497d-9c51-4b96c061f939
> State: Peer in Cluster (Connected)
>
> Hostname: gfsbrick2
> Uuid: 14f07412-b2e5-4b34-8980-d180a64b720f
> State: Peer in Cluster (Connected)
>
> Hostname: gfsbrick1
> Uuid: 00000000-0000-0000-0000-000000000000
> State: Establishing Connection (Connected)
> root at mysqldccbackupmirror ~]# gluster peer status
> Number of Peers: 1
>
> Hostname: 10.0.4.225
> Uuid: 2f4a1869-8c7e-49ea-a7b1-d9b2d364e5d6
> State: Peer in Cluster (Connected)
> [root at mysqldccbackupmirror ~]# gluster peer status
> Number of Peers: 1
>
> Hostname: 10.0.4.225
> Uuid: 2f4a1869-8c7e-49ea-a7b1-d9b2d364e5d6
> State: Peer in Cluster (Connected)
Thx a lot
KL
> Please send the complete output of gluster peer status from both the nodes.
>
> On Mon, May 23, 2011 at 9:44 AM, Karim Latouche
> <klatouche at digitalchocolate.com> wrote:
>> hi
>>
>> Thx for your answer.
>>
>> I should have mention that I already set up a proper hosts file to avoid DNS
>> resolution issue but I still have same issue.
>>
>> The last brick is allways the one having issues to be added . I tried adding
>> gfsbrick2 first then gfsbrick1 and the result is the same
>>
>> I get
>>
>>> Hostname: gfsbrick2
>>> Uuid: 14f07412-b2e5-4b34-8980-d180a64b720f
>>> State: Peer in Cluster (Connected)
>>>
>>> Hostname: gfsbrick1
>>> Uuid: 00000000-0000-0000-0000-000000000000
>>> State: Establishing Connection (Connected)
>>
>> instead of
>>
>>
>>> Hostname: gfsbrick2
>>> Uuid: 00000000-0000-0000-0000-000000000000
>>> State: Establishing Connection (Connected)
>>
>> It 's really strange.
>>
>>
>> Thx
>>
>> KL
>>
>>
>>
>>
>>> Karim,
>>> gfsbrick1 is not able to contact gfsbrick2 yet. Generally happens if
>>> the DNS resolutions dont happen as expected. You can map them manually in
>>> /etc/hosts for both the machines?.
>>>
>>> something like:
>>> on gfsbrick1
>>> <ip-of-brick2> gfsbrick2
>>> on gfsbrick2
>>> <ip-of-brick1> gfsbrick1
>>>
>>> Pranith.
>>>
>>> ----- Original Message -----
>>> From: "Karim Latouche"<klatouche at digitalchocolate.com>
>>> To: gluster-users at gluster.org
>>> Sent: Monday, May 23, 2011 7:56:22 PM
>>> Subject: [Gluster-users] Trouble to add brick
>>>
>>> Hi
>>>
>>> I got a strange problems
>>>
>>> I run a two bricks replicated volume and I tried to add 2 more bricks
>>>
>>> The first one went ok
>>>
>>>> gluster peer probe gfsbrick1
>>>> Probe successful
>>> It seems I can't add the second one
>>>
>>> I get a
>>>
>>>> Hostname: gfsbrick2
>>>> Uuid: 00000000-0000-0000-0000-000000000000
>>>> State: Establishing Connection (Connected)
>>> Did anyone encounter this issue ?
>>>
>>> Thx
>>>
>>> KL
>>>
>>>
>>> _______________________________________________
>>> Gluster-users mailing list
>>> Gluster-users at gluster.org
>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>> _______________________________________________
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>
_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
DISCLAIMER:
This e-mail, and any attachments thereto, is intended only for use by the addressee(s) named herein and may contain legally privileged and/or confidential information. If you are not the intended recipient of this e-mail, you are hereby notified that any dissemination, distribution or copying of this e-mail, and any attachments thereto, is strictly prohibited. If you have received this in error, please immediately notify me and permanently delete the original and any copy of any e-mail and any printout thereof. E-mail transmission cannot be guaranteed to be secure or error-free. The sender therefore does not accept liability for any errors or omissions in the contents of this message which arise as a result of e-mail transmission.
NOTICE REGARDING PRIVACY AND CONFIDENTIALITY Knight Capital Group may, at its discretion, monitor and review the content of all e-mail communications. http://www.knight.com
More information about the Gluster-users
mailing list