<div dir="ltr"><div>Hi Brigit,</div><div><br></div>sorry for the late reply. I've been on holidays and I haven't checked the email for a while.<div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Dec 27, 2019 at 2:46 PM DUCARROZ Birgit <<a href="mailto:birgit.ducarroz@unifr.ch">birgit.ducarroz@unifr.ch</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi, me again.<br>
<br>
I think I managed it, anyway, it works, I hope this is the right way to <br>
do it and not a hack. I tried the version using..<br>
<br>
setfattr -x trusted.glusterfs.volume-id /bigdisk/brick7/vol-cdimages<br>
setfattr -x trusted.gfid /bigdisk/brick7/vol-cdimages<br>
<br>
but this did not work (error message).<br></blockquote><div><br></div><div>If the directory was completely empty and no xattrs were present on it, it should have worked.</div><div><br></div><div>Probably the error was not on the directory itself, but on gluster configuration based on the way you solved it.</div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<br>
<br>
Copied from a working server the vol informations to the new servers ...<br>
scp -r /var/lib/glusterd/vols/* sysadmin@nas29:/var/lib/glusterd/vols/<br>
<br>
changed the rights on the new server:<br>
chown -R root.root /var/lib/glusterd/vols/*<br>
<br>
Then, on the new server:<br>
gluster volume add-brick vol-cdimages nas28:/bigdisk/brick7/vol-cdimages <br>
nas29:/bigdisk/brick8/vol-cdimages nas22:/bigdisk/brick9/vol-cdimages force<br>
<br>
--> success.<br></blockquote><div><br></div><div>Not sure what this fixed, but it was the problem. The possible issue with this change is that sometimes the volume information is not exactly the same on all servers.</div><div><br></div><div>Now that it seems to work, one way to force a rewrite of the configuration of a volume is to change any option using 'gluster volume set <volname> <option> <value>'. This will regenerate volume configuration with the new option and, in the process, any specific difference between servers will be reapplied.</div><div><br></div><div>Regards,</div><div><br></div><div>Xavi</div><div><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<br>
<br>
#gluster volume info vol-cdimages<br>
<br>
Volume Name: vol-cdimages<br>
Type: Distributed-Replicate<br>
Volume ID: xxxxxxxxx<br>
Status: Started<br>
Snapshot Count: 0<br>
Number of Bricks: 2 x (2 + 1) = 6<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: nas20:/bigdisk/brick1/vol-cdimages<br>
Brick2: nas21:/bigdisk/brick2/vol-cdimages<br>
Brick3: nas22:/bigdisk/brick3/vol-cdimages (arbiter)<br>
Brick4: nas28:/bigdisk/brick7/vol-cdimages<br>
Brick5: nas29:/bigdisk/brick8/vol-cdimages<br>
Brick6: nas22:/bigdisk/brick9/vol-cdimages (arbiter)<br>
<br>
Hoping this info might be useful for other users.<br>
<br>
Regards,<br>
Birgit<br>
<br>
<br>
<br>
<br>
On 27/12/19 13:00, DUCARROZ Birgit wrote:<br>
> Hi Xavi,<br>
> <br>
> Thank you a lot for your response. That's the information I needed.<br>
> <br>
> However, I run actually into an other error message:<br>
> <br>
> <br>
> root@nas22:# gluster volume add-brick vol-cdimages nas28:/bigdisk/brick7 <br>
> nas29:/bigdisk/brick8 nas23:/bigdisk/brick9<br>
> <br>
> volume add-brick: failed: Pre Validation failed on nas28. Please check <br>
> log file for details.<br>
> Pre Validation failed on nas29. Please check log file for details.<br>
> <br>
> <br>
> The logfile says:<br>
> <br>
> [2019-12-27 11:37:41.439048] E [MSGID: 106121] <br>
> [glusterd-mgmt.c:1148:glusterd_mgmt_v3_pre_validate] 0-management: Pre <br>
> Validation failed on peers<br>
> <br>
> All peers are in Cluster and Connected.<br>
> <br>
> How can I solve this problem?<br>
> Kind regards,<br>
> Birgit<br>
> <br>
> On 19/12/19 08:43, Xavi Hernandez wrote:<br>
>> Hi Brigit,<br>
>><br>
>> On Wed, Dec 18, 2019 at 3:16 PM DUCARROZ Birgit <br>
>> <<a href="mailto:birgit.ducarroz@unifr.ch" target="_blank">birgit.ducarroz@unifr.ch</a> <mailto:<a href="mailto:birgit.ducarroz@unifr.ch" target="_blank">birgit.ducarroz@unifr.ch</a>>> wrote:<br>
>><br>
>> Hi list,<br>
>><br>
>> I have a replica 3 volume with arbiter.<br>
>> Now I would like to add a new brick.<br>
>> How can I do this?<br>
>><br>
>><br>
>> When you expand a volume you need to add as many bricks as necessary <br>
>> to create a new replica set. In your case you need to add 3 more <br>
>> bricks (2 data bricks and 1 arbiter) to expand the volume.<br>
>><br>
>> You can check the documentation [1] for more information.<br>
>><br>
>> Xavi<br>
>><br>
>> [1] <br>
>> <a href="https://docs.gluster.org/en/latest/Administrator%20Guide/Managing%20Volumes/#expanding-volumes" rel="noreferrer" target="_blank">https://docs.gluster.org/en/latest/Administrator%20Guide/Managing%20Volumes/#expanding-volumes</a> <br>
>><br>
>><br>
>><br>
>><br>
>> gluster volume add-brick ... gives me output:<br>
>> volume add-brick: failed: Increasing replica count for arbiter <br>
>> volumes<br>
>> is not supported.<br>
>><br>
>> Thank you for any help.<br>
>> Regards,<br>
>> Birgit<br>
>> ________<br>
>><br>
>> Community Meeting Calendar:<br>
>><br>
>> APAC Schedule -<br>
>> Every 2nd and 4th Tuesday at 11:30 AM IST<br>
>> Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
>><br>
>> NA/EMEA Schedule -<br>
>> Every 1st and 3rd Tuesday at 01:00 PM EDT<br>
>> Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
>><br>
>> Gluster-users mailing list<br>
>> <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a> <mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>><br>
>> <a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
>><br>
> ________<br>
> <br>
> Community Meeting Calendar:<br>
> <br>
> APAC Schedule -<br>
> Every 2nd and 4th Tuesday at 11:30 AM IST<br>
> Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
> <br>
> NA/EMEA Schedule -<br>
> Every 1st and 3rd Tuesday at 01:00 PM EDT<br>
> Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
> <br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
> <a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
</blockquote></div></div></div>