<div dir="ltr">Not sure whether I understood it correctly, are you using an heterogeneous cluster? If yes, why?<div><br></div><div>Are the new servers are in part of the cluster? You need to peer probe the servers before adding bricks. Copying the configurations of volume will not help.</div><div><br></div><div>scp -r /var/lib/glusterd/vols/* root@diufnas22:/var/lib/glusterd/vols/<br>scp -r /var/lib/glusterd/vols/* root@diufnas23:/var/lib/glusterd/vols/<br></div><div><br></div><div>Please paste the peer status output and glusterd logs from peers around the time when add-brick is performed.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Mar 3, 2020 at 2:56 PM DUCARROZ Birgit <<a href="mailto:birgit.ducarroz@unifr.ch">birgit.ducarroz@unifr.ch</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
Just some additional info:<br>
<br>
On diufnas26 and diufnas27:<br>
glusterfs 4.1.8<br>
<br>
On diufnas22 and diufnas23:<br>
glusterfs 7.2<br>
<br>
<br>
setfattr -x --> does not help<br>
<br>
On 03/03/20 10:01, DUCARROZ Birgit wrote:<br>
> Hi,<br>
> <br>
> Having 2 servers diufnas26 and diufnas27 with 3 volumes (Type=Distribute):<br>
> vol-backup<br>
> vol-restore<br>
> vol-veeam<br>
> <br>
> diufnas26<br>
> /bigdisk/brick1<br>
> <br>
> diufnas27<br>
> /bigdisk/brick2<br>
> <br>
> <br>
> I would like to add 2 new servers: diufnas22 and diufnas23.<br>
> <br>
> diufnas22<br>
> /bigdisk/brick3<br>
> <br>
> diufnas23<br>
> /bigdisk/brick4<br>
> <br>
> gluster peer status on all servers shows State: Peer in Cluster (Connected)<br>
> <br>
> Wanna add the 2 new bricks:<br>
> <br>
> root@diufnas26:/bigdisk/brick1# gluster volume add-brick vol-backup <br>
> diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force<br>
> *volume add-brick: failed: Pre Validation failed on diufnas23. Please <br>
> check log file for details.<br>
> Pre Validation failed on diufnas22. Please check log file for details.*<br>
> <br>
> <br>
> <br>
> I tried this, but it does not help:<br>
> scp -r /var/lib/glusterd/vols/* root@diufnas22:/var/lib/glusterd/vols/<br>
> scp -r /var/lib/glusterd/vols/* root@diufnas23:/var/lib/glusterd/vols/<br>
> <br>
> <br>
> root@diufnas26:/bigdisk/brick1# tail /var/log/glusterfs/*log -f | grep E<br>
> <br>
> [2020-03-03 08:37:52.544881] : volume add-brick vol-backup <br>
> diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED : Pre <br>
> Validation failed on diufnas22. Please check log file for details.<br>
> [2020-03-03 08:39:35.991559] : volume add-brick vol-backup <br>
> diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED : Pre <br>
> Validation failed on diufnas23. Please check log file for details.<br>
> [2020-03-03 08:42:40.800060] : volume add-brick vol-backup <br>
> diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED : Pre <br>
> Validation failed on diufnas23. Please check log file for details.<br>
> [2020-03-03 08:50:15.699112] : volume add-brick vol-backup <br>
> diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED : Pre <br>
> Validation failed on diufnas22. Please check log file for details.<br>
> [2020-03-03 08:54:56.472727] : volume add-brick vol-backup <br>
> diufnas22:/bigdisk/brick3 diufnas23:/bigdisk/brick4 force : FAILED : Pre <br>
> Validation failed on diufnas23. Please check log file for details.<br>
> [2020-03-03 08:50:15.698286] E [MSGID: 106121] <br>
> [glusterd-mgmt.c:1148:glusterd_mgmt_v3_pre_validate] 0-management: Pre <br>
> Validation failed on peers<br>
> [2020-03-03 08:50:15.698315] E [MSGID: 106121] <br>
> [glusterd-mgmt.c:2242:glusterd_mgmt_v3_initiate_all_phases] <br>
> 0-management: Pre Validation Failed<br>
> [2020-03-03 08:54:56.471628] E [MSGID: 106115] <br>
> [glusterd-mgmt.c:124:gd_mgmt_v3_collate_errors] 0-management: Pre <br>
> Validation failed on diufnas23. Please check log file for details.<br>
> [2020-03-03 08:54:56.471687] E [MSGID: 106115] <br>
> [glusterd-mgmt.c:124:gd_mgmt_v3_collate_errors] 0-management: Pre <br>
> Validation failed on diufnas22. Please check log file for details.<br>
> [2020-03-03 08:54:56.471908] E [MSGID: 106121] <br>
> [glusterd-mgmt.c:1148:glusterd_mgmt_v3_pre_validate] 0-management: Pre <br>
> Validation failed on peers<br>
> [2020-03-03 08:54:56.471935] E [MSGID: 106121] <br>
> [glusterd-mgmt.c:2242:glusterd_mgmt_v3_initiate_all_phases] <br>
> 0-management: Pre Validation Failed<br>
> <br>
> <br>
> What am I missing?<br>
> Thank you for any help.<br>
> Regards, Birgit<br>
> <br>
> ________<br>
> <br>
> <br>
> <br>
> Community Meeting Calendar:<br>
> <br>
> Schedule -<br>
> Every Tuesday at 14:30 IST / 09:00 UTC<br>
> Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
> <br>
> Gluster-users mailing list<br>
> <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
> <a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
________<br>
<br>
<br>
<br>
Community Meeting Calendar:<br>
<br>
Schedule -<br>
Every Tuesday at 14:30 IST / 09:00 UTC<br>
Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div>Thanks,<br></div>Sanju<br></div></div>