<div dir="ltr"><div dir="ltr"><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Dec 11, 2019 at 10:06 PM woz woz <<a href="mailto:thewoz10@gmail.com">thewoz10@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hi guys,<br>how are you? I have a question for you<br>Last week one of our 8 servers went down due to a problem on the RAID controller and, unfortunately, we had to reinstall and reconfigure it. The hostname of this server is <a href="http://gluster09.example.int" target="_blank">gluster09.example.int</a>, below you can find the volume status:<div>#####################################################<br>Volume Name: gv0<br>Type: Distributed-Replicate<br>Volume ID: 4e9122d3-f4c9-4509-b25e-a30f7b5f452f<br>Status: Started<br>Snapshot Count: 0<br>Number of Bricks: 4 x 2 = 8<br>Transport-type: tcp<br>Bricks:<br>Brick1: gluster09.example.int:/mnt/gluster/brick<br>Brick2: gluster01.example.int:/mnt/gluster/brick<br>Brick3: gluster03.example.int:/mnt/gluster/brick<br>Brick4: gluster04.example.int:/mnt/gluster/brick<br>Brick5: gluster05.example.int:/mnt/gluster/brick<br>Brick6: gluster06.example.int:/mnt/gluster/brick<br>Brick7: gluster07.example.int:/mnt/gluster/brick<br>Brick8: gluster08.example.int:/mnt/gluster/brick<br>Options Reconfigured:</div><div>cluster.shd-wait-qlength: 16384<br>cluster.self-heal-daemon: enable<br>cluster.shd-max-threads: 12<br>nfs.disable: on<br>performance.readdir-ahead: on<br>transport.address-family: inet</div><div>#####################################################<br>To add the new server again we followed the official procedure provided by REDHAT (<a href="https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.5/pdf/administration_guide/Red_Hat_Gluster_Storage-3.5-Administration_Guide-en-US.pdf" target="_blank">https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.5/pdf/administration_guide/Red_Hat_Gluster_Storage-3.5-Administration_Guide-en-US.pdf</a>) and we noticed that the self heal is in progress, in fact-checking the status of it using the command gluster volume heal gv0 info we see a lot of entries like:</div><div>#####################################################<br>Brick gluster09.example.int:/mnt/gluster/brick<br>Status: Connected<br>Number of entries: 0<br>Brick gluster01.example.int:/mnt/gluster/brick<br><gfid:2786f558-3b4a-42dd-b519-4be548b7c735><br><gfid:15921050-7538-43bb-9c5a-80d2e74c73b8><br><gfid:00a120eb-d7c9-490b-8996-e06ceeaf2f7c><br><gfid:366ce3d7-6ab4-49b6-8fe0-10f8af07864c><br><gfid:09d94803-c4e0-4d3d-b89d-1f70e0910fdd><br><gfid:b54ebaac-ab84-4277-bded-762b2dd09ae2><br><gfid:3bab3231-cccc-44db-9ec5-1f167a7b47b1><br><gfid:e3d209ae-e260-4d0a-93fd-65e8ef35d2ff><br><gfid:8fbe07a6-b46e-4c02-b20e-0c0a2d36cee1><br><gfid:131b9889-2a4d-4b67-a0f2-99c782de2b69><br><gfid:73f76c29-b4a2-4a2d-92e3-2c9f86884d04><br><gfid:b998387c-d8fc-4fc0-9ddf-dabb26eb2f4e><br><gfid:ccdbd77d-e548-4561-a9ec-1d186e0a6bbe><br>............................</div><div>#####################################################<br>but it seems that the sync is only for the indices and not for the data, in fact, the disk space occupied is, currently, just 120 GB on the new server whereas on the "master" node the server <a href="http://gluster01.example.int" target="_blank">gluster01.example.int</a> is 60TB. We tried to change also the parameters regarding the number of threads for the self-heal daemon moving it from 1 to 12 and cluster.shd-wait-qlength from 1024 to 16384 but we didn't notice any improvements...<br>Moreover, we tried also the start a full heal of the volume using the command gluster volume heal gv0 full but we receive the following error:<br>Launching heal operation to perform full self-heal on volume gv0 has been unsuccessful on bricks that are down. Please check if all brick processes are running.<br></div></div></blockquote><div><br></div><div>Please, check whether you are hitting <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1676812">https://bugzilla.redhat.com/show_bug.cgi?id=1676812</a> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div>How we can synchronize the data on the new server and not just the indices?</div><div><br></div><div>Thanks in advance for your support,</div><div>Best regards,</div><div>Woz</div></div>
________<br>
<br>
Community Meeting Calendar:<br>
<br>
APAC Schedule -<br>
Every 2nd and 4th Tuesday at 11:30 AM IST<br>
Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
<br>
NA/EMEA Schedule -<br>
Every 1st and 3rd Tuesday at 01:00 PM EDT<br>
Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div>Thanks,<br></div>Sanju<br></div></div></div>