<html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">I was now able to catch the split brain log:<div class=""><br class=""></div><div class=""><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">sudo gluster volume heal storage2 info</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Brick storage3:/data/data-cluster</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><gfid:256ca960-1601-4f0d-9b08-905c6fd52326> </span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><gfid:7a63a729-c48f-4a00-9040-c3e2a0710ae6> </span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">/dms/final_archive - Is in split-brain</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Status: Connected</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Number of entries: 3</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Brick storage4:/data/data-cluster</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""><gfid:276fec9a-1c9b-4efe-9715-dcf4207e99b0> </span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">/dms/final_archive - Is in split-brain</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo; min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Status: Connected</span></div><div style="margin: 0px; font-stretch: normal; font-size: 11px; line-height: normal; font-family: Menlo;" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Number of entries: 2</span></div><div class=""><br class=""></div><div class="">
<div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;">Milos</div></div><div style="color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: auto; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; widows: auto; word-spacing: 0px; -webkit-text-stroke-width: 0px;"><br class=""></div><div><blockquote type="cite" class=""><div class="">On 21 Mar 2019, at 09:07, Milos Cuculovic <<a href="mailto:cuculovic@mdpi.com" class="">cuculovic@mdpi.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="">Since 24h, after upgrading from 4.0 to 4.1.7 one of the servers, the heal shows this:<br class=""><br class="">sudo gluster volume heal storage2 info<br class="">Brick storage3:/data/data-cluster<br class=""><gfid:256ca960-1601-4f0d-9b08-905c6fd52326> <br class=""><gfid:7a63a729-c48f-4a00-9040-c3e2a0710ae6> <br class="">/dms/final_archive - Possibly undergoing heal<br class=""><br class="">Status: Connected<br class="">Number of entries: 3<br class=""><br class="">Brick storage4:/data/data-cluster<br class=""><gfid:276fec9a-1c9b-4efe-9715-dcf4207e99b0> <br class="">/dms/final_archive - Possibly undergoing heal<br class=""><br class="">Status: Connected<br class="">Number of entries: 2<br class=""><br class="">The same files stay there. From time to time the status of the /dms/final_archive is in split brain at the following command shows:<br class=""><br class="">sudo gluster volume heal storage2 info split-brain<br class="">Brick storage3:/data/data-cluster<br class="">/dms/final_archive<br class="">Status: Connected<br class="">Number of entries in split-brain: 1<br class=""><br class="">Brick storage4:/data/data-cluster<br class="">/dms/final_archive<br class="">Status: Connected<br class="">Number of entries in split-brain: 1<br class=""><br class="">How to know the file who is in split brain? The files in /dms/final_archive are not very important, fine to remove (ideally resolve the split brain) for the ones that differ.<br class=""><br class="">I can only see the directory and GFID. Any idea on how to resolve this situation as I would like to continue with the upgrade on the 2nd server, and for this the heal needs to be done with 0 entries in sudo gluster volume heal storage2 info<br class=""><br class="">Thank you in advance, Milos.</div></div></blockquote></div><br class=""></div></body></html>