<html>
<head>
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p><br>
</p>
<br>
<div class="moz-cite-prefix">On 02/23/2017 12:18 PM,
<a class="moz-txt-link-abbreviated" href="mailto:max.degraaf@kpn.com">max.degraaf@kpn.com</a> wrote:<br>
</div>
<blockquote
cite="mid:BD35B08176463944A213E3C94AD3CEFE17FC1378@CPEMS-KPN510.KPNCNL.LOCAL"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<meta name="Generator" content="Microsoft Word 14 (filtered
medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.E-mailStijl17
{mso-style-type:personal-compose;
font-family:"Calibri","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hi,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">We have a 4 node
glusterfs setup that seems to be running without any
problems. We can’t find any problems with replication or
whatever.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">We also have 4 machines
running the glusterfs client. On all 4 machines we see the
following error in the logs at random moments:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">[2017-02-23
00:04:33.168778] I
[afr-self-heal-common.c:2869:afr_log_self_heal_completion_status]
0-aab-replicate-0: metadata self heal is successfully
completed, metadata self heal from source aab-client-0 to
aab-client-1, aab-client-2, aab-client-3, metadata -
Pending matrix: [ [ 0 0 0 0 ] [ 0 0 0 0 ] [ 0 0 0 0 ] [ 0 0
0 0 ] ], on /<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">[2017-02-23
00:09:34.431089] E
[afr-self-heal-common.c:2869:afr_log_self_heal_completion_status]
0-aab-replicate-0: metadata self heal failed, on /<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">[2017-02-23
00:14:34.948975] I
[afr-self-heal-common.c:2869:afr_log_self_heal_completion_status]
0-aab-replicate-0: metadata self heal is successfully
completed, metadata self heal from source aab-client-0 to
aab-client-1, aab-client-2, aab-client-3, metadata -
Pending matrix: [ [ 0 0 0 0 ] [ 0 0 0 0 ] [ 0 0 0 0 ] [ 0 0
0 0 ] ], on /<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">The content within the
glusterfs filesystems is rather static with only minor
changes on it. This “self heal failed” is printed randomly
in the logs on the glusterfs client. It’s printed even at
moment where nothing has changed within the glusterfs
filesystem. When it is printed, its never on multiple
servers at the same time. What we also don’t understand :
the error indicates self heal failed on root “/”. In the
root of this glusterfs mount there only 2 folders and no
files are ever written at the root level.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Any thoughts?</span></p>
</div>
</blockquote>
<br>
From the logs, It looks like an older version of gluster , probably
3.5 . Please confirm your glusterfs version. The version is pretty
old and it may be moved End of Life. And this is AFR v1 , where the
latest stable version runs with AFRv2.<br>
<br>
So I would suggest you to upgrade to a later version may be 3.8 .<br>
<br>
If you still want to go with this version, I can give it a try. Let
me know the version, volume info and volume status. Still I will
suggest to upgrade ;)<br>
<br>
<br>
Regards<br>
Rafi KC<br>
<br>
<br>
<br>
<blockquote
cite="mid:BD35B08176463944A213E3C94AD3CEFE17FC1378@CPEMS-KPN510.KPNCNL.LOCAL"
type="cite">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://lists.gluster.org/mailman/listinfo/gluster-users">http://lists.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<br>
</body>
</html>