<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>I guess you're right aboug gfid, I got that:</p>
<p>[2017-07-07 07:35:15.197003] W [MSGID: 108008]
[afr-self-heal-name.c:354:afr_selfheal_name_gfid_mismatch_check]
0-applicatif-replicate-0: GFID mismatch for
<gfid:3fa785b5-4242-4816-a452-97da1a5e45c6>/snooper
b9222041-72dd-43a3-b0ab-4169dbd9a87f on applicatif-client-1 and
60056f98-20f8-4949-a4ae-81cc1a139147 on applicatif-client-0</p>
<p>Can you tell me how can I fix that ?If that helps I don't mind
deleting the whole folder snooper, I have backup.<br>
</p>
<p>Thanks.<br>
</p>
<br>
<div class="moz-cite-prefix">Le 07/07/2017 à 11:54, Ravishankar N a
écrit :<br>
</div>
<blockquote type="cite"
cite="mid:914645d5-28c3-752c-1396-a41e55de5019@redhat.com">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<div class="moz-cite-prefix">What does the mount log say when you
get the EIO error on snooper? Check if there is a gfid mismatch
on snooper directory or the files under it for all 3 bricks. In
any case the mount log or the glustershd.log of the 3 nodes for
the gfids you listed below should give you some idea on why the
files aren't healed.<br>
Thanks.<br>
<br>
On 07/07/2017 03:10 PM, Florian Leleu wrote:<br>
</div>
<blockquote
cite="mid:b53dd855-8ef4-aaf8-07e7-ba5ec889fad0@cognix-systems.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=windows-1252">
<p>Hi Ravi,</p>
<p>thanks for your answer, sure there you go:</p>
<p># gluster volume heal applicatif info<br>
Brick ipvr7.xxx:/mnt/gluster-applicatif/brick<br>
<gfid:e3b5ef36-a635-4e0e-bd97-d204a1f8e7ed> <br>
<gfid:f8030467-b7a3-4744-a945-ff0b532e9401> <br>
<gfid:def47b0b-b77e-4f0e-a402-b83c0f2d354b> <br>
<gfid:46f76502-b1d5-43af-8c42-3d833e86eb44> <br>
<gfid:d27a71d2-6d53-413d-b88c-33edea202cc2> <br>
<gfid:7e7f02b2-3f2d-41ff-9cad-cd3b5a1e506a> <br>
Status: Connected<br>
Number of entries: 6<br>
<br>
Brick ipvr8.xxx:/mnt/gluster-applicatif/brick<br>
<gfid:47ddf66f-a5e9-4490-8cd7-88e8b812cdbd> <br>
<gfid:8057d06e-5323-47ff-8168-d983c4a82475> <br>
<gfid:5b2ea4e4-ce84-4f07-bd66-5a0e17edb2b0> <br>
<gfid:baedf8a2-1a3f-4219-86a1-c19f51f08f4e> <br>
<gfid:8261c22c-e85a-4d0e-b057-196b744f3558> <br>
<gfid:842b30c1-6016-45bd-9685-6be76911bd98> <br>
<gfid:1fcaef0f-c97d-41e6-87cd-cd02f197bf38> <br>
<gfid:9d041c80-b7e4-4012-a097-3db5b09fe471> <br>
<gfid:ff48a14a-c1d5-45c6-a52a-b3e2402d0316> <br>
<gfid:01409b23-eff2-4bda-966e-ab6133784001> <br>
<gfid:c723e484-63fc-4267-b3f0-4090194370a0> <br>
<gfid:fb1339a8-803f-4e29-b0dc-244e6c4427ed> <br>
<gfid:056f3bba-6324-4cd8-b08d-bdf0fca44104> <br>
<gfid:a8f6d7e5-0ff2-4747-89f3-87592597adda> <br>
<gfid:3f6438a0-2712-4a09-9bff-d5a3027362b4> <br>
<gfid:392c8e2f-9da4-4af8-a387-bfdfea2f404e> <br>
<gfid:37e1edfd-9f58-4da3-8abe-819670c70906> <br>
<gfid:15b7cdb3-aae8-4ca5-b28c-e87a3e599c9b> <br>
<gfid:1d087e51-fb40-4606-8bb5-58936fb11a4c> <br>
<gfid:bb0352b9-4a5e-4075-9179-05c3a5766cf4> <br>
<gfid:40133fcf-a1fb-4d60-b169-e2355b66fb53> <br>
<gfid:00f75963-1b4a-4d75-9558-36b7d85bd30b> <br>
<gfid:2c0babdf-c828-475e-b2f5-0f44441fffdc> <br>
<gfid:bbeff672-43ef-48c9-a3a2-96264aa46152> <br>
<gfid:6c0969dd-bd30-4ba0-a7e5-ba4b3a972b9f> <br>
<gfid:4c81ea14-56f4-4b30-8fff-c088fe4b3dff> <br>
<gfid:1072cda3-53c9-4b95-992d-f102f6f87209> <br>
<gfid:2e8f9f29-78f9-4402-bc0c-e63af8cf77d6> <br>
<gfid:eeaa2765-44f4-4891-8502-5787b1310de2> <br>
Status: Connected<br>
Number of entries: 29<br>
<br>
Brick ipvr9.xxx:/mnt/gluster-applicatif/brick<br>
<gfid:e3b5ef36-a635-4e0e-bd97-d204a1f8e7ed> <br>
<gfid:f8030467-b7a3-4744-a945-ff0b532e9401> <br>
<gfid:def47b0b-b77e-4f0e-a402-b83c0f2d354b> <br>
<gfid:46f76502-b1d5-43af-8c42-3d833e86eb44> <br>
<gfid:d27a71d2-6d53-413d-b88c-33edea202cc2> <br>
<gfid:7e7f02b2-3f2d-41ff-9cad-cd3b5a1e506a> <br>
Status: Connected<br>
Number of entries: 6<br>
</p>
<br>
# gluster volume heal applicatif info split-brain<br>
Brick ipvr7.xxx:/mnt/gluster-applicatif/brick<br>
Status: Connected<br>
Number of entries in split-brain: 0<br>
<br>
Brick ipvr8.xxx:/mnt/gluster-applicatif/brick<br>
Status: Connected<br>
Number of entries in split-brain: 0<br>
<br>
Brick ipvr9.xxx:/mnt/gluster-applicatif/brick<br>
Status: Connected<br>
Number of entries in split-brain: 0<br>
<br>
Doesn't it seem odd that the first command give some different
output ?<br>
<br>
<div class="moz-cite-prefix">Le 07/07/2017 à 11:31, Ravishankar
N a écrit :<br>
</div>
<blockquote type="cite"
cite="mid:e4295115-8e0c-f007-966e-7c323f760ad7@redhat.com">
<meta content="text/html; charset=windows-1252"
http-equiv="Content-Type">
<div class="moz-cite-prefix">On 07/07/2017 01:23 PM, Florian
Leleu wrote:<br>
</div>
<blockquote
cite="mid:d3cd07eb-77c1-89ad-2f7e-f36b1d673041@cognix-systems.com"
type="cite">
<meta http-equiv="content-type" content="text/html;
charset=windows-1252">
<p>Hello everyone,</p>
<p>first time on the ML so excuse me if I'm not following
well the rules, I'll improve if I get comments.<br>
</p>
<p>We got one volume "applicatif" on three nodes (2 and 1
arbiter), each following command was made on node
ipvr8.xxx:</p>
<p># gluster volume info applicatif<br>
<br>
Volume Name: applicatif<br>
Type: Replicate<br>
Volume ID: ac222863-9210-4354-9636-2c822b332504<br>
Status: Started<br>
Snapshot Count: 0<br>
Number of Bricks: 1 x (2 + 1) = 3<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: ipvr7.xxx:/mnt/gluster-applicatif/brick<br>
Brick2: ipvr8.xxx:/mnt/gluster-applicatif/brick<br>
Brick3: ipvr9.xxx:/mnt/gluster-applicatif/brick (arbiter)<br>
Options Reconfigured:<br>
performance.read-ahead: on<br>
performance.cache-size: 1024MB<br>
performance.quick-read: off<br>
performance.stat-prefetch: on<br>
performance.io-cache: off<br>
transport.address-family: inet<br>
performance.readdir-ahead: on<br>
nfs.disable: off</p>
<p># gluster volume status applicatif<br>
Status of volume: applicatif<br>
Gluster process TCP Port RDMA
Port Online Pid<br>
------------------------------------------------------------------------------<br>
Brick ipvr7.xxx:/mnt/gluster-applicatif/<br>
brick 49154
0 Y 2814 <br>
Brick ipvr8.xxx:/mnt/gluster-applicatif/<br>
brick 49154
0 Y 2672 <br>
Brick ipvr9.xxx:/mnt/gluster-applicatif/<br>
brick 49154
0 Y 3424 <br>
NFS Server on localhost 2049
0 Y 26530<br>
Self-heal Daemon on localhost N/A
N/A Y 26538<br>
NFS Server on ipvr9.xxx 2049
0 Y 12238<br>
Self-heal Daemon on ipvr9.xxx N/A
N/A Y 12246<br>
NFS Server on ipvr7.xxx 2049
0 Y 2234 <br>
Self-heal Daemon on ipvr7.xxx N/A
N/A Y 2243 <br>
<br>
Task Status of Volume applicatif<br>
------------------------------------------------------------------------------<br>
There are no active volume tasks<br>
</p>
<p>The volume is mounted with autofs (nfs) in
/home/applicatif and one folder is "broken":</p>
<p>l /home/applicatif/services/<br>
ls: cannot access /home/applicatif/services/snooper:
Input/output error<br>
total 16<br>
lrwxrwxrwx 1 applicatif applicatif 9 Apr 6 15:53
config -> ../config<br>
lrwxrwxrwx 1 applicatif applicatif 7 Apr 6 15:54 .pwd
-> ../.pwd<br>
drwxr-xr-x 3 applicatif applicatif 4096 Apr 12 10:24
querybuilder<br>
d????????? ? ? ? ? ?
snooper<br>
drwxr-xr-x 3 applicatif applicatif 4096 Jul 6 02:57
snooper_new<br>
drwxr-xr-x 16 applicatif applicatif 4096 Jul 6 02:58
snooper_old<br>
drwxr-xr-x 4 applicatif applicatif 4096 Jul 4 23:45
ssnooper</p>
<p>I checked wether there was a heal, and it seems so:</p>
<p># gluster volume heal applicatif statistics heal-count<br>
Gathering count of entries to be healed on volume
applicatif has been successful <br>
<br>
Brick ipvr7.xxx:/mnt/gluster-applicatif/brick<br>
Number of entries: 8<br>
<br>
Brick ipvr8.xxx:/mnt/gluster-applicatif/brick<br>
Number of entries: 29<br>
<br>
Brick ipvr9.xxx:/mnt/gluster-applicatif/brick<br>
Number of entries: 8</p>
<p>But actually in the brick on each server the folder
"snooper" is fine.</p>
<p>I tried rebooting the servers, restarting gluster after
killing every process using it but it's not working.</p>
<p>Has anyone already experienced that ? Any help would be
nice.<br>
</p>
</blockquote>
<br>
Can you share the output of `gluster volume heal
<volname> info` and `gluster volume heal <volname>
info split-brain`? If the second command shows entries, please
also share the getfattr output from the bricks for these files
(getfattr -d -m . -e hex /brick/path/to/file).<br>
-Ravi<br>
<blockquote
cite="mid:d3cd07eb-77c1-89ad-2f7e-f36b1d673041@cognix-systems.com"
type="cite">
<p> </p>
<p>Thanks a lot !<br>
</p>
<div class="moz-signature">-- <br>
<table style="background: #fff; border-collapse: collapse;
border: 0; font-family: Arial, Verdana, Trebuchet MS;
font-size: 12px;" border="0" cellspacing="0"
cellpadding="0">
<tbody>
<tr>
<td colspan="6" style="font-size: 12px; font-weight:
normal; color: #2e2f34; font-family: Arial,
Verdana, Trebuchet MS;">
<p style="margin-top: 1em; margin-bottom: 1em;
font-size: 12px; font-weight: normal; color:
#2e2f34; font-family: Arial, Verdana, Trebuchet
MS;">Cordialement,<br>
<br>
</p>
</td>
</tr>
<tr>
<td style="color: white;" width="132" height="101"
valign="top"> <a moz-do-not-send="true"
href="http://www.cognix-systems.com/"
style="color: white; text-decoration: none;"> <img
src="cid:part1.7FF63D8B.F0BFCD08@cognix-systems.com" alt=""
style="display: block;" class=""> </a> </td>
<td width="12" height="101" valign="top"> </td>
<td height="101" valign="top">
<p style="margin-top: 0; margin-bottom: 1em;
font-family: Arial, Verdana, Trebuchet MS;
line-height: 1.3;"><span style="font-size: 14px;
font-weight: bold; color: #d48314;
font-family: Arial, Verdana, Trebuchet MS;">Florian
LELEU</span><br>
<span style="font-size: 12px; font-weight:
normal; color: #2e2f34; font-family: Arial,
Verdana, Trebuchet MS;">Responsable Hosting,
Cognix Systems</span></p>
<p style="margin-top: 1em; margin-bottom: 1em;
font-size: 12px; font-weight: normal; color:
#2e2f34; font-family: Arial, Verdana, Trebuchet
MS; line-height: 1.3;"><strong style="color:
#d48314; font-weight: bold;">Rennes</strong> <span
style="font-size: 12px; color: #d48314;
font-weight: normal; font-family: Arial,
Verdana, Trebuchet MS;">|</span> Brest <span
style="font-size: 12px; color: #d48314;
font-weight: normal; font-family: Arial,
Verdana, Trebuchet MS;">|</span> Saint-Malo <span
style="font-size: 12px; color: #d48314;
font-weight: normal; font-family: Arial,
Verdana, Trebuchet MS;">|</span> Paris<br>
<a moz-do-not-send="true"
href="mailto:florian.leleu@cognix-systems.com"
style="color: #d48314; font-weight: normal;
text-decoration: underline;"><span
style="color: #d48314; font-weight: normal;
text-decoration: underline;">florian.leleu@cognix-systems.com</span></a></p>
<p style="margin-top: 1em; margin-bottom: 0;
font-size: 12px; font-weight: normal; color:
#2e2f34; font-family: Arial, Verdana, Trebuchet
MS;"><span style="font-weight: bold;">Tél. :</span>
02 99 27 75 92</p>
</td>
<td width="12" height="101" valign="top"> </td>
<td style="border-left: 1px solid #eecda1;"
width="12" height="101" valign="top"> </td>
<td valign="top">
<div style="margin-bottom: 10px;"><a
moz-do-not-send="true"
href="https://www.facebook.com/cognix.systems/"
style="color: white; text-decoration: none;">
<img
src="cid:part4.C7DDADA6.DBB03C78@cognix-systems.com"
alt="Facebook Cognix Systems"
style="display: block;" class=""> </a></div>
<div style="margin-bottom: 10px;"><a
moz-do-not-send="true"
href="https://twitter.com/cognixsystems"
style="color: white; text-decoration: none;">
<img
src="cid:part6.D92060A8.6D46CA75@cognix-systems.com"
alt="Twitter Cognix Systems" style="display:
block;" class=""> </a></div>
<div style=""><a moz-do-not-send="true"
href="http://www.cognix-systems.com/"
style="color: white; text-decoration: none;">
<img
src="cid:part8.663A6990.E55A2734@cognix-systems.com"
alt="Logo Cognix Systems" style="display:
block;" class=""> </a></div>
</td>
</tr>
</tbody>
</table>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org" moz-do-not-send="true">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://lists.gluster.org/mailman/listinfo/gluster-users" moz-do-not-send="true">http://lists.gluster.org/mailman/listinfo/gluster-users</a></pre>
</blockquote>
<p><br>
</p>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<table style="background: #fff; border-collapse: collapse;
border: 0; font-family: Arial, Verdana, Trebuchet MS;
font-size: 12px;" border="0" cellspacing="0" cellpadding="0">
<tbody>
<tr>
<td colspan="6" style="font-size: 12px; font-weight:
normal; color: #2e2f34; font-family: Arial, Verdana,
Trebuchet MS;">
<p style="margin-top: 1em; margin-bottom: 1em;
font-size: 12px; font-weight: normal; color:
#2e2f34; font-family: Arial, Verdana, Trebuchet MS;">Cordialement,<br>
<br>
</p>
</td>
</tr>
<tr>
<td style="color: white;" width="132" height="101"
valign="top"> <a moz-do-not-send="true"
href="http://www.cognix-systems.com/" style="color:
white; text-decoration: none;"> <img
src="cid:part1.7FF63D8B.F0BFCD08@cognix-systems.com"
alt="" style="display: block;" class=""> </a> </td>
<td width="12" height="101" valign="top"> </td>
<td height="101" valign="top">
<p style="margin-top: 0; margin-bottom: 1em;
font-family: Arial, Verdana, Trebuchet MS;
line-height: 1.3;"><span style="font-size: 14px;
font-weight: bold; color: #d48314; font-family:
Arial, Verdana, Trebuchet MS;">Florian LELEU</span><br>
<span style="font-size: 12px; font-weight: normal;
color: #2e2f34; font-family: Arial, Verdana,
Trebuchet MS;">Responsable Hosting, Cognix Systems</span></p>
<p style="margin-top: 1em; margin-bottom: 1em;
font-size: 12px; font-weight: normal; color:
#2e2f34; font-family: Arial, Verdana, Trebuchet MS;
line-height: 1.3;"><strong style="color: #d48314;
font-weight: bold;">Rennes</strong> <span
style="font-size: 12px; color: #d48314;
font-weight: normal; font-family: Arial, Verdana,
Trebuchet MS;">|</span> Brest <span
style="font-size: 12px; color: #d48314;
font-weight: normal; font-family: Arial, Verdana,
Trebuchet MS;">|</span> Saint-Malo <span
style="font-size: 12px; color: #d48314;
font-weight: normal; font-family: Arial, Verdana,
Trebuchet MS;">|</span> Paris<br>
<a moz-do-not-send="true"
href="mailto:florian.leleu@cognix-systems.com"
style="color: #d48314; font-weight: normal;
text-decoration: underline;"><span style="color:
#d48314; font-weight: normal; text-decoration:
underline;">florian.leleu@cognix-systems.com</span></a></p>
<p style="margin-top: 1em; margin-bottom: 0;
font-size: 12px; font-weight: normal; color:
#2e2f34; font-family: Arial, Verdana, Trebuchet MS;"><span
style="font-weight: bold;">Tél. :</span> 02 99 27
75 92</p>
</td>
<td width="12" height="101" valign="top"> </td>
<td style="border-left: 1px solid #eecda1;" width="12"
height="101" valign="top"> </td>
<td valign="top">
<div style="margin-bottom: 10px;"><a
moz-do-not-send="true"
href="https://www.facebook.com/cognix.systems/"
style="color: white; text-decoration: none;"> <img
src="cid:part4.C7DDADA6.DBB03C78@cognix-systems.com" alt="Facebook
Cognix Systems" style="display: block;" class="">
</a></div>
<div style="margin-bottom: 10px;"><a
moz-do-not-send="true"
href="https://twitter.com/cognixsystems"
style="color: white; text-decoration: none;"> <img
src="cid:part6.D92060A8.6D46CA75@cognix-systems.com" alt="Twitter Cognix
Systems" style="display: block;" class=""> </a></div>
<div style=""><a moz-do-not-send="true"
href="http://www.cognix-systems.com/"
style="color: white; text-decoration: none;"> <img
src="cid:part8.663A6990.E55A2734@cognix-systems.com" alt="Logo Cognix
Systems" style="display: block;" class=""> </a></div>
</td>
</tr>
</tbody>
</table>
</div>
</blockquote>
<p><br>
</p>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<table style="background: #fff; border-collapse: collapse; border:
0; font-family: Arial, Verdana, Trebuchet MS; font-size: 12px;"
border="0" cellspacing="0" cellpadding="0">
<tbody>
<tr>
<td colspan="6" style="font-size: 12px; font-weight: normal;
color: #2e2f34; font-family: Arial, Verdana, Trebuchet
MS;">
<p style="margin-top: 1em; margin-bottom: 1em; font-size:
12px; font-weight: normal; color: #2e2f34; font-family:
Arial, Verdana, Trebuchet MS;">Cordialement,<br>
<br>
</p>
</td>
</tr>
<tr>
<td style="color: white;" width="132" height="101"
valign="top"> <a href="http://www.cognix-systems.com/"
style="color: white; text-decoration: none;"> <img
src="cid:part21.B76A8FC6.08519EA4@cognix-systems.com"
alt="" style="display: block;"> </a> </td>
<td width="12" height="101" valign="top"> </td>
<td height="101" valign="top">
<p style="margin-top: 0; margin-bottom: 1em; font-family:
Arial, Verdana, Trebuchet MS; line-height: 1.3;"><span
style="font-size: 14px; font-weight: bold; color:
#d48314; font-family: Arial, Verdana, Trebuchet MS;">Florian
LELEU</span><br>
<span style="font-size: 12px; font-weight: normal;
color: #2e2f34; font-family: Arial, Verdana, Trebuchet
MS;">Responsable Hosting, Cognix Systems</span></p>
<p style="margin-top: 1em; margin-bottom: 1em; font-size:
12px; font-weight: normal; color: #2e2f34; font-family:
Arial, Verdana, Trebuchet MS; line-height: 1.3;"><strong
style="color: #d48314; font-weight: bold;">Rennes</strong> <span
style="font-size: 12px; color: #d48314; font-weight:
normal; font-family: Arial, Verdana, Trebuchet MS;">|</span> Brest <span
style="font-size: 12px; color: #d48314; font-weight:
normal; font-family: Arial, Verdana, Trebuchet MS;">|</span> Saint-Malo <span
style="font-size: 12px; color: #d48314; font-weight:
normal; font-family: Arial, Verdana, Trebuchet MS;">|</span> Paris<br>
<a href="mailto:florian.leleu@cognix-systems.com"
style="color: #d48314; font-weight: normal;
text-decoration: underline;"><span style="color:
#d48314; font-weight: normal; text-decoration:
underline;">florian.leleu@cognix-systems.com</span></a></p>
<p style="margin-top: 1em; margin-bottom: 0; font-size:
12px; font-weight: normal; color: #2e2f34; font-family:
Arial, Verdana, Trebuchet MS;"><span style="font-weight:
bold;">Tél. :</span> 02 99 27 75 92</p>
</td>
<td width="12" height="101" valign="top"> </td>
<td style="border-left: 1px solid #eecda1;" width="12"
height="101" valign="top"> </td>
<td valign="top">
<div style="margin-bottom: 10px;"><a
href="https://www.facebook.com/cognix.systems/"
style="color: white; text-decoration: none;"> <img
src="cid:part4.C7DDADA6.DBB03C78@cognix-systems.com"
alt="Facebook Cognix Systems" style="display:
block;"> </a></div>
<div style="margin-bottom: 10px;"><a
href="https://twitter.com/cognixsystems" style="color:
white; text-decoration: none;"> <img
src="cid:part6.D92060A8.6D46CA75@cognix-systems.com"
alt="Twitter Cognix Systems" style="display: block;">
</a></div>
<div style=""><a href="http://www.cognix-systems.com/"
style="color: white; text-decoration: none;"> <img
src="cid:part8.663A6990.E55A2734@cognix-systems.com"
alt="Logo Cognix Systems" style="display: block;"> </a></div>
</td>
</tr>
</tbody>
</table>
</div>
</body>
</html>