<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Heal does never finish on disperse 1 x (2 + 1) volume gv0.
Something seems to be wrong with a shard? Help and explanation
appreciated!</p>
<p><br>
</p>
<p><b>gstatus</b></p>
<p>Cluster:<br>
Status: Healthy GlusterFS: 10.1<br>
Nodes: 3/3 Volumes: 1/1<br>
<br>
Volumes: <br>
<br>
gv0<br>
Disperse Started (UP) - 3/3 Bricks Up <br>
Capacity: (74.76% used) 648.00
GiB/867.00 GiB (used/total)<br>
Self-Heal:<br>
armc1m1.net.innostus.com:/export/nvme0n1p3/brick (1 File(s) to
heal).<br>
armc1m3.net.innostus.com:/export/nvme0n1p3/brick (1 File(s) to
heal).</p>
<p></p>
<p><b>gluster volume info gv0</b> <br>
Volume Name: gv0<br>
Type: Disperse<br>
Volume ID: d511c58e-45a0-4829-b41d-fb98885e6cf5<br>
Status: Started<br>
Snapshot Count: 0<br>
Number of Bricks: 1 x (2 + 1) = 3<br>
Transport-type: tcp<br>
Bricks:<br>
Brick1: armc1m1.net.innostus.com:/export/nvme0n1p3/brick<br>
Brick2: armc1m2.net.innostus.com:/export/nvme0n1p3/brick<br>
Brick3: armc1m3.net.innostus.com:/export/nvme0n1p3/brick<br>
Options Reconfigured:<br>
storage.build-pgfid: on<br>
cluster.use-anonymous-inode: yes<br>
features.shard: on<br>
storage.fips-mode-rchecksum: on<br>
transport.address-family: inet<br>
nfs.disable: on<br>
features.scrub: Active<br>
features.bitrot: on<br>
features.cache-invalidation: on<br>
features.cache-invalidation-timeout: 600<br>
performance.stat-prefetch: on<br>
performance.cache-invalidation: on<br>
performance.md-cache-timeout: 600<br>
network.inode-lru-limit: 200000<br>
performance.cache-samba-metadata: on<br>
performance.readdir-ahead: on<br>
performance.parallel-readdir: on<br>
performance.nl-cache: on<br>
performance.nl-cache-timeout: 600<br>
performance.nl-cache-positive-entry: on<br>
performance.quick-read: off<br>
performance.read-ahead: off<br>
performance.io-cache: off<br>
performance.low-prio-threads: 32<br>
network.remote-dio: disable<br>
performance.strict-o-direct: on<br>
cluster.eager-lock: enable<br>
cluster.quorum-type: auto<br>
cluster.server-quorum-type: server<br>
cluster.data-self-heal-algorithm: full<br>
cluster.locking-scheme: granular<br>
cluster.shd-wait-qlength: 10000<br>
user.cifs: off<br>
cluster.choose-local: off<br>
client.event-threads: 4<br>
server.event-threads: 4<br>
performance.client-io-threads: on<br>
network.ping-timeout: 20<br>
server.tcp-user-timeout: 20<br>
server.keepalive-time: 10<br>
server.keepalive-interval: 2<br>
server.keepalive-count: 5<br>
cluster.lookup-optimize: off</p>
<p><b>gluster volume heal gv0 info</b></p>
<p>Brick armc1m1.net.innostus.com:/export/nvme0n1p3/brick<br>
/.shard/37307871-a4b9-4492-9523-4c8446d0d163.27 <br>
Status: Connected<br>
Number of entries: 1<br>
<br>
Brick armc1m2.net.innostus.com:/export/nvme0n1p3/brick<br>
Status: Connected<br>
Number of entries: 0<br>
<br>
Brick armc1m3.net.innostus.com:/export/nvme0n1p3/brick<br>
<gfid:c348cefd-1cfe-442a-899e-9302f907f9e2> <br>
Status: Connected<br>
Number of entries: 1</p>
<p><b>root@armc1m1:~# getfattr -d -m . -e hex
/export/nvme0n1p3/brick/.shard/37307871-a4b9-4492-9523-4c8446d0d163.27</b><br>
getfattr: Removing leading '/' from absolute path names<br>
# file:
export/nvme0n1p3/brick/.shard/37307871-a4b9-4492-9523-4c8446d0d163.27<br>
trusted.bit-rot.version=0x0400000000000000644f8e31000ec56c<br>
trusted.ec.config=0x0000080301000200<br>
trusted.ec.dirty=0x00000000000000510000000000000051<br>
trusted.ec.size=0x0000000004000000<br>
trusted.ec.version=0x00000000000001050000000000000105<br>
trusted.gfid=0xc348cefd1cfe442a899e9302f907f9e2<br>
trusted.gfid2path.417a2b73213425c1=0x62653331383633382d653861302d346336642d393737642d3761393337616138343830362f33373330373837312d613462392d343439322d393532332d3463383434366430643136332e3237<br>
trusted.glusterfs.mdata=0x01000000000000000000000000644bd9f0000000001be65cb300000000644bd9f0000000001be65cb300000000644b7fcc000000001c12b5cd<br>
trusted.pgfid.be318638-e8a0-4c6d-977d-7a937aa84806=0x00000001</p>
<p><b>root@armc1m2:~# getfattr -d -m . -e hex
/export/nvme0n1p3/brick/.shard/37307871-a4b9-4492-9523-4c8446d0d163.27</b><br>
getfattr: Removing leading '/' from absolute path names<br>
# file:
export/nvme0n1p3/brick/.shard/37307871-a4b9-4492-9523-4c8446d0d163.27<br>
trusted.ec.config=0x0000080301000200<br>
trusted.ec.size=0x0000000000000000<br>
trusted.ec.version=0x00000000000000000000000000000000<br>
trusted.gfid=0x1e63467f038d47688e76bd808ecdccd0<br>
trusted.gfid2path.417a2b73213425c1=0x62653331383633382d653861302d346336642d393737642d3761393337616138343830362f33373330373837312d613462392d343439322d393532332d3463383434366430643136332e3237<br>
trusted.glusterfs.mdata=0x01000000000000000000000000644b7fcc000000001c12b5cd00000000644b7fcc000000001c12b5cd00000000644b7fcc000000001c12b5cd<br>
trusted.pgfid.be318638-e8a0-4c6d-977d-7a937aa84806=0x00000001</p>
<p><b>root@armc1m3:~# getfattr -d -m . -e hex
/export/nvme0n1p3/brick/.shard/37307871-a4b9-4492-9523-4c8446d0d163.27</b><br>
getfattr:
/export/nvme0n1p3/brick/.shard/37307871-a4b9-4492-9523-4c8446d0d163.27:
No such file or directory</p>
<p><br>
</p>
<p>Kind regards,</p>
<br>
<div class="moz-signature">-- <br>
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
<style>
.logo {
aspect-ratio: 1920/339;
width: 100%;
height: auto;
fill: black;
}
.logo > .logo-leaf {
fill: #34B317;
}
</style>
<table style="width: 480px; font-size: 10pt; font-family: Arial,
sans-serif; line-height:normal;" cellspacing="0" cellpadding="0">
<tbody>
<tr>
<td style="padding-top:10px; padding-bottom:12px;
width:260px; vertical-align:top" valign="top"> <a
href="https://www.innostus.com/" target="_blank">
<svg class="logo" viewBox="0 0 1920 339" width="1920"
height="339">
<path d="m0,0h54.75v333.81H0V0Z"></path>
<path
d="m305.03,185.88c0-48.51-26.42-73.49-66.28-73.49s-66.76,24.98-66.76,73.49v147.94h-54.75V69.16h54.75v30.26c17.77-21.61,47.07-34.58,78.77-34.58,61.96,0,108.55,38.91,108.55,112.87v156.1h-54.28v-147.94Z"></path>
<path
d="m605.97,185.88c0-48.51-26.41-73.49-66.28-73.49s-66.76,24.98-66.76,73.49v147.94h-54.75V69.16h54.75v30.26c17.77-21.61,47.07-34.58,78.77-34.58,61.96,0,108.55,38.91,108.55,112.87v156.1h-54.28v-147.94Z"></path>
<path class="logo-leaf"
d="m816.15,205.72c-59.43-27.11-84.13-58.34-94.36-78.5-65.24,116.64,38.61,249.05,164.48,202.04-4.81-43.33-20.77-101.03-70.12-123.54Z"></path>
<path
d="m837.5,64.84c-43.82,0-82.25,18.03-106.79,49.41l3.41,6.72c7.4,14.59,18.8,27.23,31.76,38.04,12.91-31.37,40.64-46.62,70.66-46.62,40.83,0,79.73,28.82,79.73,88.86,0,32.13-11.56,55.45-28.56,70.19,5.2,14.76,9.28,32.04,11.78,52.2,43.41-21.28,72.97-64.79,72.97-122.39,0-83.1-59.56-136.41-134.97-136.41Z"></path>
<path
d="m1111.45,338.14c-63.4,0-108.07-37.46-110.47-85.49h56.67c1.92,21.61,22.57,39.38,52.83,39.38s48.51-13.45,48.51-31.7c0-51.87-153.7-22.09-153.7-119.12,0-42.27,39.38-76.37,101.83-76.37s99.42,32.18,102.31,85.02h-54.75c-1.92-23.05-19.69-38.91-49.47-38.91s-44.67,12.01-44.67,29.78c0,53.31,149.38,23.53,152.26,119.12,0,44.67-38.91,78.29-101.34,78.29Z"></path>
<path
d="m1266.62,113.83h-31.22v-44.67h31.22V3.36h55.23v65.8h64.36v44.67h-64.36v146.49c0,19.69,7.69,27.86,30.74,27.86h33.62v45.63h-43.23c-47.07,0-76.37-19.69-76.37-73.49V113.83Z"></path>
<path
d="m1661.38,333.81h-54.76v-31.7c-17.29,22.57-47.07,35.54-78.29,35.54-61.96,0-109.03-38.91-109.03-112.87V69.16h54.28v147.45c0,48.51,26.42,73.49,66.28,73.49s66.76-24.97,66.76-73.49V69.16h54.76v264.65Z"></path>
<path
d="m1818.65,338.14c-63.4,0-108.07-37.46-110.47-85.49h56.68c1.92,21.61,22.57,39.38,52.83,39.38s48.51-13.45,48.51-31.7c0-51.87-153.7-22.09-153.7-119.12,0-42.27,39.38-76.37,101.83-76.37s99.42,32.18,102.31,85.02h-54.75c-1.92-23.05-19.69-38.91-49.47-38.91s-44.67,12.01-44.67,29.78c0,53.31,149.38,23.53,152.26,119.12,0,44.67-38.91,78.29-101.35,78.29Z"></path></svg></a>
<br>
</td>
<td style="padding-top:6px; padding-bottom:6px; width:320px;
">
<table cellspacing="0" cellpadding="0">
<tbody>
<tr>
<td style="font-size: 12pt; font-family: Arial,
sans-serif; font-weight: bold; color: #3d3c3f;"><span
style="font-family: Arial, sans-serif;
color:#3d3c3f">Arnold Boer</span> </td>
</tr>
<tr>
<td style="font-size: 10pt; font-family: Arial,
sans-serif; color: #9b9b9b;"><span
style="font-family: Arial, sans-serif;
color:#9b9b9b">tel: 06-24499722</span></td>
</tr>
<tr>
<td style="font-size: 10pt; font-family: Arial,
sans-serif; color: #9b9b9b;"><span
style="font-family: Arial, sans-serif;
color:#9b9b9b">email: </span><span
style="font-family: Arial, sans-serif;
color:#1793d2;"><span style="font-family: Arial,
sans-serif; color:#1793d2"><a class="moz-txt-link-abbreviated" href="mailto:arnold@innostus.com">arnold@innostus.com</a></span></span></td>
</tr>
<tr>
<td style="font-size: 10pt; font-family: Arial,
sans-serif; color: #9b9b9b;"><span
style="font-family: Arial, sans-serif;
color:#9b9b9b">Verlengde Vaart NZ 124</span></td>
</tr>
<tr>
<td style="font-size: 10pt; font-family: Arial,
sans-serif; color: #9b9b9b;"><span
style="font-family: Arial, sans-serif;
color:#9b9b9b">7887EK, Erica</span></td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</div>
</body>
</html>