<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
</head>
<body dir="ltr">
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif;" dir="ltr">
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<p>Hi community,</p>
<p>we ran an extensive issue on our installation of gluster 3.10, which we did upgraded from 3.8.8 (it's a distribute+replicate, 5 nodes, 3 bricks in replica 2+1 quorum); recently we noticed a frequent issue where files get duplicated on the some of the directories;
this is visible on the fuse mount points (RW), but not on the NFS/Ganesha (RO) mount points.</p>
<p><br>
</p>
<p>A sample of an ll output:</p>
<p><br>
</p>
<p></p>
<div>---------T 1 48 web_rw 0 Mar 10 11:57 paginazione.shtml</div>
<div>-rw-rw-r-- 1 48 web_rw 272 Feb 18 22:00 paginazione.shtml</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<br>
</div>
As you can see, the file is listed twice, but only one of the two is good (the name is identical, we verified that no spurious/hidden characters are present in the name); the issue maybe is related on how we uploaded the files on the file system, via incremental
rsync on the fuse mount.</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<br>
</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
Do anyone have suggestion on how it can happen, how to solve existing duplication or how to prevent to happen anymore.</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<br>
</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
Thanks in advance.</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
Best regards,</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
andrea</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<br>
</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<div>Options Reconfigured:</div>
<div>performance.cache-invalidation: true</div>
<div>cluster.favorite-child-policy: mtime</div>
<div>features.cache-invalidation: 1</div>
<div>network.inode-lru-limit: 90000</div>
<div>performance.cache-size: 1024MB</div>
<div>storage.linux-aio: on</div>
<div>nfs.outstanding-rpc-limit: 64</div>
<div>storage.build-pgfid: on</div>
<div>cluster.server-quorum-type: server</div>
<div>cluster.self-heal-daemon: enable</div>
<div>performance.nfs.io-cache: on</div>
<div>performance.client-io-threads: on</div>
<div>performance.nfs.stat-prefetch: on</div>
<div>performance.nfs.io-threads: on</div>
<div>diagnostics.latency-measurement: on</div>
<div>diagnostics.count-fop-hits: on</div>
<div>performance.md-cache-timeout: 1</div>
<div>performance.io-thread-count: 16</div>
<div>performance.high-prio-threads: 32</div>
<div>performance.normal-prio-threads: 32</div>
<div>performance.low-prio-threads: 32</div>
<div>performance.least-prio-threads: 1</div>
<div>nfs.acl: off</div>
<div>nfs.rpc-auth-unix: off</div>
<div>diagnostics.client-log-level: ERROR</div>
<div>diagnostics.brick-log-level: ERROR</div>
<div>cluster.lookup-unhashed: auto</div>
<div>performance.nfs.quick-read: on</div>
<div>performance.nfs.read-ahead: on</div>
<div>cluster.quorum-type: auto</div>
<div>cluster.locking-scheme: granular</div>
<div>cluster.data-self-heal-algorithm: full</div>
<div>transport.address-family: inet</div>
<div>performance.readdir-ahead: on</div>
<div>nfs.disable: on</div>
<div>cluster.lookup-optimize: on</div>
<div>cluster.readdir-optimize: on</div>
<div>performance.read-ahead: off</div>
<div>performance.write-behind-window-size: 1MB</div>
<div>client.event-threads: 4</div>
<div>server.event-threads: 16</div>
<div>cluster.granular-entry-heal: enable</div>
<div>performance.parallel-readdir: on</div>
<div>cluster.server-quorum-ratio: 51</div>
</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<br>
</div>
<div id="divtagdefaultwrapper" dir="ltr" style="font-size:12pt; color:#000000; font-family:Calibri,Arial,Helvetica,sans-serif">
<p><br>
</p>
<p><br>
</p>
<div id="Signature"><span style="color:rgb(34,34,34); font-family:arial,sans-serif; font-size:13px">Andrea Fogazzi</span><br style="color:rgb(34,34,34); font-family:arial,sans-serif; font-size:13px">
<br>
<div><span style="color:rgb(34,34,34); font-family:arial,sans-serif; font-size:13px"></span></div>
</div>
</div>
</div>
</body>
</html>