That doesn't clarify anything.<div id="yMail_cursorElementTracker_1641340452912">I can mount my GlusterFS brick on a VM, or I can mount the volume via the FUSE .</div><div id="yMail_cursorElementTracker_1641340488199">If you have the first, then ensure you don't have double I/O queueing (set the I/O scheduler to noop/none).</div><div id="yMail_cursorElementTracker_1641340529347"><br></div><div id="yMail_cursorElementTracker_1641340529517">Also, you will need to profile your volume to get a clear picture when your volume is having troubles.</div><div id="yMail_cursorElementTracker_1641340563252"><br></div><div id="yMail_cursorElementTracker_1641340583651">Having a lot of event-threads could lead to locking contention, so try with smaller numbers first.</div><div id="yMail_cursorElementTracker_1641340622942"><br></div><div id="yMail_cursorElementTracker_1641341025608">Also, ensure setting sane 'dirty' sysctl tunables, the maximum MTU possible and also test by disabling <span style="background-color: rgb(245, 245, 245); color: rgb(37, 37, 37); font-family: Consolas, Monaco, "Andale Mono", monospace; font-size: 14.4px; white-space: pre-wrap;" id="yMail_cursorElementTracker_1641341005243">Large Receive Offload (LRO)</span></div><div id="yMail_cursorElementTracker_1641340623163"><span style="background-color: rgb(245, 245, 245); color: rgb(37, 37, 37); font-family: Consolas, Monaco, "Andale Mono", monospace; font-size: 14.4px; white-space: pre-wrap;" id="yMail_cursorElementTracker_1641341020988"><br></span></div><div id="yMail_cursorElementTracker_1641340623163"><span style="background-color: rgb(245, 245, 245); color: rgb(37, 37, 37); font-family: Consolas, Monaco, "Andale Mono", monospace; font-size: 14.4px; white-space: pre-wrap;" id="yMail_cursorElementTracker_1641341021168"><br></span></div><div id="yMail_cursorElementTracker_1641341024377">Best Regards,<br></div><div id="yMail_cursorElementTracker_1641341039765">Strahil Nikolov</div><div id="yMail_cursorElementTracker_1641340563471"> <br> <blockquote style="margin: 0 0 20px 0;"> <div style="font-family:Roboto, sans-serif; color:#6D00F6;"> <div>On Fri, Dec 17, 2021 at 22:50, Erik Frangež</div><div><erik@frangez.net> wrote:</div> </div> <div style="padding: 10px 0 0 20px; margin: 10px 0 0 0; border-left: 1px solid #6D00F6;"> <div id="yiv5835891221"><style><!--
#yiv5835891221  
 _filtered {}
 _filtered {}
 _filtered {}
 _filtered {}
 _filtered {}
 _filtered {}
#yiv5835891221  
#yiv5835891221 p.yiv5835891221MsoNormal, #yiv5835891221 li.yiv5835891221MsoNormal, #yiv5835891221 div.yiv5835891221MsoNormal
        {margin:0cm;font-size:11.0pt;font-family:"Calibri", sans-serif;}
#yiv5835891221 a:link, #yiv5835891221 span.yiv5835891221MsoHyperlink
        {color:blue;text-decoration:underline;}
#yiv5835891221 p.yiv5835891221p1, #yiv5835891221 li.yiv5835891221p1, #yiv5835891221 div.yiv5835891221p1
        {margin-right:0cm;margin-left:0cm;font-size:11.0pt;font-family:"Calibri", sans-serif;}
#yiv5835891221 p.yiv5835891221msonormal, #yiv5835891221 li.yiv5835891221msonormal, #yiv5835891221 div.yiv5835891221msonormal
        {margin-right:0cm;margin-left:0cm;font-size:11.0pt;font-family:"Calibri", sans-serif;}
#yiv5835891221 span.yiv5835891221s1
        {}
#yiv5835891221 span.yiv5835891221EmailStyle29
        {font-family:"Tahoma", sans-serif;color:windowtext;}
#yiv5835891221 .yiv5835891221MsoChpDefault
        {font-size:10.0pt;}
 _filtered {}
#yiv5835891221 div.yiv5835891221WordSection1
        {}
--></style><div><div class="yiv5835891221WordSection1"><p class="yiv5835891221MsoNormal"><span lang="SL" style="font-family:sans-serif;">Hi,</span></p><p class="yiv5835891221MsoNormal"><span lang="SL" style="font-family:sans-serif;">  </span></p><p class="yiv5835891221MsoNormal"><span lang="SL" style="font-family:sans-serif;">We are using Gluster as a mounted storage on VM. We mount it in /etc/fstab as glusterfs disk.</span></p><p class="yiv5835891221MsoNormal"><span lang="SL" style="font-family:sans-serif;">  </span></p><p class="yiv5835891221MsoNormal"><span lang="SL" style="font-family:sans-serif;">Thank you for help!</span></p><p class="yiv5835891221MsoNormal"><span lang="SL" style="font-family:sans-serif;">  </span></p><p class="yiv5835891221MsoNormal"><span lang="SL" style="font-family:sans-serif;">Best, Erik</span></p><p class="yiv5835891221MsoNormal"><span style="font-family:sans-serif;">  </span></p><div id="yiv5835891221yqt46251" class="yiv5835891221yqt4639237713"><div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm;"><p class="yiv5835891221MsoNormal"><b><span style="font-size:12.0pt;color:black;">From: </span></b><span style="font-size:12.0pt;color:black;">Strahil Nikolov <hunter86_bg@yahoo.com><br clear="none"><b>Date: </b>Thursday, 16 December 2021 at 23:04<br clear="none"><b>To: </b><gluster-users@gluster.org>, Erik Frangež <erik@frangez.net><br clear="none"><b>Subject: </b>Re: [Gluster-users] Gluster speed</span></p></div><div><p class="yiv5835891221MsoNormal">  </p></div><div><p class="yiv5835891221MsoNormal">Are you using Gluster as VM Disk storage or you use Gluster as App storage via the FUSE client ?<br clear="none"><br clear="none">Best Regards,<br clear="none">Strahil Nikolov</p></div><div style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-top:7.5pt;"><div><div><p class="yiv5835891221MsoNormal"><span style="font-size:10.0pt;color:#26282A;">В сряда, 15 декември 2021 г., 17:23:10 Гринуич+2, Erik Frangež <erik@frangez.net> написа: </span></p></div><div><p class="yiv5835891221MsoNormal"><span style="font-size:10.0pt;color:#26282A;">  </span></p></div><div><p class="yiv5835891221MsoNormal"><span style="font-size:10.0pt;color:#26282A;">  </span></p></div><div><div id="yiv5835891221"><div><div><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;">Hello guys,</span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;"> </span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;">I have set up 3 vm and combine them with GlusterFS which will be used as a MoodleData location. </span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;"> </span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;">On all web servers there is mounted glusterFS volume. Configuration of GlusterFS is not very twicked, its here:</span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;"> </span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Volume Name: gv0</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Type: Replicate</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Volume ID: e301ec6b-a051-47a1-ab55-4b201325629b</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Status: Started</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Snapshot Count: 0</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Number of Bricks: 1 x 3 = 3</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Transport-type: tcp</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Bricks:</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Brick1: </span></span><span class="yiv5835891221s1"><span lang="SL" style="font-size:10.0pt;color:#26282A;">vm1</span></span><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">:/data/gluster/gv0</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Brick2: </span></span><span class="yiv5835891221s1"><span lang="SL" style="font-size:10.0pt;color:#26282A;">vm2</span></span><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">:/data/gluster/gv0</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Brick3: </span></span><span class="yiv5835891221s1"><span lang="SL" style="font-size:10.0pt;color:#26282A;">vm3:</span></span><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">/data/gluster/gv0</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">Options Reconfigured:</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">server.event-threads: 8</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;" id="yMail_cursorElementTracker_1641340575010">client.event-threads: 8</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">performance.readdir-ahead: on</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">performance.write-behind-window-size: 8MB</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">performance.io-thread-count: 8</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">performance.cache-size: 2GB</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">performance.client-io-threads: off</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">nfs.disable: on</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">transport.address-family: inet</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">storage.fips-mode-rchecksum: on</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221p1"><span class="yiv5835891221s1"><span style="font-size:10.0pt;color:#26282A;">cluster.granular-entry-heal: on</span></span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;"> </span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;">Whan we accessing our Moodle is (in time of loading course) very slow – the time when GlusterFS searching and publishing data.</span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;"> </span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;">Please help me to speed up Gluster.</span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;"> </span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;">Thank you!</span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;"> </span><span style="font-size:10.0pt;color:#26282A;"></span></p><p class="yiv5835891221msonormal"><span lang="SL" style="font-size:10.0pt;font-family:sans-serif;color:#26282A;">Best, Erik</span><span style="font-size:10.0pt;color:#26282A;"></span></p></div></div></div><p class="yiv5835891221MsoNormal"><span style="font-size:10.0pt;color:#26282A;">________<br clear="none"><br clear="none"><br clear="none"><br clear="none">Community Meeting Calendar:<br clear="none"><br clear="none">Schedule -<br clear="none">Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC<br clear="none">Bridge: <a rel="nofollow noopener noreferrer" shape="rect" target="_blank" href="https://meet.google.com/cpu-eiue-hvk">https://meet.google.com/cpu-eiue-hvk</a><br clear="none">Gluster-users mailing list<br clear="none"><a rel="nofollow noopener noreferrer" shape="rect" ymailto="mailto:Gluster-users@gluster.org" target="_blank" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br clear="none"><a rel="nofollow noopener noreferrer" shape="rect" target="_blank" href="https://lists.gluster.org/mailman/listinfo/gluster-users">https://lists.gluster.org/mailman/listinfo/gluster-users</a></span></p></div></div></div></div></div></div></div> </div> </blockquote></div>