<div dir="auto"><div data-smartmail="gmail_signature" dir="auto"><br></div><br><div class="gmail_quote" dir="auto"><div dir="ltr" class="gmail_attr">On Wed, Jan 26, 2022, 7:02 AM <<a href="mailto:gluster-users-request@gluster.org">gluster-users-request@gluster.org</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Send Gluster-users mailing list submissions to<br>
<a href="mailto:gluster-users@gluster.org" target="_blank" rel="noreferrer">gluster-users@gluster.org</a><br>
<br>
To subscribe or unsubscribe via the World Wide Web, visit<br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
or, via email, send a message with subject or body 'help' to<br>
<a href="mailto:gluster-users-request@gluster.org" target="_blank" rel="noreferrer">gluster-users-request@gluster.org</a><br>
<br>
You can reach the person managing the list at<br>
<a href="mailto:gluster-users-owner@gluster.org" target="_blank" rel="noreferrer">gluster-users-owner@gluster.org</a><br>
<br>
When replying, please edit your Subject line so it is more specific<br>
than "Re: Contents of Gluster-users digest..."<br>
<br>
<br>
Today's Topics:<br>
<br>
1. Re: Is such level of performance degradation to be expected?<br>
(Strahil Nikolov)<br>
<br>
<br>
----------------------------------------------------------------------<br>
<br>
Message: 1<br>
Date: Wed, 26 Jan 2022 06:01:03 +0000 (UTC)<br>
From: Strahil Nikolov <<a href="mailto:hunter86_bg@yahoo.com" target="_blank" rel="noreferrer">hunter86_bg@yahoo.com</a>><br>
To: <a href="mailto:mygluster22@eml.cc" target="_blank" rel="noreferrer">mygluster22@eml.cc</a>, <a href="mailto:gluster-users@gluster.org" target="_blank" rel="noreferrer">gluster-users@gluster.org</a><br>
Subject: Re: [Gluster-users] Is such level of performance degradation<br>
to be expected?<br>
Message-ID: <<a href="mailto:1298200402.1061411.1643176863994@mail.yahoo.com" target="_blank" rel="noreferrer">1298200402.1061411.1643176863994@mail.yahoo.com</a>><br>
Content-Type: text/plain; charset="utf-8"<br>
<br>
Well,<br>
the idea of mentioning all these is to point out that you missed the basics of setting up GlusterFS and you should start from scratch.<br>
Synthetic benchmarks are useless as you need to test with your workload. When you don't get what you need -> the next step is profiling and tuning. Profiling will be useless for synthetics...<br>
I guess you didn't notice that you can control the ammount of server and client threads. Too few and performance will be low, too much and contention locking occurs. Sharing the volume options would have helped ;)<br>
sysctl dirty settings are important , as all writes go "dirty" before they are flushed to disk. Setting a lower limit for starting to flush will reduce potential issues.<br>
Also, don't expect miracles as you use the FUSE client. If you seek higher performance (after tuning everything else) - you can use the libgfapi (for example NFS-Ganesha is such).<br>
Best Regards,Strahil Nikolov<br>
<br>
<br>
On Mon, Jan 24, 2022 at 15:30, Sam<<a href="mailto:mygluster22@eml.cc" target="_blank" rel="noreferrer">mygluster22@eml.cc</a>> wrote: Thanks for your response Strahil. <br>
<br>
> Usually synthetic benchmarks do not show anything, because gluster has to be tuned to your real workload and not to a synth.<br>
<br>
I understand that they do not paint the real picture. But doing same benchmark between a set of file-systems on same server should be able to throw results that can be compared? <br>
<br>
> Also, RH recommends disks of 3-4TB each in a HW raid of 10-12 disks with a stripe size between 1M and 2M.<br>
Next, you need to ensure that hardware alignment is properly done.<br>
<br>
Gluster isn't interacting with the underlying RAID device here so that shouldn't matter. If the XFS layer just below gluster is giving me 3.5 GB/s random reads and writes (--rw=randrw --direct=1), </blockquote></div><div dir="auto"><br></div><div dir="auto">If it is hard drive raid, random IO cannot be this fast.</div><div dir="auto"><br></div><div dir="auto">BTW, for random IO, you might want to use IOPS, as IO size doesn't matter much.</div><div dir="auto"><br></div><div dir="auto">Best,</div><div dir="auto">Manhong</div><div dir="auto"><br></div><div dir="auto"><br></div><div class="gmail_quote" dir="auto"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">why Gluster above it is struggling at 130 MB/s on the same RAID setup. That is 27 times slower.<br>
<br>
I understand that Gluster volume may perform better when its bricks are distributed on different nodes but the fact that its performance penalty when compared to file-system its residing on it is so much high doesn't inspire much confidence. <br>
<br>
I may be wrong here but system settings, cache settings, raid cache etc. shouldn't have any play here as its parent file-system is performing perfectly fine with the default settings.<br>
<br>
- Sam<br>
<br>
-------------- next part --------------<br>
An HTML attachment was scrubbed...<br>
URL: <<a href="http://lists.gluster.org/pipermail/gluster-users/attachments/20220126/11f57d4a/attachment-0001.html" rel="noreferrer noreferrer" target="_blank">http://lists.gluster.org/pipermail/gluster-users/attachments/20220126/11f57d4a/attachment-0001.html</a>><br>
<br>
------------------------------<br>
<br>
Subject: Digest Footer<br>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank" rel="noreferrer">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
<br>
------------------------------<br>
<br>
End of Gluster-users Digest, Vol 165, Issue 13<br>
**********************************************<br>
</blockquote></div></div>