<div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Welcome first of all, glad to see interest in improving Gluster performance.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">I believe there's a huge potential for improvements in different areas you can look into.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Certainly zero-copy (or just eliminating extra copies we have today in the code) would be most welcome.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">We seem to have some lock contention in some areas of Gluster. Depending on the setup and workload, there might be different ones.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Certainly reducing some of them could lead to reduced latency and CPU consumption.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">RDMA has been dropped as it was not properly tested and therefore maintained. I do believe there is value, but it is not a major bottleneck at the moment - 10g from a performance perspective provides a good enough alternative, and latency is still something we should work in the code.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">The network stack for example, may be contributing to increased latency.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Removal of translators that are not needed in the stack might help performance as well. We have many translators, but few are needed in most cases.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Y.</div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Thu, Jun 11, 2020 at 10:52 AM Federico Strati <<a href="mailto:strati.federico@gmail.com">strati.federico@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Dear All,<br>
<br>
I just started working for a company named A3Cube, who produces HPC <br>
supercomputers.<br>
<br>
I was assigned the task to investigate which improvements to gluster are <br>
viable<br>
<br>
in order to lead to overall better performance in latency and throughput.<br>
<br>
I'm quite new to SDS and so pardon me if some questions are naive.<br>
<br>
From what I've understood so far, possible bottlenecks are<br>
<br>
in FUSE and transport.<br>
<br>
Generally speaking, if you have time to just drop me some pointers,<br>
<br>
1] FUSE + splice has never been considered (issue closed without real <br>
discussions)<br>
<br>
(probably because it conflicts with the general architecture and in <br>
particular<br>
<br>
with the write-behind translator)<br>
<br>
Recently, it has been announced a new userspace fs kernel module, ZUFS, <br>
whose aim<br>
<br>
is to zero copy and improving vastly over FUSE: would you be interested<br>
<br>
in investigating it ?<br>
<br>
(ZUFS: <a href="https://github.com/NetApp/zufs-zuf" rel="noreferrer" target="_blank">https://github.com/NetApp/zufs-zuf</a> ; <br>
<a href="https://lwn.net/Articles/756625/" rel="noreferrer" target="_blank">https://lwn.net/Articles/756625/</a>)<br>
<br>
2] Transport over RDMA (Infiniband) has been recently dropped:<br>
<br>
may I ask you what considerations have been made ?<br>
<br>
3] I would love to hear what you consider real bottlenecks in gluster<br>
<br>
right now regarding latency and thruput.<br>
<br>
Thanks in advance<br>
<br>
Kind regards<br>
<br>
Federico<br>
<br>
_______________________________________________<br>
<br>
Community Meeting Calendar:<br>
<br>
Schedule -<br>
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC<br>
Bridge: <a href="https://bluejeans.com/441850968" rel="noreferrer" target="_blank">https://bluejeans.com/441850968</a><br>
<br>
<br>
<br>
<br>
Gluster-devel mailing list<br>
<a href="mailto:Gluster-devel@gluster.org" target="_blank">Gluster-devel@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-devel" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-devel</a><br>
<br>
</blockquote></div>