<div dir="ltr"><div>It would be good to compare and contrast performance numbers based on additional detail about the test workbench as well as configuration for the workloads. Else, it is just a lot of graphs along with lists of end-results and drawing inferences are difficult.</div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Nov 22, 2019 at 4:21 PM Yaniv Kaul &lt;<a href="mailto:ykaul@redhat.com">ykaul@redhat.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div dir="ltr"><div style="font-family:arial,helvetica,sans-serif">Spinning off the conversation, comments within<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Nov 22, 2019 at 8:28 AM Xie Changlong &lt;<a href="mailto:zgrep@139.com" target="_blank">zgrep@139.com</a>&gt; wrote:<br></div><div><br></div><div style="font-family:arial,helvetica,sans-serif">&lt;snip&gt;</div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><p>
    </p>Interesting - we&#39;ve seen far better performance
          with Ganesha v4.1 vs. gnfs. <br>
        <blockquote type="cite"><div dir="auto">
      </div>
    </blockquote>
    <blockquote type="cite">
      <div dir="auto">
        <div dir="auto">Would be great if you could share the details. <br>
        </div>
      </div>
    </blockquote>
    <p>vdbench 6/4  random read/write<br>
    </p>
    <p><img src="cid:16e927c112e478b4eb71" alt=""></p>
    <p><br></p></div></blockquote><div><br></div><div style="font-family:arial,helvetica,sans-serif">You are comparing old versions of Gluster (assuming it&#39;s downstream, Red Hat&#39;s version - it was released January 2018 - almost 2 years ago) and certainly an old version of NFS Ganesha.</div><div style="font-family:arial,helvetica,sans-serif">We believe newer releases are substantially better.</div><div style="font-family:arial,helvetica,sans-serif">Just sharing the internal number of improvement we are seeing:</div><div style="font-family:arial,helvetica,sans-serif">glusterfs-6.0-17 vs glusterfs-3.12.2-47 (rhel 7.7)<br>33.86%<br>1075.49%<br>232.88%<br>761.36%<br>91.15%<br>138.01%<br></div><div style="font-family:arial,helvetica,sans-serif">-30.07%  &lt;-- there&#39;s a bug about it.</div><div style="font-family:arial,helvetica,sans-serif"></div><div style="font-family:arial,helvetica,sans-serif">28.59%<br>12.36%<br>-1.44%</div><div style="font-family:arial,helvetica,sans-serif"><br></div><div style="font-family:arial,helvetica,sans-serif">(The RHEL release isn&#39;t up-to-date either)</div><div style="font-family:arial,helvetica,sans-serif"><br></div><div style="font-family:arial,helvetica,sans-serif">Y.</div><div style="font-family:arial,helvetica,sans-serif"><br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><p>
    </p>
    <blockquote type="cite">
      <div dir="auto">
        <div dir="auto">Same for NFS Ganesha and Windows support.</div>
        <div dir="auto"><br>
        </div>
      </div>
    </blockquote>
    <p>ganesha 2.5.5,  glusterfs 3.12.2, windows server 2003. Use
      windows nfsv3 mount nfs-ganesha and test read/write with
      vdbench50406. Following is crash bt<br>
    </p>
    <p><img src="cid:16e927c112e25410e22" alt=""></p>
    <p>Btw, the environment has been redeployed, so i can&#39;t share more.<br>
    </p>
    <p><br>
    </p>
    <blockquote type="cite">
      <div dir="auto">
        <div dir="auto">It&#39;s difficult to counterpart without referring
          to specific issues. It&#39;s eveb to harder to fix them ;-) <br>
        </div>
      </div>
    </blockquote>
    <blockquote type="cite">
      <div dir="auto">
        <div dir="auto">
          <div class="gmail_quote">
            <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
              <div>
                <p> </p>
                <p>Gnfs is stable enough, we have about ~1000 servers,
                  4~24 servers for a gluster cluster, about ~2000 nfs
                  clients, all works fine till the last two years expect
                  some memleak issue. <br>
                </p>
              </div>
            </blockquote>
          </div>
        </div>
        <div dir="auto"><br>
        </div>
        <div dir="auto">Nice! Would be great for the Gluster community
          to learn more about the use case! <br>
        </div>
      </div>
    </blockquote>
    <p><br>
    </p>
    <p>It&#39;s my pleasure.</p>
    <p><br>
    </p>
    <blockquote type="cite">
      <div dir="auto">
        <div dir="auto">Y. </div>
        <div dir="auto">
          <div class="gmail_quote">
            <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
              <div>
                <p> </p>
                <p>Thanks</p>
                <p>    -Xie<br>
                </p>
                <blockquote type="cite">
                  <div dir="ltr">
                    <div class="gmail_quote">
                      <div dir="ltr" class="gmail_attr">On Thu, Nov 21,
                        2019 at 5:31 AM Amar Tumballi &lt;<a href="mailto:amarts@gmail.com" rel="noreferrer" target="_blank">amarts@gmail.com</a>&gt;
                        wrote:<br>
                      </div>
                      <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
                        <div dir="ltr">Hi All,
                          <div><br>
                          </div>
                          <div>As per the discussion on <a href="https://review.gluster.org/23645" rel="noreferrer" target="_blank">https://review.gluster.org/23645</a>,
                            recently we changed the status of gNFS
                            (gluster&#39;s native NFSv3 support) feature to
                            &#39;Depricated / Orphan&#39; state. (ref: <a href="https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L185..L189" rel="noreferrer" target="_blank">https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L185..L189</a>).
                            With this email, I am proposing to change
                            the status again to &#39;Odd Fixes&#39; (ref: <a href="https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L22" rel="noreferrer" target="_blank">https://github.com/gluster/glusterfs/blob/master/MAINTAINERS#L22</a>) </div>
                          <div><br>
                          </div>
                          <div>TL;DR;</div>
                          <div><br>
                          </div>
                          <div>
                            <div>I understand the current maintainers
                              are not able to focus on maintaining it as
                              the focus of the project, as earlier
                              described, is keeping NFS-Ganesha based
                              integration with glusterfs. But, I am
                              volunteering along with Xie Changlong
                              (currently working at Chinamobile), to
                              keep the feature running as it used to in
                              previous versions. Hence the status of
                              &#39;Odd Fixes&#39;. </div>
                            <div><br>
                            </div>
                            <div>Before sending the patch to make these
                              changes, I am proposing it here now, as
                              gNFS is not even shipped with latest
                              glusterfs-7.0 releases. I have heard from
                              some users that it was working great for
                              them with earlier releases, as all they
                              wanted was NFS v3 support, and not much of
                              features from gNFS. Also note that, even
                              though the packages are not built, none of
                              the regression tests using gNFS are
                              stopped with latest master, so it is
                              working same from at least last 2 years. </div>
                          </div>
                          <div><br>
                          </div>
                          <div>I request the package maintainers to
                            please add &#39;--with gnfs&#39; (or --enable-gnfs)
                            back to their release script through this
                            email, so those users wanting to use gNFS
                            happily can continue to use it. Also points
                            to users/admins is that, the status is &#39;Odd
                            Fixes&#39;, so don&#39;t expect any &#39;enhancements&#39;
                            on the features provided by gNFS.</div>
                          <div><br>
                          </div>
                          <div>Happy to hear feedback, if any.</div>
                          <div><br>
                          </div>
                          <div>Regards,</div>
                          <div>Amar</div></div></blockquote></div></div></blockquote></div></blockquote></div></div></div></blockquote></div></blockquote></div></div></blockquote><div><br></div><div><br></div></div></div>