<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Aptos;
panose-1:2 11 0 4 2 2 2 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Aptos",sans-serif;
mso-ligatures:standardcontextual;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:11.0pt;
mso-ligatures:none;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="EN-US" link="#467886" vlink="#96607D" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Dear team,</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">First, a thank as always for making the gluster storage solution.</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The question:</p>
<p class="MsoNormal">Years back, when we first started using Gluster, we had a requirement to provide NFS services. Documentation and discussions at the time made us feel as if we should not use the kernel NFS server from a fuse mount but rather use Ganesha.
Recently I have seen people are using Linux kernel NFS server with gluster fuse mounts. It has been working well in our test environment. What are the drawbacks to exporting a fuse-mounted glusterfs filesystem using the Linux NFS server?</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Optional background reading for the question:</p>
<p class="MsoNormal">At the time, and still today, Ganesha doesn’t serve our specific workload fast enough (no disrespect to the great people working on Ganesha). We therefore used and continue to use Gluster NFS.</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Recently, we have begun to have issues with gluster NFS mounts when the nfs performance io cache is enabled. Files under 200M or so, in certain situations and systems but not all systems, will get an IO error on the NFS mount. The fuse
access is fine. Turning off the cache makes the server nearly unusable for our specific workload and scale. We may write about that separately but we’re behind in gluster version and know we need to get current before we ask for help.</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">This problem at an important site had us looking for workarounds. We are using Ganesha as the work-around, but it is significantly slower. Internal testing showed exporting with kernel NFS was very slick. Hence the question.</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Gluster is used for several things but for NFS, it’s largely a collection of squashfs files that represent root filesystems that is the most load.</p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Thank you all!!! </p>
</div>
</body>
</html>