[Gluster-devel] Re: NFS reexport status

[Sam Wouters]

On Friday 03 October 2008 16:08:00 Brent A Nelson wrote:
> I had nfs-kernel mostly working with earlier GlusterFS versions,
> Linux-to-Linux (except that CWD in a shell cded into the mount would
> eventually disappear on an idle shell); Linux-to-Solaris had very
> unreliable rm -rf behavior.  It took a lot of effort on the part of
> GlusterFS developers to get to that point.
>
> I would suggest that, if you don't get acceptable behavior from
> nfs-kernel, give the latest release of UNFS3 a try.  In testing, at least,
> I had it working without issue, reexporting a GlusterFS via NFS to Linux
> and Solaris.  Performance was quite reasonable, and I very much get the
> impression that there's less to go wrong with user-mode vs. kernel-mode
> NFS, which is very hard to get right (and is probably very easy to break
> with a small change to GlusterFS code).
>
> Thanks,
>
> Brent
>
> PS I assume you know to set fsid= on your NFS exports, both for nfs-kernel
> and UNFS3 (otherwise, you probably wouldn't have even been able to mount,
> and you need to turn off direct-io on GlusterFS with
> direct-io-mode=DISABLE on your GlusterFS mount options (or writes will
> fail horribly, at best giving you zero-length files).  I don't recall for
> certain, but direct-io may not be an issue with UNFS3.

Thanks for the update,

fsid was set for the exports, but the direct-io-mode was set to none as stated 
in the optimizing guide 
(http://www.gluster.org/docs/index.php/Guide_to_Optimizing_GlusterFS).
Basic storage bricks seem to be working now, I will try the complete AFR setup 
again monday and let you know.

Thanks,

Sam


>
> On Fri, 3 Oct 2008, Sam Wouters wrote:
> > Hi,
> >
> > do you have any update about this?
> >
> > I'm trying to reexport a glusterfs mount with nfs using glusterfs 1.3.12,
> > using nfs-kernel.
> > I can list and read files perfectly through the nfs share, however when
> > trying to write I get a "nfsd: write err=-1" in my nfs debug. Tracing the
> > process, I see the file being written but after fh_verify ?by nfs, the
> > file gets emptied. This happens with a basic storage brick as well as
> > when using afr.
> >
> > It doesn't seem to be a fuse problem, because exporting an sshfs fuse
> > mount works perfectly.
> >
> > Any ideas?
> >
> > thanks,
> >
> > Sam
> >
> >
> > _______________________________________________
> > Gluster-devel mailing list
> > Gluster-devel at nongnu.org
> > http://lists.nongnu.org/mailman/listinfo/gluster-devel