[Gluster-users] NFS share issue #Personal#

A Ghoshal a.ghoshal at tcs.com
Thu Jan 22 11:51:25 UTC 2015


Hello,

I tried using the linuxl's NFS server by exporting mount.glusterfs mounts, 
and man it didn't go well either (similar, stale file handle issues from 
time to time). Actually, it's not just glusterfs, but all FUse based 
file-systems that encounter problems with the linuxl's nfs server. Which 
is why we finally moved to the glusterfs NFS server. It was a lot smoother 
afterwards.

In your volume configuration I can see that nfs.disable is ON. To start 
glusterfs's NFS server, you would need to shut down your current NFS 
service and set nfs.disable to OFF, just so: 

gluster volume set vol_home nfs.disable off

Then, your mountable export (say, on promethee in your example) would be 
hades:vol_home, and your mount command would look like this:

mount -otcp,nfsvers=3 -t nfs  hades:vol_home /hades

Thanks,
Anirban



From:   Geoffrey Letessier <geoffrey.letessier at cnrs.fr>
To:     gluster-users at gluster.org
Date:   01/22/2015 05:05 PM
Subject:        [Gluster-users] NFS share issue
Sent by:        gluster-users-bounces at gluster.org



Dear all,

Since a few days, some users raise IT issues concerning GlusterFS NFS 
Shares and more specifically, in about NFS shares available on my HPC 
clusters.
Indeed, from their workstations which, if they try to copy some 
directories/files from the NFS share into somewhere else (taking place 
in), they get some "Stale NFS file handle" errors.

Here is an example: my machine is promethee and the remote machine where 
is located the NFS share is hades. the mount point of my NFS share in my 
machine is /hades.

[me at promethee ~]$ cp -r /hades/Gquads/ /home/me/Gquads/
=> here all is OK

[me at promethee ~]$ cd /hades
[me at promethee ~]$ cp -r Gquads/ /home/me/Gquads/
cp: reading `2KF8/dihedrals/traj.pdb': Stale NFS file handle
cp: failed to extend `/data/pasquali/Gquads/2KF8/dihedrals/traj.pdb': 
Stale NFS file handle
cp: cannot stat `2KF8/dihedrals/line_14.png': Stale NFS file handle
cp: cannot stat `2KF8/dihedrals/polar_log_14.png': Stale NFS file handle
cp: cannot stat `2KF8/dihedrals/polar_9.png': Stale NFS file handle
cp: cannot stat `2KF8/dihedrals/polar_log_13.png': Stale NFS file handle
cp: cannot stat `2KF8/dihedrals/line_15.png': Stale NFS file handle
cp: cannot stat `2KF8/dihedrals/polar_log_12.png': Stale NFS file handle
cp: cannot stat `2KF8/dihedrals/line_21.png': Stale NFS file handle

It looks like to have problems to solve relative paths...

For information: i use NFS export over my GlusterFS volume remote mount. 
In other words: hades is a master whose the /home is a mount of a 
GlusterFS volume. Here is my volume settings:
  [root at hades ~]# gluster volume info vol_home

Volume Name: vol_home
Type: Distributed-Replicate
Volume ID: f6ebcfc1-b735-4a0e-b1d7-47ed2d2e7af6
Status: Started
Number of Bricks: 4 x 2 = 8
Transport-type: tcp,rdma
Bricks:
Brick1: ib-storage1:/export/brick_home/brick1
Brick2: ib-storage2:/export/brick_home/brick1
Brick3: ib-storage3:/export/brick_home/brick1
Brick4: ib-storage4:/export/brick_home/brick1
Brick5: ib-storage1:/export/brick_home/brick2
Brick6: ib-storage2:/export/brick_home/brick2
Brick7: ib-storage3:/export/brick_home/brick2
Brick8: ib-storage4:/export/brick_home/brick2
Options Reconfigured:
features.default-soft-limit: 90%
features.quota: on
diagnostics.brick-log-level: CRITICAL
auth.allow: localhost,127.0.0.1,10.*
nfs.disable: on
performance.cache-size: 64MB
performance.write-behind-window-size: 1MB
performance.quick-read: on
performance.io-cache: on
performance.io-thread-count: 64

[root at hades ~]# cat /etc/exports
/home *.lbt.ibpc.fr(fsid=0,rw,root_squash)

[root at lucifer ~]# mount |grep home
ib-storage1:vol_home.rdma on /home type fuse.glusterfs 
(rw,default_permissions,allow_other,max_read=131072)

Any idea? Am I the only one with this problem?

Thanks in advance,
Geoffrey

-- 
-----------------------------------------------
Geoffrey Letessier

Responsable informatique
CNRS - UPR 9080 - Laboratoire de Biochimie Théorique
Institut de Biologie Physico-Chimique
13, rue Pierre et Marie Curie - 75005 Paris
Tel: 01 58 41 50 93 - eMail:geoffrey.letessier at cnrs.fr

_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://www.gluster.org/mailman/listinfo/gluster-users
=====-----=====-----=====
Notice: The information contained in this e-mail
message and/or attachments to it may contain 
confidential or privileged information. If you are 
not the intended recipient, any dissemination, use, 
review, distribution, printing or copying of the 
information contained in this e-mail message 
and/or attachments to it are strictly prohibited. If 
you have received this communication in error, 
please notify us by reply e-mail or telephone and 
immediately and permanently delete the message 
and any attachments. Thank you


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150122/b382c184/attachment.html>


More information about the Gluster-users mailing list