<html><head><meta http-equiv="content-type" content="text/html; charset=UTF-8"><style>body { line-height: 1.5; }blockquote { margin-top: 0px; margin-bottom: 0px; margin-left: 0.5em; }body { font-size: 10.5pt; font-family: 'Microsoft YaHei UI'; color: rgb(0, 0, 0); line-height: 1.5; }</style></head><body>
<div><span></span>Ok,I see.</div><div><br></div><div>Your answer is very clear!</div><div><br></div><div>Thanks!</div>
<div><br></div><hr style="width: 210px; height: 1px;" color="#b5c4df" size="1" align="left">
<div><span><div style="MARGIN: 10px; FONT-FAMILY: verdana; FONT-SIZE: 10pt"><div>sz_cuitao@163.com</div></div></span></div>
<blockquote style="margin-Top: 0px; margin-Bottom: 0px; margin-Left: 0.5em"><div> </div><div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"><div style="PADDING-RIGHT: 8px; PADDING-LEFT: 8px; FONT-SIZE: 12px;FONT-FAMILY:tahoma;COLOR:#000000; BACKGROUND: #efefef; PADDING-BOTTOM: 8px; PADDING-TOP: 8px"><div><b>发件人：</b> <a href="mailto:erik.jacobson@hpe.com">Erik Jacobson</a></div><div><b>发送时间：</b> 2020-04-02 09:29</div><div><b>收件人：</b> <a href="mailto:sz_cuitao@163.com">sz_cuitao@163.com</a></div><div><b>抄送：</b> <a href="mailto:hunter86_bg@yahoo.com">Strahil Nikolov</a>; <a href="mailto:erik.jacobson@hpe.com">Erik Jacobson</a>; <a href="mailto:gluster-users@gluster.org">gluster-users</a></div><div><b>主题：</b> Re:回复: Re: [Gluster-users] Cann't mount NFS,please help!</div></div></div><div><div>> Thanks everyone!</div>
<div>> </div>
<div>> You mean that: Ganesha is new solution ablout NFS Server function than gNFS,</div>
<div>> in new version gNFS is not the suggest compoment,</div>
<div>> but,if I want using NFS Server ,I should install and configure Ganesha</div>
<div>> separately, is that ?</div>
<div> </div>
<div>I would phrase it this way:</div>
<div>- The community is moving to Ganesha to provide NFS services. Ganesha</div>
<div> supports several storage solutions, including gluster</div>
<div> </div>
<div>- Therefore, distros and packages tend to disable the gNFS support in</div>
<div> gluster since they assume people are moving to Ganesha. It would</div>
<div> otherwise be a competing solutions for NFS.</div>
<div> </div>
<div>- Some people still prefer gNFS and do not want to use Ganesha yet, and</div>
<div> those people need to re-build their package in some cases like was</div>
<div> outlined in the thread. This then provides the necessary libraries and</div>
<div> config files to run gNFS</div>
<div> </div>
<div>- gNFS still works well if you build it as far as I have found</div>
<div> </div>
<div>- For my use, Ganesha crashes with my "not normal" workload and</div>
<div> so I can't switch to it yet. I worked with the community some but ran</div>
<div> out of system time and had to drop the thread. I would like to revisit</div>
<div> so that I can run Ganesha too some day. My work load is very far away</div>
<div> from typical.</div>
<div> </div>
<div>Erik</div>
<div> </div>
<div> </div>
<div>> </div>
<div>> </div>
<div>> </div>
<div>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━</div>
<div>> sz_cuitao@163.com</div>
<div>> </div>
<div>> </div>
<div>> From: Strahil Nikolov</div>
<div>> Date: 2020-04-02 00:58</div>
<div>> To: Erik Jacobson; sz_cuitao@163.com</div>
<div>> CC: gluster-users</div>
<div>> Subject: Re: [Gluster-users] Cann't mount NFS,please help!</div>
<div>> On April 1, 2020 3:37:35 PM GMT+03:00, Erik Jacobson</div>
<div>> <erik.jacobson@hpe.com> wrote:</div>
<div>> >If you are like me and cannot yet switch to Ganesha (it doesn't work in</div>
<div>> >our workload yet; I need to get back to working with the community on</div>
<div>> >that...)</div>
<div>> ></div>
<div>> >What I would have expected in the process list was a glusterfs process</div>
<div>> >with</div>
<div>> >"nfs" in the name.</div>
<div>> ></div>
<div>> >here it is from one of my systems:</div>
<div>> ></div>
<div>> >root 57927 1 0 Mar31 ? 00:00:00 /usr/sbin/glusterfs -s</div>
<div>> >localhost --volfile-id gluster/nfs -p /var/run/gluster/nfs/nfs.pid -l</div>
<div>> >/var/log/glusterfs/nfs.log -S /var/run/gluster/933ab0ad241fab5f.socket</div>
<div>> ></div>
<div>> ></div>
<div>> >My guess - but you'd have to confirm this with the logs - is your</div>
<div>> >gluster</div>
<div>> >build does not have gnfs built in. Since they wish us to move to</div>
<div>> >Ganesha, it is often off by default. For my own builds, I enable it in</div>
<div>> >the spec file.</div>
<div>> ></div>
<div>> >So you should have this installed:</div>
<div>> ></div>
<div>> >/usr/lib64/glusterfs/7.2/xlator/nfs/server.so</div>
<div>> ></div>
<div>> >If that isn't there, you likely need to adjust your spec file and</div>
<div>> >rebuild.</div>
<div>> ></div>
<div>> >As others mentioned, the suggestion is to use Ganesha if possible,</div>
<div>> >which is a separate project.</div>
<div>> ></div>
<div>> >I hope this helps!</div>
<div>> ></div>
<div>> >PS here is a sniip from the spec file I use, with an erikj comment for</div>
<div>> >what I adjusted:</div>
<div>> ></div>
<div>> ># gnfs</div>
<div>> ># if you wish to compile an rpm with the legacy gNFS server xlator</div>
<div>> ># rpmbuild -ta @PACKAGE_NAME@-@PACKAGE_VERSION@.tar.gz --with gnfs</div>
<div>> >%{?_without_gnfs:%global _with_gnfs --disable-gnfs}</div>
<div>> ></div>
<div>> ># erikj force enable</div>
<div>> >%global _with_gnfs --enable-gnfs</div>
<div>> ># end erikj</div>
<div>> ></div>
<div>> ></div>
<div>> >On Wed, Apr 01, 2020 at 11:57:16AM +0800, sz_cuitao@163.com wrote:</div>
<div>> >> 1.The gluster server has set volume option nfs.disable to: off</div>
<div>> >></div>
<div>> >> Volume Name: gv0</div>
<div>> >> Type: Disperse</div>
<div>> >> Volume ID: 429100e4-f56d-4e28-96d0-ee837386aa84</div>
<div>> >> Status: Started</div>
<div>> >> Snapshot Count: 0</div>
<div>> >> Number of Bricks: 1 x (2 + 1) = 3</div>
<div>> >> Transport-type: tcp</div>
<div>> >> Bricks:</div>
<div>> >> Brick1: gfs1:/brick1/gv0</div>
<div>> >> Brick2: gfs2:/brick1/gv0</div>
<div>> >> Brick3: gfs3:/brick1/gv0</div>
<div>> >> Options Reconfigured:</div>
<div>> >> transport.address-family: inet</div>
<div>> >> storage.fips-mode-rchecksum: on</div>
<div>> >> nfs.disable: off</div>
<div>> >></div>
<div>> >> 2. The process has start.</div>
<div>> >></div>
<div>> >> [root@gfs1 ~]# ps -ef | grep glustershd</div>
<div>> >> root 1117 1 0 10:12 ? 00:00:00 /usr/sbin/glusterfs</div>
<div>> >-s</div>
<div>> >> localhost --volfile-id shd/gv0 -p</div>
<div>> >/var/run/gluster/shd/gv0/gv0-shd.pid -l /var/</div>
<div>> >> log/glusterfs/glustershd.log -S</div>
<div>> >/var/run/gluster/ca97b99a29c04606.socket</div>
<div>> >> --xlator-option</div>
<div>> >*replicate*.node-uuid=323075ea-2b38-427c-a9aa-70ce18e94208</div>
<div>> >> --process-name glustershd --client-pid=-6</div>
<div>> >></div>
<div>> >></div>
<div>> >> 3.But the status of gv0 is not correct,for it's status of NFS Server</div>
<div>> >is not</div>
<div>> >> online.</div>
<div>> >></div>
<div>> >> [root@gfs1 ~]# gluster volume status gv0</div>
<div>> >> Status of volume: gv0</div>
<div>> >> Gluster process TCP Port RDMA Port</div>
<div>> >Online Pid</div>
<div>> >></div>
<div>> ></div>
<div>> ------------------------------------------------------------------------------</div>
<div>> >> Brick gfs1:/brick1/gv0 49154 0 Y </div>
<div>> > 4180</div>
<div>> >> Brick gfs2:/brick1/gv0 49154 0 Y </div>
<div>> > 1222</div>
<div>> >> Brick gfs3:/brick1/gv0 49154 0 Y </div>
<div>> > 1216</div>
<div>> >> Self-heal Daemon on localhost N/A N/A Y </div>
<div>> > 1117</div>
<div>> >> NFS Server on localhost N/A N/A N </div>
<div>> > N/A</div>
<div>> >> Self-heal Daemon on gfs2 N/A N/A Y </div>
<div>> > 1138</div>
<div>> >> NFS Server on gfs2 N/A N/A N </div>
<div>> > N/A</div>
<div>> >> Self-heal Daemon on gfs3 N/A N/A Y </div>
<div>> > 1131</div>
<div>> >> NFS Server on gfs3 N/A N/A N </div>
<div>> > N/A</div>
<div>> >></div>
<div>> >> Task Status of Volume gv0</div>
<div>> >></div>
<div>> ></div>
<div>> ------------------------------------------------------------------------------</div>
<div>> >> There are no active volume tasks</div>
<div>> >></div>
<div>> >> 4.So, I cann't mount the gv0 on my client.</div>
<div>> >></div>
<div>> >> [root@kvms1 ~]# mount -t nfs gfs1:/gv0 /mnt/test</div>
<div>> >> mount.nfs: Connection refused</div>
<div>> >></div>
<div>> >></div>
<div>> >> Please Help!</div>
<div>> >> Thanks!</div>
<div>> >></div>
<div>> >></div>
<div>> >></div>
<div>> >></div>
<div>> >></div>
<div>> >></div>
<div>> ></div>
<div>> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━</div>
<div>> >> sz_cuitao@163.com</div>
<div>> ></div>
<div>> >> ________</div>
<div>> >></div>
<div>> >></div>
<div>> >></div>
<div>> >> Community Meeting Calendar:</div>
<div>> >></div>
<div>> >> Schedule -</div>
<div>> >> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC</div>
<div>> >> Bridge: https://bluejeans.com/441850968</div>
<div>> >></div>
<div>> >> Gluster-users mailing list</div>
<div>> >> Gluster-users@gluster.org</div>
<div>> >> https://lists.gluster.org/mailman/listinfo/gluster-users</div>
<div>> ></div>
<div>> ></div>
<div>> ></div>
<div>> >Erik Jacobson</div>
<div>> >Software Engineer</div>
<div>> ></div>
<div>> >erik.jacobson@hpe.com</div>
<div>> >+1 612 851 0550 Office</div>
<div>> ></div>
<div>> >Eagan, MN</div>
<div>> >hpe.com</div>
<div>> >________</div>
<div>> ></div>
<div>> ></div>
<div>> ></div>
<div>> >Community Meeting Calendar:</div>
<div>> ></div>
<div>> >Schedule -</div>
<div>> >Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC</div>
<div>> >Bridge: https://bluejeans.com/441850968</div>
<div>> ></div>
<div>> >Gluster-users mailing list</div>
<div>> >Gluster-users@gluster.org</div>
<div>> >https://lists.gluster.org/mailman/listinfo/gluster-users</div>
<div>> </div>
<div>> Helll All,</div>
<div>> </div>
<div>> </div>
<div>> As far as I know, most distributions (at least CentOS does) provide their</div>
<div>> binaries with gNFS disabled.</div>
<div>> Most probably you need to rebuild.</div>
<div>> </div>
<div>> You can use Ganesha - it ises libgfapi to connect to the pool.</div>
<div>> </div>
<div>> Best Regards,</div>
<div>> Strahil Nikolov</div>
<div>> </div>
<div> </div>
<div> </div>
<div>Erik Jacobson</div>
<div>Software Engineer</div>
<div> </div>
<div>erik.jacobson@hpe.com</div>
<div>+1 612 851 0550 Office</div>
<div> </div>
<div>Eagan, MN</div>
<div>hpe.com</div>
</div></blockquote>
</body></html>