<div dir="ltr"><div>Hi Soumya,</div><div><br></div><div>thank you very much for your reply.</div><div><br></div><div>I enabled pcsd during setup and after reboot during troubleshooting I manually started it and checked resources (pcs status). They were not running. I didn’t find what was wrong but I’m going to try it again.</div><div><br></div><div>I’ve thoroughly checked</div><div><a href="http://gluster.readthedocs.io/en/latest/Administrator%20Guide/NFS-Ganesha%20GlusterFS%20Integration/">http://gluster.readthedocs.io/en/latest/Administrator%20Guide/NFS-Ganesha%20GlusterFS%20Integration/</a></div><div>and I can confirm that I followed all steps with one exception. I installed following RPMs:</div><div>glusterfs-server</div><div>glusterfs-fuse</div><div>glusterfs-cli</div><div>glusterfs-ganesha</div><div>nfs-ganesha-xfs</div><div><br></div><div>and the guide referenced above specifies:</div><div>glusterfs-server</div><div>glusterfs-api</div><div>glusterfs-ganesha</div><div><br></div><div>glusterfs-api is a dependency of one of RPMs that I installed so this is not a problem. But I cannot find any mention to install nfs-ganesha-xfs.</div><div><br></div><div>I’ll try to setup the whole environment again without installing nfs-ganesha-xfs (I assume glusterfs-ganesha has all required binaries).</div><div><br></div><div>Again, thank you for you time to answer my previous message.</div><div><br></div><div>Kind regards,</div><div>Adam</div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 2, 2017 at 8:49 AM, Soumya Koduri <span dir="ltr"><<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi,<span class="gmail-"><br>
<br>
On 05/02/2017 01:34 AM, Rudolf wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
Hi Gluster users,<br>
<br>
First, I'd like to thank you all for this amazing open-source! Thank you!<br>
<br>
I'm working on home project – three servers with Gluster and<br>
NFS-Ganesha. My goal is to create HA NFS share with three copies of each<br>
file on each server.<br>
<br>
My systems are CentOS 7.3 Minimal install with the latest updates and<br>
the most current RPMs from "centos-gluster310" repository.<br>
<br>
I followed this tutorial:<br>
<a href="http://blog.gluster.org/2015/10/linux-scale-out-nfsv4-using-nfs-ganesha-and-glusterfs-one-step-at-a-time/" rel="noreferrer" target="_blank">http://blog.gluster.org/2015/1<wbr>0/linux-scale-out-nfsv4-using-<wbr>nfs-ganesha-and-glusterfs-one-<wbr>step-at-a-time/</a><br>
(second half that describes multi-node HA setup)<br>
<br>
with a few exceptions:<br>
<br>
1. All RPMs are from "centos-gluster310" repo that is installed by "yum<br>
-y install centos-release-gluster"<br>
2. I have three nodes (not four) with "replica 3" volume.<br>
3. I created empty ganesha.conf and not empty ganesha-ha.conf in<br>
"/var/run/gluster/shared_stora<wbr>ge/nfs-ganesha/" (referenced blog post is<br>
outdated, this is now requirement)<br>
4. ganesha-ha.conf doesn't have "HA_VOL_SERVER" since this isn't needed<br>
anymore.<br>
<br>
</blockquote>
<br></span>
Please refer to <a href="http://gluster.readthedocs.io/en/latest/Administrator%20Guide/NFS-Ganesha%20GlusterFS%20Integration/" rel="noreferrer" target="_blank">http://gluster.readthedocs.io/<wbr>en/latest/Administrator%20Guid<wbr>e/NFS-Ganesha%20GlusterFS%<wbr>20Integration/</a><br>
<br>
It is being updated with latest changes happened wrt setup.<span class="gmail-"><br>
<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
When I finish configuration, all is good. nfs-ganesha.service is active<br>
and running and from client I can ping all three VIPs and I can mount<br>
NFS. Copied files are replicated to all nodes.<br>
<br>
But when I restart nodes (one by one, with 5 min. delay between) then I<br>
cannot ping or mount (I assume that all VIPs are down). So my setup<br>
definitely isn't HA.<br>
<br>
I found that:<br>
# pcs status<br>
Error: cluster is not currently running on this node<br>
</blockquote>
<br></span>
This means pcsd service is not up. Did you enable (systemctl enable pcsd) pcsd service so that is comes up post reboot automatically. If not please start it manually.<span class="gmail-"><br>
<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<br>
and nfs-ganesha.service is in inactive state. Btw. I didn't enable<br>
"systemctl enable nfs-ganesha" since I assume that this is something<br>
that Gluster does.<br>
</blockquote>
<br></span>
Please check /var/log/ganesha.log for any errors/warnings.<br>
<br>
We recommend not to enable nfs-ganesha.service (by default), as the shared storage (where the ganesha.conf file resides now) should be up and running before nfs-ganesha gets started.<br>
So if enabled by default it could happen that shared_storage mount point is not yet up and it resulted in nfs-ganesha service failure. If you would like to address this, you could have a cron job which keeps checking the mount point health and then start nfs-ganesha service.<br>
<br>
Thanks,<br>
Soumya<br>
<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span class="gmail-">
<br>
I assume that my issue is that I followed instructions in blog post from<br>
2015/10 that are outdated. Unfortunately I cannot find anything better –<br>
I spent whole day by googling.<br>
<br>
Would you be so kind and check the instructions in blog post and let me<br>
know what steps are wrong / outdated? Or please do you have more current<br>
instructions for Gluster+Ganesha setup?<br>
<br>
Thank you.<br>
<br>
Kind regards,<br>
Adam<br>
<br>
<br>
<br></span>
______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br>
<br>
</blockquote>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr">Adam</div></div>
</div></div>