<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body>
<style type="text/css" style="display:none;"><!-- P {margin-top:0;margin-bottom:0;} --></style>
<div id="divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Arial,Helvetica,sans-serif;" dir="ltr">
<p>Hi,</p>
<p><br>
</p>
<p>Same here, when i reboot the node i have to manually execute "<span>pcs cluster start gluster01" and pcsd already enabled and started.</span></p>
<p><span>Gluster 3.8.11</span></p>
<p><span>Centos 7.3 latest</span></p>
<p><span>Installed using <span>CentOS Storage SIG repository</span></span></p>
<p><br>
</p>
<div id="Signature"><br>
<div class="ecxmoz-signature">-- <br>
<br>
<font color="#3366ff"><font color="#000000">Respectfully<b><br>
</b><b>Mahdi A. Mahdi</b></font></font><font color="#3366ff"><br>
<br>
</font><font color="#3366ff"></font></div>
</div>
</div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> gluster-users-bounces@gluster.org <gluster-users-bounces@gluster.org> on behalf of Adam Ru <ad.ruckel@gmail.com><br>
<b>Sent:</b> Wednesday, May 3, 2017 12:09:58 PM<br>
<b>To:</b> Soumya Koduri<br>
<b>Cc:</b> gluster-users@gluster.org<br>
<b>Subject:</b> Re: [Gluster-users] Gluster and NFS-Ganesha - cluster is down after reboot</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div>Hi Soumya,</div>
<div><br>
</div>
<div>thank you very much for your reply.</div>
<div><br>
</div>
<div>I enabled pcsd during setup and after reboot during troubleshooting I manually started it and checked resources (pcs status). They were not running. I didn’t find what was wrong but I’m going to try it again.</div>
<div><br>
</div>
<div>I’ve thoroughly checked</div>
<div><a href="http://gluster.readthedocs.io/en/latest/Administrator%20Guide/NFS-Ganesha%20GlusterFS%20Integration/">http://gluster.readthedocs.io/en/latest/Administrator%20Guide/NFS-Ganesha%20GlusterFS%20Integration/</a></div>
<div>and I can confirm that I followed all steps with one exception. I installed following RPMs:</div>
<div>glusterfs-server</div>
<div>glusterfs-fuse</div>
<div>glusterfs-cli</div>
<div>glusterfs-ganesha</div>
<div>nfs-ganesha-xfs</div>
<div><br>
</div>
<div>and the guide referenced above specifies:</div>
<div>glusterfs-server</div>
<div>glusterfs-api</div>
<div>glusterfs-ganesha</div>
<div><br>
</div>
<div>glusterfs-api is a dependency of one of RPMs that I installed so this is not a problem. But I cannot find any mention to install nfs-ganesha-xfs.</div>
<div><br>
</div>
<div>I’ll try to setup the whole environment again without installing nfs-ganesha-xfs (I assume glusterfs-ganesha has all required binaries).</div>
<div><br>
</div>
<div>Again, thank you for you time to answer my previous message.</div>
<div><br>
</div>
<div>Kind regards,</div>
<div>Adam</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, May 2, 2017 at 8:49 AM, Soumya Koduri <span dir="ltr">
<<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
Hi,<span class="gmail-"><br>
<br>
On 05/02/2017 01:34 AM, Rudolf wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
Hi Gluster users,<br>
<br>
First, I'd like to thank you all for this amazing open-source! Thank you!<br>
<br>
I'm working on home project – three servers with Gluster and<br>
NFS-Ganesha. My goal is to create HA NFS share with three copies of each<br>
file on each server.<br>
<br>
My systems are CentOS 7.3 Minimal install with the latest updates and<br>
the most current RPMs from "centos-gluster310" repository.<br>
<br>
I followed this tutorial:<br>
<a href="http://blog.gluster.org/2015/10/linux-scale-out-nfsv4-using-nfs-ganesha-and-glusterfs-one-step-at-a-time/" rel="noreferrer" target="_blank">http://blog.gluster.org/2015/1<wbr>0/linux-scale-out-nfsv4-using-<wbr>nfs-ganesha-and-glusterfs-one-<wbr>step-at-a-time/</a><br>
(second half that describes multi-node HA setup)<br>
<br>
with a few exceptions:<br>
<br>
1. All RPMs are from "centos-gluster310" repo that is installed by "yum<br>
-y install centos-release-gluster"<br>
2. I have three nodes (not four) with "replica 3" volume.<br>
3. I created empty ganesha.conf and not empty ganesha-ha.conf in<br>
"/var/run/gluster/shared_stora<wbr>ge/nfs-ganesha/" (referenced blog post is<br>
outdated, this is now requirement)<br>
4. ganesha-ha.conf doesn't have "HA_VOL_SERVER" since this isn't needed<br>
anymore.<br>
<br>
</blockquote>
<br>
</span>Please refer to <a href="http://gluster.readthedocs.io/en/latest/Administrator%20Guide/NFS-Ganesha%20GlusterFS%20Integration/" rel="noreferrer" target="_blank">
http://gluster.readthedocs.io/<wbr>en/latest/Administrator%20Guid<wbr>e/NFS-Ganesha%20GlusterFS%<wbr>20Integration/</a><br>
<br>
It is being updated with latest changes happened wrt setup.<span class="gmail-"><br>
<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
When I finish configuration, all is good. nfs-ganesha.service is active<br>
and running and from client I can ping all three VIPs and I can mount<br>
NFS. Copied files are replicated to all nodes.<br>
<br>
But when I restart nodes (one by one, with 5 min. delay between) then I<br>
cannot ping or mount (I assume that all VIPs are down). So my setup<br>
definitely isn't HA.<br>
<br>
I found that:<br>
# pcs status<br>
Error: cluster is not currently running on this node<br>
</blockquote>
<br>
</span>This means pcsd service is not up. Did you enable (systemctl enable pcsd) pcsd service so that is comes up post reboot automatically. If not please start it manually.<span class="gmail-"><br>
<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<br>
and nfs-ganesha.service is in inactive state. Btw. I didn't enable<br>
"systemctl enable nfs-ganesha" since I assume that this is something<br>
that Gluster does.<br>
</blockquote>
<br>
</span>Please check /var/log/ganesha.log for any errors/warnings.<br>
<br>
We recommend not to enable nfs-ganesha.service (by default), as the shared storage (where the ganesha.conf file resides now) should be up and running before nfs-ganesha gets started.<br>
So if enabled by default it could happen that shared_storage mount point is not yet up and it resulted in nfs-ganesha service failure. If you would like to address this, you could have a cron job which keeps checking the mount point health and then start nfs-ganesha
service.<br>
<br>
Thanks,<br>
Soumya<br>
<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<span class="gmail-"><br>
I assume that my issue is that I followed instructions in blog post from<br>
2015/10 that are outdated. Unfortunately I cannot find anything better –<br>
I spent whole day by googling.<br>
<br>
Would you be so kind and check the instructions in blog post and let me<br>
know what steps are wrong / outdated? Or please do you have more current<br>
instructions for Gluster+Ganesha setup?<br>
<br>
Thank you.<br>
<br>
Kind regards,<br>
Adam<br>
<br>
<br>
<br>
</span>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br>
<br>
</blockquote>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
<div class="gmail_signature">
<div dir="ltr">Adam</div>
</div>
</div>
</div>
</div>
</body>
</html>