[Gluster-users] NFS Ganesha HA w/ GlusterFS

[TomK]

Hey Guy's,

A success story instead of a question.

With your help, managed to get the HA component working with HAPROXY and 
keepalived to build a fairly resilient NFS v4 VM cluster.  ( Used 
Gluster, NFS Ganesha v2.60, HAPROXY, keepalived w/ selinux enabled )

If someone needs or it could help your work, please PM me for the 
written up post or I could just post here if the lists allow it.

Cheers,
Tom


On 2/19/2018 12:25 PM, TomK wrote:
> On 2/19/2018 12:09 PM, Kaleb S. KEITHLEY wrote:
> Sounds good and no problem at all.  Will look out for this update in the 
> future.  In the meantime, three's a few things I'll try including your 
> suggestion.
> 
> Was looking for a sense of direction with the projects and now you've 
> given that.  Ty.  Appreciated!
> 
> Cheers,
> Tom
> 
> 
>> On 02/19/2018 11:37 AM, TomK wrote:
>>> On 2/19/2018 10:55 AM, Kaleb S. KEITHLEY wrote:
>>> Yep, I noticed a couple of pages including this for 'storhaug
>>> configuration' off google.  Adding 'mailing list' to the search didn't
>>> help alot:
>>>
>>> https://sourceforge.net/p/nfs-ganesha/mailman/message/35929089/
>>>
>>> https://www.spinics.net/lists/gluster-users/msg33018.html
>>>
>>> Hence the ask here.  storhaug feels like it's not moving with any sort
>>> of update now.
>>>
>>> Any plans to move back to the previous NFS Ganesha HA model with
>>> upcoming GlusterFS versions as a result?
>>
>> No.
>>
>> (re)writing or finishing storhaug has been on my plate ever since the
>> guy who was supposed to do it didn't.
>>
>> I have lots of other stuff to do too. All I can say is it'll get done
>> when it gets done.
>>
>>
>>>
>>> In the meantime I'll look to cobble up the GlusterFS 3.10 packages and
>>> try with those per your suggestion.
>>>
>>> What's your thoughts on using HAPROXY / keepalived w/ NFS Ganesha and
>>> GlusterFS?  Anyone tried this sort of combination?  I want to avoid the
>>> situation where I have to remount clients as a result of a node failing.
>>>   In other words, avoid this situation:
>>>
>>> [root at yes01 ~]# cd /n
>>> -bash: cd: /n: Stale file handle
>>> [root at yes01 ~]#
>>>
>>> Cheers,
>>> Tom
>>>
>>>> On 02/19/2018 10:24 AM, TomK wrote:
>>>>> On 2/19/2018 2:39 AM, TomK wrote:
>>>>> + gluster users as well.  Just read another post on the mailing lists
>>>>> about a similar ask from Nov which didn't really have a clear answer.
>>>>
>>>> That's funny because I've answered questions like this several times.
>>>>
>>>> Gluster+Ganesha+Pacemaker-based HA is available up to GlusterFS 3.10.x.
>>>>
>>>> If you need HA, that is one "out of the box" option.
>>>>
>>>> There's support for using CTDB in Samba for Ganesha HA, and people have
>>>> used it successfully with Gluster+Ganesha.
>>>>
>>>>>
>>>>> Perhaps there's a way to get NFSv4 work with GlusterFS without NFS
>>>>> Ganesha then?
>>>>
>>>> Not that I'm aware of.
>>>>
>>>>>
>>>>> Cheers,
>>>>> Tom
>>>>>
>>>>>> Hey All,
>>>>>>
>>>>>> I've setup GlusterFS on two virtuals and enabled NFS Ganesha on each
>>>>>> node.  ATM the configs are identical between the two NFS Ganesha
>>>>>> hosts. (Probably shouldn't be but I'm just testing things out.)
>>>>>>
>>>>>> I need HA capability and notice these instructions here:
>>>>>>
>>>>>> http://aravindavkgluster.readthedocs.io/en/latest/Administrator%20Guide/Configuring%20HA%20NFS%20Server/ 
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> However I don't have package glusterfs-ganesha available on this
>>>>>> CentOS Linux release 7.4.1708 (Core) and the maintainer's of CentOS 7
>>>>>> haven't uploaded some of the 2.5.x packages yet so I can't use that
>>>>>> version.
>>>>>>
>>>>>> glusterfs-api-3.12.6-1.el7.x86_64
>>>>>> glusterfs-libs-3.12.6-1.el7.x86_64
>>>>>> glusterfs-3.12.6-1.el7.x86_64
>>>>>> glusterfs-fuse-3.12.6-1.el7.x86_64
>>>>>> glusterfs-server-3.12.6-1.el7.x86_64
>>>>>> python2-glusterfs-api-1.1-1.el7.noarch
>>>>>> glusterfs-client-xlators-3.12.6-1.el7.x86_64
>>>>>> glusterfs-cli-3.12.6-1.el7.x86_64
>>>>>>
>>>>>> nfs-ganesha-xfs-2.3.2-1.el7.x86_64
>>>>>> nfs-ganesha-vfs-2.3.2-1.el7.x86_64
>>>>>> nfs-ganesha-2.3.2-1.el7.x86_64
>>>>>> nfs-ganesha-gluster-2.3.2-1.el7.x86_64
>>>>>>
>>>>>> The only high availability packages are the following but they don't
>>>>>> come with any instructions that I can find:
>>>>>>
>>>>>> storhaug.noarch : High-Availability Add-on for NFS-Ganesha and Samba
>>>>>> storhaug-nfs.noarch : storhaug NFS-Ganesha module
>>>>>>
>>>>>> Given that I'm missing that one package above, will configuring using
>>>>>> ganesha-ha.conf still work?  Or should I be looking at another option
>>>>>> alltogether?
>>>>>>
>>>>>> Appreciate any help.  Ty!
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
> 
> 


-- 
Cheers,
Tom K.
-------------------------------------------------------------------------------------

Living on earth is expensive, but it includes a free trip around the sun.