[Gluster-users] GlusterFS mount crash

[David Cunningham]

Hi Xavi,

Thank you for that information. We'll look at upgrading it.


On Fri, 12 Mar 2021 at 05:20, Xavi Hernandez <jahernan at redhat.com> wrote:

> Hi David,
>
> with so little information it's hard to tell, but given that there are
> several OPEN and UNLINK operations, it could be related to an already fixed
> bug (in recent versions) in open-behind.
>
> You can try disabling open-behind with this command:
>
>     # gluster volume set <volname> open-behind off
>
> But given the version you are using is very old and unmaintained, I would
> recommend you to upgrade to 8.x at least.
>
> Regards,
>
> Xavi
>
>
> On Wed, Mar 10, 2021 at 5:10 AM David Cunningham <
> dcunningham at voisonics.com> wrote:
>
>> Hello,
>>
>> We have a GlusterFS 5.13 server which also mounts itself with the native
>> FUSE client. Recently the FUSE mount crashed and we found the following in
>> the syslog. There isn't anything logged in mnt-glusterfs.log for that time.
>> After killing all processes with a file handle open on the filesystem we
>> were able to unmount and then remount the filesystem successfully.
>>
>> Would anyone have advice on how to debug this crash? Thank you in advance!
>>
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: pending frames:
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: frame : type(0) op(0)
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: frame : type(0) op(0)
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: frame : type(1) op(UNLINK)
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: frame : type(1) op(UNLINK)
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: frame : type(1) op(OPEN)
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: message repeated 3355 times: [
>> frame : type(1) op(OPEN)]
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: frame : type(1) op(OPEN)
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: message repeated 6965 times: [
>> frame : type(1) op(OPEN)]
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: frame : type(1) op(OPEN)
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: message repeated 4095 times: [
>> frame : type(1) op(OPEN)]
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: frame : type(0) op(0)
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: patchset: git://
>> git.gluster.org/glusterfs.git
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: signal received: 11
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: time of crash:
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: 2021-03-09 03:12:31
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: configuration details:
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: argp 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: backtrace 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: dlfcn 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: libpthread 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: llistxattr 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: setfsid 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: spinlock 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: epoll.h 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: xattr.h 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: st_atim.tv_nsec 1
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: package-string: glusterfs 5.13
>> Mar 9 05:12:31 voip1 mnt-glusterfs[2932]: ---------
>> ...
>> Mar 9 05:13:50 voip1 systemd[1]: glusterfssharedstorage.service: Main
>> process exited, code=killed, status=11/SEGV
>> Mar 9 05:13:50 voip1 systemd[1]: glusterfssharedstorage.service: Failed
>> with result 'signal'.
>> ...
>> Mar 9 05:13:54 voip1 systemd[1]: glusterfssharedstorage.service: Service
>> hold-off time over, scheduling restart.
>> Mar 9 05:13:54 voip1 systemd[1]: glusterfssharedstorage.service:
>> Scheduled restart job, restart counter is at 2.
>> Mar 9 05:13:54 voip1 systemd[1]: Stopped Mount glusterfs sharedstorage.
>> Mar 9 05:13:54 voip1 systemd[1]: Starting Mount glusterfs sharedstorage...
>> Mar 9 05:13:54 voip1 mount-shared-storage.sh[20520]: ERROR: Mount point
>> does not exist
>> Mar 9 05:13:54 voip1 mount-shared-storage.sh[20520]: Please specify a
>> mount point
>> Mar 9 05:13:54 voip1 mount-shared-storage.sh[20520]: Usage:
>> Mar 9 05:13:54 voip1 mount-shared-storage.sh[20520]: man 8
>> /sbin/mount.glusterfs
>>
>> --
>> David Cunningham, Voisonics Limited
>> http://voisonics.com/
>> USA: +1 213 221 1092
>> New Zealand: +64 (0)28 2558 3782
>> ________
>>
>>
>>
>> Community Meeting Calendar:
>>
>> Schedule -
>> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
>> Bridge: https://meet.google.com/cpu-eiue-hvk
>> Gluster-users mailing list
>> Gluster-users at gluster.org
>> https://lists.gluster.org/mailman/listinfo/gluster-users
>>
>

-- 
David Cunningham, Voisonics Limited
http://voisonics.com/
USA: +1 213 221 1092
New Zealand: +64 (0)28 2558 3782
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20210319/23b5d613/attachment.html>