[Gluster-devel] 3.6.8 crashing a lot in production

Joe Julian joe at julianfamily.org
Tue Feb 23 16:07:15 UTC 2016


To satisfy this curiosity, however, ubuntu 12.04's 
libc6-2.15-0ubuntu10.5 produces:

objdump -r -d /lib/x86_64-linux-gnu/libc.so.6 | grep -C 20 _int_free | 
grep -C 10 cmpxchg | head -21 | grep -A 3 cmpxchg | tail -1 | (grep '%r' 
&& echo "Your libc is likely buggy." || echo "Your libc looks OK.")
Your libc looks OK.

On 02/23/2016 07:53 AM, Krutika Dhananjay wrote:
> Raghavendra,
>
> The crash was due to bug(s) in clear-locks command implementation. Joe 
> and I had had an offline discussion about this.
>
> -Krutika
> ------------------------------------------------------------------------
>
>     *From: *"Raghavendra G" <raghavendra at gluster.com>
>     *To: *"Krutika Dhananjay" <kdhananj at redhat.com>
>     *Cc: *"Joe Julian" <joe at julianfamily.org>, "Gluster Devel"
>     <gluster-devel at gluster.org>
>     *Sent: *Tuesday, February 23, 2016 8:54:01 PM
>     *Subject: *Re: [Gluster-devel] 3.6.8 crashing a lot in production
>
>     Came across a glibc bug which could've caused some corruptions. On
>     googling about possible problems, we found that there is an issue
>     (https://bugzilla.redhat.com/show_bug.cgi?id=1305406) fixed in
>     glibc-2.17-121.el7. From the bug we found the following
>     test-script to determine if the glibc is buggy. And on running it,
>     we ran it on the local setup using the following method given in
>     the bug:
>     ---------------- # objdump -r -d /lib64/libc.so.6 | grep -C 20
>     _int_free | grep -C 10 cmpxchg | head -21 | grep -A 3 cmpxchg |
>     tail -1 | (grep '%r' && echo "Your libc is likely buggy." || echo
>     "Your libc looks OK.") 7cc36: 48 85 c9 test %rcx,%rcx Your libc is
>     likely buggy. ---------------- Could you check if the above
>     command on your setup gives the same output which says "Your libc
>     is likely buggy." regards,
>
>     On Sat, Feb 13, 2016 at 7:46 AM, Krutika Dhananjay
>     <kdhananj at redhat.com <mailto:kdhananj at redhat.com>> wrote:
>
>         Taking a look. Give me some time.
>
>         -Krutika
>
>         ------------------------------------------------------------------------
>
>             *From: *"Joe Julian" <joe at julianfamily.org
>             <mailto:joe at julianfamily.org>>
>             *To: *"Krutika Dhananjay" <kdhananj at redhat.com
>             <mailto:kdhananj at redhat.com>>, gluster-devel at gluster.org
>             <mailto:gluster-devel at gluster.org>
>             *Sent: *Saturday, February 13, 2016 6:02:13 AM
>             *Subject: *Fwd: [Gluster-devel] 3.6.8 crashing a lot in
>             production
>
>
>             Could this be a regression from
>             http://review.gluster.org/7981 ?
>
>             -------- Forwarded Message --------
>             Subject: 	[Gluster-devel] 3.6.8 crashing a lot in production
>             Date: 	Fri, 12 Feb 2016 16:20:59 -0800
>             From: 	Joe Julian <joe at julianfamily.org>
>             <mailto:joe at julianfamily.org>
>             To: 	gluster-users at gluster.org
>             <mailto:gluster-users at gluster.org>,
>             gluster-devel at gluster.org <mailto:gluster-devel at gluster.org>
>
>
>
>             I have multiple bricks crashing in production. Any help would be greatly
>             appreciated.
>
>             The crash log is in this bug report:
>             https://bugzilla.redhat.com/show_bug.cgi?id=1307146
>
>             Looks like it's crashing in pl_inodelk_client_cleanup
>             _______________________________________________
>             Gluster-devel mailing list
>             Gluster-devel at gluster.org <mailto:Gluster-devel at gluster.org>
>             http://www.gluster.org/mailman/listinfo/gluster-devel
>
>
>
>
>
>         _______________________________________________
>         Gluster-devel mailing list
>         Gluster-devel at gluster.org <mailto:Gluster-devel at gluster.org>
>         http://www.gluster.org/mailman/listinfo/gluster-devel
>
>
>
>
>     -- 
>     Raghavendra G
>
>

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-devel/attachments/20160223/7314a5ec/attachment.html>


More information about the Gluster-devel mailing list