[Gluster-users] Performance issues with one node

[Mathieu Chateau]

Hello,

thanks for this guidance, I wasn't aware of!

Any doc that describe all settings values ?
For example, I can't find documentation for cluster.lookup-optimize


Cordialement,
Mathieu CHATEAU
http://www.lotp.fr

2015-07-27 14:58 GMT+02:00 André Bauer <abauer at magix.net>:

> Some more infos:
>
> http://gluster.readthedocs.org/en/latest/Feature%20Planning/GlusterFS%203.7/Small%20File%20Performance/index.html?highlight=small%20file%20performance
>
> Am 24.07.2015 um 20:15 schrieb Mathieu Chateau:
> > Hello,
> >
> > gluster performance are not good with large number of small files.
> > Recent version do a better job with them, but not yet what I would enjoy.
> >
> > As you are starting at gluster having an existing architecture, you
> > should first setup a lab to learn about it Else you will learn the hard
> way.
> > Don't play with turning off nodes, as you may create more issues than
> solve.
> >
> > just my 2cents
> >
> > Cordialement,
> > Mathieu CHATEAU
> > http://www.lotp.fr
> >
> > 2015-07-24 19:34 GMT+02:00 John Kennedy <skebi69 at gmail.com
> > <mailto:skebi69 at gmail.com>>:
> >
> >     I am new to Gluster and have not found anything useful from my
> >     friend Google. I have not dealt with physical hardware in a few
> >     years (my last few jobs have been VM's and AWS based)
> >
> >     I inherited a 4 node gluster configuration. There are 2 bricks, one
> >     is 9TB the other 11TB.
> >
> >     The 11TB brick has a HUGE number of small files taking up only 1.3TB
> >     of the brick. For some reason, even a simple ls command can take
> >     hours to even start listing files. I removed a node by shutting down
> >     gluster on that node. The change in performance is dramatic. If I
> >     try and do ls on the 11TB brick on the downed node, I am still
> >     getting the slow response. I have narrowed the issue down to this
> >     one node as a result.
> >
> >     When I start gluster on the bad node, glusterfsd hits over 1000%CPU
> >     use (The server has dual 8 core CPU's) and the load will jump to
> >     25-30 within 5 minutes. As such, I think this is a gluster issue and
> >     not a hardware issue. I am trying to not reinstall gluster yet.
> >
> >     Is there something I am missing in my checks or will I need to
> >     reinstall gluster on that node?
> >
> >     Thanks,
> >     John
> >
> >     John Kennedy  (_8(|)
> >     Sometimes it happens, sometimes it doesn't - Pedro Catacora
> >
> >     Just because nobody disagrees with you doesn't mean you are correct.
> >
> >     Anatidaephobia is the fear that somehow, somewhere a duck is
> >     watching you - urbandictionary.com <http://urbandictionary.com>
> >
> >     The Dunning-Kruger effect occurs when incompetent people not only
> >     fail to realize their incompetence, but consider themselves much
> >     more competent than everyone else. Basically - they're too stupid to
> >     know that they're stupid.
> >
> >     _______________________________________________
> >     Gluster-users mailing list
> >     Gluster-users at gluster.org <mailto:Gluster-users at gluster.org>
> >     http://www.gluster.org/mailman/listinfo/gluster-users
> >
> >
> >
> >
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org
> > http://www.gluster.org/mailman/listinfo/gluster-users
> >
>
>
> --
> Mit freundlichen Grüßen
> André Bauer
>
> MAGIX Software GmbH
> André Bauer
> Administrator
> August-Bebel-Straße 48
> 01219 Dresden
> GERMANY
>
> tel.: 0351 41884875
> e-mail: abauer at magix.net
> abauer at magix.net <mailto:Email>
> www.magix.com <http://www.magix.com/>
>
>
> Geschäftsführer | Managing Directors: Dr. Arnd Schröder, Michael Keith
> Amtsgericht | Commercial Register: Berlin Charlottenburg, HRB 127205
>
> Find us on:
>
> <http://www.facebook.com/MAGIX> <http://www.twitter.com/magix_de>
> <http://www.youtube.com/wwwmagixcom> <http://www.magixmagazin.de>
> ----------------------------------------------------------------------
> The information in this email is intended only for the addressee named
> above. Access to this email by anyone else is unauthorized. If you are
> not the intended recipient of this message any disclosure, copying,
> distribution or any action taken in reliance on it is prohibited and
> may be unlawful. MAGIX does not warrant that any attachments are free
> from viruses or other defects and accepts no liability for any losses
> resulting from infected email transmissions. Please note that any
> views expressed in this email may be those of the originator and do
> not necessarily represent the agenda of the company.
> ----------------------------------------------------------------------
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://www.gluster.org/mailman/listinfo/gluster-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150728/19d3927b/attachment.html>