<div dir="ltr"><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">Dear gluster community</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">We are running GlusterFS replication server on 2 nodes and we have 2 clients. Self healing daemon is enabled. Each client is connected to a different server using the Gluster client. We have a lot of very small files on the Gluster volume.</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">We use GlusterFS 3.9.1 from the official GlusterFS APT Repositories on a Debian Jessie system.</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">The issue we are facing with is that one of the servers is at 0.1-0.5 load average while the other is at 200. The server with the high load also has a huge amount of data being streamed constantly to both the client nodes. This data stream continues even when the clients are not reading writing data.</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">The following values are measured by <code style="margin:0px;padding:1px 5px;border:0px;font-size:13px;font-family:consolas,menlo,monaco,"lucida console","liberation mono","dejavu sans mono","bitstream vera sans mono","courier new",monospace,sans-serif;background-color:rgb(239,240,241);white-space:pre-wrap">nload</code> and <code style="margin:0px;padding:1px 5px;border:0px;font-size:13px;font-family:consolas,menlo,monaco,"lucida console","liberation mono","dejavu sans mono","bitstream vera sans mono","courier new",monospace,sans-serif;background-color:rgb(239,240,241);white-space:pre-wrap">iftop</code> :</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif"><strong style="margin:0px;padding:0px;border:0px">server:</strong> outgoing 35-40 MB/s</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif"><strong style="margin:0px;padding:0px;border:0px">Two clients:</strong> incoming 17-20 MB/s</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">Our performance on the Gluster client is very poor. An <code style="margin:0px;padding:1px 5px;border:0px;font-size:13px;font-family:consolas,menlo,monaco,"lucida console","liberation mono","dejavu sans mono","bitstream vera sans mono","courier new",monospace,sans-serif;background-color:rgb(239,240,241);white-space:pre-wrap">ls</code> can take up to 10 second to complete, and our app works extremely slow.</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">Servers and clients are connecting over an internal data-center network and can handle much more bandwidth so this is not a limiting factor.</p><h3 style="margin:0px 0px 1em;padding:0px;border:0px;font-size:17px;line-height:1.3;word-wrap:break-word;font-weight:400;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">My two main questions are :</h3><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif"><strong style="margin:0px;padding:0px;border:0px">1:</strong> Are these differences in server load normal behavior for GlusterFS and what causes this?</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif"><strong style="margin:0px;padding:0px;border:0px">2:</strong> Why is there such a high constant data stream to clients form one of the servers.</p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">I cannot seem to find any information concerning this in the Gluster Documentation or on the </p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif"><br></p><p style="margin:0px 0px 1em;padding:0px;border:0px;font-size:15px;clear:both;color:rgb(36,39,41);font-family:arial,"helvetica neue",helvetica,sans-serif">link to the server fault question</p><p style="margin:0px 0px 1em;padding:0px;border:0px;clear:both"><font color="#242729" face="arial, helvetica neue, helvetica, sans-serif"><span style="font-size:15px"><a href="http://serverfault.com/questions/835343/unexplicable-glusterfs-load-and-poor-performance">http://serverfault.com/questions/835343/unexplicable-glusterfs-load-and-poor-performance</a></span></font><br></p><p style="margin:0px 0px 1em;padding:0px;border:0px;clear:both"><font color="#242729" face="arial, helvetica neue, helvetica, sans-serif"><span style="font-size:15px"><br></span></font></p><p style="margin:0px 0px 1em;padding:0px;border:0px;clear:both"><font color="#242729" face="arial, helvetica neue, helvetica, sans-serif"><span style="font-size:15px">Kind regards</span></font></p><div><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><span style="color:rgb(0,0,0);text-align:-webkit-auto;border-collapse:separate;font-family:helvetica"><div style="word-wrap:break-word"><span style="border-collapse:separate;text-align:-webkit-auto"><div style="word-wrap:break-word"><table width="100%"><tbody><tr><td align="left" valign="top"><font color="#2E5171" face="Arial,'Arial Unicode MS',Helvetica" style="font-size:medium"><b>JELLE VAN HEES</b></font><font color="#2e5171"><font face="Arial" size="1"><br></font></font><span style="color:rgb(46,81,113);font-family:arial;font-size:x-small"><b>LINUX SYSTEM ENGINEER</b></span><br><font color="#2E5171" size="1" face="Arial,'Arial Unicode MS',Helvetica"><br>AVIOVISION<br>Jaarbeurslaan 19 box 11, 3600 Genk, Belgium</font><span style="color:rgb(34,34,34);font-size:medium"> </span><br style="color:rgb(34,34,34);font-size:medium"><font color="#2E5171" size="1" face="Arial,'Arial Unicode MS',Helvetica"><br>T <a value="+3289323480" style="color:rgb(17,85,204)">+32 (0)89 32 34 80</a> F <a value="+3289363795" style="color:rgb(17,85,204)">+32 (0)89 36 37 95</a></font><br style="color:rgb(34,34,34);font-size:medium"><span style="color:rgb(34,34,34);font-size:medium"> <br></span><br><a href="https://www.facebook.com/AvioVision" style="color:rgb(17,85,204);font-family:-apple-system,blinkmacsystemfont,sans-serif;font-size:14px" target="_blank"><img src="http://aviobook.aero/facebook-round_blue.png" width="30px"></a><span style="color:rgb(80,0,80);font-family:-apple-system,blinkmacsystemfont,sans-serif;font-size:14px"> </span><a href="https://twitter.com/aviobook" style="color:rgb(17,85,204);font-family:-apple-system,blinkmacsystemfont,sans-serif;font-size:14px" target="_blank"><img src="http://aviobook.aero/twitter-round_blue.png" width="30px"></a><span style="color:rgb(80,0,80);font-family:-apple-system,blinkmacsystemfont,sans-serif;font-size:14px"> </span><a href="https://www.instagram.com/aviobook/" style="color:rgb(17,85,204);font-family:-apple-system,blinkmacsystemfont,sans-serif;font-size:14px" target="_blank"><img src="http://aviobook.aero/instagram-round_blue.png" width="30px"></a><span style="color:rgb(80,0,80);font-family:-apple-system,blinkmacsystemfont,sans-serif;font-size:14px"> </span><a href="https://www.linkedin.com/company/aviovision-nv" style="color:rgb(17,85,204);font-family:-apple-system,blinkmacsystemfont,sans-serif;font-size:14px" target="_blank"><img src="http://aviobook.aero/linkedin-round_blue.png" width="30px"></a><span style="color:rgb(80,0,80);font-family:-apple-system,blinkmacsystemfont,sans-serif;font-size:14px"> </span><a href="http://www.aviobook.aero/" style="color:rgb(17,85,204);font-family:-apple-system,blinkmacsystemfont,sans-serif;font-size:14px" target="_blank"><img src="http://aviobook.aero/web-round_blue.png" width="30px"></a><br></td><td align="right"><img src="http://www.aviobook.aero/logo.jpg"></td></tr><tr><td colspan="2" align="right" bgcolor="#EDEDED"><font color="#2E5171" size="-3" face="Arial,'Arial Unicode MS',Helvetica">Product of AvioVision - A Thales Group Company </font></td></tr></tbody></table><br></div></span></div></span><span style="color:rgb(0,0,0);font-family:arial;font-size:x-small"><i><font color="#2e5171"><span style="text-align:-webkit-auto">The information contained in this message may be privileged and confidential and protected from disclosure. If the reader of this message is</span><span style="text-align:-webkit-auto"> </span><span style="text-align:-webkit-auto">not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this communication is strictly prohibited. If you</span><span style="text-align:-webkit-auto"> </span><span style="text-align:-webkit-auto">have received this communication in error, you are kindly requested to notify us immediately by replying to the message and deleting it from your</span><span style="text-align:-webkit-auto"> </span><span style="text-align:-webkit-auto">computer.</span></font><font color="#2e5171">Any views or opinions presented in this email or any attachments are solely those of the author and do not necessarily represent those of AvioVision, or associated companies</font>.</i></span><br><table width="100%" style="font-family:arial;font-size:medium"><tbody><tr><td align="left" valign="top"><span style="color:rgb(0,0,0);font-size:13px;text-align:-webkit-auto;border-collapse:separate;font-family:helvetica"><div style="word-wrap:break-word"><span style="border-collapse:separate;text-align:-webkit-auto"><div style="word-wrap:break-word"><br></div></span></div></span></td><td align="right"><br></td></tr></tbody></table></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
</div>