<div dir="ltr">
<p style="box-sizing:border-box;margin-bottom:16px;margin-top:0px"><font color="#24292e" face="-apple-system, BlinkMacSystemFont, Segoe UI, Helvetica, Arial, sans-serif, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol"><span style="font-size:14px">An update, and a very interesting one!</span></font></p><p style="box-sizing:border-box;margin-bottom:16px;margin-top:0px"><span style="font-size:14px;color:rgb(36,41,46);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol"">After I started stracing rsync, all I could see was lstat calls, quite slow ones, over and over, which is expected.</span></p><p style="box-sizing:border-box;margin-bottom:16px;margin-top:0px"><font color="#24292e" face="-apple-system, BlinkMacSystemFont, Segoe UI, Helvetica, Arial, sans-serif, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol"><span style="font-size:14px">For example: lstat("uploads/2016/10/nexus2cee_DSC05339_thumb-161x107.jpg", {st_mode=S_IFREG|0664, st_size=4043, ...}) = 0</span></font><br></p><p style="box-sizing:border-box;margin-bottom:16px;margin-top:0px"><span style="font-size:14px;color:rgb(36,41,46);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol"">I googled around and foundĀ </span><font color="#24292e" face="-apple-system, BlinkMacSystemFont, Segoe UI, Helvetica, Arial, sans-serif, Apple Color Emoji, Segoe UI Emoji, Segoe UI Symbol"><span style="font-size:14px"><a href="https://gist.github.com/nh2/1836415489e2132cf85ed3832105fcc1">https://gist.github.com/nh2/1836415489e2132cf85ed3832105fcc1</a>, which isĀ </span></font><span style="color:rgb(36,41,46);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol";font-size:14px">seeing this exact issue with gluster, rsync and xfs.</span></p><p style="box-sizing:border-box;margin-bottom:16px;margin-top:0px"><span style="font-size:14px;color:rgb(36,41,46);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol"">Here's the craziest finding so far. If while rsync is running (or right before), I run /bin/ls or find on the same gluster dirs, it immediately speeds up rsync by a factor of 100 or maybe even 1000. It's absolutely insane.</span><br></p><p style="box-sizing:border-box;margin-bottom:16px;margin-top:0px"><span style="font-size:14px;color:rgb(36,41,46);font-family:-apple-system,BlinkMacSystemFont,"Segoe UI",Helvetica,Arial,sans-serif,"Apple Color Emoji","Segoe UI Emoji","Segoe UI Symbol"">I'm stracing the rsync run, and the slow lstat calls flood in at an incredible speed as soon as ls or find run. Several hundred of files per minute (excruciatingly slow) becomes thousands or even tens of thousands of files a second.</span><br></p><p style="box-sizing:border-box;margin-bottom:16px;margin-top:0px">What do you make of this?</p></div>