<div dir="ltr">Hi Alex, John<div><br></div><div>Thanks for confirming my suspicion that there is no getting away from POSIX tree traversal . I was aware of age-du but not robinhood.</div><div><br></div><div>Cheers</div><div><br></div><div>Kashif </div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 2, 2018 at 8:57 AM, JOHE (John Hearns) <span dir="ltr"><<a href="mailto:JOHE@novozymes.com" target="_blank">JOHE@novozymes.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">
<div id="m_-5595814052310597967divtagdefaultwrapper" style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif" dir="ltr">
<p style="margin-top:0;margin-bottom:0">I rather like agedu It probably does what you want.</p>
<p style="margin-top:0;margin-bottom:0">But as Mohammad says you do have to traverse your filesystem.</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0"><a href="https://www.chiark.greenend.org.uk/~sgtatham/agedu/" class="m_-5595814052310597967OWAAutoLink" id="m_-5595814052310597967LPlnk889730" target="_blank">https://www.chiark.greenend.<wbr>org.uk/~sgtatham/agedu/</a></p>
<div id="m_-5595814052310597967LPBorder_GT_15252478210020.20953169730489485" style="margin-bottom:20px;overflow:auto;width:100%;text-indent:0px">
<table id="m_-5595814052310597967LPContainer_15252478209960.624262908971429" style="width:90%;background-color:rgb(255,255,255);overflow:auto;padding-top:20px;padding-bottom:20px;margin-top:20px;border-top:1px dotted rgb(200,200,200);border-bottom:1px dotted rgb(200,200,200)" cellspacing="0">
<tbody>
<tr style="border-spacing:0px" valign="top">
<td id="m_-5595814052310597967TextCell_15252478209980.841700443260775" style="vertical-align:top;padding:0px;display:table-cell" colspan="2">
<div id="m_-5595814052310597967LPRemovePreviewContainer_15252478209980.06758856262382107"></div>
<div id="m_-5595814052310597967LPTitle_15252478209980.38885681528567106" style="color:rgb(0,120,215);font-weight:400;font-size:21px;font-family:"wf_segoe-ui_light","Segoe UI Light","Segoe WP Light","Segoe UI","Segoe WP",Tahoma,Arial,sans-serif;line-height:21px">
<a id="m_-5595814052310597967LPUrlAnchor_15252478210000.33630320305736583" style="text-decoration:none" href="https://www.chiark.greenend.org.uk/~sgtatham/agedu/" target="_blank">agedu: track down wasted disk space - chiark home page</a></div>
<div id="m_-5595814052310597967LPMetadata_15252478210000.37814578824189593" style="margin:10px 0px 16px;color:rgb(102,102,102);font-weight:400;font-family:"wf_segoe-ui_normal","Segoe UI","Segoe WP",Tahoma,Arial,sans-serif;font-size:14px;line-height:14px">
<a href="http://www.chiark.greenend.org.uk" target="_blank">www.chiark.greenend.org.uk</a></div>
<div id="m_-5595814052310597967LPDescription_15252478210020.30584728162971764" style="display:block;color:rgb(102,102,102);font-weight:400;font-family:"wf_segoe-ui_normal","Segoe UI","Segoe WP",Tahoma,Arial,sans-serif;font-size:14px;line-height:20px;max-height:100px;overflow:hidden">
agedu. a Unix utility for tracking down wasted disk space Introduction. Suppose you're running low on disk space. You need to free some up, by finding something that's a waste of space and deleting it (or moving it to an archive medium).</div>
</td>
</tr>
</tbody>
</table>
</div>
<br>
<p></p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<p style="margin-top:0;margin-bottom:0"><br>
</p>
<br>
<br>
<div style="color:rgb(0,0,0)">
<hr style="display:inline-block;width:98%">
<div id="m_-5595814052310597967divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> <a href="mailto:gluster-users-bounces@gluster.org" target="_blank">gluster-users-bounces@gluster.<wbr>org</a> <<a href="mailto:gluster-users-bounces@gluster.org" target="_blank">gluster-users-bounces@<wbr>gluster.org</a>> on behalf of Alex Chekholko <<a href="mailto:alex@calicolabs.com" target="_blank">alex@calicolabs.com</a>><br>
<b>Sent:</b> 01 May 2018 18:45<br>
<b>To:</b> mohammad kashif<br>
<b>Cc:</b> gluster-users<br>
<b>Subject:</b> Re: [Gluster-users] Usage monitoring per user</font>
<div> </div>
</div><div><div class="h5">
<div>
<div dir="ltr">Hi,
<div><br>
</div>
<div>There are several programs that will basically take the outputs of your scans and store the results in a database. If you size the database appropriately, then querying that database will be much quicker than querying the filesystem. But of course the
results will be a little bit outdated.</div>
<div><br>
</div>
<div>One such project is robinhood. <a href="https://emea01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fcea-hpc%2Frobinhood%2Fwiki&data=01%7C01%7Cjohe%40novozymes.com%7Cb280d3cf0fde4c28124c08d5af82fa19%7C43d5f49ee03a4d22a2285684196bb001%7C0&sdata=m5s1l7DvoKiXlAhSP8eGlu9lYjtlkIM5k3CTGt6zoH0%3D&reserved=0" id="m_-5595814052310597967LPlnk778953" class="m_-5595814052310597967OWAAutoLink" target="_blank">https://github.com/<wbr>cea-hpc/robinhood/wiki</a></div>
<div><br>
</div>
<div>A simpler way might be to just have daily/weekly cron jobs that output text reports, without maintaining a separate database.</div>
<div><br>
</div>
<div>But there is no way to avoid doing a recursive POSIX tree traversal, since that is how you get your info out of your filesystem.</div>
<div><br>
</div>
<div>Regards,</div>
<div>Alex</div>
</div>
<div class="m_-5595814052310597967x_gmail_extra"><br>
<div class="m_-5595814052310597967x_gmail_quote">On Tue, May 1, 2018 at 5:30 AM, mohammad kashif <span dir="ltr">
<<a href="mailto:kashif.alig@gmail.com" id="m_-5595814052310597967LPlnk911255" class="m_-5595814052310597967OWAAutoLink" target="_blank">kashif.alig@gmail.com</a>></span> wrote:<br>
<blockquote class="m_-5595814052310597967x_gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">Hi
<div><br>
</div>
<div>Is there any easy way to find usage per user in Gluster? We have 300TB storage with almost 100 million files. Running du take too much time. Are people aware of any other tool which can be used to break up storage per user?</div>
<div><br>
</div>
<div>Thanks</div>
<span class="m_-5595814052310597967x_HOEnZb"><font color="#888888">
<div><br>
</div>
<div>Kashif </div>
</font></span></div>
<br>
______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" id="m_-5595814052310597967LPlnk113324" class="m_-5595814052310597967OWAAutoLink" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://emea01.safelinks.protection.outlook.com/?url=http%3A%2F%2Flists.gluster.org%2Fmailman%2Flistinfo%2Fgluster-users&data=01%7C01%7Cjohe%40novozymes.com%7Cb280d3cf0fde4c28124c08d5af82fa19%7C43d5f49ee03a4d22a2285684196bb001%7C0&sdata=P%2Bkfpz8XaI7j7PM9%2FocnBkf0Wop%2BLZDAbgnvNpIcdd0%3D&reserved=0" rel="noreferrer" id="m_-5595814052310597967LPlnk431824" class="m_-5595814052310597967OWAAutoLink" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br>
</blockquote>
</div>
<br>
</div>
</div>
</div></div></div>
</div>
</div>
</blockquote></div><br></div>