[Gluster-users] Usage not updating in quotas

Tue Apr 26 09:08:13 UTC 2022

Dear Amar and list,

Coming back to this again a few months later. We have a need for quotas so
I'm curious to hear if anything has changed in Gluster or the wider
ecosystem. What do people use for quotas? We are currently on Gluster 9.5
and will be moving to Gluster 10 once we complete our CentOS Stream 8
migration.

Thank you,

On Tue, Sep 14, 2021 at 3:45 PM Alan Orth <alan.orth at gmail.com> wrote:

> Thank you for the feedback, Amar!
>
> This is the first time I'm hearing of the Kadalu project. I will keep an
> eye on that as well as Gluster 10.
>
> Cheers,
>
> On Thu, Sep 9, 2021 at 10:30 AM Amar Tumballi <amar at kadalu.io> wrote:
>
>>
>>
>> On Thu, Sep 9, 2021 at 11:13 AM Alan Orth <alan.orth at gmail.com> wrote:
>>
>>> For what it's worth, I disabled quotas and re-enabled them. This of
>>> course caused the limits I had set to be erased and GlusterFS to re-run the
>>> find/stat on all bricks. Once it finished I was able to add a limit and it
>>> was finally accurate.
>>>
>>> I'm still hoping someone can comment about this. Is it normal, what is
>>> the status of quotas in GlusterFS 8.x, is there maintenance I should do,
>>> etc?
>>>
>>>
>> Glad to hear that it worked for you. In general, Quota feature is
>> maintained not actively but based on any critical or CVE bug fixes right
>> now.
>>
>> We needed quota feature for the kadalu project (https://kadalu.io or
>> https://github.com/kadalu/kadalu), for which the crawling quota update
>> turned out to be a major bottleneck. Hence we came up with 'simple-quota'
>> approach which is based on ideas previously discussed around project quotas
>> etc. The feature is already developed and used in kadalu releases, but
>> waiting reviews in glusterfs. Hopefully would make it to glusterfs-10.
>>
>>
>>> Thank you,
>>>
>>> On Thu, Sep 2, 2021 at 1:42 PM Alan Orth <alan.orth at gmail.com> wrote:
>>>
>>>> Yesterday I noticed that there were still several find / stat processes
>>>> running on this node (there are two bricks for this volume on this host)
>>>> after enabling quotas:
>>>>
>>>> # ps auxw | grep stat
>>>> root      5875  0.0  0.0 112812   976 pts/0    S+   13:28   0:00 grep
>>>> --color=auto stat
>>>> root     19846  3.9  0.0 121804  2624 ?        S    Aug31  52:49
>>>> /usr/bin/find . -exec /usr/bin/stat {} \ ;
>>>> root     19856  3.1  0.0 121784  2536 ?        S    Aug31  42:02
>>>> /usr/bin/find . -exec /usr/bin/stat {} \ ;
>>>>
>>>> I waited for them to finish, but my quota information is still
>>>> incorrect for the two directories I have enabled it on. I ran the
>>>> quota_fsck.py script on two different hosts and every time it runs it has a
>>>> different number of objects fixed:
>>>>
>>>> # ./quota_fsck.py --sub-dir aorth --fix-issues /mnt/homes-quota-fix
>>>> /data/glusterfs/sdc/homes
>>>>
>>>> MARKING DIRTY: /data/glusterfs/sdc/homes/aorth
>>>> stat on /mnt/homes-quota-fix/aorth
>>>> Files verified : 9160
>>>> Directories verified : 4670
>>>> Objects Fixed : 2920
>>>>
>>>> MARKING DIRTY: /data/glusterfs/sdc/homes/aorth
>>>> stat on /mnt/homes-quota-fix/aorth
>>>> Files verified : 9160
>>>> Directories verified : 4670
>>>> Objects Fixed : 3487
>>>>
>>>> MARKING DIRTY: /data/glusterfs/sdc/homes/aorth
>>>> stat on /mnt/homes-quota-fix/aorth
>>>> Files verified : 9160
>>>> Directories verified : 4670
>>>> Objects Fixed : 3486
>>>>
>>>> What's going on here?
>>>>
>>>> Thank you for any help...
>>>>
>>>> On Wed, Sep 1, 2021 at 10:41 AM Alan Orth <alan.orth at gmail.com> wrote:
>>>>
>>>>> Dear list,
>>>>>
>>>>> I enabled quotas and set hard limits for several directories on a
>>>>> distribute–replicate replica 2 volume yesterday. After setting the limits I
>>>>> did a du, a find/stat, and a recursive ls on the paths on the FUSE mount.
>>>>> The usage reported in `gluster volume quota <volume> list` initially began
>>>>> to update, but now it's been about twelve hours and the reported usage is
>>>>> still much lower than actual usage.
>>>>>
>>>>> GlusterFS version 8.5 on CentOS 7. How can I force the quotas to
>>>>> update?
>>>>>
>>>>> Thank you,
>>>>>
>>>>> --
>>>>> Alan Orth
>>>>> alan.orth at gmail.com
>>>>> https://picturingjordan.com
>>>>> https://englishbulgaria.net
>>>>> https://mjanja.ch
>>>>>
>>>>
>>>>
>>>> --
>>>> Alan Orth
>>>> alan.orth at gmail.com
>>>> https://picturingjordan.com
>>>> https://englishbulgaria.net
>>>> https://mjanja.ch
>>>>
>>>
>>>
>>> --
>>> Alan Orth
>>> alan.orth at gmail.com
>>> https://picturingjordan.com
>>> https://englishbulgaria.net
>>> https://mjanja.ch
>>> ________
>>>
>>>
>>>
>>> Community Meeting Calendar:
>>>
>>> Schedule -
>>> Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
>>> Bridge: https://meet.google.com/cpu-eiue-hvk
>>> Gluster-users mailing list
>>> Gluster-users at gluster.org
>>> https://lists.gluster.org/mailman/listinfo/gluster-users
>>>
>>
>>
>> --
>> --
>> https://kadalu.io
>> Container Storage made easy!
>>
>>
>
> --
> Alan Orth
> alan.orth at gmail.com
> https://picturingjordan.com
> https://englishbulgaria.net
> https://mjanja.ch
>

-- 
Alan Orth
alan.orth at gmail.com
https://picturingjordan.com
https://englishbulgaria.net
https://mjanja.ch
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20220426/67a4cf0e/attachment.html>