[Gluster-users] Gluster quota issue
Barry Stetler
barry at hivelocity.net
Fri Apr 11 11:58:38 UTC 2014
The heartbleed bug put me back a couple days but here are the results of
running the command on all 4 gluster nodes. I did a du -sh on the two
servers that have gluster mounted.
[root at glusterfront1 gbilletz_9774]# du -sh
76G .
[root at glusterfront2 gbilletz_9774]# du -sh
76G .
root at gluster1 ~]# gluster volume quota home list /gbilletz_9774
path limit_set size
----------------------------------------------------------------------------------
/gbilletz_9774 500GB 91.7GB
[root at gluster1 ~]# gluster --version
glusterfs 3.4.2 built on Jan 3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU
General Public License.
[root at gluster1 ~]# getfattr -d -m . -e hex /export/cluster1/gbilletz_9774/
getfattr: Removing leading '/' from absolute path names
# file: export/cluster1/gbilletz_9774/
trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
trusted.glusterfs.dht=0x00000001000000007fffffffffffffff
trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000c7e202600
trusted.glusterfs.quota.dirty=0x3000
trusted.glusterfs.quota.size=0x0000000c7e202600
[root at gluster2 ~]# gluster volume quota home list /gbilletz_9774
path limit_set size
----------------------------------------------------------------------------------
/gbilletz_9774 500GB 91.7GB
[root at gluster2 ~]# gluster --version
glusterfs 3.4.2 built on Jan 3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU
General Public License.
[root at gluster2 ~]# getfattr -d -m . -e hex /export/cluster1/gbilletz_9774/
getfattr: Removing leading '/' from absolute path names
# file: export/cluster1/gbilletz_9774/
trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
trusted.glusterfs.dht=0x00000001000000007fffffffffffffff
trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000c7c520200
trusted.glusterfs.quota.dirty=0x3000
trusted.glusterfs.quota.size=0x0000000c7c520200
[root at gluster3 ~]# gluster volume quota home list /gbilletz_9774
path limit_set size
----------------------------------------------------------------------------------
/gbilletz_9774 500GB 91.7GB
[root at gluster3 ~]# gluster --version
glusterfs 3.4.2 built on Jan 3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU
General Public License.
[root at gluster3 ~]# getfattr -d -m . -e hex /export/cluster1/gbilletz_9774/
getfattr: Removing leading '/' from absolute path names
# file: export/cluster1/gbilletz_9774/
trusted.afr.home-client-2=0x000000000000000000000000
trusted.afr.home-client-3=0x000000000000000000000000
trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
trusted.glusterfs.dht=0x0000000100000000000000007ffffffe
trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000a6ff6b400
trusted.glusterfs.quota.dirty=0x3000
trusted.glusterfs.quota.size=0x0000000a6ff6b400
[root at gluster4 ~]# gluster volume quota home list /gbilletz_9774
path limit_set size
----------------------------------------------------------------------------------
/gbilletz_9774 500GB 91.5GB
[root at gluster4 ~]# gluster --version
glusterfs 3.4.2 built on Jan 3 2014 12:38:06
Repository revision: git://git.gluster.com/glusterfs.git
Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
GlusterFS comes with ABSOLUTELY NO WARRANTY.
You may redistribute copies of GlusterFS under the terms of the GNU
General Public License.
[root at gluster4 ~]# getfattr -d -m . -e hex /export/cluster1/gbilletz_9774/
getfattr: Removing leading '/' from absolute path names
# file: export/cluster1/gbilletz_9774/
trusted.afr.home-client-2=0x000000000000000000000000
trusted.afr.home-client-3=0x000000000000000000000000
trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
trusted.glusterfs.dht=0x0000000100000000000000007ffffffe
trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000a62c12e00
trusted.glusterfs.quota.dirty=0x3000
trusted.glusterfs.quota.size=0x0000000a62c12e00
[root at gluster4 ~]# gluster volume status
Status of volume: home
Gluster process Port Online Pid
------------------------------------------------------------------------------
Brick gluster1:/export/cluster1 49152 Y 1453
Brick gluster2:/export/cluster1 49152 Y 1134
Brick gluster3:/export/cluster1 49152 Y 1317
Brick gluster4:/export/cluster1 49152 Y 1220
NFS Server on localhost 2049 Y 2875
Self-heal Daemon on localhost N/A Y 1237
NFS Server on gluster1 2049 Y 29311
Self-heal Daemon on gluster1 N/A Y 1474
NFS Server on gluster3 2049 Y 26328
Self-heal Daemon on gluster3 N/A Y 1329
NFS Server on gluster2 2049 Y 27141
Self-heal Daemon on gluster2 N/A Y 1142
Barry Stetler
HIVELOCITY | Devops and Operations Leader
888-869-4678 ext. 224 | Hivelocity.net <http://hivelocity.net>
On 4/9/14, 9:25 AM, Barry Stetler wrote:
> I will check all bricks and resend thank you...
>
> Barry Stetler
> HIVELOCITY | Devops and Operations Leader
> 888-869-4678 ext. 224 | Hivelocity.net <http://hivelocity.net>
>
>
>
>
> On 4/8/2014 6:08 AM, Varun Shastry wrote:
>> Hi,
>> On Monday 07 April 2014 08:10 PM, Barry Stetler wrote:
>>> Gluster Server
>>>
>>> [root at gluster1 ~]# gluster --version
>>> glusterfs 3.4.2 built on Jan 3 2014 12:38:06
>>> Repository revision: git://git.gluster.com/glusterfs.git
>>> Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
>>> GlusterFS comes with ABSOLUTELY NO WARRANTY.
>>> You may redistribute copies of GlusterFS under the terms of the GNU
>>> General Public License.
>>> [root at gluster1 ~]#
>>>
>>>
>>> [root at gluster1 ~]# getfattr -d -m . -e hex
>>> /export/cluster1/gbilletz_9774/
>>> getfattr: Removing leading '/' from absolute path names
>>> # file: export/cluster1/gbilletz_9774/
>>> trusted.gfid=0xfd31ccda2e0447abbf9adf9fe25b9d2e
>>> trusted.glusterfs.dht=0x00000001000000007fffffffffffffff
>>> trusted.glusterfs.quota.00000000-0000-0000-0000-000000000001.contri=0x0000000c0aafb400
>>> trusted.glusterfs.quota.dirty=0x3000
>>> trusted.glusterfs.quota.size=0x0000000c0aafb400
>> There can be bug/problem in two cases
>> i. Accounting :- ie aggregated value of trusted.glusterfs.quota.size
>> from all the bricks (in above case of take one of the bricks from
>> replica pair)should match the du of the directory.
>> ii. Reading the values from trusted.glusterfs.quota.size.
>>
>> My intention was to check whether we have problem in level (i). I
>> have only one brick's information here, so can you please check and
>> where the problem among the above two cases?
>>
>> - Varun Shastry
>>>
>>> Server space is mounted on
>>>
>>> [root at glusterfront1 dump]# gluster --version
>>> glusterfs 3.4.2 built on Jan 3 2014 12:38:06
>>> Repository revision: git://git.gluster.com/glusterfs.git
>>> Copyright (c) 2006-2011 Gluster Inc. <http://www.gluster.com>
>>> GlusterFS comes with ABSOLUTELY NO WARRANTY.
>>> You may redistribute copies of GlusterFS under the terms of the GNU
>>> General Public License.
>>>
>>> Logs pretty much say quota exceeded.. On the side its mounted on I
>>> have not seen anything in logs pertaining to the issue on the
>>> gluster side.. I had to disbale it for the client but I will try to
>>> recreate the issue on another user...
>>>
>>> Actual Usage
>>> [root at glusterfront1 gjhgjhg_9774]# du -sh
>>> 85G .
>>>
>>> Gluster Usage
>>>
>>> [root at gluster1 ~]# gluster volume quota home list /gjhgjhg_9774
>>> path limit_set size
>>> ----------------------------------------------------------------------------------
>>> /gjhgjhg_9774 200GB 116.9GB
>>>
>>> Barry Stetler
>>> HIVELOCITY | Devops and Operations Leader
>>> 888-869-4678 ext. 224 | Hivelocity.net <http://hivelocity.net>
>>>
>>>
>>>
>>>
>>> On 4/7/14, 9:40 AM, Varun Shastry wrote:
>>>> Can you please provide these info?
>>>>
>>>> - gluster --version
>>>> - getfattr -d -m . -e hex <quota-limit-directories-in-the-backend>
>>>> - logs
>>>>
>>>> Thanks
>>>> Varun Shastry
>>>>
>>>> On Monday 07 April 2014 06:23 PM, Barry Stetler wrote:
>>>>> I am having an issue with Gluster quotas. User is set to to 200GB
>>>>> and he is using about 57 GB on mounted file system, Gluster says
>>>>> he is using 180 GB,
>>>>>
>>>>> gluster volume quota home list /user
>>>>>
>>>>> shows he is using 180 GB
>>>>>
>>>>> Is this a bug is this looking at the replicas?
>>>>>
>>>>> Here is the volume info
>>>>>
>>>>> Volume Name: home
>>>>> Type: Distributed-Replicate
>>>>> Volume ID: 9e0ffc91-9d46-477a-b8eb-dfd3b7d65765
>>>>> Status: Started
>>>>> Number of Bricks: 2 x 2 = 4
>>>>> Transport-type: tcp
>>>>> Bricks:
>>>>> Brick1: gluster1:/export/cluster1
>>>>> Brick2: gluster2:/export/cluster1
>>>>> Brick3: gluster3:/export/cluster1
>>>>> Brick4: gluster4:/export/cluster1
>>>>> Options Reconfigured:
>>>>>
>>>>>
>>>>> --
>>>>> Barry Stetler
>>>>> HIVELOCITY | Devops and Operations Leader
>>>>> 888-869-4678 ext. 224 | Hivelocity.net <http://hivelocity.net>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Gluster-users mailing list
>>>>> Gluster-users at gluster.org
>>>>> http://supercolony.gluster.org/mailman/listinfo/gluster-users
>>>>
>>>
>>
>
>
>
>
>
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140411/f28f81a0/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: sig.png
Type: image/png
Size: 208 bytes
Desc: not available
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140411/f28f81a0/attachment.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 208 bytes
Desc: not available
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140411/f28f81a0/attachment-0001.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 208 bytes
Desc: not available
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140411/f28f81a0/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: image/png
Size: 208 bytes
Desc: not available
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140411/f28f81a0/attachment-0003.png>
More information about the Gluster-users
mailing list