[Gluster-users] Quota problems with Gluster3.3b2

[Daniel Pereira]

  Hi everyone,

  I'm playing with Gluster3.3b2, and everything is working fine when 
uploading stuff through swift. However, when I enable quotas on Gluster, 
I randomly get permission errors. Sometimes I can upload files, most 
times I can't.

  I'm mounting the partitions with the acl flag, I've tried wiping out 
everything and starting from scratch, same result. As soon as I disable 
quotas everything works great. I don't even need to add any limit-usage 
for the errors to crop up.

  Any idea?

Daniel



  Relevant info:

=========================
  To enable quotas I use the following commands:

# /usr/local/sbin/gluster volume quota r2 enable
Enabling quota has been successful

# /usr/local/sbin/gluster volume quota r2 list
Limit not set on any directory

# /usr/local/sbin/gluster volume quota r2 limit-usage /test 10GB
limit set on /test

# /usr/local/sbin/gluster volume quota r2 list
     path          limit_set         size
----------------------------------------------------------------------------------
/test                      10GB               88.0KB

# /usr/local/sbin/gluster volume quota r2 disable
Disabling quota will delete all the quota configuration. Do you want to 
continue? (y/n) y
Disabling quota has been successful

=========================
  Directory listing:
ls -la *
test:
total 184
drwxrwxrwx 2 user user 24576 Jan 13 12:07 .
drwxrwxrwx 5 user user 24576 Jan 13 12:03 ..
-rw------- 1 user user 82735 Jan 13 12:07 manual.txt

tmp:
total 96
drwxrwxrwx 2 user user 24576 Jan 13 12:07 .
drwxrwxrwx 5 user user 24576 Jan 13 12:03 ..

==========================
Gluster logs:
Unsuccessful write:

[2012-01-13 12:06:27.97140] I [afr-common.c:1225:afr_launch_self_heal] 
0-r2-replicate-4: background  entry self-heal triggered. path: /tmp
[2012-01-13 12:06:27.97704] I 
[afr-self-heal-common.c:2022:afr_self_heal_completion_cbk] 
0-r2-replicate-4: background  entry self-heal completed on /tmp
[2012-01-13 12:06:27.102813] I [afr-common.c:1225:afr_launch_self_heal] 
0-r2-replicate-4: background  entry self-heal triggered. path: /test
[2012-01-13 12:06:27.103199] I 
[afr-self-heal-common.c:2022:afr_self_heal_completion_cbk] 
0-r2-replicate-4: background  entry self-heal completed on /test
[2012-01-13 12:06:27.106876] E 
[stat-prefetch.c:695:sp_remove_caches_from_all_fds_opened] 
(-->/usr/local/lib/glusterfs/3.3beta2/xlator/mount/fuse.so(fuse_setxattr_resume+0x148) 
[0x2acd7b862118] 
(-->/usr/local/lib/glusterfs/3.3beta2/xlator/debug/io-stats.so(io_stats_setxattr+0x15f) 
[0x2aaaae8cf71f] 
(-->/usr/local/lib/glusterfs/3.3beta2/xlator/performance/stat-prefetch.so(sp_setxattr+0x6c) 
[0x2aaaae6bc3fc]))) 0-r2-stat-prefetch: invalid argument: inode
[2012-01-13 12:06:27.164168] I 
[client3_1-fops.c:1999:client3_1_rename_cbk] 0-r2-client-8: remote 
operation failed: Permission denied
[2012-01-13 12:06:27.164211] I 
[client3_1-fops.c:1999:client3_1_rename_cbk] 0-r2-client-9: remote 
operation failed: Permission denied
[2012-01-13 12:06:27.164227] W [dht-rename.c:480:dht_rename_cbk] 
0-r2-dht: /tmp/tmpyhBbAD: rename on r2-replicate-4 failed (Permission 
denied)
[2012-01-13 12:06:27.164855] W [fuse-bridge.c:1351:fuse_rename_cbk] 
0-glusterfs-fuse: 706: /tmp/tmpyhBbAD -> /test/manual.txt => -1 
(Permission denied)
[2012-01-13 12:06:27.166115] I 
[client3_1-fops.c:1999:client3_1_rename_cbk] 0-r2-client-8: remote 
operation failed: Permission denied
[2012-01-13 12:06:27.166142] I 
[client3_1-fops.c:1999:client3_1_rename_cbk] 0-r2-client-9: remote 
operation failed: Permission denied
[2012-01-13 12:06:27.166156] W [dht-rename.c:480:dht_rename_cbk] 
0-r2-dht: /tmp/tmpyhBbAD: rename on r2-replicate-4 failed (Permission 
denied)
[2012-01-13 12:06:27.166763] W [fuse-bridge.c:1351:fuse_rename_cbk] 
0-glusterfs-fuse: 707: /tmp/tmpyhBbAD -> /test/manual.txt => -1 
(Permission denied)

Successful write:
[2012-01-13 12:07:02.49562] I [afr-common.c:1225:afr_launch_self_heal] 
0-r2-replicate-4: background  entry self-heal triggered. path: /test
[2012-01-13 12:07:02.50013] I 
[afr-self-heal-common.c:2022:afr_self_heal_completion_cbk] 
0-r2-replicate-4: background  entry self-heal completed on /test
[2012-01-13 12:07:02.52255] I [afr-common.c:1225:afr_launch_self_heal] 
0-r2-replicate-4: background  entry self-heal triggered. path: /tmp
[2012-01-13 12:07:02.52832] I 
[afr-self-heal-common.c:2022:afr_self_heal_completion_cbk] 
0-r2-replicate-4: background  entry self-heal completed on /tmp