[Gluster-users] Quota

Tue Jul 14 07:35:39 UTC 2015

Hi Vijay,

However the problem seemed to happen with one of these path… From strace output…

Geoffrey
------------------------------------------------------
Geoffrey Letessier
Responsable informatique & ingénieur système
UPR 9080 - CNRS - Laboratoire de Biochimie Théorique
Institut de Biologie Physico-Chimique
13, rue Pierre et Marie Curie - 75005 Paris
Tel: 01 58 41 50 93 - eMail: geoffrey.letessier at ibpc.fr

Le 14 juil. 2015 à 05:15, Vijaikumar M <vmallika at redhat.com> a écrit :

> Hi Geoffrey,
> 
> Quota-Crawl is a background operation, this will not create problem in IO path.
> I will check the logs provided if I can find some clue here.
> 
> Thanks,
> Vijay
> 
> 
> 
> On Tuesday 14 July 2015 12:08 AM, Geoffrey Letessier wrote:
>> Additional information:
>> 
>> Here what i can find in /var/log/glusterfs/vol_home-quota-crawl.log:
>> [2015-07-13 16:41:08.099848] W [rdma.c:121:gf_rdma_new_post] 0-vol_home-client-0: memory registration failed (Ne peut allouer de la mémoire)
>> [2015-07-13 16:41:08.099899] E [rdma.c:333:__gf_rdma_create_posts] 0-vol_home-client-0: post creation failed
>> [2015-07-13 16:41:51.692421] E [rdma.c:796:gf_rdma_get_device] 0-vol_home-client-0: could not allocate posts for device (qib0)
>> [2015-07-13 16:41:51.693331] I [mem-pool.c:604:mem_pool_destroy] 0-glusterfs: size=1404 max=0 total=0
>> [2015-07-13 16:41:51.693391] I [mem-pool.c:604:mem_pool_destroy] 0-glusterfs: size=132 max=0 total=0
>> [2015-07-13 16:41:51.696491] I [mem-pool.c:604:mem_pool_destroy] 0-glusterfs: size=52 max=0 total=0
>> [2015-07-13 16:41:51.697378] W [rdma.c:3141:gf_rdma_create_qp] 0-vol_home-client-0: cannot get device for device qib0
>> [2015-07-13 16:41:51.697394] W [rdma.c:1047:gf_rdma_cm_handle_route_resolved] 0-vol_home-client-0: could not create QP (peer:10.0.4.1:24008 me:10.0.4.1:988)
>> 
>> Is RDMA afresh supported? or do you advice me to set TCP as transport-type? If you advice me to change the transport-type, can you explain me how to do it step-by-step because I set my volume with rdma only as transport-type…
>> 
>> Thanks in advance,
>> Geoffrey
>> 
>> ------------------------------------------------------
>> Geoffrey Letessier
>> Responsable informatique & ingénieur système
>> UPR 9080 - CNRS - Laboratoire de Biochimie Théorique
>> Institut de Biologie Physico-Chimique
>> 13, rue Pierre et Marie Curie - 75005 Paris
>> Tel: 01 58 41 50 93 - eMail: geoffrey.letessier at ibpc.fr
>> 
>> Le 13 juil. 2015 à 20:25, Geoffrey Letessier <geoffrey.letessier at cnrs.fr> a écrit :
>> 
>>> Arf, now, without quota features enabled, my system hangs with a DF, a LS on, etc..
>>> Here is the result of strace command:
>>> statfs("/archive/sterpone_team", {f_type="NFS_SUPER_MAGIC", f_bsize=1048576, f_blocks=36700160, f_bfree=22460451, f_bavail=22460451, f_files=45999237162, f_ffree=45999003257, f_fsid={0, 0}, f_namelen=255, f_frsize=1048576}) = 0
>>> statfs("/archive/amyloid_team", {f_type="NFS_SUPER_MAGIC", f_bsize=1048576, f_blocks=7340032, f_bfree=3258562, f_bavail=3258562, f_files=6676333171, f_ffree=6673534246, f_fsid={0, 0}, f_namelen=255, f_frsize=1048576}) = 0
>>> statfs("/home", {f_type=0x65735546, f_bsize=131072, f_blocks=602107776, f_bfree=602106710, f_bavail=602106710, f_files=7707031808, f_ffree=7707031719, f_fsid={0, 0}, f_namelen=255, f_frsize=131072}) = 0
>>> statfs("/tmp/mntqM2nAB", 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> ^C <unfinished ...>
>>> 
>>> As you can note, a mount point to /mnt/mntqM2nAB that i dont know appears to exist… Do you have an idea of what it is form?
>>> 
>>> Here is an extract of /etc/mtab file:
>>> localhost:vol_home.rdma /home fuse.glusterfs rw,default_permissions,allow_other,max_read=131072 0 0
>>> localhost:vol_home /tmp/mntqM2nAB fuse.glusterfs rw,default_permissions,allow_other,max_read=131072 0 0
>>> localhost:vol_home /tmp/mnt88HLLE fuse.glusterfs rw,default_permissions,allow_other,max_read=131072 0 0
>>> 
>>> 
>>> Geoffrey
>>> ------------------------------------------------------
>>> Geoffrey Letessier
>>> Responsable informatique & ingénieur système
>>> UPR 9080 - CNRS - Laboratoire de Biochimie Théorique
>>> Institut de Biologie Physico-Chimique
>>> 13, rue Pierre et Marie Curie - 75005 Paris
>>> Tel: 01 58 41 50 93 - eMail: geoffrey.letessier at ibpc.fr
>>> 
>>> Le 13 juil. 2015 à 16:45, Atin Mukherjee <atin.mukherjee83 at gmail.com> a écrit :
>>> 
>>>> 
>>>> -Atin
>>>> Sent from one plus one
>>>> On Jul 13, 2015 8:08 PM, "Geoffrey Letessier" <geoffrey.letessier at cnrs.fr> wrote:
>>>> >
>>>> > Hi Atin,
>>>> >
>>>> > First of all, thanks for your reply and for your help.
>>>> > Now, after having set features.quota-deem-statfs to on, my df hang:
>>>> >
>>>> > # gluster volume set vol_home features.quota-deem-statfs on;
>>>> > volume set: success
>>>> > [root at lucifer ~]# df
>>>> I am not a quota expert, Vijaikumar can help you on this. However 'strace df' might give you a hint where exactly its stuck.
>>>> >
>>>> > An idea? :)
>>>> >
>>>> > Thanks in advance,
>>>> > Geoffrey
>>>> > ------------------------------------------------------
>>>> > Geoffrey Letessier
>>>> > Responsable informatique & ingénieur système
>>>> > UPR 9080 - CNRS - Laboratoire de Biochimie Théorique
>>>> > Institut de Biologie Physico-Chimique
>>>> > 13, rue Pierre et Marie Curie - 75005 Paris
>>>> > Tel: 01 58 41 50 93 - eMail: geoffrey.letessier at ibpc.fr
>>>> >
>>>> >> Le 13 juil. 2015 à 16:29, Atin Mukherjee <atin.mukherjee83 at gmail.com> a écrit :
>>>> >>
>>>> >> Please bump up the op version by Gluster volume set all cluster.op-version 30702
>>>> >>
>>>> >> -Atin
>>>> >> Sent from one plus one
>>>> >>
>>>> >> On Jul 13, 2015 7:43 PM, "Geoffrey Letessier" <geoffrey.letessier at cnrs.fr> wrote:
>>>> >>>
>>>> >>> Dear all,
>>>> >>>
>>>> >>> I just upgraded my storage cluster from 3.5.3 to the latest version of GlusterFS (3.7.2-3) but when I want to activate quota info my volume I obtain this result:
>>>> >>> # gluster volume quota vol_home enable
>>>> >>> quota command failed : Volume quota failed. The cluster is operating at version 3. Quota command enable is unavailable in this version.
>>>> >>>
>>>> >>> Can you give me your help?
>>>> >>>
>>>> >>> Thanks in advance,
>>>> >>> Geoffrey
>>>> >>> ------------------------------------------------------
>>>> >>> Geoffrey Letessier
>>>> >>> Responsable informatique & ingénieur système
>>>> >>> UPR 9080 - CNRS - Laboratoire de Biochimie Théorique
>>>> >>> Institut de Biologie Physico-Chimique
>>>> >>> 13, rue Pierre et Marie Curie - 75005 Paris
>>>> >>> Tel: 01 58 41 50 93 - eMail: geoffrey.letessier at ibpc.fr
>>>> >>>
>>>> >>>
>>>> >>> _______________________________________________
>>>> >>> Gluster-users mailing list
>>>> >>> Gluster-users at gluster.org
>>>> >>> http://www.gluster.org/mailman/listinfo/gluster-users
>>>> >
>>>> >
>>> 
>> 
> 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150714/391decba/attachment.html>