[Gluster-users] Self-heal Problems with gluster and nfs

[Norman Mähler]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1



Am 07.07.2014 15:39, schrieb Pranith Kumar Karampuri:
> 
> On 07/07/2014 06:58 PM, Norman Mähler wrote: Dear community,
> 
> we have got some serious problems with our Gluster installation.
> 
> Here is the setting:
> 
> We have got 2 bricks (version 3.4.4) on a debian 7.5, one of them
> with an nfs export. There are about 120 clients connecting to the
> exported nfs. These clients are thin clients reading and writing
> their Linux home directories from the exported nfs.
> 
> We want to change the access of these clients one by one to access
> via gluster client.
>> I did not understand what you meant by this. Are you moving to 
>> glusterfs-fuse based mounts?

Yes, this is what i meant. At the moment we are using 90% nfs and 10%
mounts with glusterfs.fuse
> 
> 
> 
> Here are our problems:
> 
> In the moment we have got two types of error messages which come
> in burts to our glusterfshd.log
> 
> [2014-07-07 13:10:21.572487] W 
> [client-rpc-fops.c:1538:client3_3_inodelk_cbk] 
> 0-gluster_dateisystem-client-1: remote operation failed: No such
> file or directory [2014-07-07 13:10:21.573448] W 
> [client-rpc-fops.c:471:client3_3_open_cbk] 
> 0-gluster_dateisystem-client-1: remote operation failed: No such
> file or directory. Path:
> <gfid:b0c4f78a-249f-4db7-9d5b-0902c7d8f6cc> 
> (00000000-0000-0000-0000-000000000000) [2014-07-07 13:10:21.573468]
> E [afr-self-heal-data.c:1270:afr_sh_data_open_cbk] 
> 0-gluster_dateisystem-replicate-0: open of 
> <gfid:b0c4f78a-249f-4db7-9d5b-0902c7d8f6cc> failed on child 
> gluster_dateisystem-client-1 (No such file or directory)
> 
> 
> This looks like a missing gfid file on one of the bricks. I looked
> it up and yes the file is missing on the second brick.
> 
> We got these messages the other way round, too (missing on
> client-0 and the first brick).
> 
> Is it possible to repair this one by copying the gfid file to the 
> brick where it was missing? Or ist there another way to repair it?

I read some more documentation and came to the conclusion, that this
will not work because a have to hardlink the gfid files for that.

> 
> 
> The second message is
> 
> [2014-07-07 13:06:35.948738] W 
> [client-rpc-fops.c:2469:client3_3_link_cbk] 
> 0-gluster_dateisystem-client-1: remote operation failed: File
> exists (00000000-0000-0000-0000-000000000000 -> 
> <gfid:aae47250-8f69-480c-ac75-2da2f4d21d7a>/lock)
> 
> and I really do not know what to do with this one...
>> Did any of the bricks went offline and came back online?
> 

It went down once, yes. While doing a rsync from the former system.

>> Pranith
> 
> 
> I am really looking forward to your help because this is an active 
> system and the system load on the nfs brick is about 25 (!!)
> 
> Thanks in advance! Norman Maehler
> 
> 
>> _______________________________________________ Gluster-users
>> mailing list Gluster-users at gluster.org 
>> http://supercolony.gluster.org/mailman/listinfo/gluster-users
> 

- -- 
Mit freundlichen Grüßen,

Norman Mähler

Bereichsleiter IT-Hochschulservice
uni-assist e. V.
Geneststr. 5
Aufgang H, 3. Etage
10829 Berlin

Tel.: 030-66644382
n.maehler at uni-assist.de
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJTusbjAAoJEB810LSP8y+R6M0H/1pQxrcRrOOR/A9tBXEcSuIn
cnhAfXRLv1vGwvT4BVYoXpKhC6vmI7ha+8VhY9i8z8fq7ihjfcA8i4zn4A029PzO
unrE8I9vS3r7V6Jdwul9L2v3W108qQ8Y2vp/+ac3XjJbk2gaTXP+wyyZo/fx98yL
zxRlS415EoZO/ZvvsTlFsUVKHtgPPvizUqSNBMpLCH+iKT525HBdFYTC8QsIsCCv
IjEOEc5XdJcn2CoSFjZlLpAGhrhK/9psGNIMccAvchWvyxcbb2t3m467xJ4Q5D+h
JXyIEkybn5susIE9ZNQDtsHHHlR41QPDqLZGejGeXnbXd7j9KRzNvnx8IK11OSo=
=18iA
-----END PGP SIGNATURE-----