[Gluster-users] Problems after adding bricks and rebalancing

Anders Blomdell anders.blomdell at control.lth.se
Fri Jun 13 13:46:23 UTC 2014


-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Forgot to tell version; it is gluster*-3.5.0-3.fc20.x86_64

On 2014-06-13 13:54, Anders Blomdell wrote:
> After having expanded my test gluster from 2*4 to 4*4, I got very weird results in some
> directories:
> 
> On machine 1 (that had the gluster mounted during rebalance)
> # ls -l /mnt/gluster/some/sub/path/
> total 2902
> -rw-r--r-- 1 user    group    151 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.heu
> -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> -rw-r--r-- 1 user    group      0 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> ---------T 1 user    group      0 13 jun 10.08 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> -rw-r--r-- 1 user    group      0  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> -rw-r--r-- 1 user    group      0  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> -rw-r--r-- 1 user    group  54494  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.heu
> -rw-r--r-- 1 user    group 156308  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.heu
> -rw-r--r-- 1 user    group  98047  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.swz
> -rw-r--r-- 1 user    group      8  7 mar 09.42 cacheSize.txt
> ---------T 1 user    group      0 13 jun 10.08 cacheSize.txt
> -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> -rw-r--r-- 1 user    group      0  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> -rw-r--r-- 1 user    group      0  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> -rw-r--r-- 1 user    group      0  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> -rw-r--r-- 1 user    group 621999  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.swz
> 
> On machine 2 (that had the gluster mounted after rebalance)
> 
> # ls -l /mnt/gluster/some/sub/path/
> -rw-r--r-- 1 user    group    151 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.heu
> -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> ---------T 1 user    group      0 13 jun 10.08 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> -rw-r--r-- 1 user    group      0  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> -rw-r--r-- 1 user    group      0  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> -rw-r--r-- 1 user    group  54494  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.heu
> -rw-r--r-- 1 user    group 156308  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.heu
> -rw-r--r-- 1 user    group  98047  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.swz
> -rw-r--r-- 1 user    group      8  7 mar 09.42 cacheSize.txt
> ---------T 1 user    group      0 13 jun 10.08 cacheSize.txt
> -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> -rw-r--r-- 1 user    group 621999  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.swz
> 
> As can be seen there are both files with T bit set, and duplicates (sometimes up to three times
> D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu).
> 
> Anybody that has a hint of what might have gone wrong (and how to fix it)?
> 
> /Anders
> 
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
> 

- -- 
Anders Blomdell                  Email: anders.blomdell at control.lth.se
Department of Automatic Control
Lund University                  Phone:    +46 46 222 4625
P.O. Box 118                     Fax:      +46 46 138118
SE-221 00 Lund, Sweden

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJTmwCvAAoJENZYyvaDG8NcDCMH/2oSmfpzx3tHZQa7ShkHKjL2
MY495uxF/nuyVexQPt0wP+7NdMcez/UCgk0beWoclk+t2Kdmcl0Wmu9H5xgzorM7
SQ4MAoOmGiJio0WrkaRRRZZMRq5ScEka2gav/5xG9lwgAPkNnllLUhUJ0sat24Mv
LwfwOZSMUXST1Gfqq/FmHZDXi5zZc7tF1xueS8E5c1rVup4VLT1zjNY5+KpBS4Xd
WuhED68Wl0BO+9tsZSjAQB6UMI7ZN2DgcLd44LhwsA7vZsTYKPMmwQddpbhQdteU
TS8mC0oUByCTUDjHUJRR2WpphnYmCkhk8uFPqEvr/yfJrqoWZ2k1Z0QWbtqUQ2Q=
=D1YM
-----END PGP SIGNATURE-----



More information about the Gluster-users mailing list