[Gluster-users] Problems after adding bricks and rebalancing

Anders Blomdell anders.blomdell at control.lth.se
Fri Jun 13 11:54:03 UTC 2014 

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

After having expanded my test gluster from 2*4 to 4*4, I got very weird results in some
directories:

On machine 1 (that had the gluster mounted during rebalance)
# ls -l /mnt/gluster/some/sub/path/
total 2902
- -rw-r--r-- 1 user    group    151 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.heu
- -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
- -rw-r--r-- 1 user    group      0 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
- -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
- ---------T 1 user    group      0 13 jun 10.08 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
- -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
- -rw-r--r-- 1 user    group      0  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
- -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
- -rw-r--r-- 1 user    group      0  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
- -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
- -rw-r--r-- 1 user    group  54494  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.heu
- -rw-r--r-- 1 user    group 156308  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.heu
- -rw-r--r-- 1 user    group  98047  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.swz
- -rw-r--r-- 1 user    group      8  7 mar 09.42 cacheSize.txt
- ---------T 1 user    group      0 13 jun 10.08 cacheSize.txt
- -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
- -rw-r--r-- 1 user    group      0  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
- -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
- -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
- -rw-r--r-- 1 user    group      0  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
- -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
- -rw-r--r-- 1 user    group      0  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
- -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
- -rw-r--r-- 1 user    group 621999  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.swz

On machine 2 (that had the gluster mounted after rebalance)

# ls -l /mnt/gluster/some/sub/path/
- -rw-r--r-- 1 user    group    151 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.heu
- -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
- -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
- -rw-r--r-- 1 user    group 565987 10 nov  2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
- ---------T 1 user    group      0 13 jun 10.08 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
- -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
- -rw-r--r-- 1 user    group      0  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
- -rw-r--r-- 1 user    group 317992  7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
- -rw-r--r-- 1 user    group      0  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
- -rw-r--r-- 1 user    group    151  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
- -rw-r--r-- 1 user    group  54494  7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.heu
- -rw-r--r-- 1 user    group 156308  7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.heu
- -rw-r--r-- 1 user    group  98047  7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.swz
- -rw-r--r-- 1 user    group      8  7 mar 09.42 cacheSize.txt
- ---------T 1 user    group      0 13 jun 10.08 cacheSize.txt
- -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
- -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
- -rw-r--r-- 1 user    group    148  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
- -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
- -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
- -rw-r--r-- 1 user    group 131911  7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
- -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
- -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
- -rw-r--r-- 1 user    group    151  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
- -rw-r--r-- 1 user    group 621999  7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.swz

As can be seen there are both files with T bit set, and duplicates (sometimes up to three times
D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu).

Anybody that has a hint of what might have gone wrong (and how to fix it)?

/Anders

- -- 
Anders Blomdell                  Email: anders.blomdell at control.lth.se
Department of Automatic Control
Lund University                  Phone:    +46 46 222 4625
P.O. Box 118                     Fax:      +46 46 138118
SE-221 00 Lund, Sweden

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/

iQEcBAEBAgAGBQJTmuZbAAoJENZYyvaDG8NcSBUH/0xotErU1u0GMjfTI5puq8te
WxXSYWu8um9+6e5LBQi0w6lAoJLZ1GaAaL5s0BtvKKDeKHYWt3HcFMj6RLd996wz
sTp/ltA0eMnLuFZUTqwE/kyL7m8JR6D0bGlTcH4R8VN641WImwAx3th7vuRaTDyt
9fwNfLS4OexBXefR7LNZmRl6E4t1G8aaDl2PrLpqPBB8u9AMls0l5D22hmlgAMIt
K1olC589nskhKxVgEAcafsNixZM2PfLREX+Tifs/y7R3gNBtKvdp+OXZ8TEmm2cy
1WXzEWUsSncgTtTQly0E4nBpBmb3Wo9de1ofLp2SimZKee/sJ2pMS4kbn83kAW8=
=IlR7
-----END PGP SIGNATURE-----

More information about the Gluster-users mailing list