[Gluster-users] Problems after adding bricks and rebalancing
Pranith Kumar Karampuri
pkarampu at redhat.com
Wed Jun 18 02:20:07 UTC 2014
CC people who work on rebalance.
Pranith
On 06/13/2014 05:24 PM, Anders Blomdell wrote:
> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
>
> After having expanded my test gluster from 2*4 to 4*4, I got very weird results in some
> directories:
>
> On machine 1 (that had the gluster mounted during rebalance)
> # ls -l /mnt/gluster/some/sub/path/
> total 2902
> - -rw-r--r-- 1 user group 151 10 nov 2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.heu
> - -rw-r--r-- 1 user group 565987 10 nov 2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user group 0 10 nov 2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user group 565987 10 nov 2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> - ---------T 1 user group 0 13 jun 10.08 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> - -rw-r--r-- 1 user group 317992 7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user group 0 7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user group 317992 7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user group 0 7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user group 151 7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user group 54494 7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.heu
> - -rw-r--r-- 1 user group 156308 7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.heu
> - -rw-r--r-- 1 user group 98047 7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.swz
> - -rw-r--r-- 1 user group 8 7 mar 09.42 cacheSize.txt
> - ---------T 1 user group 0 13 jun 10.08 cacheSize.txt
> - -rw-r--r-- 1 user group 148 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user group 0 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user group 148 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user group 131911 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user group 0 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user group 131911 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user group 0 7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user group 151 7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user group 621999 7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.swz
>
> On machine 2 (that had the gluster mounted after rebalance)
>
> # ls -l /mnt/gluster/some/sub/path/
> - -rw-r--r-- 1 user group 151 10 nov 2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.heu
> - -rw-r--r-- 1 user group 565987 10 nov 2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user group 565987 10 nov 2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user group 565987 10 nov 2010 1C04C61346A1FA3139A37D860ED92632AA13DECF.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> - ---------T 1 user group 0 13 jun 10.08 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.heu
> - -rw-r--r-- 1 user group 317992 7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user group 0 7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user group 317992 7 mar 09.42 33D9983BC427DD69DF151E816FB0AB02C0B8D5CF.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user group 0 7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user group 151 7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.heu
> - -rw-r--r-- 1 user group 54494 7 mar 09.42 67BA9F962EEC4D8B413432AFAD5C88BB810426B9.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.heu
> - -rw-r--r-- 1 user group 156308 7 mar 09.42 7421C71F94DB4F028E7528B2D278F3FE4DC21273.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.heu
> - -rw-r--r-- 1 user group 98047 7 mar 09.42 C3306B26751D6A80EB1FCB651912469AE18819AB.swz
> - -rw-r--r-- 1 user group 8 7 mar 09.42 cacheSize.txt
> - ---------T 1 user group 0 13 jun 10.08 cacheSize.txt
> - -rw-r--r-- 1 user group 148 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user group 148 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user group 148 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu
> - -rw-r--r-- 1 user group 131911 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user group 131911 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user group 131911 7 mar 09.42 D796AC95BD6E16151B6D3C0019A52E648CED1FE1.swz
> - -rw-r--r-- 1 user group 151 7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user group 151 7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user group 151 7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.heu
> - -rw-r--r-- 1 user group 621999 7 mar 09.42 F74FCD943BAC79E6DADBF0307B55B0697C5907E4.swz
>
> As can be seen there are both files with T bit set, and duplicates (sometimes up to three times
> D796AC95BD6E16151B6D3C0019A52E648CED1FE1.heu).
>
> Anybody that has a hint of what might have gone wrong (and how to fix it)?
>
> /Anders
>
> - --
> Anders Blomdell Email: anders.blomdell at control.lth.se
> Department of Automatic Control
> Lund University Phone: +46 46 222 4625
> P.O. Box 118 Fax: +46 46 138118
> SE-221 00 Lund, Sweden
>
> -----BEGIN PGP SIGNATURE-----
> Version: GnuPG v1
> Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
>
> iQEcBAEBAgAGBQJTmuZbAAoJENZYyvaDG8NcSBUH/0xotErU1u0GMjfTI5puq8te
> WxXSYWu8um9+6e5LBQi0w6lAoJLZ1GaAaL5s0BtvKKDeKHYWt3HcFMj6RLd996wz
> sTp/ltA0eMnLuFZUTqwE/kyL7m8JR6D0bGlTcH4R8VN641WImwAx3th7vuRaTDyt
> 9fwNfLS4OexBXefR7LNZmRl6E4t1G8aaDl2PrLpqPBB8u9AMls0l5D22hmlgAMIt
> K1olC589nskhKxVgEAcafsNixZM2PfLREX+Tifs/y7R3gNBtKvdp+OXZ8TEmm2cy
> 1WXzEWUsSncgTtTQly0E4nBpBmb3Wo9de1ofLp2SimZKee/sJ2pMS4kbn83kAW8=
> =IlR7
> -----END PGP SIGNATURE-----
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://supercolony.gluster.org/mailman/listinfo/gluster-users
More information about the Gluster-users
mailing list