[Gluster-users] So tangly of Glusterfs 2.0.4 distributing after dht expansion !!!!

NovA av.nova at gmail.com
Tue Jul 14 13:41:54 UTC 2009


Hi!

Empty files with sticky bit (access mode ---------T) are link-files,
which extended attributes contains the location of the real file. It's
OK, that these link-files have been created after changing the data
layout.
It seems you have not got the idea how the DHT works. It's rather
clear actually, as I understand it. When one accesses a file in a
GlusterFS directory the following actions are taken.  1) A special
number (hash) is generated from the file name. 2) Based on this number
a cluster subvolume is chosen where to look the file's data. 3) The
data is transfered form/to the selected subvolume. 3a) Instead of the
real data, the selected subvolume can contain a link to the other
subvolume where the data really resides, then the data transfered
from/to there.
The algorithm of choosing a subvolume by hash (in the 2nd item)
depends on the total number of available subvolumes. So it will select
different subvolumes if the number changes. To ensure availability of
files created in previous layout GlusterFS creates link-files, which
you see.

Best wishes,
  Andrey

2009/7/14 eagleeyes <eagleeyes at 126.com>:
> HI:
>    Today  i tested glusterfs2.0.4 with  fuse-2.8.0-pre3 , for dht expansion
> . I found a  problem.
>     I use
> [root at nio1 data6]# ls /data/
> data1  data2  data3  data4  data5  data6  as data dir ,
>
> first i  used data1+data2+data3  ,mount dot /mnt  and touch
> 11  22  33  44  55  66   , created "ddd  eee  jjj  pppppp  uuu  yy " with
> some word in them .
>         then those files  in data was :
>
> ll -h /data/*
> /data/data1:
> total 0
> -rw-r--r-- 1 root root 0 Jul 14 17:14 11
> -rw-r--r-- 1 root root 0 Jul 14 17:14 33
> /data/data2:
> total 12K
> -rw-r--r-- 1 root root   0 Jul 14 17:14 22
> -rw-r--r-- 1 root root   0 Jul 14 17:14 44
> -rw-r--r-- 1 root root 116 Jul 14 17:15 ddd
> -rw-r--r-- 1 root root 116 Jul 14 17:15 jjj
> -rw-r--r-- 1 root root 116 Jul 14 17:15 yy
> /data/data3:
> total 12K
> -rw-r--r-- 1 root root   0 Jul 14 17:14 55
> -rw-r--r-- 1 root root   0 Jul 14 17:14 66
> -rw-r--r-- 1 root root 116 Jul 14 17:15 eee
> -rw-r--r-- 1 root root 116 Jul 14 17:15 pppppp
> -rw-r--r-- 1 root root 116 Jul 14 17:15 uuu
>
> and then  i expansion dht client, used data1+data2+data3+data4+data5+data6
> ,mount dot /mnt
> this time  i find
> ll -h /data/*
> /data/data1:
> total 0
> -rw-r--r-- 1 root root 0 Jul 14 16:57 11
> -rw-r--r-- 1 root root 0 Jul 14 16:57 33
> /data/data2:
> total 16K
> ---------T 1 root root   0 Jul 14 16:58 11
> -rw-r--r-- 1 root root   0 Jul 14 16:57 22
> -rw-r--r-- 1 root root   0 Jul 14 16:57 44
> -rw-r--r-- 1 root root 126 Jul 14 16:56 ddd
> -rw-r--r-- 1 root root 126 Jul 14 16:56 jjj
> -rw-r--r-- 1 root root 126 Jul 14 16:56 yy
> /data/data3:
> total 24K
> ---------T 1 root root   0 Jul 14 16:58 44
> -rw-r--r-- 1 root root   0 Jul 14 16:57 55
> -rw-r--r-- 1 root root   0 Jul 14 16:57 66
> ---------T 1 root root   0 Jul 14 16:58 ddd
> -rw-r--r-- 1 root root 126 Jul 14 16:56 eee
> ---------T 1 root root   0 Jul 14 16:58 jjj
> -rw-r--r-- 1 root root 126 Jul 14 16:56 pppppp
> -rw-r--r-- 1 root root 126 Jul 14 16:56 uuu
> /data/data4:
> total 8.0K
> ---------T 1 root root 0 Jul 14 16:58 22
> ---------T 1 root root 0 Jul 14 16:58 yy
> /data/data5:
> total 4.0K
> ---------T 1 root root 0 Jul 14 16:58 55
> /data/data6:
> total 16K
> ---------T 1 root root 0 Jul 14 16:58 66
> ---------T 1 root root 0 Jul 14 16:58 eee
> ---------T 1 root root 0 Jul 14 16:58 pppppp
> ---------T 1 root root 0 Jul 14 16:58 uuu
>
> files' names  appeared in data4 data5 data6 ,but no byte . Why was it ?
> If a directory  i can comprehend ,but those was files  and  appeared files
> was not all files in  data1+data2+data3  .
> Why  the files distributing was  so tangly .
>
> 2009-07-14
> ________________________________
> eagleeyes
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://zresearch.com/cgi-bin/mailman/listinfo/gluster-users
>
>




More information about the Gluster-users mailing list