[Gluster-devel] copy glitch, latest TLA

Harris Landgarten harrisl at lhjonline.com
Fri Jul 27 21:57:10 UTC 2007 

No. Just writeback and io-threads

Harris

----- Original Message -----
From: "Anand Avati" <avati at zresearch.com>
To: "Harris Landgarten" <harrisl at lhjonline.com>
Cc: "Anand Babu Periasamy" <ab at gnu.org.in>, gluster-devel at nongnu.org
Sent: Friday, July 27, 2007 5:34:10 PM (GMT-0500) America/New_York
Subject: Re: [Gluster-devel] copy glitch, latest TLA

Harris, 
do you have io-cache in your setup? 

avati 


2007/7/27 , Harris Landgarten < harrisl at lhjonline.com >: 

The cp -av behavior I am seeing worked in patch-368. I am also seeing some other issues. 

1. my tar test slowed down after 368. 366 is still fast. 
2. running tar -cf immediately after restarting the client results is a failure: bad descriptor. tar -cvf runs. rerunning tar -cf runs as well. It is difficult to test this further because slowing it down makes the error go away. It also does not happen every time. 

Harris 

----- Original Message ----- 
From: "Anand Babu Periasamy" < ab at gnu.org.in > 
To: "Harris Landgarten" < harrisl at lhjonline.com > 
Cc: "Brent A Nelson" < brent at phys.ufl.edu >, gluster-devel at nongnu.org 
Sent: Thursday, July 26, 2007 7:48:12 PM (GMT-0500) America/New_York 
Subject: Re: [Gluster-devel] copy glitch, latest TLA 

You are correct, Brent's strace confirms it. ls gets the file listing 
from name space, but stat on it is performed on actual file. It looks 
like only name space entries are made, but files were not copied. We are 
looking into it. 

-- 
Anand Babu 
GPG Key ID: 0x62E15A31 
Blog [ http://ab.freeshell.org ] 
The GNU Operating System [ http://www.gnu.org ] 
Z RESEARCH Inc [ http://www.zresearch.com ] 



Harris Landgarten wrote: 
> I can verify that something is wrong. 
> 
> cp -av /usr/share/zoneinfo /mnt/glusterfs/test/ 
> 
> completed without error. 
> 
> Then: 
> 
> ls -lh /mnt/glusterfs/test/zoneinfo/ 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Hongkong: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Turkey: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/ROC: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Israel: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Eire: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Egypt: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Japan: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Portugal: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Navajo: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/W-SU: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/ROK: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/Iran: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/NZ-CHAT: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/PRC: No such file or directory 
> ls: cannot access /mnt/glusterfs/test/zoneinfo/posixrules: No such file or directory 
> total 228K 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa 
> drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil 
> -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile 
> -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba 
> -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET 
> -rw-r--r-- 1 root root 118 Jun 8 17:04 EST 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT 
> -????????? ? ? ? ? ? Egypt 
> -????????? ? ? ? ? ? Eire 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe 
> -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory 
> -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB 
> -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich 
> -rw-r--r-- 1 root root 119 Jun 8 17:04 HST 
> -????????? ? ? ? ? ? Hongkong 
> -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian 
> -????????? ? ? ? ? ? Iran 
> -????????? ? ? ? ? ? Israel 
> -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica 
> -????????? ? ? ? ? ? Japan 
> -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein 
> -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya 
> -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET 
> -rw-r--r-- 1 root root 118 Jun 8 17:04 MST 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast 
> -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ 
> -????????? ? ? ? ? ? NZ-CHAT 
> -????????? ? ? ? ? ? Navajo 
> -????????? ? ? ? ? ? PRC 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific 
> -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland 
> -????????? ? ? ? ? ? Portugal 
> -????????? ? ? ? ? ? ROC 
> -????????? ? ? ? ? ? ROK 
> -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore 
> -????????? ? ? ? ? ? Turkey 
> -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 US 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal 
> -????????? ? ? ? ? ? W-SU 
> -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu 
> -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab 
> -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime 
> drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix 
> -????????? ? ? ? ? ? posixrules 
> drwxr-xr-x 19 root root 4.0K Sep 6 2006 right 
> -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab 
> 
> 
> After restarting the client: 
> 
> ls -lh /mnt/glusterfs/test/zoneinfo/ 
> total 296K 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa 
> drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil 
> -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile 
> -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba 
> -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET 
> -rw-r--r-- 1 root root 118 Jun 8 17:04 EST 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT 
> -rw-r--r-- 2 root root 9.1K Jun 8 17:04 Egypt 
> -rw-r--r-- 2 root root 3.5K Jun 8 17:04 Eire 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc 
> drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe 
> -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory 
> -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB 
> -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0 
> -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich 
> -rw-r--r-- 1 root root 119 Jun 8 17:04 HST 
> -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Hongkong 
> -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian 
> -rw-r--r-- 2 root root 791 Jun 8 17:04 Iran 
> -rw-r--r-- 3 root root 2.2K Jun 8 17:04 Israel 
> -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica 
> -rw-r--r-- 2 root root 331 Jun 8 17:04 Japan 
> -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein 
> -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya 
> -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET 
> -rw-r--r-- 1 root root 118 Jun 8 17:04 MST 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast 
> -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ 
> -rw-r--r-- 2 root root 2.0K Jun 8 17:04 NZ-CHAT 
> -rw-r--r-- 3 root root 2.4K Jun 8 17:04 Navajo 
> -rw-r--r-- 2 root root 405 Jun 8 17:04 PRC 
> -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific 
> -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland 
> -rw-r--r-- 2 root root 3.4K Jun 8 17:04 Portugal 
> -rw-r--r-- 2 root root 724 Jun 8 17:04 ROC 
> -rw-r--r-- 2 root root 380 Jun 8 17:04 ROK 
> -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore 
> -rw-r--r-- 3 root root 2.7K Jun 8 17:04 Turkey 
> -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT 
> drwxr-xr-x 2 root root 4.0K Sep 6 2006 US 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal 
> -rw-r--r-- 2 root root 2.2K Jun 8 17:04 W-SU 
> -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET 
> -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu 
> -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab 
> -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime 
> drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix 
> -rw-r--r-- 2 root root 3.5K Jun 8 17:04 posixrules 
> drwxr-xr-x 19 root root 4.0K Sep 6 2006 right 
> -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab 
> 
> Best, 
> 
> Harris 
> 
> ----- Original Message ----- 
> From: "Brent A Nelson" < brent at phys.ufl.edu > 
> To: "Anand Avati" < avati at zresearch.com > 
> Cc: gluster-devel at nongnu.org 
> Sent: Thursday, July 26, 2007 7:09:16 PM (GMT-0500) America/New_York 
> Subject: Re: [Gluster-devel] copy glitch, latest TLA 
> 
> Strace attached. 
> 
> Thanks, 
> 
> Brent 
> 
> On Fri, 27 Jul 2007 , Anand Avati wrote: 
> 
>> Brent, August, 
>> I just committed some fixes related to hardlinks into patch-371. Is it 
>> possible to get an strace of the ls -l, so that I can confirm if patch-371 
>> will fix your issue? 
>> 
>> thanks, 
>> avati 
>> 
>> 2007/7/26 , August R. Wohlt < glusterfs at isidore.net >: 
>>> I noticed something very similar this morning with a similar setup. For me 
>>> it only shows up on hard-linked files that I do not have permissions to 
>>> view: 
>>> 
>>> [goose at test]$ ls -ail /backups/ 20070726 /root/ | head -10 
>>> total 0 
>>> ??--------- ? ? ? ? ? . 
>>> ??--------- ? ? ? ? ? .. 
>>> ??--------- ? ? ? ? ? anaconda-ks.cfg 
>>> ??--------- ? ? ? ? ? .bash_history 
>>> ??--------- ? ? ? ? ? .bash_logout 
>>> ??--------- ? ? ? ? ? .bash_profile 
>>> ??--------- ? ? ? ? ? .bashrc 
>>> ??--------- ? ? ? ? ? .config 
>>> [goose at test]$ sudo ls -ail /backups/ 20070726 /root/ | head -10 
>>> total 404 
>>> 4213728 drwxr-xr-- 18 root root 4096 Jul 20 09:44 . 
>>> 4210689 drwxr-xr-x 18 root root 4096 Jul 26 07:20 .. 
>>> 4213743 -rw-r--r-- 1 root root 1294 Mar 23 2006 anaconda-ks.cfg 
>>> 4213731 -rw------- 1 root root 2054 Jul 17 20:57 .bash_history 
>>> 4213732 -rw-r--r-- 1 root root 24 Sep 22 2004 .bash_logout 
>>> 4213733 -rw-r--r-- 1 root root 191 Sep 22 2004 .bash_profile 
>>> 4213734 -rw-r--r-- 1 root root 176 Sep 22 2004 .bashrc 
>>> 7375158 drwxr-xr-x 3 root root 4096 Mar 23 2006 .config 
>>> 
>>> :goose 
>>> 
>>> On 7/26/07 , Brent A Nelson < brent at phys.ufl.edu > wrote: 
>>>> In copying (cp -a) a local /usr to a GlusterFS (unify, protocol/client, 
>>>> protocol/server, features/posix-locks, storage/posix), I notice this 
>>>> glitch: 
>>>> 
>>>> ls -lai /beast/usr/share/zoneinfo/posix/America/ 
>>>> total 484 
>>>> 115452 drwxr-xr-x 6 root root 0 2007-06-18 13:33 . 
>>>> 115278 drwxr-xr-x 20 root root 4096 2007-06-18 13:33 .. 
>>>> 115443 -rw-r--r-- 3 root root 858 2007 -04-23 06:07 Adak 
>>>> 115435 -rw-r--r-- 3 root root 861 2007 -04-23 06:07 Anchorage 
>>>> 115528 -rw-r--r-- 1 root root 73 2007-04-23 06:07 Anguilla 
>>>> 115454 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Antigua 
>>>> 115477 -rw-r--r-- 1 root root 326 2007 -04-23 06:07 Araguaina 
>>>> 115533 drwxr-xr-x 2 root root 4096 2007-06-18 13:33 Argentina 
>>>> 115470 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Aruba 
>>>> 115517 -rw-r--r-- 1 root root 729 2007 -04-23 06:07 Asuncion 
>>>> 115472 -rw-r--r-- 2 root root 134 2007 -04-23 06:07 Atikokan 
>>>> 115443 -rw-r--r-- 3 root root 858 2007 -04-23 06:07 Atka 
>>>> 115465 -rw-r--r-- 1 root root 376 2007 -04-23 06:07 Bahia 
>>>> 115526 -rw-r--r-- 1 root root 142 2007 -04-23 06:07 Barbados 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Edmonton 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Halifax 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Regina 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Rosario 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Santiago 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/St_Johns 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Toronto 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Vancouver 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Whitehorse 
>>>> ? ?--------- ? ? ? ? ? 
>>>> /beast/usr/share/zoneinfo/posix/America/Winnipeg 
>>>> 115482 -rw-r--r-- 1 root root 226 2007 -04-23 06:07 Belem 
>>>> 115521 -rw-r--r-- 1 root root 368 2007 -04-23 06:07 Belize 
>>>> ... (everything normal after that). 
>>>> 
>>>> Plenty of other areas in zoneinfo were also affected. Is this a glitch 
>>> in 
>>>> hardlinks? 
>>>> 
>>>> Thanks, 
>>>> 
>>>> Brent 
>>>> 
>>>> 
>>>> _______________________________________________ 
>>>> Gluster-devel mailing list 
>>>> Gluster-devel at nongnu.org 
>>>> http://lists.nongnu.org/mailman/listinfo/gluster-devel 
>>>> 
>>> _______________________________________________ 
>>> Gluster-devel mailing list 
>>> Gluster-devel at nongnu.org 
>>> http://lists.nongnu.org/mailman/listinfo/gluster-devel 
>>> 
>> 
>> 
>> -- 
>> Anand V. Avati 
>> 
> 
> 
> _______________________________________________ 
> Gluster-devel mailing list 
> Gluster-devel at nongnu.org 
> http://lists.nongnu.org/mailman/listinfo/gluster-devel 



_______________________________________________ 
Gluster-devel mailing list 
Gluster-devel at nongnu.org 
http://lists.nongnu.org/mailman/listinfo/gluster-devel 



-- 
Anand V. Avati

More information about the Gluster-devel mailing list