[Gluster-devel] copy glitch, latest TLA
Anand Avati
avati at zresearch.com
Fri Jul 27 21:34:10 UTC 2007
Harris,
do you have io-cache in your setup?
avati
2007/7/27, Harris Landgarten <harrisl at lhjonline.com>:
>
> The cp -av behavior I am seeing worked in patch-368. I am also seeing some
> other issues.
>
> 1. my tar test slowed down after 368. 366 is still fast.
> 2. running tar -cf immediately after restarting the client results is a
> failure: bad descriptor. tar -cvf runs. rerunning tar -cf runs as well. It
> is difficult to test this further because slowing it down makes the error go
> away. It also does not happen every time.
>
> Harris
>
> ----- Original Message -----
> From: "Anand Babu Periasamy" <ab at gnu.org.in>
> To: "Harris Landgarten" <harrisl at lhjonline.com>
> Cc: "Brent A Nelson" <brent at phys.ufl.edu>, gluster-devel at nongnu.org
> Sent: Thursday, July 26, 2007 7:48:12 PM (GMT-0500) America/New_York
> Subject: Re: [Gluster-devel] copy glitch, latest TLA
>
> You are correct, Brent's strace confirms it. ls gets the file listing
> from name space, but stat on it is performed on actual file. It looks
> like only name space entries are made, but files were not copied. We are
> looking into it.
>
> --
> Anand Babu
> GPG Key ID: 0x62E15A31
> Blog [http://ab.freeshell.org]
> The GNU Operating System [http://www.gnu.org]
> Z RESEARCH Inc [http://www.zresearch.com]
>
>
>
> Harris Landgarten wrote:
> > I can verify that something is wrong.
> >
> > cp -av /usr/share/zoneinfo /mnt/glusterfs/test/
> >
> > completed without error.
> >
> > Then:
> >
> > ls -lh /mnt/glusterfs/test/zoneinfo/
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/Hongkong: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/Turkey: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/ROC: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/Israel: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/Eire: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/Egypt: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/Japan: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/Portugal: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/Navajo: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/W-SU: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/ROK: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/Iran: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/NZ-CHAT: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/PRC: No such file or
> directory
> > ls: cannot access /mnt/glusterfs/test/zoneinfo/posixrules: No such file
> or directory
> > total 228K
> > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa
> > drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia
> > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic
> > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil
> > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET
> > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile
> > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba
> > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET
> > -rw-r--r-- 1 root root 118 Jun 8 17:04 EST
> > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT
> > -????????? ? ? ? ? ? Egypt
> > -????????? ? ? ? ? ? Eire
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc
> > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe
> > -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory
> > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB
> > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich
> > -rw-r--r-- 1 root root 119 Jun 8 17:04 HST
> > -????????? ? ? ? ? ? Hongkong
> > -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian
> > -????????? ? ? ? ? ? Iran
> > -????????? ? ? ? ? ? Israel
> > -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica
> > -????????? ? ? ? ? ? Japan
> > -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein
> > -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya
> > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET
> > -rw-r--r-- 1 root root 118 Jun 8 17:04 MST
> > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast
> > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ
> > -????????? ? ? ? ? ? NZ-CHAT
> > -????????? ? ? ? ? ? Navajo
> > -????????? ? ? ? ? ? PRC
> > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific
> > -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland
> > -????????? ? ? ? ? ? Portugal
> > -????????? ? ? ? ? ? ROC
> > -????????? ? ? ? ? ? ROK
> > -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore
> > -????????? ? ? ? ? ? Turkey
> > -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 US
> > -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC
> > -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal
> > -????????? ? ? ? ? ? W-SU
> > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET
> > -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu
> > -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab
> > -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime
> > drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix
> > -????????? ? ? ? ? ? posixrules
> > drwxr-xr-x 19 root root 4.0K Sep 6 2006 right
> > -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab
> >
> >
> > After restarting the client:
> >
> > ls -lh /mnt/glusterfs/test/zoneinfo/
> > total 296K
> > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Africa
> > drwxr-xr-x 6 root root 4.0K Jun 8 17:04 America
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Antarctica
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Arctic
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Asia
> > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Atlantic
> > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Australia
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Brazil
> > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 CET
> > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 CST6CDT
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Canada
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Chile
> > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 Cuba
> > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 EET
> > -rw-r--r-- 1 root root 118 Jun 8 17:04 EST
> > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 EST5EDT
> > -rw-r--r-- 2 root root 9.1K Jun 8 17:04 Egypt
> > -rw-r--r-- 2 root root 3.5K Jun 8 17:04 Eire
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Etc
> > drwxr-xr-x 2 root root 4.0K Jun 8 17:04 Europe
> > -rw-r--r-- 2 root root 255 Jun 8 17:04 Factory
> > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB
> > -rw-r--r-- 7 root root 3.6K Jun 8 17:04 GB-Eire
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT+0
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT-0
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 GMT0
> > -rw-r--r-- 10 root root 118 Jun 8 17:04 Greenwich
> > -rw-r--r-- 1 root root 119 Jun 8 17:04 HST
> > -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Hongkong
> > -rw-r--r-- 2 root root 1.2K Jun 8 17:04 Iceland
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Indian
> > -rw-r--r-- 2 root root 791 Jun 8 17:04 Iran
> > -rw-r--r-- 3 root root 2.2K Jun 8 17:04 Israel
> > -rw-r--r-- 2 root root 481 Jun 8 17:04 Jamaica
> > -rw-r--r-- 2 root root 331 Jun 8 17:04 Japan
> > -rw-r--r-- 2 root root 211 Jun 8 17:04 Kwajalein
> > -rw-r--r-- 2 root root 599 Jun 8 17:04 Libya
> > -rw-r--r-- 1 root root 2.1K Jun 8 17:04 MET
> > -rw-r--r-- 1 root root 118 Jun 8 17:04 MST
> > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 MST7MDT
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mexico
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Mideast
> > -rw-r--r-- 2 root root 2.4K Jun 8 17:04 NZ
> > -rw-r--r-- 2 root root 2.0K Jun 8 17:04 NZ-CHAT
> > -rw-r--r-- 3 root root 2.4K Jun 8 17:04 Navajo
> > -rw-r--r-- 2 root root 405 Jun 8 17:04 PRC
> > -rw-r--r-- 1 root root 2.3K Jun 8 17:04 PST8PDT
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 Pacific
> > -rw-r--r-- 2 root root 2.7K Jun 8 17:04 Poland
> > -rw-r--r-- 2 root root 3.4K Jun 8 17:04 Portugal
> > -rw-r--r-- 2 root root 724 Jun 8 17:04 ROC
> > -rw-r--r-- 2 root root 380 Jun 8 17:04 ROK
> > -rw-r--r-- 2 root root 402 Jun 8 17:04 Singapore
> > -rw-r--r-- 3 root root 2.7K Jun 8 17:04 Turkey
> > -rw-r--r-- 2 root root 118 Jun 8 17:04 UCT
> > drwxr-xr-x 2 root root 4.0K Sep 6 2006 US
> > -rw-r--r-- 6 root root 118 Jun 8 17:04 UTC
> > -rw-r--r-- 6 root root 118 Jun 8 17:04 Universal
> > -rw-r--r-- 2 root root 2.2K Jun 8 17:04 W-SU
> > -rw-r--r-- 1 root root 1.9K Jun 8 17:04 WET
> > -rw-r--r-- 6 root root 118 Jun 8 17:04 Zulu
> > -rw-r--r-- 1 root root 4.0K Jun 8 17:04 iso3166.tab
> > -rw-r--r-- 2 root root 255 Jun 8 17:04 localtime
> > drwxr-xr-x 19 root root 4.0K Sep 6 2006 posix
> > -rw-r--r-- 2 root root 3.5K Jun 8 17:04 posixrules
> > drwxr-xr-x 19 root root 4.0K Sep 6 2006 right
> > -rw-r--r-- 1 root root 19K Jun 8 17:04 zone.tab
> >
> > Best,
> >
> > Harris
> >
> > ----- Original Message -----
> > From: "Brent A Nelson" <brent at phys.ufl.edu>
> > To: "Anand Avati" <avati at zresearch.com>
> > Cc: gluster-devel at nongnu.org
> > Sent: Thursday, July 26, 2007 7:09:16 PM (GMT-0500) America/New_York
> > Subject: Re: [Gluster-devel] copy glitch, latest TLA
> >
> > Strace attached.
> >
> > Thanks,
> >
> > Brent
> >
> > On Fri, 27 Jul 2007, Anand Avati wrote:
> >
> >> Brent, August,
> >> I just committed some fixes related to hardlinks into patch-371. Is it
> >> possible to get an strace of the ls -l, so that I can confirm if
> patch-371
> >> will fix your issue?
> >>
> >> thanks,
> >> avati
> >>
> >> 2007/7/26, August R. Wohlt <glusterfs at isidore.net>:
> >>> I noticed something very similar this morning with a similar setup.
> For me
> >>> it only shows up on hard-linked files that I do not have permissions
> to
> >>> view:
> >>>
> >>> [goose at test]$ ls -ail /backups/20070726/root/ | head -10
> >>> total 0
> >>> ??--------- ? ? ? ? ? .
> >>> ??--------- ? ? ? ? ? ..
> >>> ??--------- ? ? ? ? ? anaconda-ks.cfg
> >>> ??--------- ? ? ? ? ? .bash_history
> >>> ??--------- ? ? ? ? ? .bash_logout
> >>> ??--------- ? ? ? ? ? .bash_profile
> >>> ??--------- ? ? ? ? ? .bashrc
> >>> ??--------- ? ? ? ? ? .config
> >>> [goose at test]$ sudo ls -ail /backups/20070726/root/ | head -10
> >>> total 404
> >>> 4213728 drwxr-xr-- 18 root root 4096 Jul 20 09:44 .
> >>> 4210689 drwxr-xr-x 18 root root 4096 Jul 26 07:20 ..
> >>> 4213743 -rw-r--r-- 1 root root 1294 Mar 23 2006 anaconda-ks.cfg
> >>> 4213731 -rw------- 1 root root 2054 Jul 17 20:57 .bash_history
> >>> 4213732 -rw-r--r-- 1 root root 24 Sep 22 2004 .bash_logout
> >>> 4213733 -rw-r--r-- 1 root root 191 Sep 22 2004 .bash_profile
> >>> 4213734 -rw-r--r-- 1 root root 176 Sep 22 2004 .bashrc
> >>> 7375158 drwxr-xr-x 3 root root 4096 Mar 23 2006 .config
> >>>
> >>> :goose
> >>>
> >>> On 7/26/07, Brent A Nelson <brent at phys.ufl.edu> wrote:
> >>>> In copying (cp -a) a local /usr to a GlusterFS (unify,
> protocol/client,
> >>>> protocol/server, features/posix-locks, storage/posix), I notice this
> >>>> glitch:
> >>>>
> >>>> ls -lai /beast/usr/share/zoneinfo/posix/America/
> >>>> total 484
> >>>> 115452 drwxr-xr-x 6 root root 0 2007-06-18 13:33 .
> >>>> 115278 drwxr-xr-x 20 root root 4096 2007-06-18 13:33 ..
> >>>> 115443 -rw-r--r-- 3 root root 858 2007-04-23 06:07 Adak
> >>>> 115435 -rw-r--r-- 3 root root 861 2007-04-23 06:07 Anchorage
> >>>> 115528 -rw-r--r-- 1 root root 73 2007-04-23 06:07 Anguilla
> >>>> 115454 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Antigua
> >>>> 115477 -rw-r--r-- 1 root root 326 2007-04-23 06:07 Araguaina
> >>>> 115533 drwxr-xr-x 2 root root 4096 2007-06-18 13:33 Argentina
> >>>> 115470 -rw-r--r-- 1 root root 90 2007-04-23 06:07 Aruba
> >>>> 115517 -rw-r--r-- 1 root root 729 2007-04-23 06:07 Asuncion
> >>>> 115472 -rw-r--r-- 2 root root 134 2007-04-23 06:07 Atikokan
> >>>> 115443 -rw-r--r-- 3 root root 858 2007-04-23 06:07 Atka
> >>>> 115465 -rw-r--r-- 1 root root 376 2007-04-23 06:07 Bahia
> >>>> 115526 -rw-r--r-- 1 root root 142 2007-04-23 06:07 Barbados
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/Edmonton
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/Halifax
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/Regina
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/Rosario
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/Santiago
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/St_Johns
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/Toronto
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/Vancouver
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/Whitehorse
> >>>> ? ?--------- ? ? ? ? ?
> >>>> /beast/usr/share/zoneinfo/posix/America/Winnipeg
> >>>> 115482 -rw-r--r-- 1 root root 226 2007-04-23 06:07 Belem
> >>>> 115521 -rw-r--r-- 1 root root 368 2007-04-23 06:07 Belize
> >>>> ... (everything normal after that).
> >>>>
> >>>> Plenty of other areas in zoneinfo were also affected. Is this a
> glitch
> >>> in
> >>>> hardlinks?
> >>>>
> >>>> Thanks,
> >>>>
> >>>> Brent
> >>>>
> >>>>
> >>>> _______________________________________________
> >>>> Gluster-devel mailing list
> >>>> Gluster-devel at nongnu.org
> >>>> http://lists.nongnu.org/mailman/listinfo/gluster-devel
> >>>>
> >>> _______________________________________________
> >>> Gluster-devel mailing list
> >>> Gluster-devel at nongnu.org
> >>> http://lists.nongnu.org/mailman/listinfo/gluster-devel
> >>>
> >>
> >>
> >> --
> >> Anand V. Avati
> >>
> >
> >
> > _______________________________________________
> > Gluster-devel mailing list
> > Gluster-devel at nongnu.org
> > http://lists.nongnu.org/mailman/listinfo/gluster-devel
>
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>
--
Anand V. Avati
More information about the Gluster-devel
mailing list