[Gluster-devel] bug with TLA 313?

Brent A Nelson brent at phys.ufl.edu
Fri Jul 20 21:23:55 UTC 2007


Copying from a local filesystem to the GlusterFS now works without issue, 
but copying from the GlusterFS to the GlusterFS still complains.  See 
attached strace.

Note that my local filesystem is not mounted with the acl option, but the 
underlying mounts that make up my GlusterFS do have the acl mount option.

Thanks,

Brent

PS Are these fixes actually enabling support for ACLs? If they are, that's 
very cool and well ahead of the roadmap!

On Sat, 21 Jul 2007, Anand Avati wrote:

> Brent,
> there was a bug in setxattr, of the length getting calculated by -1 for
> (non ascii) binary values of setxattr. can you please check if your cp goes
> through now? I'm very sorry I am unable to test this ourselves since we dont
> have a system which uses posix acls, though xattrs are now working fine on
> binary data (before the fix it was working only for pure ascii data only)
>
> thanks,
> avati
>
> 2007/7/20, Brent A Nelson <brent at phys.ufl.edu>:
>> 
>> Nope, it's still there.  Example strace snippet:
>> 
>> setxattr("/beast/glusterfs/beast", "system.posix_acl_access",
>> 
>> "\x02\x00\x00\x00\x01\x00\x06\x00\xff\xff\xff\xff\x04\x00\x04\x00\xff\xff\xff\xff
>> \x00\x04\x00\xff\xff\xff\xff", 28, 0) = -1 EINVAL (Invalid argument)
>> 
>> It presumably should have returned EOPNOTSUPP (Operation not supported),
>> instead.
>> 
>> Thanks,
>> 
>> Brent
>> 
>> On Fri, 20 Jul 2007, Anand Avati wrote:
>> 
>> > Brent,
>> > there was a fix in fuse_setxattr in patch-325. please check if it fixes
>> > your issue. AFR was only reporting the errno's passing via it.
>> >
>> > thanks,
>> > avati
>> >
>> > 2007/7/20, Brent A Nelson <brent at phys.ufl.edu>:
>> >>
>> >> I should point out that this was with the full (AFR/unify) setup, not
>> the
>> >> stripped-down setup.  I also get a lot of messages such as the
>> following
>> >> in /var/log/glusterfs/glusterfs.log:
>> >> 2007-07-19 15:19:28 E [afr.c:514:afr_setxattr_cbk] mirror4: (path=/usr0
>> >> child=share4-0) op_ret=-1 op_errno=22
>> >> 2007-07-19 15:19:28 E [afr.c:514:afr_setxattr_cbk] mirror0: (path=/usr0
>> >> child=share0-0) op_ret=-1 op_errno=22
>> >> 2007-07-19 15:57:17 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> >> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
>> op_errno=61
>> >> 2007-07-19 15:57:17 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> >> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
>> op_errno=61
>> >> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> >> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
>> op_errno=61
>> >> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> >> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
>> op_errno=61
>> >> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror6:
>> >> (path=/nfs/share/locale/cs child=share6-0) op_ret=-1 op_errno=61
>> >> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror6:
>> >> (path=/nfs/share/locale/cs child=share6-0) op_ret=-1 op_errno=61
>> >> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> >> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
>> op_errno=61
>> >> 2007-07-19 15:57:24 E [afr.c:575:afr_getxattr_cbk] mirror7:
>> >> (path=/nfs/share/locale/cs/LC_TIME child=share7-1) op_ret=-1
>> op_errno=61
>> >>
>> >> Thanks,
>> >>
>> >> Brent
>> >>
>> >> On Thu, 19 Jul 2007, Brent A Nelson wrote:
>> >>
>> >> > Patch 322 seems to have fixed the stray ls errors, but not the cp -a
>> >> > complaints.  A "cp -a" strace is attached.
>> >> >
>> >> > Thanks,
>> >> >
>> >> > Brent
>> >> >
>> >> > On Wed, 18 Jul 2007, Brent A Nelson wrote:
>> >> >
>> >> >> Aha, it looks like GlusterFS is giving odd/varying error responses
>> to
>> >> >> queries for ACL information (I assume it should be giving an
>> "operation
>> >> not
>> >> >> supported" error).  This must be related to my previously reported
>> >> problem
>> >> >> copying from GlusterFS to GlusterFS where it was complaining about
>> >> >> preserving ACLs for every file copied.
>> >> >>
>> >> >> See attached strace.
>> >> >>
>> >> >> Thanks,
>> >> >>
>> >> >> Brent
>> >> >>
>> >> >> PS At least in this simple case where glusterfs is directly mounting
>> a
>> >> >> storage/posix, NFS reexport works fine. I haven't had a chance to
>> test
>> >> a
>> >> >> full setup with recent GlusterFS tlas, but I will once the ACL
>> glitch
>> >> is
>> >> >> squashed.
>> >> >>
>> >> >> On Wed, 18 Jul 2007, Anand Avati wrote:
>> >> >>
>> >> >>> Brent,
>> >> >>> very interesting diagnosis! is it possible for you to re-create the
>> >> 'posix
>> >> >>> only' setup (no server/client) and again do 'strace ls -ial /beast'
>> ?
>> >> we
>> >> >>> are
>> >> >>> not able to reproduce this error at our setup.
>> >> >>>
>> >> >>> thanks
>> >> >>> avati
>> >> >>>
>> >> >>> 2007/7/17, Brent A Nelson <brent at phys.ufl.edu>:
>> >> >>>>
>> >> >>>> Just a quick note that this doesn't seem to be any sort of
>> corruption
>> >> >>>> issue.  I completely emptied all my shares (even removing
>> lost+found)
>> >> and
>> >> >>>> my namespace and rsynced the corresponding AFR shares and
>> >> namespace.  The
>> >> >>>> only thing different between the AFRs would be ctimes.
>> >> >>>>
>> >> >>>> I restarted everything, and did:
>> >> >>>> ls -al /beast
>> >> >>>> ls: /beast: File exists
>> >> >>>> ls: /beast/.: File exists
>> >> >>>> total 8
>> >> >>>> drwxr-xr-x  2 root root 4096 2007-07-17 09:27 .
>> >> >>>> drwxr-xr-x 27 root root 4096 2007-07-02 10:18 ..
>> >> >>>>
>> >> >>>> I also tried disabling readahead and writebehind (my only
>> performance
>> >> >>>> translators).  It didn't help.  Changing the unify from alu to rr
>> >> also
>> >> >>>> didn't help.
>> >> >>>>
>> >> >>>> I then tried "glusterfs -f /etc/glusterfs/beast -n mirror0 /beast"
>> to
>> >> >>>> mount a single AFR, no unify.  It STILL produces the same
>> messages.
>> >> >>>>
>> >> >>>> I then tried "glusterfs -f /etc/glusterfs/beast -n share0-0
>> /beast"
>> >> to
>> >> >>>> mount a simple, single share used as half of an AFR.  Same issue.
>> >> >>>>
>> >> >>>> I then stripped down a server to serve out one single
>> storage/posix
>> >> >>>> share,
>> >> >>>> with no posix locks (I wasn't using any other translators on the
>> >> server
>> >> >>>> side, apart from protocol/server, of course).  I mounted that
>> share
>> >> as in
>> >> >>>> the previous attempt.  No difference!
>> >> >>>>
>> >> >>>> So, this issue occurs even with just protocol/client,
>> >> protocol/server,
>> >> >>>> and
>> >> >>>> storage/posix in use.  As barebones as you can get.  Almost.
>> >> >>>>
>> >> >>>> One more try.  No glusterfsd, and glusterfs accesses a single
>> >> >>>> storage/posix directly:
>> >> >>>>
>> >> >>>> ls -al /beast
>> >> >>>> ls: /beast: File exists
>> >> >>>> ls: /beast/.: File exists
>> >> >>>> total 8
>> >> >>>> drwxr-xr-x  2 root root 4096 2007-07-17 09:27 .
>> >> >>>> drwxr-xr-x 27 root root 4096 2007-07-02 10:18 ..
>> >> >>>>
>> >> >>>> No difference, even with just glusterfs directly accessing a
>> single,
>> >> >>>> local
>> >> >>>> storage/posix, with no other translators.  Spec is simply:
>> >> >>>>
>> >> >>>> volume share0
>> >> >>>>    type storage/posix                   # POSIX FS translator
>> >> >>>>    option directory /share0             # Export this directory
>> >> >>>> end-volume
>> >> >>>>
>> >> >>>> Ubuntu Feisty, Fuse 2.6.3.
>> >> >>>>
>> >> >>>> Any ideas?
>> >> >>>>
>> >> >>>> Thanks,
>> >> >>>>
>> >> >>>> Brent
>> >> >>>>
>> >> >>>>
>> >> >>>> On Sat, 14 Jul 2007, Brent A Nelson wrote:
>> >> >>>>
>> >> >>>> > It's the same spec I was using previously (AFRed namespace
>> cache,
>> >> >>>> unified
>> >> >>>> > AFRs spread across four servers, posix-locks, readahead, and
>> >> >>>> writebehind).
>> >> >>>> > It's not just the top-level directory; it's everywhere.
>> >> >>>> >
>> >> >>>> > Thanks,
>> >> >>>> >
>> >> >>>> > Brent
>> >> >>>> >
>> >> >>>> > On Sat, 14 Jul 2007, Anand Avati wrote:
>> >> >>>> >
>> >> >>>> >> Brent,
>> >> >>>> >> this is strange, we are having patch-313 work pretty smooth so
>> >> far.
>> >> >>>> are
>> >> >>>> >> there any changes in your spec? is this behaviour seen only in
>> >> this
>> >> >>>> >> particular directory or 'anywhere' in general? please attach
>> your
>> >> spec
>> >> >>>> so
>> >> >>>> >> that we can try to reproduce it in our labs.
>> >> >>>> >>
>> >> >>>> >> thanks,
>> >> >>>> >> avati
>> >> >>>> >>
>> >> >>>> >> 2007/7/14, Brent A Nelson <brent at phys.ufl.edu>:
>> >> >>>> >>>
>> >> >>>> >>> Updating to the latest TLA patch, I got odd issues just with
>> >> "ls":
>> >> >>>> >>>
>> >> >>>> >>> Example:
>> >> >>>> >>>
>> >> >>>> >>> ls -al /beast/
>> >> >>>> >>> ls: /beast/: No such file or directory
>> >> >>>> >>> ls: /beast/.: No such file or directory
>> >> >>>> >>> ls: /beast/lost+found: No such file or directory
>> >> >>>> >>> ls: /beast/usr0: No such file or directory
>> >> >>>> >>> ls: /beast/usr: No such file or directory
>> >> >>>> >>> total 32
>> >> >>>> >>> drwxr-xr-x  5 root root  4096 2007-07-13 16:18 .
>> >> >>>> >>> drwxr-xr-x 27 root root  4096 2007-06-25 18:34 ..
>> >> >>>> >>> drwx------  2 root root 16384 2007-06-25 17:08 lost+found
>> >> >>>> >>> drwxr-xr-x 10 root root  4096 2007-06-18 13:31 usr
>> >> >>>> >>> drwxr-xr-x 10 root root  4096 2007-06-18 13:31 usr0
>> >> >>>> >>>
>> >> >>>> >>> I have one machine that is no longer returning from an
>> "ls".  I
>> >> get
>> >> >>>> other
>> >> >>>> >>> messages sometimes, not just "No such file or directory", but
>> >> also
>> >> >>>> "Bad
>> >> >>>> >>> file descriptor" or even "File exists".  These extraneous
>> >> messages
>> >> >>>> are
>> >> >>>> >>> also occurring when copying from the GlusterFS to the
>> >> GlusterFS.  The
>> >> >>>> >>> files and directories mentioned do, in fact, exist, no matter
>> >> what
>> >> >>>> the
>> >> >>>> >>> extraneous error message says.
>> >> >>>> >>>
>> >> >>>> >>> Is there a known issue with the current patchset?
>> >> >>>> >>>
>> >> >>>> >>> Thanks,
>> >> >>>> >>>
>> >> >>>> >>> Brent
>> >> >>>> >>>
>> >> >>>> >>>
>> >> >>>> >>> _______________________________________________
>> >> >>>> >>> Gluster-devel mailing list
>> >> >>>> >>> Gluster-devel at nongnu.org
>> >> >>>> >>> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>> >> >>>> >>>
>> >> >>>> >>
>> >> >>>> >>
>> >> >>>> >>
>> >> >>>> >> --
>> >> >>>> >> Anand V. Avati
>> >> >>>> >>
>> >> >>>> >
>> >> >>>>
>> >> >>>
>> >> >>>
>> >> >>>
>> >> >>> --
>> >> >>> Anand V. Avati
>> >> >
>> >>
>> >
>> >
>> >
>> > --
>> > Anand V. Avati
>> >
>> 
>
>
>
> -- 
> Anand V. Avati
>
-------------- next part --------------
execve("/bin/cp", ["cp", "-a", "/beast/glusterfs", "/beast/glusterfs2"], [/* 19 vars */]) = 0
brk(0)                                  = 0x8057000
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
mmap2(NULL, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f69000
access("/etc/ld.so.preload", R_OK)      = -1 ENOENT (No such file or directory)
open("/etc/ld.so.cache", O_RDONLY)      = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=13581, ...}) = 0
mmap2(NULL, 13581, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f65000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/libacl.so.1", O_RDONLY)      = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\340\24"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=22368, ...}) = 0
mmap2(NULL, 25168, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7f5e000
mmap2(0xb7f64000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x5) = 0xb7f64000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/libselinux.so.1", O_RDONLY)  = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\0=\0\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=83512, ...}) = 0
mmap2(NULL, 88980, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7f48000
mmap2(0xb7f5c000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x13) = 0xb7f5c000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/tls/i686/cmov/libc.so.6", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\0`\1\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=1307104, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f47000
mmap2(NULL, 1312164, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7e06000
mmap2(0xb7f41000, 12288, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x13b) = 0xb7f41000
mmap2(0xb7f44000, 9636, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb7f44000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/libattr.so.1", O_RDONLY)     = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\260\f\0"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=13448, ...}) = 0
mmap2(NULL, 16228, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7e02000
mmap2(0xb7e05000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x2) = 0xb7e05000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/tls/i686/cmov/libdl.so.2", O_RDONLY) = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0P\n\0\000"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=9684, ...}) = 0
mmap2(NULL, 12412, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7dfe000
mmap2(0xb7e00000, 8192, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x1) = 0xb7e00000
close(3)                                = 0
access("/etc/ld.so.nohwcap", F_OK)      = -1 ENOENT (No such file or directory)
open("/lib/libsepol.so.1", O_RDONLY)    = 3
read(3, "\177ELF\1\1\1\0\0\0\0\0\0\0\0\0\3\0\3\0\1\0\0\0\3604\0"..., 512) = 512
fstat64(3, {st_mode=S_IFREG|0644, st_size=220380, ...}) = 0
mmap2(NULL, 265664, PROT_READ|PROT_EXEC, MAP_PRIVATE|MAP_DENYWRITE, 3, 0) = 0xb7dbd000
mmap2(0xb7df3000, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_DENYWRITE, 3, 0x35) = 0xb7df3000
mmap2(0xb7df4000, 40384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_FIXED|MAP_ANONYMOUS, -1, 0) = 0xb7df4000
close(3)                                = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7dbc000
set_thread_area({entry_number:-1 -> 6, base_addr:0xb7dbc8d0, limit:1048575, seg_32bit:1, contents:0, read_exec_only:0, limit_in_pages:1, seg_not_present:0, useable:1}) = 0
mprotect(0xb7f41000, 4096, PROT_READ)   = 0
munmap(0xb7f65000, 13581)               = 0
access("/etc/selinux/", F_OK)           = -1 ENOENT (No such file or directory)
brk(0)                                  = 0x8057000
brk(0x8078000)                          = 0x8078000
open("/proc/mounts", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f68000
read(3, "rootfs / rootfs rw 0 0\nnone /sys"..., 1024) = 1024
read(3, "/dev/mapper/share1-disk /share1 "..., 1024) = 283
read(3, "", 1024)                       = 0
close(3)                                = 0
munmap(0xb7f68000, 4096)                = 0
open("/proc/filesystems", O_RDONLY|O_LARGEFILE) = 3
read(3, "nodev\tsysfs\nnodev\trootfs\nnodev\tb"..., 4095) = 324
close(3)                                = 0
open("/usr/lib/locale/locale-archive", O_RDONLY|O_LARGEFILE) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/locale.alias", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0777, st_size=2586, ...}) = 0
mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0xb7f68000
read(3, "# Locale name alias data base.\n#"..., 4096) = 2586
read(3, "", 4096)                       = 0
close(3)                                = 0
munmap(0xb7f68000, 4096)                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_IDENTIFICATION", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_IDENTIFICATION", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=391, ...}) = 0
mmap2(NULL, 391, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f68000
close(3)                                = 0
open("/usr/lib/gconv/gconv-modules.cache", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=25460, ...}) = 0
mmap2(NULL, 25460, PROT_READ, MAP_SHARED, 3, 0) = 0xb7db5000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_MEASUREMENT", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_MEASUREMENT", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=23, ...}) = 0
mmap2(NULL, 23, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f67000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_TELEPHONE", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_TELEPHONE", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=59, ...}) = 0
mmap2(NULL, 59, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f66000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_ADDRESS", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_ADDRESS", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=155, ...}) = 0
mmap2(NULL, 155, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7f65000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_NAME", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_NAME", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=77, ...}) = 0
mmap2(NULL, 77, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db4000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_PAPER", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_PAPER", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=34, ...}) = 0
mmap2(NULL, 34, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db3000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_MESSAGES", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_MESSAGES", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
close(3)                                = 0
open("/usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=52, ...}) = 0
mmap2(NULL, 52, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db2000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_MONETARY", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_MONETARY", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=286, ...}) = 0
mmap2(NULL, 286, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7db1000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_COLLATE", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_COLLATE", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=880094, ...}) = 0
mmap2(NULL, 880094, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7cda000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_TIME", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_TIME", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=2451, ...}) = 0
mmap2(NULL, 2451, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7cd9000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_NUMERIC", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_NUMERIC", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=54, ...}) = 0
mmap2(NULL, 54, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7cd8000
close(3)                                = 0
open("/usr/lib/locale/en_US.UTF-8/LC_CTYPE", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/locale/en_US.utf8/LC_CTYPE", O_RDONLY) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=238336, ...}) = 0
mmap2(NULL, 238336, PROT_READ, MAP_PRIVATE, 3, 0) = 0xb7c9d000
close(3)                                = 0
geteuid32()                             = 0
stat64("/beast/glusterfs2", 0xbfdc3e20) = -1 ENOENT (No such file or directory)
lstat64("/beast/glusterfs", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
lstat64("/beast/glusterfs2", 0xbfdc3c6c) = -1 ENOENT (No such file or directory)
mkdir("/beast/glusterfs2", 040755)      = 0
lstat64("/beast/glusterfs2", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
stat64("/beast/glusterfs2", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
open("/beast/glusterfs", O_RDONLY|O_NONBLOCK|O_LARGEFILE|O_DIRECTORY) = 3
fstat64(3, {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
fcntl64(3, F_SETFD, FD_CLOEXEC)         = 0
getdents64(3, /* 7 entries */, 4096)    = 248
getdents64(3, /* 0 entries */, 4096)    = 0
close(3)                                = 0
lstat64("/beast/glusterfs/glusterfs-server.vol", {st_mode=S_IFREG|0644, st_size=1534, ...}) = 0
open("/beast/glusterfs/glusterfs-server.vol", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1534, ...}) = 0
open("/beast/glusterfs2/glusterfs-server.vol", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1534, ...}) = 0
read(3, "volume disk-ns0\n  type storage/p"..., 4096) = 1534
write(4, "volume disk-ns0\n  type storage/p"..., 1534) = 1534
read(3, "", 4096)                       = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0)                       = 0
getxattr("/beast/glusterfs/glusterfs-server.vol", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.UTF-8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.utf8/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en/LC_MESSAGES/coreutils.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, "cp: ", 4cp: )                     = 4
write(2, "`/beast/glusterfs/glusterfs-serv"..., 39`/beast/glusterfs/glusterfs-server.vol') = 39
open("/usr/share/locale/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en_US/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.UTF-8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en.utf8/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/share/locale-langpack/en/LC_MESSAGES/libc.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
write(2, "cp: ", 4cp: )                     = 4
write(2, "preserving ACL for `/beast/glust"..., 59preserving ACL for `/beast/glusterfs2/glusterfs-server.vol') = 59
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
close(4)                                = 0
close(3)                                = 0
lstat64("/beast/glusterfs/beast", {st_mode=S_IFREG|0644, st_size=8821, ...}) = 0
open("/beast/glusterfs/beast", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=8821, ...}) = 0
open("/beast/glusterfs2/beast", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=8821, ...}) = 0
read(3, "volume ns0-0\n  type protocol/cli"..., 4096) = 4096
write(4, "volume ns0-0\n  type protocol/cli"..., 4096) = 4096
read(3, "t 6996              # default se"..., 4096) = 4096
write(4, "t 6996              # default se"..., 4096) = 4096
read(3, "option replicate *:2     # Do no"..., 4096) = 629
write(4, "option replicate *:2     # Do no"..., 629) = 629
read(3, "", 4096)                       = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0)                       = 0
getxattr("/beast/glusterfs/beast", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: )                     = 4
write(2, "`/beast/glusterfs/beast\'", 24`/beast/glusterfs/beast') = 24
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
write(2, "cp: ", 4cp: )                     = 4
write(2, "preserving ACL for `/beast/glust"..., 44preserving ACL for `/beast/glusterfs2/beast') = 44
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
close(4)                                = 0
close(3)                                = 0
lstat64("/beast/glusterfs/glusterfs-client.vol.sample", {st_mode=S_IFREG|0644, st_size=1965, ...}) = 0
open("/beast/glusterfs/glusterfs-client.vol.sample", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1965, ...}) = 0
open("/beast/glusterfs2/glusterfs-client.vol.sample", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1965, ...}) = 0
read(3, "### file: client-volume.spec.sam"..., 4096) = 1965
write(4, "### file: client-volume.spec.sam"..., 1965) = 1965
read(3, "", 4096)                       = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0)                       = 0
getxattr("/beast/glusterfs/glusterfs-client.vol.sample", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: )                     = 4
write(2, "`/beast/glusterfs/glusterfs-clie"..., 46`/beast/glusterfs/glusterfs-client.vol.sample') = 46
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
write(2, "cp: ", 4cp: )                     = 4
write(2, "preserving ACL for `/beast/glust"..., 66preserving ACL for `/beast/glusterfs2/glusterfs-client.vol.sample') = 66
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
close(4)                                = 0
close(3)                                = 0
lstat64("/beast/glusterfs/glusterfs-server.vol.sample", {st_mode=S_IFREG|0644, st_size=1767, ...}) = 0
open("/beast/glusterfs/glusterfs-server.vol.sample", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=1767, ...}) = 0
open("/beast/glusterfs2/glusterfs-server.vol.sample", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=1767, ...}) = 0
read(3, "### file: server-volume.spec.sam"..., 4096) = 1767
write(4, "### file: server-volume.spec.sam"..., 1767) = 1767
read(3, "", 4096)                       = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0)                       = 0
getxattr("/beast/glusterfs/glusterfs-server.vol.sample", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: )                     = 4
write(2, "`/beast/glusterfs/glusterfs-serv"..., 46`/beast/glusterfs/glusterfs-server.vol.sample') = 46
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
write(2, "cp: ", 4cp: )                     = 4
write(2, "preserving ACL for `/beast/glust"..., 66preserving ACL for `/beast/glusterfs2/glusterfs-server.vol.sample') = 66
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
close(4)                                = 0
close(3)                                = 0
lstat64("/beast/glusterfs/share0", {st_mode=S_IFREG|0644, st_size=149, ...}) = 0
open("/beast/glusterfs/share0", O_RDONLY|O_LARGEFILE) = 3
fstat64(3, {st_mode=S_IFREG|0644, st_size=149, ...}) = 0
open("/beast/glusterfs2/share0", O_WRONLY|O_CREAT|O_LARGEFILE, 0100644) = 4
fstat64(4, {st_mode=S_IFREG|0644, st_size=0, ...}) = 0
fstat64(3, {st_mode=S_IFREG|0644, st_size=149, ...}) = 0
read(3, "volume share0\n  type storage/pos"..., 4096) = 149
write(4, "volume share0\n  type storage/pos"..., 149) = 149
read(3, "", 4096)                       = 0
utimes("/proc/self/fd/4", {1184965608, 0}) = 0
fchown32(4, 0, 0)                       = 0
getxattr("/beast/glusterfs/share0", "system.posix_acl_access", "=\x00\x00\x00\x00\x00\x00", 132) = 8
write(2, "cp: ", 4cp: )                     = 4
write(2, "`/beast/glusterfs/share0\'", 25`/beast/glusterfs/share0') = 25
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
write(2, "cp: ", 4cp: )                     = 4
write(2, "preserving ACL for `/beast/glust"..., 45preserving ACL for `/beast/glusterfs2/share0') = 45
write(2, ": Invalid argument", 18: Invalid argument)      = 18
write(2, "\n", 1
)                       = 1
close(4)                                = 0
close(3)                                = 0
SYS_299(0xffffff9c, 0xbfdc4ba1, 0xbfdc3a9c, 0xbfdc4ba1, 0xb7f42ff4) = 0
chown32("/beast/glusterfs2", 0, 0)      = 0
getxattr("/beast/glusterfs", "system.posix_acl_access", 0xbfdc3980, 132) = -1 ENODATA (No data available)
stat64("/beast/glusterfs", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
setxattr("/beast/glusterfs2", "system.posix_acl_access", "\x02\x00\x00\x00\x01\x00\x07\x00\xff\xff\xff\xff\x04\x00\x05\x00\xff\xff\xff\xff \x00\x05\x00\xff\xff\xff\xff", 28, 0) = 0
getxattr("/beast/glusterfs", "system.posix_acl_default", 0xbfdc3980, 132) = -1 ENODATA (No data available)
stat64("/beast/glusterfs", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
stat64("/beast/glusterfs2", {st_mode=S_IFDIR|0755, st_size=4096, ...}) = 0
setxattr("/beast/glusterfs2", "system.posix_acl_default", "\x02\x00\x00\x00", 4, 0) = 0
close(1)                                = 0
exit_group(1)                           = ?
Process 6230 detached


More information about the Gluster-devel mailing list