[Gluster-users] Confusing lstat() performance
Ben Turner
bturner at redhat.com
Mon Sep 18 16:47:18 UTC 2017
----- Original Message -----
> From: "Niklas Hambüchen" <mail at nh2.me>
> To: "Ben Turner" <bturner at redhat.com>
> Cc: "Gluster Users" <gluster-users at gluster.org>
> Sent: Monday, September 18, 2017 11:27:33 AM
> Subject: Re: [Gluster-users] Confusing lstat() performance
>
> On 18/09/17 17:23, Ben Turner wrote:
> > Do you want tuned or untuned? If tuned I'd like to try one of my tunings
> > for metadata, but I will use yours if you want.
>
> (Re-CC'd list)
>
> I would be interested in both, if possible: To confirm that it's not
> only my machines that exhibit this behaviour given my settings, and to
> see what can be achieved with your tuned settings.
I was just gonna get the details from you and post results back to list, just didn't want to spam people while we worked out the details.
Here is untuned + quota enabled:
strace -f -w -c rsync -a --dry-run ./ /tmp/
strace: Process 21797 attached
strace: Process 21827 attached
% time seconds usecs/call calls errors syscall
------ ----------- ----------- --------- --------- ----------------
60.34 7.525567 4849 1552 3 select
28.63 3.571200 821 4351 getdents
10.85 1.352934 7 200003 100000 lstat
0.05 0.006722 9 733 write
0.05 0.005798 7 817 read
0.04 0.005001 2501 2 openat
0.01 0.001722 1722 1 execve
0.01 0.001627 26 63 munmap
0.00 0.000552 9 61 mmap
0.00 0.000228 114 2 clone
0.00 0.000224 12 19 close
0.00 0.000123 7 18 fcntl
0.00 0.000090 10 9 2 open
0.00 0.000070 7 10 mprotect
0.00 0.000066 7 10 5 wait4
0.00 0.000063 5 12 rt_sigaction
0.00 0.000060 15 4 mremap
0.00 0.000037 6 6 brk
0.00 0.000036 5 7 fstat
0.00 0.000033 11 3 socketpair
0.00 0.000031 10 3 1 stat
0.00 0.000029 15 2 dup2
0.00 0.000011 11 1 kill
0.00 0.000010 5 2 2 rt_sigreturn
0.00 0.000008 8 1 getcwd
0.00 0.000007 7 1 1 access
0.00 0.000007 7 1 chdir
0.00 0.000006 6 1 rt_sigprocmask
0.00 0.000005 5 1 umask
0.00 0.000005 5 1 geteuid
0.00 0.000005 5 1 arch_prctl
------ ----------- ----------- --------- --------- ----------------
100.00 12.472277 207698 100014 total
And BUP:
strace: Process 103678 detached
strace: Process 103679 detached
% time seconds usecs/call calls errors syscall
------ ----------- ----------- --------- --------- ----------------
80.56 1627.233677 26201 62106 read
9.02 182.162398 6 30924134 lseek
7.46 150.672844 225 670684 2 lstat
1.21 24.461651 300 81647 10513 open
0.83 16.696162 190 87869 1019 close
0.25 4.993062 318 15702 llistxattr
0.19 3.874752 165 23548 msync
0.18 3.630711 23 159461 write
0.06 1.284745 6 200003 getcwd
0.04 0.880300 112 7850 rename
0.04 0.800025 6 134108 fstat
0.04 0.725158 15 47288 munmap
0.03 0.549348 14 37922 select
0.02 0.361083 8 47593 mmap
0.02 0.349493 22 15699 7850 unlink
0.01 0.275029 6 47116 fcntl
0.01 0.253821 32 7895 7879 ioctl
0.01 0.243284 31 7851 7851 getxattr
0.01 0.215476 27 7851 7851 lgetxattr
0.01 0.136050 15 8832 8707 stat
0.00 0.091960 6 15701 dup
0.00 0.024955 8318 3 execve
0.00 0.004210 8 524 brk
0.00 0.001756 8 210 mprotect
0.00 0.001450 725 2 setsid
0.00 0.001162 6 205 rt_sigaction
0.00 0.000670 335 2 clone
0.00 0.000200 17 12 getdents
0.00 0.000070 12 6 openat
0.00 0.000054 8 7 5 access
0.00 0.000046 8 6 6 readlink
0.00 0.000043 11 4 dup2
0.00 0.000042 11 4 4 connect
0.00 0.000042 6 7 getrlimit
0.00 0.000039 10 4 4 statfs
0.00 0.000039 8 5 set_robust_list
0.00 0.000035 9 4 socket
0.00 0.000032 16 2 mremap
0.00 0.000025 8 3 pipe
0.00 0.000020 7 3 futex
0.00 0.000019 6 3 geteuid
0.00 0.000018 6 3 getegid
0.00 0.000018 6 3 set_tid_address
0.00 0.000017 6 3 rt_sigprocmask
0.00 0.000017 6 3 getuid
0.00 0.000017 6 3 getgid
0.00 0.000017 6 3 arch_prctl
------ ----------- ----------- --------- --------- ----------------
100.00 2019.926042 32611894 51691 total
This is on my quota only tune.
-b
>
> Thank you!
>
More information about the Gluster-users
mailing list