[Gluster-users] Confusing lstat() performance

Ben Turner bturner at redhat.com
Mon Sep 18 16:47:18 UTC 2017


----- Original Message -----
> From: "Niklas Hambüchen" <mail at nh2.me>
> To: "Ben Turner" <bturner at redhat.com>
> Cc: "Gluster Users" <gluster-users at gluster.org>
> Sent: Monday, September 18, 2017 11:27:33 AM
> Subject: Re: [Gluster-users] Confusing lstat() performance
> 
> On 18/09/17 17:23, Ben Turner wrote:
> > Do you want tuned or untuned?  If tuned I'd like to try one of my tunings
> > for metadata, but I will use yours if you want.
> 
> (Re-CC'd list)
> 
> I would be interested in both, if possible: To confirm that it's not
> only my machines that exhibit this behaviour given my settings, and to
> see what can be achieved with your tuned settings.

I was just gonna get the details from you and post results back to list, just didn't want to spam people while we worked out the details.

Here is untuned + quota enabled:

strace -f -w -c rsync -a --dry-run ./ /tmp/
strace: Process 21797 attached
strace: Process 21827 attached
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
 60.34    7.525567        4849      1552         3 select
 28.63    3.571200         821      4351           getdents
 10.85    1.352934           7    200003    100000 lstat
  0.05    0.006722           9       733           write
  0.05    0.005798           7       817           read
  0.04    0.005001        2501         2           openat
  0.01    0.001722        1722         1           execve
  0.01    0.001627          26        63           munmap
  0.00    0.000552           9        61           mmap
  0.00    0.000228         114         2           clone
  0.00    0.000224          12        19           close
  0.00    0.000123           7        18           fcntl
  0.00    0.000090          10         9         2 open
  0.00    0.000070           7        10           mprotect
  0.00    0.000066           7        10         5 wait4
  0.00    0.000063           5        12           rt_sigaction
  0.00    0.000060          15         4           mremap
  0.00    0.000037           6         6           brk
  0.00    0.000036           5         7           fstat
  0.00    0.000033          11         3           socketpair
  0.00    0.000031          10         3         1 stat
  0.00    0.000029          15         2           dup2
  0.00    0.000011          11         1           kill
  0.00    0.000010           5         2         2 rt_sigreturn
  0.00    0.000008           8         1           getcwd
  0.00    0.000007           7         1         1 access
  0.00    0.000007           7         1           chdir
  0.00    0.000006           6         1           rt_sigprocmask
  0.00    0.000005           5         1           umask
  0.00    0.000005           5         1           geteuid
  0.00    0.000005           5         1           arch_prctl
------ ----------- ----------- --------- --------- ----------------
100.00   12.472277                207698    100014 total

And BUP:

strace: Process 103678 detached
strace: Process 103679 detached
% time     seconds  usecs/call     calls    errors syscall
------ ----------- ----------- --------- --------- ----------------
 80.56 1627.233677       26201     62106           read
  9.02  182.162398           6  30924134           lseek
  7.46  150.672844         225    670684         2 lstat
  1.21   24.461651         300     81647     10513 open
  0.83   16.696162         190     87869      1019 close
  0.25    4.993062         318     15702           llistxattr
  0.19    3.874752         165     23548           msync
  0.18    3.630711          23    159461           write
  0.06    1.284745           6    200003           getcwd
  0.04    0.880300         112      7850           rename
  0.04    0.800025           6    134108           fstat
  0.04    0.725158          15     47288           munmap
  0.03    0.549348          14     37922           select
  0.02    0.361083           8     47593           mmap
  0.02    0.349493          22     15699      7850 unlink
  0.01    0.275029           6     47116           fcntl
  0.01    0.253821          32      7895      7879 ioctl
  0.01    0.243284          31      7851      7851 getxattr
  0.01    0.215476          27      7851      7851 lgetxattr
  0.01    0.136050          15      8832      8707 stat
  0.00    0.091960           6     15701           dup
  0.00    0.024955        8318         3           execve
  0.00    0.004210           8       524           brk
  0.00    0.001756           8       210           mprotect
  0.00    0.001450         725         2           setsid
  0.00    0.001162           6       205           rt_sigaction
  0.00    0.000670         335         2           clone
  0.00    0.000200          17        12           getdents
  0.00    0.000070          12         6           openat
  0.00    0.000054           8         7         5 access
  0.00    0.000046           8         6         6 readlink
  0.00    0.000043          11         4           dup2
  0.00    0.000042          11         4         4 connect
  0.00    0.000042           6         7           getrlimit
  0.00    0.000039          10         4         4 statfs
  0.00    0.000039           8         5           set_robust_list
  0.00    0.000035           9         4           socket
  0.00    0.000032          16         2           mremap
  0.00    0.000025           8         3           pipe
  0.00    0.000020           7         3           futex
  0.00    0.000019           6         3           geteuid
  0.00    0.000018           6         3           getegid
  0.00    0.000018           6         3           set_tid_address
  0.00    0.000017           6         3           rt_sigprocmask
  0.00    0.000017           6         3           getuid
  0.00    0.000017           6         3           getgid
  0.00    0.000017           6         3           arch_prctl
------ ----------- ----------- --------- --------- ----------------
100.00 2019.926042              32611894     51691 total

This is on my quota only tune.

-b

> 
> Thank you!
> 


More information about the Gluster-users mailing list