<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hi Chiku,</p>
<p>Please tune the volume with the below parameters for performance
gain. cc'ed the guy working on windows.<br>
</p>
<p><b style="font-weight:normal;"
id="docs-internal-guid-58e8849d-ed36-92f3-8812-9d5554bdf3d6">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume stop <b><vol-name></b> --mode=script</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume set <b><vol-name></b> features.cache-invalidation on</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume set <b><vol-name></b> features.cache-invalidation-timeout 600</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume set <b><vol-name></b> performance.stat-prefetch on</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume set <b><vol-name></b> performance.cache-invalidation on</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume set <b><vol-name></b> performance.md-cache-timeout 600</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:11pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume set <b><vol-name></b> network.inode-lru-limit 90000</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:11pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume set <b><vol-name></b> cluster.lookup-optimize </span><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">on</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:11pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume set <b><vol-name></b> server.event-threads </span><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">4</span></p>
<p dir="ltr"
style="line-height:1.2;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">gluster volume set <b><vol-name></b> client.event-threads </span><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:700;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">4</span></p>
</b></p>
<p>gluster volume start <vol-name></p>
<p><br>
</p>
<p>Thanks & regards</p>
<p>Karan Sandha<br>
</p>
<br>
<div class="moz-cite-prefix">On 05/09/2017 03:03 PM, Chiku wrote:<br>
</div>
<blockquote type="cite"
cite="mid:85242ebb-9de4-7948-e530-7c79960a6971@tsgri13.fr">Hello,
<br>
<br>
I'm testing glusterfs for windows client.
<br>
I created 2 servers for glusterfs (3.10.1 replication 2) on centos
7.3.
<br>
<br>
Right now, I just use default setting and my testing use case is
alot small files in a folder.
<br>
<br>
nfs windows client is so poor performance than nfs linux client.
Idon't understand. It should have same nfs linux performance.
<br>
I saw something wierd about network traffic. On windows client I
saw more receive (9Mbps) traffic than send traffic (1Mpbs).
<br>
<br>
On nfs linux client, receive traffic is around 700Kbps.
<br>
<br>
Can someone have any idea what happen with nfs windows client?
<br>
I will try later some tunning tests.
<br>
<br>
<br>
<br>
<br>
* 1st test: centos client mount with glusterfs type :
<br>
gl1.lab.com:vol1 on /mnt/glusterfs type fuse.glusterfs
(rw,relatime,user_id=0,group_id=0,default_permissions,allow_other,max_read=131072)<br>
<br>
python smallfile_cli.py --operation create --threads 1 --file-size
30 --files 5000 --files-per-dir 10000 --top /mnt/glusterfs/test1 <br>
smallfile version 3.0
<br>
hosts in test : None
<br>
top test directory(s) :
['/mnt/glusterfs/test1']
<br>
operation : create
<br>
files/thread : 5000
<br>
threads : 1
<br>
record size (KB, 0 = maximum) : 0
<br>
file size (KB) : 30
<br>
file size distribution : fixed
<br>
files per dir : 10000
<br>
dirs per dir : 10
<br>
threads share directories? : N
<br>
filename prefix :
<br>
filename suffix :
<br>
hash file number into dir.? : N
<br>
fsync after modify? : N
<br>
pause between files (microsec) : 0
<br>
finish all requests? : Y
<br>
stonewall? : Y
<br>
measure response times? : N
<br>
verify read? : Y
<br>
verbose? : False
<br>
log to stderr? : False
<br>
ext.attr.size : 0
<br>
ext.attr.count : 0
<br>
host = cm2.lab.com,thr = 00,elapsed = 16.566169,files =
5000,records = 5000,status = ok
<br>
total threads = 1
<br>
total files = 5000
<br>
total data = 0.143 GB
<br>
100.00% of requested files processed, minimum is 90.00
<br>
16.566169 sec elapsed time
<br>
301.819932 files/sec
<br>
301.819932 IOPS
<br>
8.842381 MB/sec
<br>
<br>
* 2nd test centos client mount with nfs :
<br>
gl1.lab.com:/vol1 on /mnt/nfs type nfs
(rw,relatime,vers=3,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,mountaddr=192.168.47.11,mountvers=3,mountport=38465,mountproto=tcp,local_lock=none,addr=192.168.47.11)<br>
<br>
python smallfile_cli.py --operation create --threads 1 --file-size
30 --files 5000 --files-per-dir 10000 --top /mnt/nfs/test1 <br>
smallfile version 3.0
<br>
hosts in test : None
<br>
top test directory(s) : ['/mnt/nfs/test1']
<br>
operation : create
<br>
files/thread : 5000
<br>
threads : 1
<br>
record size (KB, 0 = maximum) : 0
<br>
file size (KB) : 30
<br>
file size distribution : fixed
<br>
files per dir : 10000
<br>
dirs per dir : 10
<br>
threads share directories? : N
<br>
filename prefix :
<br>
filename suffix :
<br>
hash file number into dir.? : N
<br>
fsync after modify? : N
<br>
pause between files (microsec) : 0
<br>
finish all requests? : Y
<br>
stonewall? : Y
<br>
measure response times? : N
<br>
verify read? : Y
<br>
verbose? : False
<br>
log to stderr? : False
<br>
ext.attr.size : 0
<br>
ext.attr.count : 0
<br>
host = cm2.lab.com,thr = 00,elapsed = 54.737751,files =
5000,records = 5000,status = ok
<br>
total threads = 1
<br>
total files = 5000
<br>
total data = 0.143 GB
<br>
100.00% of requested files processed, minimum is 90.00
<br>
54.737751 sec elapsed time
<br>
91.344637 files/sec
<br>
91.344637 IOPS
<br>
2.676112 MB/sec
<br>
<br>
<br>
* 3th test: new windows 2012R2 with nfs client installed :
<br>
<br>
C:\Users\Administrator\smallfile>smallfile_cli.py --operation
create --threads 1 --file-size 30 --files 5000 --files-per-dir
10000 --top \\192.168.47.11\vol1\test1
<br>
smallfile version 3.0
<br>
hosts in test : None
<br>
top test directory(s) :
['\\\\192.168.47.11\\vol1\\test1']
<br>
operation : create
<br>
files/thread : 5000
<br>
threads : 1
<br>
record size (KB, 0 = maximum) : 0
<br>
file size (KB) : 30
<br>
file size distribution : fixed
<br>
files per dir : 10000
<br>
dirs per dir : 10
<br>
threads share directories? : N
<br>
filename prefix :
<br>
filename suffix :
<br>
hash file number into dir.? : N
<br>
fsync after modify? : N
<br>
pause between files (microsec) : 0
<br>
finish all requests? : Y
<br>
stonewall? : Y
<br>
measure response times? : N
<br>
verify read? : Y
<br>
verbose? : False
<br>
log to stderr? : False
<br>
ext.attr.size : 0
<br>
ext.attr.count : 0
<br>
adding time for Windows synchronization
<br>
host = WIN-H8RKTO9B438,thr = 00,elapsed = 425.342000,files =
5000,records = 5000
<br>
,status = ok
<br>
total threads = 1
<br>
total files = 5000
<br>
total data = 0.143 GB
<br>
100.00% of requested files processed, minimum is 90.00
<br>
425.342000 sec elapsed time
<br>
11.755246 files/sec
<br>
11.755246 IOPS
<br>
0.344392 MB/sec
<br>
_______________________________________________
<br>
Gluster-users mailing list
<br>
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<br>
<a class="moz-txt-link-freetext" href="http://lists.gluster.org/mailman/listinfo/gluster-users">http://lists.gluster.org/mailman/listinfo/gluster-users</a>
<br>
</blockquote>
<br>
</body>
</html>