<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<br>
Hi Pranith & Ravi,<br>
<br>
Sorry for the delay. I have the profile info for the past couple of
days just below. Is this of any help to you or is there additional
information I can request?<br>
<br>
<tt>Brick: mseas-data2:/mnt/brick2</tt><tt><br>
</tt><tt>------------------------------</tt><tt><br>
</tt><tt>Cumulative Stats:</tt><tt><br>
</tt><tt> Block Size: 1b+
2b+ 4b+ </tt><tt><br>
</tt><tt> No. of Reads: 6
38 1144 </tt><tt><br>
</tt><tt>No. of Writes: 108032195
8352125 141319922 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 8b+
16b+ 32b+ </tt><tt><br>
</tt><tt> No. of Reads: 689
1256 2756 </tt><tt><br>
</tt><tt>No. of Writes: 13946933
20694915 57845473 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 64b+
128b+ 256b+ </tt><tt><br>
</tt><tt> No. of Reads: 5522
56492 149462 </tt><tt><br>
</tt><tt>No. of Writes: 714398165
11923303 2537176 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 512b+
1024b+ 2048b+ </tt><tt><br>
</tt><tt> No. of Reads: 64285
192872 200488 </tt><tt><br>
</tt><tt>No. of Writes: 5975842
217173849 94536339 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 4096b+
8192b+ 16384b+ </tt><tt><br>
</tt><tt> No. of Reads: 300021
764297 1613672 </tt><tt><br>
</tt><tt>No. of Writes: 112481858
53164978 330177486 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 32768b+
65536b+ 131072b+ </tt><tt><br>
</tt><tt> No. of Reads: 5101884
14470916 4958306977 </tt><tt><br>
</tt><tt>No. of Writes: 35098110
19969017 2243344759 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 262144b+ </tt><tt><br>
</tt><tt> No. of Reads: 0 </tt><tt><br>
</tt><tt>No. of Writes: 547 </tt><tt><br>
</tt><tt> %-latency Avg-latency Min-Latency Max-Latency No.
of calls Fop</tt><tt><br>
</tt><tt> --------- ----------- ----------- -----------
------------ ----</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
4052087 FORGET</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
6381234 RELEASE</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
28716633 RELEASEDIR</tt><tt><br>
</tt><tt> 0.00 92.81 us 48.00 us 130.00
us 53 READLINK</tt><tt><br>
</tt><tt> 0.00 201.22 us 112.00 us 457.00
us 188 RMDIR</tt><tt><br>
</tt><tt> 0.00 169.36 us 53.00 us 20417.00
us 347 SETXATTR</tt><tt><br>
</tt><tt> 0.00 20497.89 us 241.00 us 57505.00
us 45 SYMLINK</tt><tt><br>
</tt><tt> 0.00 116.97 us 42.00 us 39168.00
us 9172 SETATTR</tt><tt><br>
</tt><tt> 0.00 380.06 us 76.00 us 198427.00
us 3133 LINK</tt><tt><br>
</tt><tt> 0.00 149.60 us 14.00 us 601941.00
us 14426 INODELK</tt><tt><br>
</tt><tt> 0.00 387.81 us 69.00 us 161114.00
us 6617 RENAME</tt><tt><br>
</tt><tt> 0.01 96.47 us 14.00 us 1224734.00
us 63599 STATFS</tt><tt><br>
</tt><tt> 0.01 25041.48 us 299.00 us 93211.00
us 348 MKDIR</tt><tt><br>
</tt><tt> 0.01 380.41 us 31.00 us 561724.00
us 31452 OPEN</tt><tt><br>
</tt><tt> 0.02 1346.42 us 64.00 us 226741.00
us 18306 UNLINK</tt><tt><br>
</tt><tt> 0.02 2123.19 us 42.00 us 802398.00
us 12370 FTRUNCATE</tt><tt><br>
</tt><tt> 0.04 12161.88 us 175.00 us 158072.00
us 3244 MKNOD</tt><tt><br>
</tt><tt> 0.07 132801.87 us 39.00 us 3144448.00
us 532 FSYNC</tt><tt><br>
</tt><tt> 0.13 89.98 us 4.00 us 5550246.00 us
1492793 FLUSH</tt><tt><br>
</tt><tt> 0.45 65.89 us 6.00 us 3608035.00 us
7194229 FSTAT</tt><tt><br>
</tt><tt> 0.57 14538.33 us 162.00 us 4577282.00
us 41466 CREATE</tt><tt><br>
</tt><tt> 0.70 3183.52 us 16.00 us 4358324.00
us 231728 OPENDIR</tt><tt><br>
</tt><tt> 1.67 7559.32 us 8.00 us 4193443.00
us 234012 STAT</tt><tt><br>
</tt><tt> 2.26 119.27 us 11.00 us 4491219.00 us
20093638 WRITE</tt><tt><br>
</tt><tt> 2.51 207.00 us 10.00 us 4993074.00 us
12884466 READ</tt><tt><br>
</tt><tt> 4.17 246.12 us 13.00 us 8857354.00 us
17952607 GETXATTR</tt><tt><br>
</tt><tt> 23.72 48775.51 us 14.00 us 5022445.00
us 515770 READDIRP</tt><tt><br>
</tt><tt> 63.65 1238.53 us 25.00 us 4483760.00 us
54507520 LOOKUP</tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Duration: 9810315 seconds</tt><tt><br>
</tt><tt> Data Read: 651660783328883 bytes</tt><tt><br>
</tt><tt>Data Written: 305412177327433 bytes</tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt>Interval 0 Stats:</tt><tt><br>
</tt><tt> Block Size: 1b+
2b+ 4b+ </tt><tt><br>
</tt><tt> No. of Reads: 6
38 1144 </tt><tt><br>
</tt><tt>No. of Writes: 108032195
8352125 141319922 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 8b+
16b+ 32b+ </tt><tt><br>
</tt><tt> No. of Reads: 689
1256 2756 </tt><tt><br>
</tt><tt>No. of Writes: 13946933
20694915 57845473 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 64b+
128b+ 256b+ </tt><tt><br>
</tt><tt> No. of Reads: 5522
56492 149462 </tt><tt><br>
</tt><tt>No. of Writes: 714398165
11923303 2537176 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 512b+
1024b+ 2048b+ </tt><tt><br>
</tt><tt> No. of Reads: 64285
192872 200488 </tt><tt><br>
</tt><tt>No. of Writes: 5975842
217173849 94536339 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 4096b+
8192b+ 16384b+ </tt><tt><br>
</tt><tt> No. of Reads: 300021
764297 1613672 </tt><tt><br>
</tt><tt>No. of Writes: 112481858
53164978 330177486 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 32768b+
65536b+ 131072b+ </tt><tt><br>
</tt><tt> No. of Reads: 5101884
14470916 4958306977 </tt><tt><br>
</tt><tt>No. of Writes: 35098110
19969017 2243344759 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 262144b+ </tt><tt><br>
</tt><tt> No. of Reads: 0 </tt><tt><br>
</tt><tt>No. of Writes: 547 </tt><tt><br>
</tt><tt> %-latency Avg-latency Min-Latency Max-Latency No.
of calls Fop</tt><tt><br>
</tt><tt> --------- ----------- ----------- -----------
------------ ----</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
4052087 FORGET</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
6381233 RELEASE</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
28716630 RELEASEDIR</tt><tt><br>
</tt><tt> 0.00 92.81 us 48.00 us 130.00
us 53 READLINK</tt><tt><br>
</tt><tt> 0.00 201.22 us 112.00 us 457.00
us 188 RMDIR</tt><tt><br>
</tt><tt> 0.00 169.36 us 53.00 us 20417.00
us 347 SETXATTR</tt><tt><br>
</tt><tt> 0.00 20497.89 us 241.00 us 57505.00
us 45 SYMLINK</tt><tt><br>
</tt><tt> 0.00 116.97 us 42.00 us 39168.00
us 9172 SETATTR</tt><tt><br>
</tt><tt> 0.00 380.06 us 76.00 us 198427.00
us 3133 LINK</tt><tt><br>
</tt><tt> 0.00 149.60 us 14.00 us 601941.00
us 14426 INODELK</tt><tt><br>
</tt><tt> 0.00 387.81 us 69.00 us 161114.00
us 6617 RENAME</tt><tt><br>
</tt><tt> 0.01 96.47 us 14.00 us 1224734.00
us 63599 STATFS</tt><tt><br>
</tt><tt> 0.01 25041.48 us 299.00 us 93211.00
us 348 MKDIR</tt><tt><br>
</tt><tt> 0.01 380.41 us 31.00 us 561724.00
us 31452 OPEN</tt><tt><br>
</tt><tt> 0.02 1346.42 us 64.00 us 226741.00
us 18306 UNLINK</tt><tt><br>
</tt><tt> 0.02 2123.19 us 42.00 us 802398.00
us 12370 FTRUNCATE</tt><tt><br>
</tt><tt> 0.04 12161.88 us 175.00 us 158072.00
us 3244 MKNOD</tt><tt><br>
</tt><tt> 0.07 132801.87 us 39.00 us 3144448.00
us 532 FSYNC</tt><tt><br>
</tt><tt> 0.13 89.98 us 4.00 us 5550246.00 us
1492793 FLUSH</tt><tt><br>
</tt><tt> 0.45 65.89 us 6.00 us 3608035.00 us
7194229 FSTAT</tt><tt><br>
</tt><tt> 0.57 14538.33 us 162.00 us 4577282.00
us 41466 CREATE</tt><tt><br>
</tt><tt> 0.70 3183.52 us 16.00 us 4358324.00
us 231728 OPENDIR</tt><tt><br>
</tt><tt> 1.67 7559.32 us 8.00 us 4193443.00
us 234012 STAT</tt><tt><br>
</tt><tt> 2.26 119.27 us 11.00 us 4491219.00 us
20093638 WRITE</tt><tt><br>
</tt><tt> 2.51 207.00 us 10.00 us 4993074.00 us
12884466 READ</tt><tt><br>
</tt><tt> 4.17 246.12 us 13.00 us 8857354.00 us
17952607 GETXATTR</tt><tt><br>
</tt><tt> 23.72 48775.51 us 14.00 us 5022445.00
us 515770 READDIRP</tt><tt><br>
</tt><tt> 63.65 1238.53 us 25.00 us 4483760.00 us
54507520 LOOKUP</tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Duration: 9810315 seconds</tt><tt><br>
</tt><tt> Data Read: 651660783328883 bytes</tt><tt><br>
</tt><tt>Data Written: 305412177327433 bytes</tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt>Brick: mseas-data2:/mnt/brick1</tt><tt><br>
</tt><tt>------------------------------</tt><tt><br>
</tt><tt>Cumulative Stats:</tt><tt><br>
</tt><tt> Block Size: 1b+
2b+ 4b+ </tt><tt><br>
</tt><tt> No. of Reads: 4
38 1482 </tt><tt><br>
</tt><tt>No. of Writes: 643631512
59055444 235532859 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 8b+
16b+ 32b+ </tt><tt><br>
</tt><tt> No. of Reads: 1171
2138 4748 </tt><tt><br>
</tt><tt>No. of Writes: 31816870
23602175 50161322 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 64b+
128b+ 256b+ </tt><tt><br>
</tt><tt> No. of Reads: 9461
65360 165954 </tt><tt><br>
</tt><tt>No. of Writes: 711114605
11760241 4078907 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 512b+
1024b+ 2048b+ </tt><tt><br>
</tt><tt> No. of Reads: 94563
226053 258803 </tt><tt><br>
</tt><tt>No. of Writes: 6366990
211643393 95831137 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 4096b+
8192b+ 16384b+ </tt><tt><br>
</tt><tt> No. of Reads: 383871
1032345 2244921 </tt><tt><br>
</tt><tt>No. of Writes: 155833532
57850303 339892660 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 32768b+
65536b+ 131072b+ </tt><tt><br>
</tt><tt> No. of Reads: 7588068
22368398 5387488199 </tt><tt><br>
</tt><tt>No. of Writes: 38588368
25195605 2463004132 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 262144b+ </tt><tt><br>
</tt><tt> No. of Reads: 0 </tt><tt><br>
</tt><tt>No. of Writes: 489 </tt><tt><br>
</tt><tt> %-latency Avg-latency Min-Latency Max-Latency No.
of calls Fop</tt><tt><br>
</tt><tt> --------- ----------- ----------- -----------
------------ ----</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
4060396 FORGET</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
6244016 RELEASE</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
28716852 RELEASEDIR</tt><tt><br>
</tt><tt> 0.00 96.42 us 61.00 us 148.00
us 40 READLINK</tt><tt><br>
</tt><tt> 0.00 208.36 us 114.00 us 322.00
us 188 RMDIR</tt><tt><br>
</tt><tt> 0.00 2231.61 us 57.00 us 716342.00
us 347 SETXATTR</tt><tt><br>
</tt><tt> 0.00 20821.92 us 758.00 us 57852.00
us 38 SYMLINK</tt><tt><br>
</tt><tt> 0.00 519.11 us 76.00 us 952378.00
us 3149 LINK</tt><tt><br>
</tt><tt> 0.00 196.97 us 50.00 us 736928.00
us 9055 SETATTR</tt><tt><br>
</tt><tt> 0.00 164.34 us 18.00 us 736161.00
us 13460 INODELK</tt><tt><br>
</tt><tt> 0.00 375.54 us 73.00 us 198362.00
us 6274 RENAME</tt><tt><br>
</tt><tt> 0.01 20913.10 us 351.00 us 102696.00
us 348 MKDIR</tt><tt><br>
</tt><tt> 0.01 151.39 us 17.00 us 782025.00
us 63598 STATFS</tt><tt><br>
</tt><tt> 0.03 1103.67 us 34.00 us 618187.00
us 29597 OPEN</tt><tt><br>
</tt><tt> 0.03 2833.17 us 43.00 us 1069257.00
us 11693 FTRUNCATE</tt><tt><br>
</tt><tt> 0.04 2267.87 us 61.00 us 3746134.00
us 17859 UNLINK</tt><tt><br>
</tt><tt> 0.04 13105.16 us 254.00 us 179505.00
us 3177 MKNOD</tt><tt><br>
</tt><tt> 0.05 88496.76 us 21.00 us 1718559.00
us 613 FSYNC</tt><tt><br>
</tt><tt> 0.58 73.42 us 6.00 us 1917794.00 us
7848483 FSTAT</tt><tt><br>
</tt><tt> 0.71 17177.23 us 177.00 us 7077794.00
us 40554 CREATE</tt><tt><br>
</tt><tt> 0.79 585.79 us 3.00 us 11107703.00
us 1322036 FLUSH</tt><tt><br>
</tt><tt> 1.72 7459.40 us 9.00 us 2764285.00
us 228033 STAT</tt><tt><br>
</tt><tt> 1.96 8350.73 us 19.00 us 2235725.00
us 231728 OPENDIR</tt><tt><br>
</tt><tt> 2.60 115.35 us 12.00 us 4196355.00 us
22239110 WRITE</tt><tt><br>
</tt><tt> 4.60 313.20 us 10.00 us 6211594.00 us
14494253 READ</tt><tt><br>
</tt><tt> 5.98 307.95 us 13.00 us 9885480.00 us
19163193 GETXATTR</tt><tt><br>
</tt><tt> 25.68 48514.34 us 17.00 us 4734636.00
us 522162 READDIRP</tt><tt><br>
</tt><tt> 55.15 1075.93 us 26.00 us 4291535.00 us
50562855 LOOKUP</tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Duration: 9810315 seconds</tt><tt><br>
</tt><tt> Data Read: 708869551853133 bytes</tt><tt><br>
</tt><tt>Data Written: 335305857076797 bytes</tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt>Interval 0 Stats:</tt><tt><br>
</tt><tt> Block Size: 1b+
2b+ 4b+ </tt><tt><br>
</tt><tt> No. of Reads: 4
38 1482 </tt><tt><br>
</tt><tt>No. of Writes: 643631512
59055444 235532859 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 8b+
16b+ 32b+ </tt><tt><br>
</tt><tt> No. of Reads: 1171
2138 4748 </tt><tt><br>
</tt><tt>No. of Writes: 31816870
23602175 50161322 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 64b+
128b+ 256b+ </tt><tt><br>
</tt><tt> No. of Reads: 9461
65360 165954 </tt><tt><br>
</tt><tt>No. of Writes: 711114605
11760241 4078907 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 512b+
1024b+ 2048b+ </tt><tt><br>
</tt><tt> No. of Reads: 94563
226053 258803 </tt><tt><br>
</tt><tt>No. of Writes: 6366990
211643393 95831137 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 4096b+
8192b+ 16384b+ </tt><tt><br>
</tt><tt> No. of Reads: 383871
1032345 2244921 </tt><tt><br>
</tt><tt>No. of Writes: 155833532
57850303 339892660 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 32768b+
65536b+ 131072b+ </tt><tt><br>
</tt><tt> No. of Reads: 7588068
22368398 5387488199 </tt><tt><br>
</tt><tt>No. of Writes: 38588368
25195605 2463004132 </tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Block Size: 262144b+ </tt><tt><br>
</tt><tt> No. of Reads: 0 </tt><tt><br>
</tt><tt>No. of Writes: 489 </tt><tt><br>
</tt><tt> %-latency Avg-latency Min-Latency Max-Latency No.
of calls Fop</tt><tt><br>
</tt><tt> --------- ----------- ----------- -----------
------------ ----</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
4060397 FORGET</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
6244015 RELEASE</tt><tt><br>
</tt><tt> 0.00 0.00 us 0.00 us 0.00 us
28716850 RELEASEDIR</tt><tt><br>
</tt><tt> 0.00 96.42 us 61.00 us 148.00
us 40 READLINK</tt><tt><br>
</tt><tt> 0.00 208.36 us 114.00 us 322.00
us 188 RMDIR</tt><tt><br>
</tt><tt> 0.00 2231.61 us 57.00 us 716342.00
us 347 SETXATTR</tt><tt><br>
</tt><tt> 0.00 20821.92 us 758.00 us 57852.00
us 38 SYMLINK</tt><tt><br>
</tt><tt> 0.00 519.11 us 76.00 us 952378.00
us 3149 LINK</tt><tt><br>
</tt><tt> 0.00 196.97 us 50.00 us 736928.00
us 9055 SETATTR</tt><tt><br>
</tt><tt> 0.00 164.34 us 18.00 us 736161.00
us 13460 INODELK</tt><tt><br>
</tt><tt> 0.00 375.54 us 73.00 us 198362.00
us 6274 RENAME</tt><tt><br>
</tt><tt> 0.01 20913.10 us 351.00 us 102696.00
us 348 MKDIR</tt><tt><br>
</tt><tt> 0.01 151.39 us 17.00 us 782025.00
us 63598 STATFS</tt><tt><br>
</tt><tt> 0.03 1103.67 us 34.00 us 618187.00
us 29597 OPEN</tt><tt><br>
</tt><tt> 0.03 2833.17 us 43.00 us 1069257.00
us 11693 FTRUNCATE</tt><tt><br>
</tt><tt> 0.04 2267.87 us 61.00 us 3746134.00
us 17859 UNLINK</tt><tt><br>
</tt><tt> 0.04 13105.16 us 254.00 us 179505.00
us 3177 MKNOD</tt><tt><br>
</tt><tt> 0.05 88496.76 us 21.00 us 1718559.00
us 613 FSYNC</tt><tt><br>
</tt><tt> 0.58 73.42 us 6.00 us 1917794.00 us
7848483 FSTAT</tt><tt><br>
</tt><tt> 0.71 17177.23 us 177.00 us 7077794.00
us 40554 CREATE</tt><tt><br>
</tt><tt> 0.79 585.79 us 3.00 us 11107703.00
us 1322036 FLUSH</tt><tt><br>
</tt><tt> 1.72 7459.40 us 9.00 us 2764285.00
us 228033 STAT</tt><tt><br>
</tt><tt> 1.96 8350.73 us 19.00 us 2235725.00
us 231728 OPENDIR</tt><tt><br>
</tt><tt> 2.60 115.35 us 12.00 us 4196355.00 us
22239110 WRITE</tt><tt><br>
</tt><tt> 4.60 313.20 us 10.00 us 6211594.00 us
14494253 READ</tt><tt><br>
</tt><tt> 5.98 307.95 us 13.00 us 9885480.00 us
19163193 GETXATTR</tt><tt><br>
</tt><tt> 25.68 48514.34 us 17.00 us 4734636.00
us 522162 READDIRP</tt><tt><br>
</tt><tt> 55.15 1075.93 us 26.00 us 4291535.00 us
50562855 LOOKUP</tt><tt><br>
</tt><tt> </tt><tt><br>
</tt><tt> Duration: 9810315 seconds</tt><tt><br>
</tt><tt> Data Read: 708869551853133 bytes</tt><tt><br>
</tt>Data Written: 335305857076797 bytes<br>
<br>
<br>
<div class="moz-cite-prefix">On 04/14/2017 02:50 AM, Pranith Kumar
Karampuri wrote:<br>
</div>
<blockquote
cite="mid:CAOgeEnbijXj0VyMzi21ut-XGNhukLqU4L37AgWczB2c02yh7NQ@mail.gmail.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sat, Apr 8, 2017 at 10:28 AM,
Ravishankar N <span dir="ltr"><<a moz-do-not-send="true"
href="mailto:ravishankar@redhat.com" target="_blank">ravishankar@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF">
<div class="gmail-m_1278894059907384689moz-cite-prefix">Hi
Pat,<br>
<br>
I'm assuming you are using gluster native (fuse
mount). If it helps, you could try mounting it via
gluster NFS (gnfs) and then see if there is an
improvement in speed. Fuse mounts are slower than gnfs
mounts but you get the benefit of avoiding a single
point of failure. Unlike fuse mounts, if the gluster
node containing the gnfs server goes down, all mounts
done using that node will fail). For fuse mounts, you
could try tweaking the write-behind xlator settings to
see if it helps. See the performance.write-behind and
performance.write-behind-<wbr>window-size options in
`gluster volume set help`. Of course, even for gnfs
mounts, you can achieve fail-over by using CTDB.<br>
</div>
</div>
</blockquote>
<div><br>
</div>
<div>Ravi,<br>
</div>
<div> Do you have any data that suggests fuse mounts
are slower than gNFS servers? <br>
<br>
</div>
<div>Pat,<br>
</div>
<div> I see that I am late to the thread, but do you
happen to have "profile info" of the workload?<br>
<br>
</div>
<div>You can follow <a moz-do-not-send="true"
href="https://gluster.readthedocs.io/en/latest/Administrator%20Guide/Monitoring%20Workload/">https://gluster.readthedocs.io/en/latest/Administrator%20Guide/Monitoring%20Workload/</a>
to get the information.<br>
</div>
<div> </div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF">
<div class="gmail-m_1278894059907384689moz-cite-prefix">
<br>
Thanks,<br>
Ravi
<div>
<div class="gmail-h5"><br>
<br>
On 04/08/2017 12:07 AM, Pat Haley wrote:<br>
</div>
</div>
</div>
<blockquote type="cite">
<div>
<div class="gmail-h5"> <br>
Hi,<br>
<br>
We noticed a dramatic slowness when writing to a
gluster disk when compared to writing to an NFS
disk. Specifically when using dd (data duplicator)
to write a 4.3 GB file of zeros:<br>
<ul>
<li>on NFS disk (/home): 9.5 Gb/s</li>
<li>on gluster disk (/gdata): 508 Mb/s<br>
</li>
</ul>
The gluser disk is 2 bricks joined together, no
replication or anything else. The hardware is
(literally) the same:<br>
<ul>
<li>one server with 70 hard disks and a
hardware RAID card.</li>
<li>4 disks in a RAID-6 group (the NFS disk)</li>
<li>32 disks in a RAID-6 group (the max allowed
by the card, /mnt/brick1)</li>
<li>32 disks in another RAID-6 group
(/mnt/brick2)</li>
<li>2 hot spare<br>
</li>
</ul>
<p>Some additional information and more tests
results (after changing the log level):<br>
</p>
<p><span>glusterfs 3.7.11 built on Apr 27 2016
14:09:22</span><br>
<span>CentOS release 6.8 (Final)</span><br>
RAID bus controller: LSI Logic / Symbios Logic
MegaRAID SAS-3 3108 [Invader] (rev 02)<br>
<br>
<br>
<br>
<b>Create the file to /gdata (gluster)</b><br>
[root@mseas-data2 gdata]# dd if=/dev/zero
of=/gdata/zero1 bs=1M count=1000<br>
1000+0 records in<br>
1000+0 records out<br>
1048576000 bytes (1.0 GB) copied, 1.91876 s, <b>546
MB/s</b><br>
<br>
<b>Create the file to /home (ext4)</b><br>
[root@mseas-data2 gdata]# dd if=/dev/zero
of=/home/zero1 bs=1M count=1000<br>
1000+0 records in<br>
1000+0 records out<br>
1048576000 bytes (1.0 GB) copied, 0.686021 s, <b>1.5
GB/s - </b>3 times as fast<b><br>
<br>
<br>
Copy from /gdata to /gdata (gluster to
gluster)<br>
</b>[root@mseas-data2 gdata]# dd if=/gdata/zero1
of=/gdata/zero2<br>
2048000+0 records in<br>
2048000+0 records out<br>
1048576000 bytes (1.0 GB) copied, 101.052 s, <b>10.4
MB/s</b> - realllyyy slooowww<br>
<br>
<br>
<b>Copy from /gdata to /gdata</b> <b>2nd time <b>(gluster
to gluster)</b></b><br>
[root@mseas-data2 gdata]# dd if=/gdata/zero1
of=/gdata/zero2<br>
2048000+0 records in<br>
2048000+0 records out<br>
1048576000 bytes (1.0 GB) copied, 92.4904 s, <b>11.3
MB/s</b> <span>- realllyyy slooowww</span>
again<br>
<br>
<br>
<br>
<b>Copy from /home to /home (ext4 to ext4)</b><br>
[root@mseas-data2 gdata]# dd if=/home/zero1
of=/home/zero2<br>
2048000+0 records in<br>
2048000+0 records out<br>
1048576000 bytes (1.0 GB) copied, 3.53263 s, <b>297
MB/s </b>30 times as fast<br>
<br>
<br>
<b>Copy from /home to /home (ext4 to ext4)</b><br>
[root@mseas-data2 gdata]# dd if=/home/zero1
of=/home/zero3<br>
2048000+0 records in<br>
2048000+0 records out<br>
1048576000 bytes (1.0 GB) copied, 4.1737 s, <b>251
MB/s</b> <span>- 30 times as fast<br>
<br>
<br>
As a test, can we copy data directly to the
xfs mountpoint (/mnt/brick1) and bypass
gluster?<br>
<br>
<br>
Any help you could give us would be
appreciated.<br>
<br>
</span>Thanks<br>
</p>
<pre class="gmail-m_1278894059907384689moz-signature" cols="72">--
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=<wbr>-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=<wbr>-=-=-
Pat Haley Email: <a moz-do-not-send="true" class="gmail-m_1278894059907384689moz-txt-link-abbreviated" href="mailto:phaley@mit.edu" target="_blank">phaley@mit.edu</a>
Center for Ocean Engineering Phone: (617) 253-6824
Dept. of Mechanical Engineering Fax: (617) 253-8125
MIT, Room 5-213 <a moz-do-not-send="true" class="gmail-m_1278894059907384689moz-txt-link-freetext" href="http://web.mit.edu/phaley/www/" target="_blank">http://web.mit.edu/phaley/www/</a>
77 Massachusetts Avenue
Cambridge, MA 02139-4301
</pre>
<fieldset class="gmail-m_1278894059907384689mimeAttachmentHeader"></fieldset>
</div></div><pre>______________________________<wbr>_________________
Gluster-users mailing list
<a moz-do-not-send="true" class="gmail-m_1278894059907384689moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>
<a moz-do-not-send="true" class="gmail-m_1278894059907384689moz-txt-link-freetext" href="http://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a></pre>
</blockquote>
<p>
</p>
</div>
______________________________<wbr>_________________
Gluster-users mailing list
<a moz-do-not-send="true" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a moz-do-not-send="true" href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a>
</blockquote></div>
--
<div class="gmail_signature"><div dir="ltr">Pranith
</div></div>
</div></div>
</blockquote>
<pre class="moz-signature" cols="72">--
-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
Pat Haley Email: <a class="moz-txt-link-abbreviated" href="mailto:phaley@mit.edu">phaley@mit.edu</a>
Center for Ocean Engineering Phone: (617) 253-6824
Dept. of Mechanical Engineering Fax: (617) 253-8125
MIT, Room 5-213 <a class="moz-txt-link-freetext" href="http://web.mit.edu/phaley/www/">http://web.mit.edu/phaley/www/</a>
77 Massachusetts Avenue
Cambridge, MA 02139-4301
</pre></body></html>