<html xmlns="http://www.w3.org/1999/xhtml" xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office"><head><!--[if gte mso 9]><xml><o:OfficeDocumentSettings><o:AllowPNG/><o:PixelsPerInch>96</o:PixelsPerInch></o:OfficeDocumentSettings></xml><![endif]--></head><body><div style="color:#000; background-color:#fff; font-family:Courier New, courier, monaco, monospace, sans-serif;font-size:16px"><div>Hello Community,</div><div><br></div><div>I would be very grateful if you share your thoughts about my problem.</div><div>I'm quite new to gluster , so keep that in mind.</div><div><br></div><div>Setup:</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_2517">I have 3 nodes for an ovirt setup (2 hosts + 1 gluster arbiter). The diagram of my setup is: <a href="https://drive.google.com/file/d/1SiW21ASPXHRAEuE_jZ50R3FoO-NcnFqT/view?usp=sharing" class="enhancr2_1c11bdb3-a8ac-883b-55b8-f7cdf315e5b1" id="yui_3_16_0_ym19_1_1548197889215_2516">ovirt</a></div><div><br></div><div id="enhancr2_1c11bdb3-a8ac-883b-55b8-f7cdf315e5b1" class="yahoo-link-enhancr-card ymail-preserve-class ymail-preserve-style" style="max-width:400px;font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;" contenteditable="false" data-url="https://drive.google.com/file/d/1SiW21ASPXHRAEuE_jZ50R3FoO-NcnFqT/view?usp=sharing" data-type="yenhancr" data-category="article" data-embed-url="" data-size="medium" dir="ltr"> <a href="https://drive.google.com/file/d/1SiW21ASPXHRAEuE_jZ50R3FoO-NcnFqT/view?usp=sharing" style="text-decoration:none !important; color: #000 !important;" class="yahoo-enhancr-cardlink" target="_blank" rel="noreferrer" id="yui_3_16_0_ym19_1_1548197889215_2618"> <table class="card-wrapper yahoo-ignore-table" cellpadding="0" cellspacing="0" border="0" style="max-width:400px;" id="yui_3_16_0_ym19_1_1548197889215_2617"> <tbody id="yui_3_16_0_ym19_1_1548197889215_2616"><tr id="yui_3_16_0_ym19_1_1548197889215_2615"> <td width="400" id="yui_3_16_0_ym19_1_1548197889215_2614"> <table class="card yahoo-ignore-table" cellpadding="0" cellspacing="0" border="0" width="100%" style="max-width:400px;" id="yui_3_16_0_ym19_1_1548197889215_2613"> <tbody id="yui_3_16_0_ym19_1_1548197889215_2612"><tr id="yui_3_16_0_ym19_1_1548197889215_2611"> <td class="card-primary-image-cell" style="background:#000 url('https://s.yimg.com/vv//api/res/1.2/5YmQS2RSUI33zGmBLJzHXQ--~A/YXBwaWQ9bWFpbDtmaT1maWxsO2g9MjAwO3c9NDAw/https://lh6.googleusercontent.com/dB4j-KSRo8wqNvOfXJEp3WRkEkOTNajr3hMogftTZx-eLRwDT3eSr2r1pks=w1200-h630-p.cf.jpg') no-repeat center center;background-size:cover;height:200px;position:relative;" background="https://s.yimg.com/vv//api/res/1.2/5YmQS2RSUI33zGmBLJzHXQ--~A/YXBwaWQ9bWFpbDtmaT1maWxsO2g9MjAwO3c9NDAw/https://lh6.googleusercontent.com/dB4j-KSRo8wqNvOfXJEp3WRkEkOTNajr3hMogftTZx-eLRwDT3eSr2r1pks=w1200-h630-p.cf.jpg" bgcolor="#000000" valign="top" id="yui_3_16_0_ym19_1_1548197889215_2610"> <!--[if gte mso 9]><v:rect fill="true" stroke="false" style="width:400px;height:218px;position:absolute;top:0;left:0;"><v:fill type="frame" color="#000000" src="https://s.yimg.com/vv//api/res/1.2/5YmQS2RSUI33zGmBLJzHXQ--~A/YXBwaWQ9bWFpbDtmaT1maWxsO2g9MjAwO3c9NDAw/https://lh6.googleusercontent.com/dB4j-KSRo8wqNvOfXJEp3WRkEkOTNajr3hMogftTZx-eLRwDT3eSr2r1pks=w1200-h630-p.cf.jpg"/></v:rect><![endif]--> <table class="yahoo-ignore-table" cellpadding="0" cellspacing="0" border="0" valign="top" style="width:100%;" id="yui_3_16_0_ym19_1_1548197889215_2609"> <tbody id="yui_3_16_0_ym19_1_1548197889215_2608"><tr id="yui_3_16_0_ym19_1_1548197889215_2607"> <td style="background:transparent url('https://s.yimg.com/nq/storm/assets/enhancrV2/12/overlay-tile.png') repeat left top;height:200px;" background="https://s.yimg.com/nq/storm/assets/enhancrV2/12/overlay-tile.png" bgcolor="transparent" valign="top" id="yui_3_16_0_ym19_1_1548197889215_2606"> <!--[if gte mso 9]><v:rect fill="true" stroke="false" style="width:400px;height:218px;position:absolute;top:-18px;left:0;"><v:fill type="pattern" color="#000000" src="https://s.yimg.com/nq/storm/assets/enhancrV2/12/overlay-tile.png"/><v:textbox inset="0,0,20px,0"><![endif]--> <table class="yahoo-ignore-table" height="185" style="width:100%;height:185px;min-height:185px;" id="yui_3_16_0_ym19_1_1548197889215_2605"> <tbody id="yui_3_16_0_ym19_1_1548197889215_2604"><tr id="yui_3_16_0_ym19_1_1548197889215_2603"> <td class="card-richInfo2" style="text-align:left;text-align:left;padding:15px 0 0 15px;vertical-align:top;" id="yui_3_16_0_ym19_1_1548197889215_2602"> </td> <td class="card-actions" style="text-align:right;padding:15px 15px 0 0;vertical-align:top;"> <div class="card-share-container"></div> </td> </tr> </tbody></table> <!--[if gte mso 9]></v:textbox></v:rect><![endif]--> </td> </tr> </tbody></table> </td> </tr> <tr> <td> <table class="card-info yahoo-ignore-table" align="center" cellpadding="0" cellspacing="0" border="0" style="background:#fff;position:relative;z-index:2;width:95%;max-width:380px;border:1px solid #e0e4e9;border-bottom:3px solid #3d79f7;margin-top:-40px;margin-left:auto;margin-right:auto;"> <tbody><tr> <td style="background-color:#ffffff;padding:16px 0 16px 12px;vertical-align:top;"> <img class="card-object-1 yahoo-ignore-inline-image ymail-preserve-class" src="https://s.yimg.com/nq/storm/assets/enhancrV2/23/logos/google.png" height="32" style="min-width:32px;border:1px solid #e0e4e9;margin-top:3px;" data-id="638d0b4d-0f97-be83-5387-438a5ff49f77"> </td> <td style="vertical-align:middle;padding:16px 12px;width:99%;"> <h2 class="card-title" style="font-size: 16px; line-height:19px; margin:0 0 4px 0;font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;word-break:break-word;">ovirt</h2> <div class="card-description" style="font-size:11px;line-height:15px;color:#999;word-break:break-word;"></div> </td> <td style="text-align:right;padding:16px 12px 16px 0;"> </td> </tr> </tbody></table> </td> </tr> </tbody></table> </td> </tr> </tbody></table> </a></div><div id="yui_3_16_0_ym19_1_1548197889215_2636"><br></div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_2697"><br></div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_2637">I'm having bad write & read performance from the VM, despite having a SSD (not an enterprise-grade one , but still a SSD) for LVM writeback cache. Writing directly to the bricks is far faster than my network can do (1 Gbit/s network). I have checked the bandwidth and it seems that maximum possible for me is 123MB/s, yet observed speeds via glusterfs fuse client (testing from one of the hosts) is no more than 56MB/s and from VMs is around 20-30 MB/s.</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_2638"><br></div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_2639">Here is my volume profile info (I'm not sure what to look for):</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_2639"><br></div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3007">[root@ovirt2 tuned]# gluster volume profile data info</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3008">Brick: ovirt2.localdomain:/gluster_bricks/data/data</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3009">---------------------------------------------------</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3010">Cumulative Stats:</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3011"> Block Size: 256b+ 512b+ 1024b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3012"> No. of Reads: 5854 198 159 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3013">No. of Writes: 2 6025 1430 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3014"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3015"> Block Size: 2048b+ 4096b+ 8192b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3016"> No. of Reads: 302 9950 6485 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3017">No. of Writes: 611 23513 6540 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3018"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3019"> Block Size: 16384b+ 32768b+ 65536b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3020"> No. of Reads: 6952 1774 1699 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3021">No. of Writes: 6439 5870 5171 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3022"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3023"> Block Size: 131072b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3024"> No. of Reads: 48690 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3025">No. of Writes: 127023 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3026"> %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3027"> --------- ----------- ----------- ----------- ------------ ----</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3028"> 0.00 0.00 us 0.00 us 0.00 us 14 FORGET</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3029"> 0.00 0.00 us 0.00 us 0.00 us 534 RELEASE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3030"> 0.00 0.00 us 0.00 us 0.00 us 2180 RELEASEDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3031"> 0.00 44.00 us 44.00 us 44.00 us 1 GETXATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3032"> 0.00 28.75 us 23.00 us 33.00 us 4 INODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3033"> 0.00 85.00 us 85.00 us 85.00 us 2 SETATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3034"> 0.00 52.50 us 31.00 us 113.00 us 8 OPENDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3035"> 0.00 33.83 us 23.00 us 60.00 us 29 ENTRYLK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3036"> 0.00 40.32 us 24.00 us 157.00 us 53 STAT</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3037"> 0.00 59.32 us 43.00 us 121.00 us 38 FSTAT</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3038"> 0.00 188.08 us 28.00 us 458.00 us 13 READDIRP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3039"> 0.00 323.46 us 286.00 us 398.00 us 13 MKNOD</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3040"> 0.00 42.84 us 26.00 us 142.00 us 109 STATFS</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3041"> 0.01 147.36 us 71.00 us 365.00 us 200 LOOKUP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3042"> 0.17 914.71 us 186.00 us 3887.00 us 533 READ</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3043"> 3.57 322.84 us 41.00 us 1552044.00 us 32308 FXATTROP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3044"> 21.39 1090.04 us 15.00 us 1228946.00 us 57261 FINODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3045"> 27.42 2527.96 us 98.00 us 1552471.00 us 31651 WRITE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3046"> 47.43 12047.80 us 203.00 us 1891369.00 us 11489 FSYNC</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3047"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3048"> Duration: 59012 seconds</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3049"> Data Read: 6853540304 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3050">Data Written: 17667709568 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3051"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3052">Interval 0 Stats:</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3053"> Block Size: 256b+ 512b+ 1024b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3054"> No. of Reads: 5854 198 159 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3055">No. of Writes: 2 6025 1430 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3056"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3057"> Block Size: 2048b+ 4096b+ 8192b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3058"> No. of Reads: 302 9950 6485 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3059">No. of Writes: 611 23513 6540 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3060"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3061"> Block Size: 16384b+ 32768b+ 65536b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3062"> No. of Reads: 6952 1774 1699 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3063">No. of Writes: 6439 5870 5171 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3064"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3065"> Block Size: 131072b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3066"> No. of Reads: 48690 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3067">No. of Writes: 127023 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3068">%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3069"> --------- ----------- ----------- ----------- ------------ ----</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3070"> 0.00 0.00 us 0.00 us 0.00 us 14 FORGET</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3071"> 0.00 0.00 us 0.00 us 0.00 us 534 RELEASE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3072"> 0.00 0.00 us 0.00 us 0.00 us 2180 RELEASEDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3073"> 0.00 44.00 us 44.00 us 44.00 us 1 GETXATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3074"> 0.00 28.75 us 23.00 us 33.00 us 4 INODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3075"> 0.00 85.00 us 85.00 us 85.00 us 2 SETATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3076"> 0.00 52.50 us 31.00 us 113.00 us 8 OPENDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3077"> 0.00 33.83 us 23.00 us 60.00 us 29 ENTRYLK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3078"> 0.00 40.32 us 24.00 us 157.00 us 53 STAT</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3079"> 0.00 59.32 us 43.00 us 121.00 us 38 FSTAT</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3080"> 0.00 188.08 us 28.00 us 458.00 us 13 READDIRP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3081"> 0.00 323.46 us 286.00 us 398.00 us 13 MKNOD</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3082"> 0.00 42.84 us 26.00 us 142.00 us 109 STATFS</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3083"> 0.01 147.36 us 71.00 us 365.00 us 200 LOOKUP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3084"> 0.17 914.71 us 186.00 us 3887.00 us 533 READ</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3085"> 3.57 322.84 us 41.00 us 1552044.00 us 32308 FXATTROP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3086"> 21.39 1090.04 us 15.00 us 1228946.00 us 57261 FINODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3087"> 27.42 2527.96 us 98.00 us 1552471.00 us 31651 WRITE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3088"> 47.43 12047.80 us 203.00 us 1891369.00 us 11489 FSYNC</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3089"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3090"> Duration: 59012 seconds</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3091"> Data Read: 6853540304 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3092">Data Written: 17667709568 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3093"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3094">Brick: ovirt3.localdomain:/gluster_bricks/data/data</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3095">---------------------------------------------------</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3096">Cumulative Stats:</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3097"> Block Size: 1b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3098"> No. of Reads: 0 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3099">No. of Writes: 257997 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3100"> %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3101"> --------- ----------- ----------- ----------- ------------ ----</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3102"> 0.00 0.00 us 0.00 us 0.00 us 53 FORGET</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3103"> 0.00 0.00 us 0.00 us 0.00 us 3180 RELEASE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3104"> 0.00 0.00 us 0.00 us 0.00 us 2672 RELEASEDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3105"> 0.00 14.33 us 13.00 us 16.00 us 3 FLUSH</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3106"> 0.00 43.00 us 43.00 us 43.00 us 1 TRUNCATE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3107"> 0.00 229.00 us 229.00 us 229.00 us 1 CREATE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3108"> 0.00 80.00 us 48.00 us 114.00 us 3 XATTROP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3109"> 0.00 66.83 us 57.00 us 79.00 us 6 SETATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3110"> 0.00 29.76 us 1.00 us 72.00 us 34 OPENDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3111"> 0.00 96.12 us 12.00 us 240.00 us 17 GETXATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3112"> 0.01 375.00 us 216.00 us 790.00 us 6 READDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3113"> 0.01 30.90 us 11.00 us 186.00 us 73 INODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3114"> 0.01 178.89 us 36.00 us 541.00 us 19 OPEN</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3115"> 0.02 113.86 us 57.00 us 313.00 us 78 UNLINK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3116"> 0.05 212.36 us 146.00 us 488.00 us 90 MKNOD</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3117"> 0.14 35.88 us 10.00 us 399.00 us 1636 ENTRYLK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3118"> 0.42 80.78 us 21.00 us 495.00 us 2122 LOOKUP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3119"> 7.92 44.74 us 12.00 us 10903.00 us 71878 WRITE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3120"> 11.52 62.55 us 25.00 us 27390.00 us 74768 FXATTROP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3121"> 12.00 27.54 us 9.00 us 7191.00 us 176968 FINODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3122"> 67.90 2384.96 us 53.00 us 82033.00 us 11562 FSYNC</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3123"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3124"> Duration: 75025 seconds</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3125"> Data Read: 0 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3126">Data Written: 257997 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3127"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3128">Interval 2 Stats:</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3129"> Block Size: 1b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3130"> No. of Reads: 0 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3131">No. of Writes: 201556 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3132"> %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3133"> --------- ----------- ----------- ----------- ------------ ----</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3134"> 0.00 0.00 us 0.00 us 0.00 us 19 FORGET</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3135"> 0.00 0.00 us 0.00 us 0.00 us 2046 RELEASE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3136"> 0.00 0.00 us 0.00 us 0.00 us 2606 RELEASEDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3137"> 0.00 38.50 us 35.00 us 42.00 us 2 GETXATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3138"> 0.00 33.17 us 15.00 us 62.00 us 6 INODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3139"> 0.00 71.00 us 63.00 us 79.00 us 3 SETATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3140"> 0.00 41.75 us 24.00 us 72.00 us 12 OPENDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3141"> 0.00 26.28 us 12.00 us 48.00 us 29 ENTRYLK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3142"> 0.01 191.15 us 154.00 us 240.00 us 13 MKNOD</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3143"> 0.10 112.97 us 40.00 us 170.00 us 299 LOOKUP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3144"> 4.22 45.65 us 14.00 us 1288.00 us 31732 WRITE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3145"> 5.99 35.51 us 9.00 us 7124.00 us 57863 FINODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3146"> 9.57 101.29 us 33.00 us 27390.00 us 32435 FXATTROP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3147"> 80.11 2390.06 us 61.00 us 82033.00 us 11507 FSYNC</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3148"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3149"> Duration: 74302 seconds</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3150"> Data Read: 0 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3151">Data Written: 201556 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3152"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3153">Brick: ovirt1.localdomain:/gluster_bricks/data/data</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3154">---------------------------------------------------</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3155">Cumulative Stats:</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3156"> Block Size: 256b+ 512b+ 1024b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3157"> No. of Reads: 13408 183 2200 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3158">No. of Writes: 11 12677 1556 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3159"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3160"> Block Size: 2048b+ 4096b+ 8192b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3161"> No. of Reads: 60 3393 1278 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3162">No. of Writes: 666 59118 22688 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3163"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3164"> Block Size: 16384b+ 32768b+ 65536b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3165"> No. of Reads: 10658 574 954 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3166">No. of Writes: 32082 29900 61801 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3167"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3168"> Block Size: 131072b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3169"> No. of Reads: 55974 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3170">No. of Writes: 576153 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3171"> %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3172"> --------- ----------- ----------- ----------- ------------ ----</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3173"> 0.00 0.00 us 0.00 us 0.00 us 58 FORGET</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3174"> 0.00 0.00 us 0.00 us 0.00 us 3357 RELEASE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3175"> 0.00 0.00 us 0.00 us 0.00 us 4823 RELEASEDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3176"> 0.00 26.00 us 24.00 us 28.00 us 3 FLUSH</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3177"> 0.00 64.00 us 52.00 us 81.00 us 3 FSTAT</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3178"> 0.00 202.00 us 202.00 us 202.00 us 1 TRUNCATE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3179"> 0.00 271.00 us 271.00 us 271.00 us 1 CREATE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3180"> 0.00 135.33 us 72.00 us 180.00 us 3 XATTROP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3181"> 0.00 103.50 us 84.00 us 155.00 us 6 SETATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3182"> 0.00 69.77 us 17.00 us 174.00 us 13 GETXATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3183"> 0.00 438.67 us 399.00 us 479.00 us 3 READDIRP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3184"> 0.00 45.12 us 3.00 us 94.00 us 34 OPENDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3185"> 0.00 91.63 us 53.00 us 184.00 us 19 OPEN</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3186"> 0.00 331.57 us 262.00 us 381.00 us 7 READDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3187"> 0.00 46.28 us 24.00 us 176.00 us 337 STATFS</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3188"> 0.00 223.68 us 101.00 us 630.00 us 78 UNLINK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3189"> 0.00 318.33 us 176.00 us 456.00 us 90 MKNOD</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3190"> 0.00 237.58 us 18.00 us 148201.00 us 2122 LOOKUP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3191"> 0.01 1323.15 us 104.00 us 73159.00 us 704 READ</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3192"> 0.02 1890.07 us 15.00 us 89692.00 us 1634 ENTRYLK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3193"> 0.07 137914.67 us 22.00 us 1523239.00 us 73 INODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3194"> 0.22 395.07 us 30.00 us 676921.00 us 74768 FXATTROP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3195"> 1.16 13685.56 us 1739.00 us 650863.00 us 11562 FSYNC</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3196"> 3.08 5851.12 us 94.00 us 1033754.00 us 71879 WRITE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3197"> 95.43 76480.58 us 16.00 us 5368628.00 us 170274 FINODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3198"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3199"> Duration: 134846 seconds</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3200"> Data Read: 7665929388 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3201">Data Written: 84724663200 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3202"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3203">Interval 2 Stats:</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3204"> Block Size: 256b+ 512b+ 1024b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3205"> No. of Reads: 7432 130 1738 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3206">No. of Writes: 6 6816 1430 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3207"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3208"> Block Size: 2048b+ 4096b+ 8192b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3209"> No. of Reads: 48 3099 1040 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3210">No. of Writes: 611 24732 6649 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3211"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3212"> Block Size: 16384b+ 32768b+ 65536b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3213"> No. of Reads: 9382 442 832 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3214">No. of Writes: 6602 6234 5531 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3215"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3216"> Block Size: 131072b+ </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3217"> No. of Reads: 20719 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3218">No. of Writes: 142946 </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3219"> %-latency Avg-latency Min-Latency Max-Latency No. of calls Fop</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3220"> --------- ----------- ----------- ----------- ------------ ----</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3221"> 0.00 0.00 us 0.00 us 0.00 us 19 FORGET</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3222"> 0.00 0.00 us 0.00 us 0.00 us 2046 RELEASE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3223"> 0.00 0.00 us 0.00 us 0.00 us 2606 RELEASEDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3224"> 0.00 63.00 us 47.00 us 79.00 us 2 GETXATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3225"> 0.00 64.00 us 52.00 us 81.00 us 3 FSTAT</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3226"> 0.00 33.83 us 27.00 us 41.00 us 6 INODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3227"> 0.00 116.33 us 92.00 us 155.00 us 3 SETATTR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3228"> 0.00 479.00 us 479.00 us 479.00 us 1 READDIRP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3229"> 0.00 48.75 us 32.00 us 83.00 us 12 OPENDIR</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3230"> 0.00 283.31 us 176.00 us 383.00 us 13 MKNOD</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3231"> 0.00 46.40 us 26.00 us 142.00 us 164 STATFS</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3232"> 0.00 1303.45 us 20.00 us 36916.00 us 29 ENTRYLK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3233"> 0.00 1054.11 us 63.00 us 148201.00 us 299 LOOKUP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3234"> 0.01 1302.85 us 104.00 us 73159.00 us 618 READ</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3235"> 0.20 812.06 us 40.00 us 676921.00 us 32435 FXATTROP</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3236"> 1.19 13697.54 us 1739.00 us 650863.00 us 11507 FSYNC</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3237"> 1.94 8117.26 us 98.00 us 1033754.00 us 31733 WRITE</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3238"> 96.67 229052.02 us 17.00 us 5368628.00 us 56103 FINODELK</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3239"> </div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3240"> Duration: 74302 seconds</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3241"> Data Read: 2999932124 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3242">Data Written: 19810606944 bytes</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3242"><br></div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3242">Any help will be appreciated.</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3242"><br></div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3242">Best Regards,</div><div dir="ltr" id="yui_3_16_0_ym19_1_1548197889215_3242">Strahil Nikolov</div></div></body></html>