<div dir="ltr"><div>Hi Pratik,</div><div><br></div><div>What's the version of gluster you're running?</div><div><br></div><div>Also, what would help is the volume profile output. Here's what you should do to capture it:</div><div># gluster volume profile <volname> start</div><div># run_your_workload</div><div># gluster volume profile <volname> info > brick-profile.out</div><div><br></div><div>And attach brick-profile.out here.</div><div><br></div><div>-Krutika<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Oct 7, 2019 at 11:09 AM Satheesaran Sundaramoorthi <<a href="mailto:sasundar@redhat.com">sasundar@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Oct 7, 2019 at 1:24 AM Soumya Koduri <<a href="mailto:skoduri@redhat.com" target="_blank">skoduri@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi Pratik,<br>
<br>
Offhand I do not see any issue with the configuration. But I think for <br>
VM images store, using gfapi may give better performance than compared <br>
to fuse. CC'in Kritika and Gobinda who have been working on this <br>
use-case and may be able to guide you.<br>
<br>
Thanks,<br>
Soumya<br>
<br>
On 10/5/19 11:25 AM, Pratik Chandrakar wrote:<br>
> Hello Soumya,<br>
> <br>
> This is Pratik from India. I am writing this mail because I am facing performance issue in my cluster and searched a lot in net for the tuning but not succeeded. It would be great if you can suggest me whether I should stick with glusterfs or move to any other technology. Currently I am using Glusterfs with fuse on CentOS for Storing images of Virtual Machine in CloudStack Setup. Majority of workload is of SQL Server & MariaDB database server, and some Web Servers. The issue is of slow booting and slow UI response of VMs and also lot of time outs in SQL server database even on small databases. I have dedicated 10G network for storage in my setup.<br>
> <br>
> Request you to please guide me, whether I am have miss-configured the cluster or need to change the storage layer.<br>
> <br>
> Below is the configuration for your reference...<br>
> <br>
> *Volume Name: vmstore5152-v2*<br>
> *Type: Replicate*<br>
> *Volume ID: aa27a2cb-c0f5-41b9-a50f-fdce4d4d8358*<br>
> *Status: Started*<br>
> *Snapshot Count: 0*<br>
> *Number of Bricks: 1 x (2 + 1) = 3*<br>
> *Transport-type: tcp*<br>
> *Bricks:*<br>
> *Brick1: storagenode51:/datav2/brick51-v2/brick*<br>
> *Brick2: storagenode52:/datav2/brick52-v2/brick*<br>
> *Brick3: indphyserver2:/arbitator/arbrick5152-v2/brick (arbiter)*<br>
> *Options Reconfigured:*<br>
> *cluster.choose-local: off*<br>
> *user.cifs: off*<br>
> *features.shard: on*<br>
> *cluster.shd-wait-qlength: 10000*<br>
> *cluster.shd-max-threads: 8*<br>
> *cluster.locking-scheme: granular*<br>
> *cluster.data-self-heal-algorithm: full*<br>
> *cluster.server-quorum-type: server*<br>
> *cluster.quorum-type: auto*<br>
> *cluster.eager-lock: enable*<br>
> *network.remote-dio: enable*<br></blockquote><div><br></div><div style="font-family:monospace,monospace" class="gmail_default">Hi Krutika,</div><div style="font-family:monospace,monospace" class="gmail_default"><br></div><div style="font-family:monospace,monospace" class="gmail_default">Do you think turning off remote-dio and enabling strict-o-direct, will</div><div style="font-family:monospace,monospace" class="gmail_default">improve performance ?</div><div style="font-family:monospace,monospace" class="gmail_default"><br></div><div style="font-family:monospace,monospace" class="gmail_default">@Sahina, @Gobinda, are you aware of performance optimization for the <br></div><div style="font-family:monospace,monospace" class="gmail_default">DB workload in the VMs ?</div><div style="font-family:monospace,monospace" class="gmail_default"><br></div><div style="font-family:monospace,monospace" class="gmail_default">-- Satheesaran <br></div><div style="font-family:monospace,monospace" class="gmail_default"></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
> *performance.low-prio-threads: 32*<br>
> *performance.io-cache: off*<br>
> *performance.read-ahead: off*<br>
> *performance.quick-read: off*<br>
> *storage.owner-gid: 107*<br>
> *storage.owner-uid: 107*<br>
> *cluster.lookup-optimize: on*<br>
> *client.event-threads: 4 *<br>
> *transport.address-family: inet*<br>
> *nfs.disable: on*<br>
> *performance.client-io-threads: on*<br>
> <br>
> <br>
> -- <br>
> प्रतीक चंद्राकर | Pratik Chandrakar<br>
> वैज्ञानिक - सी | Scientist-C<br>
> एन.आई.सी - छत्तीसगढ़ राज्य केंद्र | NIC - Chhattisgarh State Centre<br>
> हॉल क्र. एडी2-14 , मंत्रालय | Hall no.-AD2-14, Mantralaya<br>
> महानदी भवन | Mahanadi Bhavan<br>
> नवा रायपुर अटल नगर | Nava Raipur Atal Nagar<br>
> <br>
> <br>
> <<a href="http://gandhi.gov.in" rel="noreferrer" target="_blank">http://gandhi.gov.in</a>><br>
> <br>
> *Disclaimer:*<br>
> <br>
> This e-mail and its attachments may contain official Indian Government <br>
> information. If you are not the intended recipient, please notify the <br>
> sender immediately and delete this e-mail. Any dissemination or use of <br>
> this information by a person other than the intended recipient is <br>
> unauthorized. The responsibility lies with the recipient to check this <br>
> email and any attachment for the presence of viruses.<br>
> <br>
________<br>
<br>
Community Meeting Calendar:<br>
<br>
APAC Schedule -<br>
Every 2nd and 4th Tuesday at 11:30 AM IST<br>
Bridge: <a href="https://bluejeans.com/118564314" rel="noreferrer" target="_blank">https://bluejeans.com/118564314</a><br>
<br>
NA/EMEA Schedule -<br>
Every 1st and 3rd Tuesday at 01:00 PM EDT<br>
Bridge: <a href="https://bluejeans.com/118564314" rel="noreferrer" target="_blank">https://bluejeans.com/118564314</a><br>
<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote></div></div>
</blockquote></div>