[Gluster-devel] [Qusetions] How profile affect glusterfs performance?

[liuyuan at cmss.chinamobile.com]

Hi Pranith,

First of all, we owe you guys big thanks for your excellent work.

I'm the lead of storage team in China Mobile, Xiubo is also in my team :)

We have deployed more than 100 glusterfs nodes in producion(20 nodes for the biggest single cluster), so far so good.  Use case ranging from image/vedio, to small files for mailbox services.
For profile stuff, we'd like to enable it as always to collect perf stat for monitoring.

We are planing to provide cloud file service by the combination of glusterfs and Openstack Manila this year. The enhancement of manila patches would be sent to upsteam later.

Also, I have a question for NDMP support. I bumpped one thread discussing it but not clear yet. (http://lists.gluster.org/pipermail/gluster-devel/2016-August/050513.html)

Do you have any plan to for a glusterfs-ndmp server from scratch? We are new to the development of glusterfs, I think ndmp support would be a good starting point for us to join the
development  of the community.  We'd like to see NDMP supported by glusterfs because some of our customers want it.

Yuan


 
From: Pranith Kumar Karampuri
Date: 2017-06-07 15:38
To: Xie Changlong
CC: Gluster Devel; Hu Jianfei; Liu Yuan
Subject: Re: [Gluster-devel] [Qusetions] How profile affect glusterfs performance?


On Tue, Jun 6, 2017 at 8:14 AM, Xie Changlong <xiechanglong.d at gmail.com> wrote:
在 6/5/2017 6:30 PM, Pranith Kumar Karampuri 写道:
I meant what are you using gluster for? VM workload or image/video file
creation or lots of small files etc etc.

1) We use glusterfs for general purpose, no limit to image/video file
creation or small files etc.
Okay, this is good. What is the cluster size?
Is it replica 3 or replica 2 or arbiter or is it EC volume?

Please don't mind me asking so many details. I am delighted to see you guys active in the community because I have seen Xiubo Li's work on tcmu-runner who is also from chinamobile and his work is pretty good :-).


2) We just want a low performance affect way to calculate each brick's iops/bandwidth for the upper layer management app. BTW, is there any other way to get iops/bandwith for each brick besides profile?

At the moment we have these stats using profile commands. As per Facebook patches they enable json capture of io-stats on their volumes and measure these. They have it enabled always. If that is not enough for you, then we should probably look at enhancing things. Do send patches if you think something would make things better :-).
 

-- 
Thanks
    -Xie



-- 
Pranith
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-devel/attachments/20170607/8a59b57f/attachment.html>