[Gluster-devel] [Qusetions] How profile affect glusterfs performance?

[Pranith Kumar Karampuri]

On Wed, Jun 7, 2017 at 1:14 PM, liuyuan at cmss.chinamobile.com <
liuyuan at cmss.chinamobile.com> wrote:

> Hi Pranith,
>
> First of all, we owe you guys big thanks for your excellent work.
>
> I'm the lead of storage team in China Mobile, Xiubo is also in my team :)
>

Ah! nice :-).


>
> We have deployed more than 100 glusterfs nodes in producion(20 nodes for
> the biggest single cluster), so far so good.  Use case ranging from
> image/vedio, to small files for mailbox services.
> For profile stuff, we'd like to enable it as always to collect perf stat
> for monitoring.
>

Yes, this is something FB guys do already and contributed the patches back
to community. So you should be able to do this too.


>
> We are planing to provide cloud file service by the combination of
> glusterfs and Openstack Manila this year. The enhancement of manila patches
> would be sent to upsteam later.
>

This is good news.


>
> Also, I have a question for NDMP support. I bumpped one thread discussing
> it but not clear yet. (http://lists.gluster.org/
> pipermail/gluster-devel/2016-August/050513.html)
>
> Do you have any plan to for a glusterfs-ndmp server from scratch? We are
> new to the development of glusterfs, I think ndmp support would be a good
> starting point for us to join the
> development  of the community.  We'd like to see NDMP supported by
> glusterfs because some of our customers want it.
>

I don't know enough about this. Vijay has idea about this, so will respond
later.


>
> Yuan
> ------------------------------
>
>
> *From:* Pranith Kumar Karampuri <pkarampu at redhat.com>
> *Date:* 2017-06-07 15:38
> *To:* Xie Changlong <xiechanglong.d at gmail.com>
> *CC:* Gluster Devel <gluster-devel at gluster.org>; Hu Jianfei
> <hujianfei at cmss.chinamobile.com>; Liu Yuan <liuyuan at cmss.chinamobile.com>
> *Subject:* Re: [Gluster-devel] [Qusetions] How profile affect glusterfs
> performance?
>
>
> On Tue, Jun 6, 2017 at 8:14 AM, Xie Changlong <xiechanglong.d at gmail.com>
> wrote:
>
>> 在 6/5/2017 6:30 PM, Pranith Kumar Karampuri 写道:
>>
>>> I meant what are you using gluster for? VM workload or image/video file
>>> creation or lots of small files etc etc.
>>>
>>
>> 1) We use glusterfs for general purpose, no limit to image/video file
>> creation or small files etc.
>>
> Okay, this is good. What is the cluster size?
> Is it replica 3 or replica 2 or arbiter or is it EC volume?
>
> Please don't mind me asking so many details. I am delighted to see you
> guys active in the community because I have seen Xiubo Li's work on
> tcmu-runner who is also from chinamobile and his work is pretty good :-).
>
>
>> 2) We just want a low performance affect way to calculate each brick's
>> iops/bandwidth for the upper layer management app. BTW, is there any other
>> way to get iops/bandwith for each brick besides profile?
>>
>
> At the moment we have these stats using profile commands. As per Facebook
> patches they enable json capture of io-stats on their volumes and measure
> these. They have it enabled always. If that is not enough for you, then we
> should probably look at enhancing things. Do send patches if you think
> something would make things better :-).
>
>
>>
>> --
>> Thanks
>>     -Xie
>>
>
>
>
> --
> Pranith
>
>


-- 
Pranith
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-devel/attachments/20170607/554e4d33/attachment.html>