[Gluster-users] Small files

[Vijay Bellur]

On 01/29/2015 09:54 PM, John_Salinas at Dell.com wrote:
> I suppose some of it may depend on what you consider a small file and
> how many of them there are and the operation read/write/sequential/etc
> as well as the performance expectations are.
>

Agree, performance is subjective and expectation,behavior varies across 
deployments.  It would be good to understand from various deployments 
the operations that seem to be slower for small files. In my experience 
and tests, performance problems seem to be associated more with 
create/write & readdir operations. Are there other operations that have 
been slow for you?

> I had looked at zfs replication also but redhat support was a problem.
>
> Does anyone know if a beta is available for:
> http://www.gluster.org/community/documentation/index.php/Features/Feature_Smallfile_Perf
>

Some enhancements listed are going to land in 3.7. Once 3.7 feature 
freeze happens in February, you should be able to try out the 
improvements. What enhancements from the list would you consider 
important for your use case?

>
> Are there any benchmarks published comparing nfs client mount vs.
> gluster fuse vs. boost (for apache)?   I know this is very current but
> https://s3.amazonaws.com/aws001/guided_trek/Performance_in_a_Gluster_Systemv6F.pdf
> pages 19-20
> <https://s3.amazonaws.com/aws001/guided_trek/Performance_in_a_Gluster_Systemv6F.pdf%20pages%2019-20>
> has some data for small files – from that doc “As can be seen in Figure
> 8 below, Gluster delivers good single storage node performance for a
> variety of small file operations. Generally speaking, Gluster Native
> FUSE will deliver better small file performance than Gluster NFS,
> although Gluster NFS is often better for very small block sizes. Perhaps
> most important, IOPS performance in Gluster scales out just as
> throughput performance scales out.”  This is from 2013 and has a few
> suggestions to try:
> https://rhsummit.files.wordpress.com/2013/07/england_th_0450_rhs_perf_practices-4_neependra.pdf.

There is a similar presentation from the 2014 Red Hat Summit at [1].

Regards,
Vijay

[1] 
https://rhsummit.files.wordpress.com/2014/04/bengland_h_1100_rhs_performance.pdf