[Gluster-users] Poor performance with small files

Raghavendra Bhat rabhat at redhat.com
Thu Apr 30 09:00:41 UTC 2015


On Thursday 30 April 2015 01:55 PM, Alex Crow wrote:
>
>> Upgrade to 3.6.3 and set client.event-threads and 
>> server.event-threads to at least 4:
>>
>> "Previously, epoll thread did socket even-handling and the same 
>> thread was used for serving the client or processing the response 
>> received from the server. Due to this, other requests were in a queue 
>> untill the current epoll thread completed its operation. With 
>> multi-threaded epoll, events are distributed that improves the 
>> performance due the parallel processing of requests/responses received."
>>
>> Here are the guidelines for tuning them:
>>
>> https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Administration_Guide/Small_File_Performance_Enhancements.html 
>>
>>
>> In my testing with epoll threads at 4 I saw a between a 15% and 50% 
>> increase depending on the workload.
>>
>> There are several smallfile perf enhancements in the works:
>>
>> *http://www.gluster.org/community/documentation/index.php/Features/Feature_Smallfile_Perf 
>>
>>
>> *Lookup unhashed is the next feature and should be ready with 
>> 3.7(correct me if I am wrong).
>>
>> *If you are using RAID 6 you may want to do some testing with RAID 10 
>> or JBOD, but the benefits here only come into play with alot of 
>> concurrent access(30+ processes / threads working with different files).
>>
>> *Tiering may help here if you want to add some SSDs, this is also a 
>> 3.7 feature.
>>
>> HTH!
>>
>> -b
> Hi,
>
> I'm on 3.6.3 and these options are not available:
>
> volume set: failed: option : client.event-threads does not exist
> volume set: failed: option : server.event-threads does not exist
>
> Any ideas?
>
> Alex
>

Alex,

That option is there in the upcoming 3.7 release. Its not available in 
3.6.3.
Regarding rebalance performancem, CCing Raghavendra G, maintainer of DHT 
(Distribute xlator).

Regards,
Raghavendra Bhat


More information about the Gluster-users mailing list