[Bugs] [Bug 1314724] New: Multi-threaded SHD support

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1314724

            Bug ID: 1314724
           Summary: Multi-threaded SHD support
           Product: Red Hat Gluster Storage
           Version: 3.1
         Component: gluster-afr
          Keywords: FutureFeature
          Severity: medium
          Priority: high
          Assignee: pkarampu at redhat.com
          Reporter: sabose at redhat.com
        QA Contact: storage-qa-internal at redhat.com
                CC: atalur at redhat.com, bugs at gluster.org,
                    ndevos at redhat.com, pkarampu at redhat.com,
                    ravishankar at redhat.com, rkavunga at redhat.com,
                    rwareing at fb.com
        Depends On: 1221737
            Blocks: 1258386 (Gluster-HC-1), 1299184



+++ This bug was initially created as a clone of Bug #1221737 +++

Multi-threading support is critical for two important use-cases:

Halo replication (separate patch) - Long distance replication are high
latency and parallel healing is required for performance. Use higher
(16-32 threads for such use-cases).

Traditional clusters where bricks are being healed from scratch w/ large
numbers of small files (4-8 threads should be sufficient for these
use-cases).

The net result is anywhere from 2-30x SHD performance depending on how
many threads you use and what kind of storage hardware you have backing
your bricks. For bricks with large numbers of small files, the effect is
especially dramatic.

NOTES: It's critical to ensure your bricks have a sufficient number of
threads available via the performance.io-thread-count volume options.
Based on my tests sizing this to 2x the number of SHD threads is a good
place to start. Failure to do so can DOS your bricks with SHD requests.

--- Additional comment from  on 2015-05-14 13:21:58 EDT ---



--- Additional comment from Mohammed Rafi KC on 2015-05-19 09:14:38 EDT ---

Thank you Richard!

--- Additional comment from Anand Avati on 2015-05-20 11:02:55 EDT ---

REVIEW: http://review.gluster.org/10851 (Multi-threaded SHD support) posted
(#1) for review on master by Kaushal M (kaushal at redhat.com)

--- Additional comment from Anand Avati on 2015-08-28 03:07:46 EDT ---

REVIEW: http://review.gluster.org/10851 (Multi-threaded SHD support) posted
(#2) for review on master by Kaushal M (kaushal at redhat.com)


Referenced Bugs:

https://bugzilla.redhat.com/show_bug.cgi?id=1221737
[Bug 1221737] Multi-threaded SHD support
https://bugzilla.redhat.com/show_bug.cgi?id=1258386
[Bug 1258386] [TRACKER] Gluster Hyperconvergence - Phase 1
-- 
You are receiving this mail because:
You are on the CC list for the bug.
Unsubscribe from this bug https://bugzilla.redhat.com/token.cgi?t=WjaQ6krJcz&a=cc_unsubscribe