[Bugs] [Bug 1221737] New: Multi-threaded SHD support

bugzilla at redhat.com bugzilla at redhat.com
Thu May 14 17:06:46 UTC 2015


https://bugzilla.redhat.com/show_bug.cgi?id=1221737

            Bug ID: 1221737
           Summary: Multi-threaded SHD support
           Product: GlusterFS
           Version: 3.6.3
         Component: nfs
          Severity: low
          Assignee: bugs at gluster.org
          Reporter: rwareing at fb.com
                CC: bugs at gluster.org, gluster-bugs at redhat.com



Multi-threading support is critical for two important use-cases:

Halo replication (separate patch) - Long distance replication are high
latency and parallel healing is required for performance. Use higher
(16-32 threads for such use-cases).

Traditional clusters where bricks are being healed from scratch w/ large
numbers of small files (4-8 threads should be sufficient for these
use-cases).

The net result is anywhere from 2-30x SHD performance depending on how
many threads you use and what kind of storage hardware you have backing
your bricks. For bricks with large numbers of small files, the effect is
especially dramatic.

NOTES: It's critical to ensure your bricks have a sufficient number of
threads available via the performance.io-thread-count volume options.
Based on my tests sizing this to 2x the number of SHD threads is a good
place to start. Failure to do so can DOS your bricks with SHD requests.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.


More information about the Bugs mailing list