[Bugs] [Bug 1476654] New: gluster-block default shard-size should be 64MB

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1476654

            Bug ID: 1476654
           Summary: gluster-block default shard-size should be 64MB
           Product: GlusterFS
           Version: 3.12
         Component: core
          Assignee: bugs at gluster.org
          Reporter: pkarampu at redhat.com
                CC: bugs at gluster.org
        Depends On: 1475605



+++ This bug was initially created as a clone of Bug #1475605 +++

Description of problem:
    With 4MB shard size I/O slows down more because of the extra
    inodelk/xattrops in replicate. So increasing it to 64MB which
    gave better performance than 4MB.

    To simulate writes on a preallocated VM-image, fallocate the file and then
do
    dd with notrunc
    do "fallocate -l 1GB" then "dd if=/dev/zero of=file-1GB bs=1MB count=1024
conv=notrunc"

    These are the results on my laptop for dd:
    With 4MB:
          1.84    1357.37 us      19.00 us   12431.00 us           1188   
FINODELK
          2.45     255.08 us      58.00 us    4038.00 us           8428      
WRITE
         95.69   78967.76 us      30.00 us 20324240.00 us           1063   
FXATTROP

    With 64MB:
          0.13      59.36 us      15.00 us     814.00 us            657   
FINODELK
          6.02     225.53 us      69.00 us    6556.00 us           8205      
WRITE
         93.82  103015.12 us      32.00 us 13046368.00 us            280   
FXATTROP


Version-Release number of selected component (if applicable):


How reproducible:


Steps to Reproduce:
1.
2.
3.

Actual results:


Expected results:


Additional info:

--- Additional comment from Worker Ant on 2017-07-26 20:39:34 EDT ---

REVIEW: https://review.gluster.org/17887 (group-gluster-block: Set default
shard-block-size to 4MB) posted (#1) for review on master by Pranith Kumar
Karampuri (pkarampu at redhat.com)

--- Additional comment from Worker Ant on 2017-07-26 20:40:53 EDT ---

REVIEW: https://review.gluster.org/17887 (group-gluster-block: Set default
shard-block-size to 64MB) posted (#2) for review on master by Pranith Kumar
Karampuri (pkarampu at redhat.com)

--- Additional comment from Worker Ant on 2017-07-27 06:39:57 EDT ---

COMMIT: https://review.gluster.org/17887 committed in master by Krutika
Dhananjay (kdhananj at redhat.com) 
------
commit abfbc3eb821e144ddbfdc5d7da401557b52beaf1
Author: Pranith Kumar K <pkarampu at redhat.com>
Date:   Wed Jul 26 20:27:08 2017 +0530

    group-gluster-block: Set default shard-block-size to 64MB

    With 4MB shard size I/O slows down more because of the extra
    inodelk/xattrops in replicate. So increasing it to 64MB which
    gave better performance than 4MB.

    To simulate writes on a preallocated VM-image, fallocate the file and then
do
    dd with notrunc
    do "fallocate -l 1GB" then "dd if=/dev/zero of=file-1GB bs=1MB count=1024
conv=notrunc"

    These are the results on my laptop for dd:
    With 4MB:
          1.84    1357.37 us      19.00 us   12431.00 us           1188   
FINODELK
          2.45     255.08 us      58.00 us    4038.00 us           8428      
WRITE
         95.69   78967.76 us      30.00 us 20324240.00 us           1063   
FXATTROP

    With 64MB:
          0.13      59.36 us      15.00 us     814.00 us            657   
FINODELK
          6.02     225.53 us      69.00 us    6556.00 us           8205      
WRITE
         93.82  103015.12 us      32.00 us 13046368.00 us            280   
FXATTROP

    BUG: 1475605
    Change-Id: I4ed5441409df639e38c731ba0d140fe92902f25f
    Signed-off-by: Pranith Kumar K <pkarampu at redhat.com>
    Reviewed-on: https://review.gluster.org/17887
    CentOS-regression: Gluster Build System <jenkins at build.gluster.org>
    Smoke: Gluster Build System <jenkins at build.gluster.org>
    Reviewed-by: Krutika Dhananjay <kdhananj at redhat.com>


Referenced Bugs:

https://bugzilla.redhat.com/show_bug.cgi?id=1475605
[Bug 1475605] gluster-block default shard-size should be 64MB
-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.