[Bugs] [Bug 1175214] [RFE] Rebalance Performance Improvements
bugzilla at redhat.com
bugzilla at redhat.com
Sun Jul 5 11:55:43 UTC 2015
https://bugzilla.redhat.com/show_bug.cgi?id=1175214
Triveni Rao <trao at redhat.com> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|ON_QA |VERIFIED
--- Comment #17 from Triveni Rao <trao at redhat.com> ---
Functionality wise rebalance is behaving as expected.
tests conducted.
add brick, remove brick and rebalance.
[root at casino-vm1 ~]# gluster v create venus replica 2
10.70.35.57:/rhs/brick2/venus 10.70.35.136:/rhs/brick2/venus
10.70.35.57:/rhs/brick1/venus 10.70.35.136:/rhs/brick1/venus
volume create: venus: success: please start the volume to access data
[root at casino-vm1 ~]# gluster v start venus
volume start: venus: success
[root at casino-vm1 ~]# gluster v info venus
Volume Name: venus
Type: Distributed-Replicate
Volume ID: 2c13461a-530c-4040-97f3-fa0f5f3837f1
Status: Started
Number of Bricks: 2 x 2 = 4
Transport-type: tcp
Bricks:
Brick1: 10.70.35.57:/rhs/brick2/venus
Brick2: 10.70.35.136:/rhs/brick2/venus
Brick3: 10.70.35.57:/rhs/brick1/venus
Brick4: 10.70.35.136:/rhs/brick1/venus
Options Reconfigured:
performance.readdir-ahead: on
[root at casino-vm1 ~]#
[root at casino-vm1 ~]# gluster v info venus
Volume Name: venus
Type: Distributed-Replicate
Volume ID: 2c13461a-530c-4040-97f3-fa0f5f3837f1
Status: Started
Number of Bricks: 2 x 2 = 4
Transport-type: tcp
Bricks:
Brick1: 10.70.35.57:/rhs/brick2/venus
Brick2: 10.70.35.136:/rhs/brick2/venus
Brick3: 10.70.35.57:/rhs/brick1/venus
Brick4: 10.70.35.136:/rhs/brick1/venus
Options Reconfigured:
features.uss: enable
features.quota-deem-statfs: on
features.inode-quota: on
features.quota: on
cluster.min-free-disk: 10
performance.readdir-ahead: on
[root at casino-vm1 ~]#
[root at casino-vm5 ~]# cat create_dir_files.sh
for i in {1..100}; do mkdir /$1/a$i; mkdir /$1/x$i; for j in {1..100}; do touch
/$1/a$i/b$j; touch /$1/x$i/y$j; done done
[root at casino-vm5 ~]# ./create_dir_files.sh /mnt
[root at casino-vm5 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_casinovm5-lv_root
18G 1.8G 15G 11% /
tmpfs 992M 0 992M 0% /dev/shm
/dev/vda1 477M 30M 422M 7% /boot
10.70.35.57:/venus 20G 0 20G 0% /mnt
[root at casino-vm5 ~]# ls /mnt
a1 a13 a18 a22 a27 a31 a36 a40 a45 a5 a54 a59 a63 a68 a72 a77
a81 a86 a90 a95 x1 x13 x18 x22 x27 x31 x36 x40 x45 x5 x54
x59 x63 x68 x72 x77 x81 x86 x90 x95
a10 a14 a19 a23 a28 a32 a37 a41 a46 a50 a55 a6 a64 a69 a73 a78
a82 a87 a91 a96 x10 x14 x19 x23 x28 x32 x37 x41 x46 x50 x55 x6
x64 x69 x73 x78 x82 x87 x91 x96
a100 a15 a2 a24 a29 a33 a38 a42 a47 a51 a56 a60 a65 a7 a74 a79
a83 a88 a92 a97 x100 x15 x2 x24 x29 x33 x38 x42 x47 x51 x56
x60 x65 x7 x74 x79 x83 x88 x92 x97
a11 a16 a20 a25 a3 a34 a39 a43 a48 a52 a57 a61 a66 a70 a75 a8
a84 a89 a93 a98 x11 x16 x20 x25 x3 x34 x39 x43 x48 x52 x57
x61 x66 x70 x75 x8 x84 x89 x93 x98
a12 a17 a21 a26 a30 a35 a4 a44 a49 a53 a58 a62 a67 a71 a76 a80
a85 a9 a94 a99 x12 x17 x21 x26 x30 x35 x4 x44 x49 x53 x58
x62 x67 x71 x76 x80 x85 x9 x94 x99
[root at casino-vm5 ~]#
[root at casino-vm1 ~]# gluster v add-brick venus 10.70.35.57:/rhs/brick4/venus
10.70.35.136:/rhs/brick4/venus 10.70.35.57:/rhs/brick3/venus
10.70.35.136:/rhs/brick3/venus
volume add-brick: success
[root at casino-vm1 ~]# time
real 0m0.000s
user 0m0.000s
sys 0m0.000s
[root at casino-vm1 ~]# time gluster v rebalance venus start force
volume rebalance: venus: success: Rebalance on venus has been started
successfully. Use rebalance status command to check status of the rebalance
process.
ID: d2d74a7e-ab97-47b7-a35a-c5c6f060b9fc
real 0m10.737s
user 0m0.092s
sys 0m0.050s
[root at casino-vm1 ~]# time gluster v rebalance venus status
Node Rebalanced-files size
scanned failures skipped status run time in secs
--------- ----------- -----------
----------- ----------- ----------- ------------ --------------
localhost 50 0Bytes
298 0 0 in progress 13.00
10.70.35.136 0 0Bytes
0 0 0 in progress 13.00
volume rebalance: venus: success:
real 0m0.781s
user 0m0.095s
sys 0m0.034s
[root at casino-vm1 ~]#
volume rebalance: venus: success:
[root at casino-vm1 ~]#
[root at casino-vm1 ~]# gluster v rebalance venus status
Node Rebalanced-files size
scanned failures skipped status run time in secs
--------- ----------- -----------
----------- ----------- ----------- ------------ --------------
localhost 1644 0Bytes
5219 0 0 in progress 253.00
10.70.35.136 0 0Bytes
0 0 0 completed 88.00
volume rebalance: venus: success:
[root at casino-vm1 ~]# gluster v rebalance venus status
Node Rebalanced-files size
scanned failures skipped status run time in secs
--------- ----------- -----------
----------- ----------- ----------- ------------ --------------
localhost 6940 0Bytes
23835 0 0 in progress 653.00
10.70.35.136 0 0Bytes
0 0 0 completed 88.00
volume rebalance: venus: success:
[root at casino-vm1 ~]# gluster v rebalance venus status
Node Rebalanced-files size
scanned failures skipped status run time in secs
--------- ----------- -----------
----------- ----------- ----------- ------------ --------------
localhost 7356 0Bytes
23835 0 0 completed 668.00
10.70.35.136 0 0Bytes
0 0 0 completed 88.00
volume rebalance: venus: success:
[root at casino-vm1 ~]#
[root at casino-vm5 mnt]# cd /root
[root at casino-vm5 ~]# ./arequal /mnt
Entry counts
Regular files : 20000
Directories : 203
Symbolic links : 0
Other : 0
Total : 20203
Metadata checksums
Regular files : 3e9
Directories : 24d74c
Symbolic links : 3e9
Other : 3e9
Checksums
Regular files : 00
Directories : d02060104765b76
Symbolic links : 0
Other : 0
Total : d02060104765b76
[root at casino-vm5 ~]#
[root at casino-vm1 ~]# date gluster v remove-brick venus
10.70.35.57:/rhs/brick2/venus 10.70.35.136:/rhs/brick2/venus start
date: extra operand `v'
Try `date --help' for more information.
[root at casino-vm1 ~]# gluster v remove-brick venus 10.70.35.57:/rhs/brick2/venus
10.70.35.136:/rhs/brick2/venus start
volume remove-brick start: success
ID: 2d012d5b-9675-4420-aedc-f9b174bebd80
[root at casino-vm1 ~]# gluster v remove-brick venus 10.70.35.57:/rhs/brick2/venus
10.70.35.136:/rhs/brick2/venus status
Node Rebalanced-files size
scanned failures skipped status run time in secs
--------- ----------- -----------
----------- ----------- ----------- ------------ --------------
localhost 203 0Bytes
1050 0 0 in progress 21.00
10.70.35.136 0 0Bytes
0 0 0 in progress 22.00
[root at casino-vm1 ~]# gluster v remove-brick venus 10.70.35.57:/rhs/brick2/venus
10.70.35.136:/rhs/brick2/venus status
Node Rebalanced-files size
scanned failures skipped status run time in secs
--------- ----------- -----------
----------- ----------- ----------- ------------ --------------
localhost 9377 0Bytes
20108 0 0 completed 424.00
10.70.35.136 0 0Bytes
0 0 0 completed 29.00
[root at casino-vm1 ~]#
[root at casino-vm1 ~]# gluster v remove-brick venus 10.70.35.57:/rhs/brick2/venus
10.70.35.136:/rhs/brick2/venus commit
Removing brick(s) can result in data loss. Do you want to Continue? (y/n) y
volume remove-brick commit: success
Check the removed bricks to ensure all files are migrated.
If files with data are found on the brick path, copy them via a gluster mount
point before re-purposing the removed brick.
[root at casino-vm1 ~]# gluster v info venus
Volume Name: venus
Type: Distributed-Replicate
Volume ID: 2c13461a-530c-4040-97f3-fa0f5f3837f1
Status: Started
Number of Bricks: 3 x 2 = 6
Transport-type: tcp
Bricks:
Brick1: 10.70.35.57:/rhs/brick1/venus
Brick2: 10.70.35.136:/rhs/brick1/venus
Brick3: 10.70.35.57:/rhs/brick4/venus
Brick4: 10.70.35.136:/rhs/brick4/venus
Brick5: 10.70.35.57:/rhs/brick3/venus
Brick6: 10.70.35.136:/rhs/brick3/venus
Options Reconfigured:
features.uss: enable
features.quota-deem-statfs: on
features.inode-quota: on
features.quota: on
cluster.min-free-disk: 10
performance.readdir-ahead: on
[root at casino-vm1 ~]#
[root at casino-vm5 ~]# ./arequal /mnt
Entry counts
Regular files : 20000
Directories : 203
Symbolic links : 0
Other : 0
Total : 20203
Metadata checksums
Regular files : 3e9
Directories : 24d74c
Symbolic links : 3e9
Other : 3e9
Checksums
Regular files : 00
Directories : d02060104765b76
Symbolic links : 0
Other : 0
Total : d02060104765b76
[root at casino-vm5 ~]#
[root at casino-vm5 ~]#
[root at casino-vm5 ~]#
--
You are receiving this mail because:
You are on the CC list for the bug.
Unsubscribe from this bug https://bugzilla.redhat.com/token.cgi?t=7FOxJv1AJB&a=cc_unsubscribe
More information about the Bugs
mailing list