[Bugs] [Bug 1275173] New: geo-replication: Fix races while handling rebalanced data in Tiering volume

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1275173

            Bug ID: 1275173
           Summary: geo-replication: Fix races while handling rebalanced
                    data in Tiering volume
           Product: GlusterFS
           Version: 3.7.0
         Component: geo-replication
          Assignee: bugs at gluster.org
          Reporter: sarumuga at redhat.com
                CC: avishwan at redhat.com, bugs at gluster.org,
                    gluster-bugs at redhat.com, vagarwal at redhat.com
        Depends On: 1266875
            Blocks: 1260923, 1267185



+++ This bug was initially created as a clone of Bug #1266875 +++

Description of problem:

Race conditions can occur while processing changelogs(by geo-replication) in
Tiering based volume, where rebalanace can cause frequent movement of files
between hot and cold tiers.

Also, rebalance operations are internal operations which needs to be avoided.
(Deletion of the file and Creation of the file while carrying out rebalance).

Version-Release number of selected component (if applicable):


How reproducible:

Following is one such example:

==================================
Brick1             Brick2
==================================
Create file        (file moved due to rebalance).
            Data file
            Delete file
==================================

If Brick2 changelogs processed first followed by Brick1, file may be created.
But, we expect the file to be deleted (as per the last operation)

Steps to Reproduce:
1.
2.
3.

Actual results:
Files are not synced properly.

Expected results:
Files are synced as expected.

Additional info:

--- Additional comment from Saravanakumar on 2015-10-09 11:39:16 EDT ---

Patches :
http://review.gluster.org/#/c/12239/
http://review.gluster.org/#/c/12326/

Ignoring cold brick namespace related fops is pending.

--- Additional comment from Vijay Bellur on 2015-10-14 02:28:13 EDT ---

REVIEW: http://review.gluster.org/12355 (geo-rep: Avoid cold tier bricks during
ENTRY operation) posted (#1) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-14 10:32:36 EDT ---

REVIEW: http://review.gluster.org/12326 (geo-rep: Add data operation if mknod
with tier attribute) posted (#2) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-15 02:28:36 EDT ---

REVIEW: http://review.gluster.org/12326 (geo-rep: Add data operation if mknod
with tier attribute) posted (#3) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-15 06:25:07 EDT ---

REVIEW: http://review.gluster.org/12239 (geo-rep: ignore recording tiering
rebalance fops) posted (#4) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-15 06:36:55 EDT ---

REVIEW: http://review.gluster.org/12355 (geo-rep: Avoid cold tier bricks during
ENTRY operation) posted (#2) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-16 01:41:17 EDT ---

REVIEW: http://review.gluster.org/12326 (geo-rep: Add data operation if mknod
with tier attribute) posted (#4) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-16 01:44:17 EDT ---

REVIEW: http://review.gluster.org/12239 (geo-rep: ignore recording tiering
rebalance fops) posted (#5) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-16 04:50:09 EDT ---

REVIEW: http://review.gluster.org/12326 (geo-rep: Add data operation if mknod
with tier attribute) posted (#5) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-16 05:52:05 EDT ---

REVIEW: http://review.gluster.org/12326 (geo-rep: Add data operation if mknod
with tier attribute) posted (#6) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-19 01:05:34 EDT ---

REVIEW: http://review.gluster.org/12326 (geo-rep: Add data operation if mknod
with tier attribute) posted (#7) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-19 02:41:37 EDT ---

REVIEW: http://review.gluster.org/12326 (geo-rep: Add data operation if mknod
with tier attribute) posted (#8) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-22 07:49:32 EDT ---

REVIEW: http://review.gluster.org/12239 (features/changelog: ignore recording
tiering rebalance fops) posted (#6) for review on master by Saravanakumar
Arumugam (sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-23 02:03:36 EDT ---

REVIEW: http://review.gluster.org/12239 (features/changelog: ignore recording
tiering rebalance fops) posted (#7) for review on master by Saravanakumar
Arumugam (sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-23 02:32:08 EDT ---

REVIEW: http://review.gluster.org/12417 (    features/changelog: Add data
operation if mknod with tier attribute) posted (#1) for review on master by
Saravanakumar Arumugam (sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-23 02:34:18 EDT ---

REVIEW: http://review.gluster.org/12326 (geo-rep: Add data operation if mknod
with tier attribute) posted (#9) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-23 02:35:55 EDT ---

REVIEW: http://review.gluster.org/12417 (features/changelog: Add data operation
if mknod with tier attribute) posted (#2) for review on master by Saravanakumar
Arumugam (sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-23 06:55:18 EDT ---

REVIEW: http://review.gluster.org/12355 (geo-rep: Avoid cold tier bricks during
ENTRY operation) posted (#3) for review on master by Saravanakumar Arumugam
(sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-23 06:58:10 EDT ---

REVIEW: http://review.gluster.org/12417 (features/changelog: Add data operation
if mknod with tier attribute) posted (#3) for review on master by Saravanakumar
Arumugam (sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-23 07:01:54 EDT ---

REVIEW: http://review.gluster.org/12417 (features/changelog: Add data operation
if mknod with tier attribute) posted (#4) for review on master by Saravanakumar
Arumugam (sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-26 01:35:01 EDT ---

REVIEW: http://review.gluster.org/12239 (features/changelog: ignore recording
tiering rebalance fops) posted (#8) for review on master by Saravanakumar
Arumugam (sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-26 01:35:25 EDT ---

REVIEW: http://review.gluster.org/12417 (features/changelog: Add data operation
if mknod with tier attribute) posted (#5) for review on master by Saravanakumar
Arumugam (sarumuga at redhat.com)

--- Additional comment from Vijay Bellur on 2015-10-26 03:21:24 EDT ---

REVIEW: http://review.gluster.org/12417 (features/changelog: record mknod if
tier-dht linkto is set) posted (#6) for review on master by Saravanakumar
Arumugam (sarumuga at redhat.com)


Referenced Bugs:

https://bugzilla.redhat.com/show_bug.cgi?id=1260923
[Bug 1260923] Tracker for tiering in 3.1.2
https://bugzilla.redhat.com/show_bug.cgi?id=1266875
[Bug 1266875] geo-replication: Fix races while handling rebalanced data in
Tiering volume
https://bugzilla.redhat.com/show_bug.cgi?id=1267185
[Bug 1267185] [RFE] Geo-replication + Tiering
-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.