[Bugs] [Bug 1486557] New: Log entry of files skipped/ failed during rebalance operation

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1486557

            Bug ID: 1486557
           Summary: Log entry of files skipped/failed during rebalance
                    operation
           Product: GlusterFS
           Version: 3.12
         Component: distribute
          Keywords: FutureFeature, ZStream
          Severity: high
          Priority: high
          Assignee: bugs at gluster.org
          Reporter: nbalacha at redhat.com
                CC: amukherj at redhat.com, bkunal at redhat.com,
                    bugs at gluster.org, rhs-bugs at redhat.com,
                    spalai at redhat.com, storage-qa-internal at redhat.com,
                    tdesala at redhat.com
        Depends On: 1480445
            Blocks: 1463114



+++ This bug was initially created as a clone of Bug #1480445 +++

+++ This bug was initially created as a clone of Bug #1463114 +++

Description of problem:

As of now rebalance status just indicate the count of failed and skipped
entries. This information should be more informative and should even give the
list of files so that list can be used to manually operate and complete
rebalancing.



  Good to have list of files in a separate log file. Preferable would be to
have file path and not gfid. 
   We should log in such a way that it can be consumed easily even if the list
is long.
   With this fix we should even create a way/script to consume the list and
make the life of Admin easier. As of now doing it manually is a tough job.

So here we have 3 requirements :
   1) Get the list of files failed or skipped with error messages
   2) Automatically consume those file list to complete rebalance( This can be
triggered manually)
   3) If not able to consume list, list the file with some reason of failure

--- Additional comment from Nithya Balachandran on 2017-08-11 02:44:32 EDT ---

Skipped files are now logged in the rebalance log :

2017-08-11 05:33:01.464620] I [MSGID: 109126]
[dht-rebalance.c:2681:gf_defrag_migrate_single_file] 0-vol1-dht: File migration
skipped for /NEWFILE-1.


Users can search for the msgid [109126] for the list of skipped files.

--- Additional comment from Worker Ant on 2017-08-11 02:50:34 EDT ---

REVIEW: https://review.gluster.org/18021 (cluster/dht:  Log files skipped by
rebalance) posted (#1) for review on master by N Balachandran
(nbalacha at redhat.com)

--- Additional comment from Worker Ant on 2017-08-30 01:56:19 EDT ---

COMMIT: https://review.gluster.org/18021 committed in master by Raghavendra G
(rgowdapp at redhat.com) 
------
commit a4c43ba9374b8f75a48d38a032353a0c7d311a73
Author: N Balachandran <nbalacha at redhat.com>
Date:   Fri Aug 11 12:16:12 2017 +0530

    cluster/dht:  Log files skipped by rebalance

    There was no easy way to find out which files were
    skipped during a rebalance.
    Rebalance now logs a message for every skipped file
    using msgid 109126, making it easier to find
    all files that were skipped.

    Change-Id: I2cac7db7285e2f82354251f3ea4094827b0daf3e
    BUG: 1480445
    Signed-off-by: N Balachandran <nbalacha at redhat.com>
    Reviewed-on: https://review.gluster.org/18021
    Smoke: Gluster Build System <jenkins at build.gluster.org>
    CentOS-regression: Gluster Build System <jenkins at build.gluster.org>
    Reviewed-by: hari gowtham <hari.gowtham005 at gmail.com>
    Reviewed-by: Raghavendra G <rgowdapp at redhat.com>


Referenced Bugs:

https://bugzilla.redhat.com/show_bug.cgi?id=1463114
[Bug 1463114] [GSS][RFE] Log entry of files skipped/failed during rebalance
operation
https://bugzilla.redhat.com/show_bug.cgi?id=1480445
[Bug 1480445] Log entry of files skipped/failed during rebalance operation
-- 
You are receiving this mail because:
You are on the CC list for the bug.
You are the assignee for the bug.