[Gluster-users] Heal pending problem

[Strahil]

Also,
Run a ' restorecon -RFvv /gluster_bricks

as I have noticed 'unlabeled' files.

Best Regards,
Strahil NikolovOn Oct 28, 2019 14:13, Grzegorz Lechowicz <grzegorz.lechowicz at enigma.com.pl> wrote:
>
> Hi, updating gluster to 6.5 didn't resolve problem :-(
>
> regards
> grzegorz
>
> W dniu pon, 28.10.2019 o godzinie 09∶53 +0100, użytkownik Grzegorz
> Lechowicz napisał:
> > Hi, I have big problem after network outage I think. I have a volume
> > which is
> > corrupted I think. Here are details:
> > 
> > [root at hv-01 ~]# gluster --version
> > glusterfs 5.3
> > 
> > 1. volume info:
> > 
> > [root at hv-01 ~]# gluster volume info engine
> >  
> > Volume Name: engine
> > Type: Replicate
> > Volume ID: ca7c567a-1512-4c6c-964b-e9a2ca45b872
> > Status: Started
> > Snapshot Count: 0
> > Number of Bricks: 1 x (2 + 1) = 3
> > Transport-type: tcp
> > Bricks:
> > Brick1: hv-01.cencert.local:/gluster_bricks/engine/engine
> > Brick2: hv-02.cencert.local:/gluster_bricks/engine/engine
> > Brick3: arbiter.cencert.local:/gluster_bricks/engine/engine (arbiter)
> > Options Reconfigured:
> > cluster.eager-lock: enable
> > performance.io-cache: off
> > performance.read-ahead: off
> > performance.quick-read: off
> > user.cifs: off
> > network.ping-timeout: 30
> > network.remote-dio: off
> > performance.strict-o-direct: on
> > performance.low-prio-threads: 32
> > features.shard: on
> > storage.owner-gid: 36
> > storage.owner-uid: 36
> > transport.address-family: inet
> > nfs.disable: on
> > performance.client-io-threads: off
> > 
> > 
> > 2. Volume heal info and summary
> > 
> > [root at hv-01 ~]# gluster volume heal engine info
> > Brick hv-01.cencert.local:/gluster_bricks/engine/engine
> > /7396183b-825b-4670-8646-5eb8d69f3480/images/02d6cf5e-179c-4730-8191-
> > a1ee7b5a7737/30b0a24e-01cb-4d53-9cf1-422f8f217e33 
> > Status: Connected
> > Number of entries: 1
> > 
> > Brick hv-02.cencert.local:/gluster_bricks/engine/engine
> > /7396183b-825b-4670-8646-5eb8d69f3480/images/02d6cf5e-179c-4730-8191-
> > a1ee7b5a7737/30b0a24e-01cb-4d53-9cf1-422f8f217e33 
> > Status: Connected
> > Number of entries: 1
> > 
> > Brick arbiter.cencert.local:/gluster_bricks/engine/engine
> > /7396183b-825b-4670-8646-5eb8d69f3480/images/02d6cf5e-179c-4730-8191-
> > a1ee7b5a7737/30b0a24e-01cb-4d53-9cf1-422f8f217e33 
> > Status: Connected
> > Number of entries: 1
> > 
> > 
> > [root at hv-01 ~]# gluster volume heal engine info summary
> > Brick hv-01.cencert.local:/gluster_bricks/engine/engine
> > Status: Connected
> > Total Number of entries: 1
> > Number of entries in heal pending: 1
> > Number of entries in split-brain: 0
> > Number of entries possibly healing: 0
> > 
> > Brick hv-02.cencert.local:/gluster_bricks/engine/engine
> > Status: Connected
> > Total Number of entries: 2
> > Number of entries in heal pending: 2
> > Number of entries in split-brain: 0
> > Number of entries possibly healing: 0
> > 
> > Brick arbiter.cencert.local:/gluster_bricks/engine/engine
> > Status: Connected
> > Total Number of entries: 2
> > Number of entries in heal pending: 2
> > Number of entries in split-brain: 0
> > Number of entries possibly healing: 0
> > 
> > 
> > 3. Details about corrupted file
> > 
> > [root at hv-01 ~]# stat /gluster_bricks/engine/engine/7396183b-825b-
> > 4670-
> > 8646-5eb8d69f3480/images/02d6cf5e-179c-4730-8191-
> > a1ee7b5a7737/30b0a24e-
> > 01cb-4d53-9cf1-422f8f217e33
> >   Plik: „/gluster_bricks/engine/engine/7396183b-825b-4670-8646-
> > 5eb8d69f3480/images/02d6cf5e-179c-4730-8191-a1ee7b5a7737/30b0a24e-
> > 01cb-
> > 4d53-9cf1-422f8f217e33”
> >   rozmiar: 67108864     bloków: 122968     bloki I/O: 4096   zwykły
> > plik
> > Urządzenie: fd0fh/64783d        inody: 134349053   dowiązań: 2
> > Dostęp: (0660/-rw-rw----)  Uid: (   36/    vdsm)   Gid:
> > (   36/     kvm)
> > Kontekst: system_u:object_r:unlabeled_t:s0
> > Dostęp:      2019-02-17 15:00:33.130284553 +0100
> > Modyfikacja: 2019-02-20 13:15:08.090856642 +0100
> > Zmiana:      2019-10-25 11:13:15.174957824 +0200
> > Utworzenie:  -
> > 
> > [root at hv-02 ~]# stat /gluster_bricks/engine/engine/7396183b-825b-
> > 4670-
> > 8646-5eb8d69f3480/images/02d6cf5e-179c-4730-8191-
> > a1ee7b