[Bugs] After Upgrade 3.12.11 -> 3.12.12 : Failed to start LSB: GlusterFS server.

Hu Bert revirii at googlemail.com
Fri Jul 13 06:10:38 UTC 2018


Hi,

this morning i upgraded from 3.12.11 to 3.12.12 on a debian stretch.
After the upgrade glusterfs is running, but some messages make me
worry:

systemctl -l status glusterfs-server.service
● glusterfs-server.service - LSB: GlusterFS server
  Loaded: loaded (/etc/init.d/glusterfs-server; generated; vendor
preset: enabled)
  Active: failed (Result: exit-code) since Fri 2018-07-13 07:38:38 CEST; 13s ago
    Docs: man:systemd-sysv-generator(8)
 Process: 8647 ExecStop=/etc/init.d/glusterfs-server stop
(code=exited, status=0/SUCCESS)
 Process: 8661 ExecStart=/etc/init.d/glusterfs-server start
(code=exited, status=1/FAILURE)
   Tasks: 31 (limit: 4915)
  CGroup: /system.slice/glusterfs-server.service
          ├─ 5970 /sbin/rpc.statd
          ├─24543 /usr/sbin/glusterfs -s localhost --volfile-id
gluster/glustershd -p /var/run/gluster/glustershd/glustershd.pid -l
/var/log/glusterfs/glustershd.log -S /var/run/
          └─28333 /usr/sbin/glusterd -p /var/run/glusterd.pid

Jul 13 07:38:38 gluster11 systemd[1]: Starting LSB: GlusterFS server...
Jul 13 07:38:38 gluster11 glusterfs-server[8661]: Starting glusterd
service: glusterd failed!
Jul 13 07:38:38 gluster11 systemd[1]: glusterfs-server.service:
Control process exited, code=exited status=1
Jul 13 07:38:38 gluster11 systemd[1]: Failed to start LSB: GlusterFS server.
Jul 13 07:38:38 gluster11 systemd[1]: glusterfs-server.service: Unit
entered failed state.
Jul 13 07:38:38 gluster11 systemd[1]: glusterfs-server.service: Failed
with result 'exit-code'.

from /var/log/syslog/

Jul 13 07:38:02 gluster11 systemd[1]: Stopping Gluster Events Notifier...
Jul 13 07:38:02 gluster11 systemd[1]: Stopped Gluster Events Notifier.
Jul 13 07:38:02 gluster11 systemd[1]: Reloading.
Jul 13 07:38:05 gluster11 systemd[1]: Reloading.
Jul 13 07:38:05 gluster11 systemd[1]: Starting GlusterFS, a clustered
file-system server...
Jul 13 07:38:05 gluster11 systemd[1]: glusterd.service: Control
process exited, code=exited status=1
Jul 13 07:38:05 gluster11 systemd[1]: Failed to start GlusterFS, a
clustered file-system server.
Jul 13 07:38:05 gluster11 systemd[1]: glusterd.service: Unit entered
failed state.
Jul 13 07:38:05 gluster11 systemd[1]: glusterd.service: Failed with
result 'exit-code'.
Jul 13 07:38:05 gluster11 systemd[1]: Started Gluster Events Notifier.
Jul 13 07:38:05 gluster11 systemd[1]: Starting GlusterFS, a clustered
file-system server...
Jul 13 07:38:05 gluster11 systemd[1]: Starting Mount glusterfs sharedstorage...
Jul 13 07:38:05 gluster11 systemd[1]: glusterd.service: Control
process exited, code=exited status=1
Jul 13 07:38:05 gluster11 systemd[1]: Failed to start GlusterFS, a
clustered file-system server.
Jul 13 07:38:05 gluster11 systemd[1]: Dependency failed for Mount
glusterfs sharedstorage.
Jul 13 07:38:05 gluster11 systemd[1]: glusterfssharedstorage.service:
Job glusterfssharedstorage.service/start failed with result
'dependency'.
Jul 13 07:38:05 gluster11 systemd[1]: glusterd.service: Unit entered
failed state.
Jul 13 07:38:05 gluster11 systemd[1]: glusterd.service: Failed with
result 'exit-code'.
Jul 13 07:38:05 gluster11 glustereventsd[8608]: Unable to get Port
details from Config
Jul 13 07:38:38 gluster11 systemd[1]: Stopping LSB: GlusterFS server...
Jul 13 07:38:38 gluster11 glusterfs-server[8647]: Stopping glusterd
service: glusterd.
Jul 13 07:38:38 gluster11 systemd[1]: Stopped LSB: GlusterFS server.
Jul 13 07:38:38 gluster11 systemd[1]: Starting LSB: GlusterFS server...
Jul 13 07:38:38 gluster11 glusterfs-server[8661]: Starting glusterd
service: glusterd failed!
Jul 13 07:38:38 gluster11 systemd[1]: glusterfs-server.service:
Control process exited, code=exited status=1
Jul 13 07:38:38 gluster11 systemd[1]: Failed to start LSB: GlusterFS server.
Jul 13 07:38:38 gluster11 systemd[1]: glusterfs-server.service: Unit
entered failed state.
Jul 13 07:38:38 gluster11 systemd[1]: glusterfs-server.service: Failed
with result 'exit-code'.

Other information:

Number of Peers: 2

Hostname: gluster13
Uuid: 4fdb11c3-a5af-4e18-af48-182c00b88cc8
State: Peer in Cluster (Connected)

Hostname: gluster12
Uuid: d5a384f0-6fde-46fd-9797-214f2b11a057
State: Peer in Cluster (Connected)

gluster volume info

Volume Name: shared
Type: Distributed-Replicate
Volume ID: e879d208-1d8c-4089-85f3-ef1b3aa45d36
Status: Started
Snapshot Count: 0
Number of Bricks: 4 x 3 = 12
Transport-type: tcp
Bricks:
Brick1: gluster11:/gluster/bricksda1/shared
Brick2: gluster12:/gluster/bricksda1/shared
Brick3: gluster13:/gluster/bricksda1/shared
Brick4: gluster11:/gluster/bricksdb1/shared
Brick5: gluster12:/gluster/bricksdb1/shared
Brick6: gluster13:/gluster/bricksdb1/shared
Brick7: gluster11:/gluster/bricksdc1/shared
Brick8: gluster12:/gluster/bricksdc1/shared
Brick9: gluster13:/gluster/bricksdc1/shared
Brick10: gluster11:/gluster/bricksdd1/shared
Brick11: gluster12:/gluster/bricksdd1/shared
Brick12: gluster13:/gluster/bricksdd1_new/shared
Options Reconfigured:
transport.listen-backlog: 100
performance.strict-o-direct: off
server.allow-insecure: on
performance.io-cache: on
performance.least-prio-threads: 8
performance.low-prio-threads: 32
performance.normal-prio-threads: 32
performance.high-prio-threads: 32
transport.address-family: inet
nfs.disable: on
performance.cache-size: 24GB
cluster.min-free-disk: 1%
performance.io-thread-count: 64
performance.write-behind-window-size: 16MB
performance.cache-max-file-size: 128MB
client.event-threads: 12
server.event-threads: 12
performance.parallel-readdir: on
performance.cache-refresh-timeout: 4
cluster.readdir-optimize: on
cluster.lookup-optimize: on
performance.md-cache-timeout: 60

gluster volume status
Status of volume: shared
Gluster process                             TCP Port  RDMA Port  Online  Pid
------------------------------------------------------------------------------
Brick gluster11:/gluster/bricksda1/shared   49152     0          Y       2027
Brick gluster12:/gluster/bricksda1/shared   49152     0          Y       2245
Brick gluster13:/gluster/bricksda1/shared   49152     0          Y       2079
Brick gluster11:/gluster/bricksdb1/shared   49153     0          Y       2036
Brick gluster12:/gluster/bricksdb1/shared   49153     0          Y       2246
Brick gluster13:/gluster/bricksdb1/shared   49153     0          Y       2080
Brick gluster11:/gluster/bricksdc1/shared   49154     0          Y       2037
Brick gluster12:/gluster/bricksdc1/shared   49154     0          Y       2247
Brick gluster13:/gluster/bricksdc1/shared   49154     0          Y       2081
Brick gluster11:/gluster/bricksdd1/shared   49156     0          Y       3094
Brick gluster12:/gluster/bricksdd1/shared   49155     0          Y       5309
Brick gluster13:/gluster/bricksdd1_new/shar
ed                                          49155     0          Y       2072
Self-heal Daemon on localhost               N/A       N/A        Y       24543
Self-heal Daemon on gluster12               N/A       N/A        Y       5300
Self-heal Daemon on gluster13               N/A       N/A        Y       7899

Task Status of Volume shared
------------------------------------------------------------------------------
There are no active volume tasks

Everything seems fine, besides of the errors during/after upgrade/restart.


More information about the Bugs mailing list