[Gluster-users] read error: Input/output error but not in brain split stat
likun
kun.li at ucarinc.com
Tue Jan 3 03:33:49 UTC 2017
Hello, everyone.
Today, one of our glusterfs consumer reported an error:
java.io.FileNotFoundException: /mnt/glusterfs/gps/data/2017-01/02/4.txt
(Input/output error).
Then I tried to access this file:
# cd /mnt/glusterfs/gps/data/2017-01/02
# more 4.txt
# cat 4.txt
cat: read error: Input/output error
I supposed there was something wrong with glusterfs, so I logined into
glusterfs system, found nothing wrong, the output of 'gluster volume
status|info' and 'gluster volume heal gvol0 info' command appended at the
end. So, question is what's wrong?
Then I logined into the bricks that hold this file, the size of the file
4.txt was different:
core at ab09 /export/gluster/sdb3/vol/gps/data/2017-01/02 $ ls -l 4.txt
-rw-r--r--. 2 root root 7490 Jan 2 00:00 4.txt
core at ac08 /export/gluster/sdb3/vol/gps/data/2017-01/02 $ ls -l 4.txt
-rw-r--r--. 2 root root 9046 Jan 2 00:00 4.txt
core at ad08 /export/gluster/sdb3/vol/gps/data/2017-01/02 $ ls -l 4.txt
-rw-r--r--. 2 root root 9046 Jan 2 00:00 4.txt
And the getfattr output:
core at ab09 /export/gluster/sdb3/vol/gps/data/2017-01/02 # getfattr -m . -d
-e hex 4.txt
# file: 4.txt
security.selinux=0x73797374656d5f753a6f626a6563745f723a756e6c6162656c65645f7
43a733000
trusted.afr.gvol0-client-51=0x000000000000000000000000
trusted.afr.gvol0-client-52=0x000000000000000000000000
trusted.afr.gvol0-client-53=0x000000000000000000000000
trusted.bit-rot.version=0x02000000000000005850b03d00072c12
trusted.gfid=0xa61d7b2fd53f4eb9be7a656b0915dbea
trusted.glusterfs.quota.363d3c2d-5ccb-497e-9ecc-6eaf5f435026.contri.1=0x0000
000000001e000000000000000001
trusted.pgfid.363d3c2d-5ccb-497e-9ecc-6eaf5f435026=0x00000001
core at ac08 /export/gluster/sdb3/vol/gps/data/2017-01/02 # getfattr -m . -d
-e hex 4.txt
# file: 4.txt
security.selinux=0x73797374656d5f753a6f626a6563745f723a756e6c6162656c65645f7
43a733000
trusted.afr.gvol0-client-51=0x000000000000000000000000
trusted.afr.gvol0-client-52=0x000000000000000000000000
trusted.afr.gvol0-client-53=0x000000000000000000000000
trusted.bit-rot.version=0x02000000000000005850b03d0007711e
trusted.gfid=0xa61d7b2fd53f4eb9be7a656b0915dbea
trusted.glusterfs.quota.363d3c2d-5ccb-497e-9ecc-6eaf5f435026.contri.1=0x0000
0000000024000000000000000001
trusted.pgfid.363d3c2d-5ccb-497e-9ecc-6eaf5f435026=0x00000001
core at ad08 /export/gluster/sdb3/vol/gps/data/2017-01/02 # getfattr -m . -d
-e hex 4.txt
# file: 4.txt
security.selinux=0x73797374656d5f753a6f626a6563745f723a756e6c6162656c65645f7
43a733000
trusted.afr.gvol0-client-51=0x000000000000000000000000
trusted.afr.gvol0-client-52=0x000000000000000000000000
trusted.afr.gvol0-client-53=0x000000000000000000000000
trusted.bit-rot.version=0x02000000000000005861dcf900054117
trusted.gfid=0xa61d7b2fd53f4eb9be7a656b0915dbea
trusted.glusterfs.quota.363d3c2d-5ccb-497e-9ecc-6eaf5f435026.contri.1=0x0000
0000000024000000000000000001
trusted.pgfid.363d3c2d-5ccb-497e-9ecc-6eaf5f435026=0x00000001
Anyone know what was wrong with here ? Brain split ? but gluster volume heal
info didn't report it .
Is this a bug or something? What caused this? Although a "gluster volume
heal gvol0 full" command handled this, synced this file, the impact to
glusterfs consumer was real, and would happen again in the near future, I
supposed.
How can this be avoided, or recommend some preactive action to handle this ?
I'm running official gluster-centos:gluster3u8_centos7 image (version 3.8.5)
in container with kubernetes.
Likun
Appendix:
# gluster volume status
Status of volume: gvol0
Gluster process TCP Port RDMA Port Online Pid
----------------------------------------------------------------------------
--
Brick 10.3.3.9:/mnt/brick1/vol 49152 0 Y 318
Brick 10.3.3.19:/mnt/brick1/vol 49152 0 Y 316
Brick 10.3.3.29:/mnt/brick1/vol 49152 0 Y 316
Brick 10.3.3.10:/mnt/brick1/vol 49152 0 Y 316
Brick 10.3.3.20:/mnt/brick1/vol 49152 0 Y 318
Brick 10.3.3.30:/mnt/brick1/vol 49152 0 Y 339
Brick 10.3.3.9:/mnt/brick2/vol 49153 0 Y 337
Brick 10.3.3.19:/mnt/brick2/vol 49153 0 Y 335
Brick 10.3.3.29:/mnt/brick2/vol 49153 0 Y 335
Brick 10.3.3.11:/mnt/brick1/vol 49152 0 Y 318
Brick 10.3.3.21:/mnt/brick1/vol 49152 0 Y 316
Brick 10.3.3.39:/mnt/brick1/vol 49152 0 Y 744
Brick 10.3.3.12:/mnt/brick1/vol 49152 0 Y 316
Brick 10.3.3.22:/mnt/brick1/vol 49152 0 Y 287
Brick 10.3.3.40:/mnt/brick1/vol 49152 0 Y 333
Brick 10.3.3.13:/mnt/brick1/vol 49152 0 Y 318
Brick 10.3.3.31:/mnt/brick1/vol 49152 0 Y 308
Brick 10.3.3.41:/mnt/brick1/vol 49152 0 Y 331
Brick 10.3.3.23:/mnt/brick1/vol 49152 0 Y 322
Brick 10.3.3.32:/mnt/brick1/vol 49152 0 Y 308
Brick 10.3.3.42:/mnt/brick1/vol 49152 0 Y 324
Brick 10.3.3.33:/mnt/brick1/vol 49152 0 Y 308
Brick 10.3.3.43:/mnt/brick1/vol 49152 0 Y 341
Brick 10.3.3.10:/mnt/brick2/vol 49153 0 Y 335
Brick 10.3.3.20:/mnt/brick2/vol 49153 0 Y 337
Brick 10.3.3.30:/mnt/brick2/vol 49153 0 Y 355
Brick 10.3.3.40:/mnt/brick2/vol 49153 0 Y 339
Brick 10.3.3.11:/mnt/brick2/vol 49153 0 Y 337
Brick 10.3.3.21:/mnt/brick2/vol 49153 0 Y 335
Brick 10.3.3.39:/mnt/brick2/vol 49153 0 Y 763
Brick 10.3.3.12:/mnt/brick2/vol 49153 0 Y 335
Brick 10.3.3.22:/mnt/brick2/vol 49153 0 Y 306
Brick 10.3.3.31:/mnt/brick2/vol 49153 0 Y 327
Brick 10.3.3.13:/mnt/brick2/vol 49153 0 Y 337
Brick 10.3.3.32:/mnt/brick2/vol 49153 0 Y 327
Brick 10.3.3.41:/mnt/brick2/vol 49153 0 Y 336
Brick 10.3.3.23:/mnt/brick2/vol 49153 0 Y 330
Brick 10.3.3.33:/mnt/brick2/vol 49153 0 Y 327
Brick 10.3.3.42:/mnt/brick2/vol 49153 0 Y 343
Brick 10.3.3.9:/mnt/brick3/vol 49154 0 Y 356
Brick 10.3.3.19:/mnt/brick3/vol 49154 0 Y 354
Brick 10.3.3.29:/mnt/brick3/vol 49154 0 Y 354
Brick 10.3.3.10:/mnt/brick3/vol 49154 0 Y 354
Brick 10.3.3.20:/mnt/brick3/vol 49154 0 Y 356
Brick 10.3.3.43:/mnt/brick2/vol 49153 0 Y 336
Brick 10.3.3.11:/mnt/brick3/vol 49154 0 Y 356
Brick 10.3.3.21:/mnt/brick3/vol 49154 0 Y 354
Brick 10.3.3.39:/mnt/brick3/vol 49154 0 Y 782
Brick 10.3.3.12:/mnt/brick3/vol 49154 0 Y 354
Brick 10.3.3.30:/mnt/brick3/vol 49154 0 Y 363
Brick 10.3.3.40:/mnt/brick3/vol 49154 0 Y 345
Brick 10.3.3.22:/mnt/brick3/vol 49154 0 Y 325
Brick 10.3.3.31:/mnt/brick3/vol 49154 0 Y 346
Brick 10.3.3.41:/mnt/brick3/vol 49154 0 Y 343
Brick 10.3.3.13:/mnt/brick3/vol 49154 0 Y 356
Brick 10.3.3.32:/mnt/brick3/vol 49154 0 Y 346
Brick 10.3.3.42:/mnt/brick3/vol 49154 0 Y 349
Brick 10.3.3.23:/mnt/brick3/vol 49154 0 Y 338
Brick 10.3.3.33:/mnt/brick3/vol 49154 0 Y 346
Brick 10.3.3.43:/mnt/brick3/vol 49154 0 Y 349
Brick 10.3.3.9:/mnt/brick4/vol 49155 0 Y 375
Brick 10.3.3.19:/mnt/brick4/vol 49155 0 Y 373
Brick 10.3.3.29:/mnt/brick4/vol 49155 0 Y 373
Brick 10.3.3.10:/mnt/brick4/vol 49155 0 Y 373
Brick 10.3.3.20:/mnt/brick4/vol 49155 0 Y 375
Brick 10.3.3.30:/mnt/brick4/vol 49155 0 Y 345
Brick 10.3.3.11:/mnt/brick4/vol 49155 0 Y 375
Brick 10.3.3.21:/mnt/brick4/vol 49155 0 Y 373
Brick 10.3.3.39:/mnt/brick4/vol 49155 0 Y 801
Brick 10.3.3.12:/mnt/brick4/vol 49155 0 Y 373
Brick 10.3.3.22:/mnt/brick4/vol 49155 0 Y 344
Brick 10.3.3.40:/mnt/brick4/vol 49155 0 Y 351
Brick 10.3.3.13:/mnt/brick4/vol 49155 0 Y 375
Brick 10.3.3.31:/mnt/brick4/vol 49155 0 Y 365
Brick 10.3.3.41:/mnt/brick4/vol 49155 0 Y 355
Brick 10.3.3.10:/mnt/brick5/vol 49156 0 Y 392
Brick 10.3.3.33:/mnt/brick4/vol 49155 0 Y 365
Brick 10.3.3.43:/mnt/brick4/vol 49155 0 Y 331
Brick 10.3.3.23:/mnt/brick4/vol 49155 0 Y 347
Brick 10.3.3.32:/mnt/brick4/vol 49155 0 Y 365
Brick 10.3.3.42:/mnt/brick4/vol 49155 0 Y 355
Brick 10.3.3.9:/mnt/brick5/vol 49156 0 Y 394
Brick 10.3.3.19:/mnt/brick5/vol 49156 0 Y 392
Brick 10.3.3.29:/mnt/brick5/vol 49156 0 Y 392
Brick 10.3.3.20:/mnt/brick5/vol 49156 0 Y 394
Brick 10.3.3.30:/mnt/brick5/vol 49156 0 Y 332
Brick 10.3.3.40:/mnt/brick5/vol 49156 0 Y 357
Brick 10.3.3.11:/mnt/brick5/vol 49156 0 Y 394
Brick 10.3.3.21:/mnt/brick5/vol 49156 0 Y 392
Brick 10.3.3.39:/mnt/brick5/vol 49156 0 Y 820
Brick 10.3.3.12:/mnt/brick5/vol 49156 0 Y 392
Brick 10.3.3.22:/mnt/brick5/vol 49156 0 Y 363
Brick 10.3.3.31:/mnt/brick5/vol 49156 0 Y 384
Brick 10.3.3.13:/mnt/brick5/vol 49156 0 Y 394
Brick 10.3.3.23:/mnt/brick5/vol 49156 0 Y 352
Brick 10.3.3.41:/mnt/brick5/vol 49156 0 Y 349
Brick 10.3.3.10:/mnt/brick6/vol 49157 0 Y 411
Brick 10.3.3.32:/mnt/brick5/vol 49156 0 Y 384
Brick 10.3.3.42:/mnt/brick5/vol 49156 0 Y 335
Brick 10.3.3.11:/mnt/brick6/vol 49157 0 Y 413
Brick 10.3.3.33:/mnt/brick5/vol 49156 0 Y 384
Brick 10.3.3.43:/mnt/brick5/vol 49156 0 Y 355
Brick 10.3.3.9:/mnt/brick6/vol 49157 0 Y 413
Brick 10.3.3.19:/mnt/brick6/vol 49157 0 Y 411
Brick 10.3.3.29:/mnt/brick6/vol 49157 0 Y 411
Brick 10.3.3.20:/mnt/brick6/vol 49157 0 Y 413
Brick 10.3.3.30:/mnt/brick6/vol 49157 0 Y 350
Brick 10.3.3.40:/mnt/brick6/vol 49157 0 Y 363
Brick 10.3.3.21:/mnt/brick6/vol 49157 0 Y 411
Brick 10.3.3.31:/mnt/brick6/vol 49157 0 Y 403
Brick 10.3.3.41:/mnt/brick6/vol 49157 0 Y 361
Brick 10.3.3.12:/mnt/brick6/vol 49157 0 Y 411
Brick 10.3.3.22:/mnt/brick6/vol 49157 0 Y 382
Brick 10.3.3.39:/mnt/brick6/vol 49157 0 Y 839
Brick 10.3.3.13:/mnt/brick6/vol 49157 0 Y 413
Brick 10.3.3.32:/mnt/brick6/vol 49157 0 Y 403
Brick 10.3.3.42:/mnt/brick6/vol 49157 0 Y 361
Brick 10.3.3.23:/mnt/brick6/vol 49157 0 Y 359
Brick 10.3.3.33:/mnt/brick6/vol 49157 0 Y 403
Brick 10.3.3.43:/mnt/brick6/vol 49157 0 Y 360
Brick 10.3.3.9:/mnt/brick7/vol 49158 0 Y 432
Brick 10.3.3.19:/mnt/brick7/vol 49158 0 Y 430
Brick 10.3.3.29:/mnt/brick7/vol 49158 0 Y 430
Brick 10.3.3.10:/mnt/brick7/vol 49158 0 Y 430
Brick 10.3.3.20:/mnt/brick7/vol 49158 0 Y 432
Brick 10.3.3.30:/mnt/brick7/vol 49158 0 Y 369
Brick 10.3.3.11:/mnt/brick7/vol 49158 0 Y 432
Brick 10.3.3.21:/mnt/brick7/vol 49158 0 Y 430
Brick 10.3.3.39:/mnt/brick7/vol 49158 0 Y 858
Brick 10.3.3.12:/mnt/brick7/vol 49158 0 Y 430
Brick 10.3.3.22:/mnt/brick7/vol 49158 0 Y 401
Brick 10.3.3.40:/mnt/brick7/vol 49158 0 Y 369
Self-heal Daemon on localhost N/A N/A Y
15582
Quota Daemon on localhost N/A N/A Y
15590
Bitrot Daemon on localhost N/A N/A Y
15598
Scrubber Daemon on localhost N/A N/A Y
15607
Self-heal Daemon on 10.3.3.42 N/A N/A Y 1383
Quota Daemon on 10.3.3.42 N/A N/A Y 1391
Bitrot Daemon on 10.3.3.42 N/A N/A Y 1399
Scrubber Daemon on 10.3.3.42 N/A N/A Y 1408
Self-heal Daemon on 10.3.3.23 N/A N/A Y 4002
Quota Daemon on 10.3.3.23 N/A N/A Y 4010
Bitrot Daemon on 10.3.3.23 N/A N/A Y 4018
Scrubber Daemon on 10.3.3.23 N/A N/A Y 4027
Self-heal Daemon on 10.3.3.31 N/A N/A Y
15002
Quota Daemon on 10.3.3.31 N/A N/A Y
15010
Bitrot Daemon on 10.3.3.31 N/A N/A Y
15018
Scrubber Daemon on 10.3.3.31 N/A N/A Y
15027
Self-heal Daemon on 10.3.3.43 N/A N/A Y 9882
Quota Daemon on 10.3.3.43 N/A N/A Y 9890
Bitrot Daemon on 10.3.3.43 N/A N/A Y 9898
Scrubber Daemon on 10.3.3.43 N/A N/A Y 9907
Self-heal Daemon on 10.3.3.22 N/A N/A Y
15096
Quota Daemon on 10.3.3.22 N/A N/A Y
15104
Bitrot Daemon on 10.3.3.22 N/A N/A Y
15112
Scrubber Daemon on 10.3.3.22 N/A N/A Y
15121
Self-heal Daemon on 10.3.3.41 N/A N/A Y 9732
Quota Daemon on 10.3.3.41 N/A N/A Y 9740
Bitrot Daemon on 10.3.3.41 N/A N/A Y 9748
Scrubber Daemon on 10.3.3.41 N/A N/A Y 9757
Self-heal Daemon on 10.3.3.40 N/A N/A Y 5869
Quota Daemon on 10.3.3.40 N/A N/A Y 5877
Bitrot Daemon on 10.3.3.40 N/A N/A Y 5885
Scrubber Daemon on 10.3.3.40 N/A N/A Y 5894
Self-heal Daemon on 10.3.3.21 N/A N/A Y
15588
Quota Daemon on 10.3.3.21 N/A N/A Y
15596
Bitrot Daemon on 10.3.3.21 N/A N/A Y
15604
Scrubber Daemon on 10.3.3.21 N/A N/A Y
15613
Self-heal Daemon on ad06.pek.prod.com N/A N/A Y
16011
Quota Daemon on ad06.pek.prod.com N/A N/A Y 16019
Bitrot Daemon on ad06.pek.prod.com N/A N/A Y 16027
Scrubber Daemon on ad06.pek.prod.com N/A N/A Y
16036
Self-heal Daemon on 10.3.3.13 N/A N/A Y
15312
Quota Daemon on 10.3.3.13 N/A N/A Y
15320
Bitrot Daemon on 10.3.3.13 N/A N/A Y
15328
Scrubber Daemon on 10.3.3.13 N/A N/A Y
15337
Self-heal Daemon on 10.3.3.32 N/A N/A Y
15524
Quota Daemon on 10.3.3.32 N/A N/A Y
15532
Bitrot Daemon on 10.3.3.32 N/A N/A Y
15540
Scrubber Daemon on 10.3.3.32 N/A N/A Y
15549
Self-heal Daemon on 10.3.3.30 N/A N/A Y 5690
Quota Daemon on 10.3.3.30 N/A N/A Y 5698
Bitrot Daemon on 10.3.3.30 N/A N/A Y 5706
Scrubber Daemon on 10.3.3.30 N/A N/A Y 5715
Self-heal Daemon on 10.3.3.9 N/A N/A Y
15370
Quota Daemon on 10.3.3.9 N/A N/A Y
15378
Bitrot Daemon on 10.3.3.9 N/A N/A Y
15386
Scrubber Daemon on 10.3.3.9 N/A N/A Y
15395
Self-heal Daemon on 10.3.3.19 N/A N/A Y
15381
Quota Daemon on 10.3.3.19 N/A N/A Y
15389
Bitrot Daemon on 10.3.3.19 N/A N/A Y
15397
Scrubber Daemon on 10.3.3.19 N/A N/A Y
15406
Self-heal Daemon on 10.3.3.10 N/A N/A Y
15264
Quota Daemon on 10.3.3.10 N/A N/A Y
15272
Bitrot Daemon on 10.3.3.10 N/A N/A Y
15280
Scrubber Daemon on 10.3.3.10 N/A N/A Y
15289
Self-heal Daemon on 10.3.3.33 N/A N/A Y
15359
Quota Daemon on 10.3.3.33 N/A N/A Y
15367
Bitrot Daemon on 10.3.3.33 N/A N/A Y
15375
Scrubber Daemon on 10.3.3.33 N/A N/A Y
15384
Self-heal Daemon on 10.3.3.29 N/A N/A Y
15437
Quota Daemon on 10.3.3.29 N/A N/A Y
15445
Bitrot Daemon on 10.3.3.29 N/A N/A Y
15453
Scrubber Daemon on 10.3.3.29 N/A N/A Y
15462
Self-heal Daemon on 10.3.3.12 N/A N/A Y
15322
Quota Daemon on 10.3.3.12 N/A N/A Y
15330
Bitrot Daemon on 10.3.3.12 N/A N/A Y
15338
Scrubber Daemon on 10.3.3.12 N/A N/A Y
15347
Self-heal Daemon on 10.3.3.20 N/A N/A Y
15435
Quota Daemon on 10.3.3.20 N/A N/A Y
15443
Bitrot Daemon on 10.3.3.20 N/A N/A Y
15451
Scrubber Daemon on 10.3.3.20 N/A N/A Y
15460
Task Status of Volume gvol0
----------------------------------------------------------------------------
--
There are no active volume tasks
[root at aa08 /]# gluster volume heal gvol0 info
Brick 10.3.3.9:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.19:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.29:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.10:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.20:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.30:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.9:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.19:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.29:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.11:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.21:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.39:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.12:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.22:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.40:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.13:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.31:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.41:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.23:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.32:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.42:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.33:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.43:/mnt/brick1/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.10:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.20:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.30:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.40:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.11:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.21:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.39:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.12:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.22:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.31:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.13:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.32:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.41:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.23:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.33:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.42:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.9:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.19:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.29:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.10:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.20:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.43:/mnt/brick2/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.11:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.21:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.39:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.12:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.30:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.40:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.22:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.31:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.41:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.13:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.32:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.42:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.23:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.33:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.43:/mnt/brick3/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.9:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.19:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.29:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.10:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.20:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.30:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.11:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.21:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.39:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.12:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.22:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.40:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.13:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.31:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.41:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.10:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.33:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.43:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.23:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.32:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.42:/mnt/brick4/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.9:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.19:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.29:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.20:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.30:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.40:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.11:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.21:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.39:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.12:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.22:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.31:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.13:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.23:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.41:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.10:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.32:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.42:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.11:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.33:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.43:/mnt/brick5/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.9:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.19:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.29:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.20:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.30:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.40:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.21:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.31:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.41:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.12:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.22:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.39:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.13:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.32:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.42:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.23:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.33:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.43:/mnt/brick6/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.9:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.19:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.29:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.10:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.20:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.30:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.11:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.21:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.39:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.12:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.22:/mnt/brick7/vol
Status: Connected
Number of entries: 0
Brick 10.3.3.40:/mnt/brick7/vol
Status: Connected
Number of entries: 0
# gluster volume info
Volume Name: gvol0
Type: Distributed-Replicate
Volume ID: cc9f0101-0bc7-4a40-a813-a7e540593a2b
Status: Started
Snapshot Count: 0
Number of Bricks: 44 x 3 = 132
Transport-type: tcp
Bricks:
Brick1: 10.3.3.9:/mnt/brick1/vol
Brick2: 10.3.3.19:/mnt/brick1/vol
Brick3: 10.3.3.29:/mnt/brick1/vol
Brick4: 10.3.3.10:/mnt/brick1/vol
Brick5: 10.3.3.20:/mnt/brick1/vol
Brick6: 10.3.3.30:/mnt/brick1/vol
Brick7: 10.3.3.9:/mnt/brick2/vol
Brick8: 10.3.3.19:/mnt/brick2/vol
Brick9: 10.3.3.29:/mnt/brick2/vol
Brick10: 10.3.3.11:/mnt/brick1/vol
Brick11: 10.3.3.21:/mnt/brick1/vol
Brick12: 10.3.3.39:/mnt/brick1/vol
Brick13: 10.3.3.12:/mnt/brick1/vol
Brick14: 10.3.3.22:/mnt/brick1/vol
Brick15: 10.3.3.40:/mnt/brick1/vol
Brick16: 10.3.3.13:/mnt/brick1/vol
Brick17: 10.3.3.31:/mnt/brick1/vol
Brick18: 10.3.3.41:/mnt/brick1/vol
Brick19: 10.3.3.23:/mnt/brick1/vol
Brick20: 10.3.3.32:/mnt/brick1/vol
Brick21: 10.3.3.42:/mnt/brick1/vol
Brick22: 10.3.3.33:/mnt/brick1/vol
Brick23: 10.3.3.43:/mnt/brick1/vol
Brick24: 10.3.3.10:/mnt/brick2/vol
Brick25: 10.3.3.20:/mnt/brick2/vol
Brick26: 10.3.3.30:/mnt/brick2/vol
Brick27: 10.3.3.40:/mnt/brick2/vol
Brick28: 10.3.3.11:/mnt/brick2/vol
Brick29: 10.3.3.21:/mnt/brick2/vol
Brick30: 10.3.3.39:/mnt/brick2/vol
Brick31: 10.3.3.12:/mnt/brick2/vol
Brick32: 10.3.3.22:/mnt/brick2/vol
Brick33: 10.3.3.31:/mnt/brick2/vol
Brick34: 10.3.3.13:/mnt/brick2/vol
Brick35: 10.3.3.32:/mnt/brick2/vol
Brick36: 10.3.3.41:/mnt/brick2/vol
Brick37: 10.3.3.23:/mnt/brick2/vol
Brick38: 10.3.3.33:/mnt/brick2/vol
Brick39: 10.3.3.42:/mnt/brick2/vol
Brick40: 10.3.3.9:/mnt/brick3/vol
Brick41: 10.3.3.19:/mnt/brick3/vol
Brick42: 10.3.3.29:/mnt/brick3/vol
Brick43: 10.3.3.10:/mnt/brick3/vol
Brick44: 10.3.3.20:/mnt/brick3/vol
Brick45: 10.3.3.43:/mnt/brick2/vol
Brick46: 10.3.3.11:/mnt/brick3/vol
Brick47: 10.3.3.21:/mnt/brick3/vol
Brick48: 10.3.3.39:/mnt/brick3/vol
Brick49: 10.3.3.12:/mnt/brick3/vol
Brick50: 10.3.3.30:/mnt/brick3/vol
Brick51: 10.3.3.40:/mnt/brick3/vol
Brick52: 10.3.3.22:/mnt/brick3/vol
Brick53: 10.3.3.31:/mnt/brick3/vol
Brick54: 10.3.3.41:/mnt/brick3/vol
Brick55: 10.3.3.13:/mnt/brick3/vol
Brick56: 10.3.3.32:/mnt/brick3/vol
Brick57: 10.3.3.42:/mnt/brick3/vol
Brick58: 10.3.3.23:/mnt/brick3/vol
Brick59: 10.3.3.33:/mnt/brick3/vol
Brick60: 10.3.3.43:/mnt/brick3/vol
Brick61: 10.3.3.9:/mnt/brick4/vol
Brick62: 10.3.3.19:/mnt/brick4/vol
Brick63: 10.3.3.29:/mnt/brick4/vol
Brick64: 10.3.3.10:/mnt/brick4/vol
Brick65: 10.3.3.20:/mnt/brick4/vol
Brick66: 10.3.3.30:/mnt/brick4/vol
Brick67: 10.3.3.11:/mnt/brick4/vol
Brick68: 10.3.3.21:/mnt/brick4/vol
Brick69: 10.3.3.39:/mnt/brick4/vol
Brick70: 10.3.3.12:/mnt/brick4/vol
Brick71: 10.3.3.22:/mnt/brick4/vol
Brick72: 10.3.3.40:/mnt/brick4/vol
Brick73: 10.3.3.13:/mnt/brick4/vol
Brick74: 10.3.3.31:/mnt/brick4/vol
Brick75: 10.3.3.41:/mnt/brick4/vol
Brick76: 10.3.3.10:/mnt/brick5/vol
Brick77: 10.3.3.33:/mnt/brick4/vol
Brick78: 10.3.3.43:/mnt/brick4/vol
Brick79: 10.3.3.23:/mnt/brick4/vol
Brick80: 10.3.3.32:/mnt/brick4/vol
Brick81: 10.3.3.42:/mnt/brick4/vol
Brick82: 10.3.3.9:/mnt/brick5/vol
Brick83: 10.3.3.19:/mnt/brick5/vol
Brick84: 10.3.3.29:/mnt/brick5/vol
Brick85: 10.3.3.20:/mnt/brick5/vol
Brick86: 10.3.3.30:/mnt/brick5/vol
Brick87: 10.3.3.40:/mnt/brick5/vol
Brick88: 10.3.3.11:/mnt/brick5/vol
Brick89: 10.3.3.21:/mnt/brick5/vol
Brick90: 10.3.3.39:/mnt/brick5/vol
Brick91: 10.3.3.12:/mnt/brick5/vol
Brick92: 10.3.3.22:/mnt/brick5/vol
Brick93: 10.3.3.31:/mnt/brick5/vol
Brick94: 10.3.3.13:/mnt/brick5/vol
Brick95: 10.3.3.23:/mnt/brick5/vol
Brick96: 10.3.3.41:/mnt/brick5/vol
Brick97: 10.3.3.10:/mnt/brick6/vol
Brick98: 10.3.3.32:/mnt/brick5/vol
Brick99: 10.3.3.42:/mnt/brick5/vol
Brick100: 10.3.3.11:/mnt/brick6/vol
Brick101: 10.3.3.33:/mnt/brick5/vol
Brick102: 10.3.3.43:/mnt/brick5/vol
Brick103: 10.3.3.9:/mnt/brick6/vol
Brick104: 10.3.3.19:/mnt/brick6/vol
Brick105: 10.3.3.29:/mnt/brick6/vol
Brick106: 10.3.3.20:/mnt/brick6/vol
Brick107: 10.3.3.30:/mnt/brick6/vol
Brick108: 10.3.3.40:/mnt/brick6/vol
Brick109: 10.3.3.21:/mnt/brick6/vol
Brick110: 10.3.3.31:/mnt/brick6/vol
Brick111: 10.3.3.41:/mnt/brick6/vol
Brick112: 10.3.3.12:/mnt/brick6/vol
Brick113: 10.3.3.22:/mnt/brick6/vol
Brick114: 10.3.3.39:/mnt/brick6/vol
Brick115: 10.3.3.13:/mnt/brick6/vol
Brick116: 10.3.3.32:/mnt/brick6/vol
Brick117: 10.3.3.42:/mnt/brick6/vol
Brick118: 10.3.3.23:/mnt/brick6/vol
Brick119: 10.3.3.33:/mnt/brick6/vol
Brick120: 10.3.3.43:/mnt/brick6/vol
Brick121: 10.3.3.9:/mnt/brick7/vol
Brick122: 10.3.3.19:/mnt/brick7/vol
Brick123: 10.3.3.29:/mnt/brick7/vol
Brick124: 10.3.3.10:/mnt/brick7/vol
Brick125: 10.3.3.20:/mnt/brick7/vol
Brick126: 10.3.3.30:/mnt/brick7/vol
Brick127: 10.3.3.11:/mnt/brick7/vol
Brick128: 10.3.3.21:/mnt/brick7/vol
Brick129: 10.3.3.39:/mnt/brick7/vol
Brick130: 10.3.3.12:/mnt/brick7/vol
Brick131: 10.3.3.22:/mnt/brick7/vol
Brick132: 10.3.3.40:/mnt/brick7/vol
Options Reconfigured:
nfs.disable: on
performance.readdir-ahead: on
transport.address-family: inet
features.quota: on
features.inode-quota: on
features.quota-deem-statfs: on
cluster.quorum-type: auto
features.quota-timeout: 10
features.bitrot: on
features.scrub: Active
performance.cache-size: 4GB
diagnostics.latency-measurement: on
diagnostics.count-fop-hits: on
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20170103/220de743/attachment.html>
More information about the Gluster-users
mailing list