[Gluster-users] Geo-rep failing initial sync

Wade Fitzpatrick wade.fitzpatrick at ladbrokes.com.au
Mon Oct 19 04:29:24 UTC 2015


I have now tried to re-initialise the whole geo-rep setup but the 
replication slave went Faulty immediately. Any help here would be 
appreciated, I cannot even find how to recover a faulty node without 
recreating the geo-rep.

root at james:~# gluster volume geo-replication static gluster-b1::static stop
Stopping geo-replication session between static & gluster-b1::static has 
been successful
root at james:~# gluster volume geo-replication static gluster-b1::static 
delete
Deleting geo-replication session between static & gluster-b1::static has 
been successful

I then destroyed the volume and re-created bricks on gluster-b1::static 
slave volume.

root at palace:~# gluster volume stop static
Stopping volume will make its data inaccessible. Do you want to 
continue? (y/n) y
volume stop: static: success
root at palace:~# gluster volume delete static
Deleting volume will erase all information about the volume. Do you want 
to continue? (y/n) y
volume delete: static: success

root at palace:~# gluster volume create static stripe 2 transport tcp 
palace:/data/gluster1/static/brick1 madonna:/data/gluster1/static/brick2
volume create: static: success: please start the volume to access data
root at palace:~# gluster volume info

Volume Name: static
Type: Stripe
Volume ID: dc14cd83-2736-4faf-8e11-c6d711ff8f56
Status: Created
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: palace:/data/gluster1/static/brick1
Brick2: madonna:/data/gluster1/static/brick2
Options Reconfigured:
performance.readdir-ahead: on
root at palace:~# gluster volume start static
volume start: static: success


Then established the geo-rep sync again

root at james:~# gluster volume geo-replication static 
ssh://gluster-b1::static create
Creating geo-replication session between static & 
ssh://gluster-b1::static has been successful
root at james:~# gluster volume geo-replication static 
ssh://gluster-b1::static config use_meta_volume true
geo-replication config updated successfully
root at james:~# gluster volume geo-replication static 
ssh://gluster-b1::static config use-tarssh true
geo-replication config updated successfully

root at james:~# gluster volume geo-replication static 
ssh://gluster-b1::static config
special_sync_mode: partial
state_socket_unencoded: 
/var/lib/glusterd/geo-replication/static_gluster-b1_static/ssh%3A%2F%2Froot%40palace%3Agluster%3A%2F%2F127.0.0.1%3Astatic.socket
gluster_log_file: 
/var/log/glusterfs/geo-replication/static/ssh%3A%2F%2Froot%40palace%3Agluster%3A%2F%2F127.0.0.1%3Astatic.gluster.log
ssh_command: ssh -oPasswordAuthentication=no -oStrictHostKeyChecking=no 
-i /var/lib/glusterd/geo-replication/secret.pem
use_tarssh: true
ignore_deletes: false
change_detector: changelog
gluster_command_dir: /usr/sbin/
state_file: 
/var/lib/glusterd/geo-replication/static_gluster-b1_static/ssh%3A%2F%2Froot%40palace%3Agluster%3A%2F%2F127.0.0.1%3Astatic.status
remote_gsyncd: /nonexistent/gsyncd
log_file: 
/var/log/glusterfs/geo-replication/static/ssh%3A%2F%2Froot%40palace%3Agluster%3A%2F%2F127.0.0.1%3Astatic.log
changelog_log_file: 
/var/log/glusterfs/geo-replication/static/ssh%3A%2F%2Froot%40palace%3Agluster%3A%2F%2F127.0.0.1%3Astatic-changes.log
socketdir: /var/run/gluster
working_dir: 
/var/lib/misc/glusterfsd/static/ssh%3A%2F%2Froot%40palace%3Agluster%3A%2F%2F127.0.0.1%3Astatic
state_detail_file: 
/var/lib/glusterd/geo-replication/static_gluster-b1_static/ssh%3A%2F%2Froot%40palace%3Agluster%3A%2F%2F127.0.0.1%3Astatic-detail.status
use_meta_volume: true
ssh_command_tar: ssh -oPasswordAuthentication=no 
-oStrictHostKeyChecking=no -i /var/lib/glusterd/geo-replication/tar_ssh.pem
pid_file: 
/var/lib/glusterd/geo-replication/static_gluster-b1_static/ssh%3A%2F%2Froot%40palace%3Agluster%3A%2F%2F127.0.0.1%3Astatic.pid
georep_session_working_dir: 
/var/lib/glusterd/geo-replication/static_gluster-b1_static/
gluster_params: aux-gfid-mount acl

root at james:~# gluster volume geo-replication static 
ssh://gluster-b1::static start
Geo-replication session between static and ssh://gluster-b1::static does 
not exist.
geo-replication command failed
root at james:~# gluster volume geo-replication static 
ssh://gluster-b1::static status detail

MASTER NODE    MASTER VOL    MASTER BRICK                    SLAVE 
USER    SLAVE                       SLAVE NODE    STATUS    CRAWL 
STATUS    LAST_SYNCED    ENTRY    DATA    META    FAILURES CHECKPOINT 
TIME    CHECKPOINT COMPLETED    CHECKPOINT COMPLETION TIME
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
james          static        /data/gluster1/static/brick1 root          
ssh://gluster-b1::static    N/A           N/A N/A             
N/A            N/A      N/A     N/A N/A         N/A                
N/A                     N/A
hilton         static        /data/gluster1/static/brick3 root          
ssh://gluster-b1::static    N/A           N/A N/A             
N/A            N/A      N/A     N/A N/A         N/A                
N/A                     N/A
present        static        /data/gluster1/static/brick4 root          
ssh://gluster-b1::static    N/A           N/A N/A             
N/A            N/A      N/A     N/A N/A         N/A                
N/A                     N/A
cupid          static        /data/gluster1/static/brick2 root          
ssh://gluster-b1::static    N/A           N/A N/A             
N/A            N/A      N/A     N/A N/A         N/A                
N/A                     N/A

root at james:~# gluster volume geo-replication static 
ssh://gluster-b1::static start
Starting geo-replication session between static & 
ssh://gluster-b1::static has been successful
root at james:~# gluster volume geo-replication static 
ssh://gluster-b1::static status detail

MASTER NODE    MASTER VOL    MASTER BRICK                    SLAVE 
USER    SLAVE                       SLAVE NODE STATUS             CRAWL 
STATUS    LAST_SYNCED    ENTRY    DATA META    FAILURES    CHECKPOINT 
TIME    CHECKPOINT COMPLETED CHECKPOINT COMPLETION TIME
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
james          static        /data/gluster1/static/brick1 root          
ssh://gluster-b1::static    N/A Initializing...    N/A             
N/A            N/A      N/A N/A     N/A         N/A                
N/A                     N/A
hilton         static        /data/gluster1/static/brick3 root          
ssh://gluster-b1::static    palace Active             Hybrid Crawl    
N/A            0        0 0       0           N/A                
N/A                     N/A
present        static        /data/gluster1/static/brick4 root          
ssh://gluster-b1::static    madonna Passive            N/A             
N/A            N/A      N/A N/A     N/A         N/A                
N/A                     N/A
cupid          static        /data/gluster1/static/brick2 root          
ssh://gluster-b1::static    madonna Active             Hybrid Crawl    
N/A            0        0 0       0           N/A                
N/A                     N/A
root at james:~# gluster volume geo-replication static 
ssh://gluster-b1::static status detail

MASTER NODE    MASTER VOL    MASTER BRICK                    SLAVE 
USER    SLAVE                       SLAVE NODE    STATUS     CRAWL 
STATUS    LAST_SYNCED    ENTRY    DATA    META    FAILURES CHECKPOINT 
TIME    CHECKPOINT COMPLETED    CHECKPOINT COMPLETION TIME
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
james          static        /data/gluster1/static/brick1 root          
ssh://gluster-b1::static    N/A           Faulty N/A             
N/A            N/A      N/A     N/A N/A         N/A                
N/A                     N/A
hilton         static        /data/gluster1/static/brick3 root          
ssh://gluster-b1::static    palace        Active Hybrid Crawl    
N/A            8191     8187    0 0           N/A                
N/A                     N/A
present        static        /data/gluster1/static/brick4 root          
ssh://gluster-b1::static    madonna       Passive N/A             
N/A            N/A      N/A     N/A N/A         N/A                
N/A                     N/A
cupid          static        /data/gluster1/static/brick2 root          
ssh://gluster-b1::static    madonna       Active Hybrid Crawl    
N/A            8191     8187    0 0           N/A                
N/A                     N/A



More information about the Gluster-users mailing list