<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Hi Felix,<div class=""><br class=""></div><div class="">I am adding the details inline. Will open an issue to update the doc. Thanks for reporting.</div><div class=""><br class=""></div><div class="">Let me know if any of these needs more clarity.<br class=""><div><br class=""><blockquote type="cite" class=""><div class="">On 08-Oct-2020, at 12:42 AM, Felix Kölzow <<a href="mailto:felix.koelzow@gmx.de" class="">felix.koelzow@gmx.de</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="">Dear Community,<br class=""><br class=""><br class="">actually, I am looking for a more detailed explaination of all<br class="">geo-replication options which can be obtained by the command:<br class=""><br class=""><br class="">gluster volume geo-replication master-vol slave-node::slave-volume config<br class=""><br class=""><br class="">I only found<br class=""><br class=""><a href="https://docs.gluster.org/en/latest/Administrator%20Guide/Geo%20Replication/" class="">https://docs.gluster.org/en/latest/Administrator%20Guide/Geo%20Replication/</a><br class=""><br class="">but i am wondering if there is a more detailed explanation of all the<br class="">other options listed below.<br class=""><br class=""><br class="">Thanks in advance.<br class=""><br class="">Felix<br class=""><br class="">access_mount:false<br class=""></div></div></blockquote>Internal Gluster mounts created by Geo-rep are not accessible from outside. With this option, these mounts can be accessed from outside. Useful for debugging purposes.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">allow_network:<br class="">change_detector:changelog<br class=""></div></div></blockquote>Use changelogs to detect the changes happened in the Primary Volume. Other available option is xsync which is File system crawl and known limitation to detect deletes.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">change_interval:5<br class=""></div></div></blockquote>Changelogs rollover interval</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">changelog_archive_format:%Y%m<br class=""></div></div></blockquote>Processed changelogs will be stored in working directory partitioned by the specified format.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">changelog_batch_size:727040<br class=""></div></div></blockquote>Bytes to limit the changelogs in Batches. Mostly useful if backlog to sync is more.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">changelog_log_file:/var/log/glusterfs/geo-replication/<br class=""></div></div></blockquote>Changelogs processing log files directory</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">changelog_log_level:INFO<br class=""></div></div></blockquote>Changelogs processing log level</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">checkpoint:0<br class=""></div></div></blockquote><div>Time will be set here when checkpoint command is run.</div><div><br class=""></div><blockquote type="cite" class=""><div class=""><div class="">cli_log_file:/var/log/glusterfs/geo-replication/cli.log<br class=""></div></div></blockquote>CLI Log file path</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">cli_log_level:INFO<br class=""></div></div></blockquote>CLI log level</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">connection_timeout:60<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">georep_session_working_dir:/var/lib/glusterd/geo-replication<br class=""></div></div></blockquote>Geo-rep Working dir to store config, status etc</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">gfid_conflict_resolution:true<br class=""></div></div></blockquote><div>This enables automatic resolution to GFID conflicts in Secondary Volume.</div><br class=""><blockquote type="cite" class=""><div class=""><div class="">gluster_cli_options:<br class=""></div></div></blockquote>Geo-rep runs Gluster CLI when needed, any extra options can be provided using this.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">gluster_command:gluster<br class=""></div></div></blockquote>If command name is different.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">gluster_command_dir:/usr/sbin<br class=""></div></div></blockquote>If gluster command is not in PATH(gluster_command_dir=/usr/local/sbin)</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">gluster_log_file:/var/log/glusterfs/geo-replication/<br class=""></div></div></blockquote>Gluster mount(Mounted by Geo-rep process) log directory</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">gluster_log_level:INFO<br class=""></div></div></blockquote>Gluster mount(Mounted by Geo-rep process) log level</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">gluster_logdir:/var/log/glusterfs<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">gluster_params:aux-gfid-mount acl<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">gluster_rundir:/var/run/gluster<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">glusterd_workdir:/var/lib/glusterd<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">gsyncd_miscdir:/var/lib/misc/gluster/gsyncd<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">ignore_deletes:false<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">isolated_slaves:<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">log_file:/var/log/glusterfs/geo-replication/<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">log_level:INFO<br class=""></div></div></blockquote><br class=""><blockquote type="cite" class=""><div class=""><div class="">log_rsync_performance:true<br class=""></div></div></blockquote>After every batches records Rsync performance metrics in log file<br class=""><br class=""><blockquote type="cite" class=""><div class=""><div class="">master_disperse_count:1<br class=""></div></div></blockquote>Not used now<br class=""><br class=""><blockquote type="cite" class=""><div class=""><div class="">master_distribution_count:2<br class=""></div></div></blockquote>Not used now</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">master_replica_count:1<br class=""></div></div></blockquote>Not used now</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">max_rsync_retries:10<br class=""></div></div></blockquote>In case of rsync errors, maximum number of retries</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">meta_volume_mnt:/var/run/gluster/shared_storage<br class=""></div></div></blockquote><div>If meta volume is used for Active/Passive switching then the mount path.</div><br class=""><blockquote type="cite" class=""><div class=""><div class="">pid_file:<br class=""></div></div></blockquote>Path of Geo-rep worker PID file<br class=""><br class=""><blockquote type="cite" class=""><div class=""><div class="">remote_gsyncd:<br class=""></div></div></blockquote>Path of remote_gsyncd. No need to change this since Geo-rep ssh connection uses proper path prefix in .ssh/authorized_keys file<br class=""><br class=""><blockquote type="cite" class=""><div class=""><div class="">replica_failover_interval:1<br class=""></div></div></blockquote>In case of Active worker goes down, interval to make Passive worker becomes Active.<br class=""><br class=""><blockquote type="cite" class=""><div class=""><div class="">rsync_command:rsync<br class=""></div></div></blockquote>If rsync command is not in PATH(rsync_command=/usr/local/bin/rsync)<br class=""><br class=""><blockquote type="cite" class=""><div class=""><div class="">rsync_opt_existing:true<br class=""></div></div></blockquote>Adds `—existing` to rsync command<br class=""><br class=""><blockquote type="cite" class=""><div class=""><div class="">rsync_opt_ignore_missing_args:true<br class=""></div></div></blockquote>Adds `<span style="caret-color: rgb(3, 47, 98); color: rgb(3, 47, 98); font-family: SFMono-Regular, Consolas, "Liberation Mono", Menlo, monospace; white-space: pre; background-color: rgb(255, 255, 255);" class="">--ignore-missing-args` to rsync command. Helps to avoid retries in case of file is deleted in Primary Volume at the time of syncing.</span><br class=""><br class=""><blockquote type="cite" class=""><div class=""><div class="">rsync_options:-h<br class=""></div></div></blockquote>Extra Options to Rsync</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">rsync_ssh_options:<br class=""></div></div></blockquote>Extra options to SSH command</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">slave_access_mount:false<br class=""></div></div></blockquote>Same as access_mount, for debugging purpose<br class=""><br class=""><blockquote type="cite" class=""><div class=""><div class="">slave_gluster_command_dir:/usr/sbin</div></div></blockquote>Gluster command directory in remote nodes(Secondary volume)</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">slave_gluster_log_file:/var/log/glusterfs/geo-replication-slaves/<br class=""></div></div></blockquote>Log dir path</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">slave_gluster_log_file_mbr:/var/log/glusterfs/geo-replication-slaves<br class=""></div></div></blockquote><div>Log directory path in case of non-root Geo-replication</div><br class=""><blockquote type="cite" class=""><div class=""><div class="">slave_gluster_log_level:INFO<br class=""></div></div></blockquote>Log level for Gluster mounts done by Geo-rep process remote side.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">slave_gluster_params:aux-gfid-mount acl<br class=""></div></div></blockquote>Parameters to Remote mount</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">slave_log_file:/var/log/glusterfs/geo-replication-slaves/<br class=""></div></div></blockquote>Log file for Remote errors</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">slave_log_level:INFO<br class=""></div></div></blockquote>Log level in remote side</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">slave_timeout:120<br class=""></div></div></blockquote>SSH connections timeout</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">special_sync_mode:<br class=""></div></div></blockquote>This is required to set during the failover</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">ssh_command:ssh<br class=""></div></div></blockquote>If ssh command is not in PATH(ssh_command=/usr/local/sbin/ssh)</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">ssh_options:-oPasswordAuthentication=no -oStrictHostKeyChecking=no -i<br class="">/var/lib/glusterd/geo-replication/secret.pem<br class=""></div></div></blockquote>If any additional option to ssh command.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">ssh_options_tar:-oPasswordAuthentication=no -oStrictHostKeyChecking=no<br class="">-i /var/lib/glusterd/geo-replication/tar_ssh.pem<br class=""></div></div></blockquote>If any additional option to tar + ssh command.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">ssh_port:22<br class=""></div></div></blockquote>SSH port for all SSH connection between Primary Volume to Secondary volume.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">state_file:/var/lib/glusterd/geo-replication/<br class=""></div></div></blockquote>Status file directory</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">state_socket_unencoded:<br class=""></div></div></blockquote>Internal</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">stime_xattr_prefix:<br class=""></div></div></blockquote>Internal</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">sync_acls:true<br class=""></div></div></blockquote>Sync Posix Acls to remote volume.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">sync_jobs:3<br class=""></div></div></blockquote><div>Number of parallel rsync/tar processes to sync</div><br class=""><blockquote type="cite" class=""><div class=""><div class="">sync_method:rsync<br class=""></div></div></blockquote><div><br class=""></div>Supported sync methods are rsync and tarssh. rsync - After change detection, uses rsync to sync files. tarssh - After change detection, uses tar + ssh to sync files.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">sync_xattrs:true<br class=""></div></div></blockquote>Same as use_rsync_xattrs, but it is having a known issue of not working in tarssh mode</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">tar_command:tar<br class=""></div></div></blockquote>In case tar command is not in Path(`tar_command=/usr/local/bin/tar`)</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">use_meta_volume:true<br class=""></div></div></blockquote>In case of Replica bricks only one brick’s worker will be Active and participant in syncing. Other workers will be Passive and becomes active if the previously Active one goes down. With this option Geo-rep maintains a lock file in Meta Volume. Without this option, Geo-rep uses node uuid to detect Active/Passive.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">use_rsync_xattrs:false<br class=""></div></div></blockquote>Sync user created xattrs to remote volume.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class="">working_dir:/var/lib/misc/gluster/gsyncd/…..<br class=""></div></div></blockquote>Not Configurable, Working directory to store the processed changelog files.</div><div><br class=""><blockquote type="cite" class=""><div class=""><div class=""><br class="">________<br class=""><br class=""><br class=""><br class="">Community Meeting Calendar:<br class=""><br class="">Schedule -<br class="">Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC<br class="">Bridge: <a href="https://bluejeans.com/441850968" class="">https://bluejeans.com/441850968</a><br class=""><br class="">Gluster-users mailing list<br class=""><a href="mailto:Gluster-users@gluster.org" class="">Gluster-users@gluster.org</a><br class="">https://lists.gluster.org/mailman/listinfo/gluster-users<br class=""></div></div></blockquote></div><br class=""><div class="">
<div>Aravinda Vishwanathapura</div><div><a href="https://kadalu.io" class="">https://kadalu.io</a></div><div class=""><br class=""></div><br class="Apple-interchange-newline">
</div>
<br class=""></div></body></html>