<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body>
    <p>Hello Felix,</p>
    <p>thank you for your reply...</p>
    <p>batch-fsync-delay-usec was already set to 0 and I increased the
      sync_jobs from 3 to 6. In the moment I increased the sync_jobs
      following error appeared in gsyncd.log :<br>
    </p>
    <p>[2021-03-03 23:17:46.59727] E [syncdutils(worker
      /brick1/mvol1):312:log_raise_exception] &lt;top&gt;: connection to
      peer is broken<br>
      [2021-03-03 23:17:46.59912] E [syncdutils(worker
      /brick2/mvol1):312:log_raise_exception] &lt;top&gt;: connection to
      peer is broken</p>
    <p>passive nodes became active and the content in
      &lt;brick&gt;/.processing was removed. currently new changelog
      files are created in this directory.</p>
    <p>shortly before I changed the sync_jobs I have checked the
      &lt;brick&gt;/.processing directory on the master nodes. the
      result was the same for every master node.</p>
    <p>since the last error about 12 hours ago nearly 2400 changelog
      files were created on each node but it looks like none of them
      were consumed.</p>
    <p>in the moment I'm not sure what is right and what is wrong...<span class="VIiyi" lang="en"><span class="JLqJ4b ChMk0b" data-language-for-alternatives="en" data-language-to-translate-into="de" data-phrase-index="0"><span>should
            at least the oldest changelog files in this directory have
            been processed gradually ?</span></span></span> </p>
    <p>best regards</p>
    <p>Dietmar</p>
    <p><br>
    </p>
    <font face="monospace">[ 00:12:57 ] - putz@centreon-3qmedien&nbsp;
      ~/central $./mycommand.sh -H gl-master -c &quot;ls -l
/var/lib/misc/gluster/gsyncd/mvol1_gl-slave-01-int_svol1/brick1-mvol1/.processing/&quot;</font><br>
    <br>
    <font face="monospace">Host : gl-master-01</font><br>
    <font face="monospace">total 9824</font><br>
    <font face="monospace">-rw-r--r-- 1 root root&nbsp; 268 Mar&nbsp; 3 12:02
      CHANGELOG.1614772950</font><br>
    <font face="monospace">-rw-r--r-- 1 root root 1356 Mar&nbsp; 3 12:02
      CHANGELOG.1614772965</font><br>
    <font face="monospace">-rw-r--r-- 1 root root 1319 Mar&nbsp; 3 12:03
      CHANGELOG.1614772980</font><br>
    <font face="monospace">...</font><br>
    <font face="monospace">-rw-r--r-- 1 root root&nbsp; 693 Mar&nbsp; 3 23:10
      CHANGELOG.1614813002<br>
      -rw-r--r-- 1 root root&nbsp;&nbsp; 48 Mar&nbsp; 3 23:12 CHANGELOG.1614813170<br>
      -rw-r--r-- 1 root root 1222 Mar&nbsp; 3 23:13 CHANGELOG.1614813226</font><br>
    <br>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 03.03.21 20:41, Felix Kölzow wrote:<br>
    </div>
    <blockquote type="cite" cite="mid:7d55beec-86b7-96a0-dcd2-944531eac489@gmx.de">
      
      <p>Dear Dietmar, <br>
      </p>
      <p><br>
      </p>
      <p>I am very interested in helping you with that geo-replication,
        since we also have a setup with geo-replication that is crucial
        for the <br>
      </p>
      <p>backup procedure. I just had a quick look at this and for the
        moment, I just can suggest:</p>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"> </span></p>
      <blockquote type="cite"><span style="color: rgb(0, 0, 0);
          font-family: &quot;open sans&quot;, &quot;lucida grande&quot;,
          sans-serif; font-size: 15px; font-style: normal;
          font-variant-ligatures: normal; font-variant-caps: normal;
          font-weight: 400; letter-spacing: normal; orphans: 2;
          text-align: start; text-indent: 0px; text-transform: none;
          white-space: normal; widows: 2; word-spacing: 0px;
          -webkit-text-stroke-width: 0px; background-color: rgb(255,
          255, 255); text-decoration-thickness: initial;
          text-decoration-style: initial; text-decoration-color:
          initial; display: inline !important; float: none;">is there
          any suitable setting in the gluster-environment which would
          take influence on the speed of the processing (current
          settings attached) ?</span></blockquote>
      gluster volume geo-replication <font face="monospace">mvol1
        gl-slave-05-int::svol&nbsp; config sync_jobs&nbsp; 9</font>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"><font face="monospace"><br>
          </font></span></p>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"><font face="monospace">in order to
            increase the number of rsync processes. <br>
          </font></span></p>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"><font face="monospace">Furthermore,
            taken from
            <a class="moz-txt-link-freetext" href="https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.5/html/administration_guide/recommended_practices3" moz-do-not-send="true">https://access.redhat.com/documentation/en-us/red_hat_gluster_storage/3.5/html/administration_guide/recommended_practices3</a><br>
          </font></span></p>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"><font face="monospace"><br>
          </font></span></p>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"><font face="monospace"> </font></span></p>
      <blockquote type="cite"><font face="monospace">
          <div class="para">
            <div class="title">Performance Tuning</div>
            <p> When the following option is set, it has been observed
              that there is an increase in geo-replication performance.
              On the slave volume, run the following command: </p>
          </div>
          <pre class="screen"># <code class="command">gluster volume set <em class="replaceable">SLAVE_VOL</em> batch-fsync-delay-usec 0</code></pre>
        </font></blockquote>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"><font face="monospace">Can you
            verify that the changelog-files are consumed?</font></span></p>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"><font face="monospace"><br>
          </font></span></p>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"><font face="monospace">Regards,</font></span></p>
      <p><span style="color: rgb(0, 0, 0); font-family: &quot;open
          sans&quot;, &quot;lucida grande&quot;, sans-serif; font-size:
          15px; font-style: normal; font-variant-ligatures: normal;
          font-variant-caps: normal; font-weight: 400; letter-spacing:
          normal; orphans: 2; text-align: start; text-indent: 0px;
          text-transform: none; white-space: normal; widows: 2;
          word-spacing: 0px; -webkit-text-stroke-width: 0px;
          background-color: rgb(255, 255, 255);
          text-decoration-thickness: initial; text-decoration-style:
          initial; text-decoration-color: initial; display: inline
          !important; float: none;"><font face="monospace">Felix</font></span></p>
      <div class="moz-cite-prefix">On 03/03/2021 17:28, Dietmar Putz
        wrote:<br>
      </div>
      <blockquote type="cite" cite="mid:fc56548d-708d-14d6-fc71-cc8946adba5d@3q.video">
        <p>Hi,</p>
        <div class="moz-forward-container"><span class="VIiyi" lang="en"><span class="JLqJ4b ChMk0b" data-language-for-alternatives="en" data-language-to-translate-into="de" data-phrase-index="0"><span>I'm
                having a problem with geo-replication.</span></span> <span class="JLqJ4b ChMk0b" data-language-for-alternatives="en" data-language-to-translate-into="de" data-phrase-index="1"><span>A
                short summary...</span></span></span> </div>
        <div class="moz-forward-container">About two month ago I have
          added two further nodes to a distributed replicated volume.
          For that purpose I have stopped the geo-replication, added two
          nodes on mvol and svol and started a rebalance process on both
          sides. Once the rebalance process was finished I startet the
          geo-replication again.<br>
          <br>
          After a few days and beside some Unicode Errors the status of
          the new added brick changed from hybrid crawl to history
          crawl. Since then no progress, no files / directories have
          been created on svol for a couple of days. <br>
        </div>
        <div class="moz-forward-container"><br>
        </div>
        <div class="moz-forward-container">Looking for a possible reason
          I recognized that there is was
          /var/log/glusterfs/geo-replication-slaves/mvol1_gl-slave-01-int_svol1
          directory on the new added slave nodes.</div>
        <div class="moz-forward-container">Obviously I forgot to add the
          new svol node IP addresses on all master's /etc/hosts. After
          fixing that I did the '... execute gsec_create' and '...create
          push-pem force' command again and corresponding directory were
          created. Geo-replication started normal, all active sessions
          were in history crawl (as shown below) and for a short while
          some data were transfered to svol. But for about a week
          nothing had changed on svol, 0 byte transferred.<br>
        </div>
        <div class="moz-forward-container"><br>
        </div>
        <div class="moz-forward-container">Meanwhile i have deleted
          (without reset-sync-time) and recreated the geo-rep session.
          the current status is as shown below but without any
          last_synced date.</div>
        <div class="moz-forward-container">an entry like
          &quot;last_synced_entry&quot;: 1609283145 is still visible in
          /var/lib/glusterd/geo-replication/mvol1_gl-slave-01-int_svol1/*status
          and changelog files are continously created in
/var/lib/misc/gluster/gsyncd/mvol1_gl-slave-01-int_svol1/&lt;brick&gt;/.processing.
          <br>
        </div>
        <div class="moz-forward-container"><br>
        </div>
        <div class="moz-forward-container">Short time ago i changed
          log_level to DEBUG for a moment. Unfortunately I got an
          'EOFError: Ran out of input' in gsyncd.log and rebuild of
          .processing starts from beginning.&nbsp; <br>
        </div>
        <div class="moz-forward-container">But one of the first very
          long lines in gsyncd.log looks like :<br>
        </div>
        <div class="moz-forward-container"><br>
        </div>
        <div class="moz-forward-container"><font face="monospace">[2021-03-03
            11:59:39.503881] D [repce(worker
            /brick1/mvol1):215:__call__] RepceClient: call
            9163:139944064358208:1614772779.4982471 history_getchanges
            -&gt;
['/var/lib/misc/gluster/gsyncd/mvol1_gl-slave-01-int_svol1/brick1-mvol1/.history/.processing/CHANGELOG.1609280278',...</font></div>
        <div class="moz-forward-container"><br>
        </div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">1609280278
            means Tuesday, December 29, 2020 10:17:58 PM and would
            somehow fit to the last_synced date.</span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;"><br>
          </span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">However,
            I got nearly 300k files in
            &lt;brick&gt;/.history/.processing and in in log/trace it
            seems that any file in &lt;brick&gt;/.history/.processing
            will be processed and transferred to
            &lt;brick&gt;/.processing. <br>
          </span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">My
            questions so far...</span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">first of
            all, is everything still ok with this geo-replication ?</span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">do i have
            to wait until all changelog files in
            &lt;brick&gt;/.history/.processing are processed until
            transfers to svol start ?</span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">what
            happens if any other error appears in geo-replication while
            these changelog files are processed resp. crawl status is
            history crawl ... does the entire process starts from the
            beginning ? would a checkpiont be helpful...for future
            decisions...?</span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">is there
            any suitable setting in the gluster-environment which would
            take influence on the speed of the processing (current
            settings attached) ?</span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;"><br>
          </span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;"><br>
          </span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">I hope
            someone can help...</span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;"><br>
          </span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">best
            regards</span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;">dietmar<br>
          </span></div>
        <div class="moz-forward-container"><span style="color: rgb(0, 0,
            0); font-family: &quot;open sans&quot;, &quot;lucida
            grande&quot;, sans-serif; font-size: 15px; font-style:
            normal; font-variant-ligatures: normal; font-variant-caps:
            normal; font-weight: 400; letter-spacing: normal; orphans:
            2; text-align: start; text-indent: 0px; text-transform:
            none; white-space: normal; widows: 2; word-spacing: 0px;
            -webkit-text-stroke-width: 0px; background-color: rgb(255,
            255, 255); text-decoration-thickness: initial;
            text-decoration-style: initial; text-decoration-color:
            initial; display: inline !important; float: none;"><br>
          </span></div>
        <div class="moz-forward-container"><br>
        </div>
        <div class="moz-forward-container"><br>
        </div>
        <div class="moz-forward-container"> <font face="monospace">[
            15:17:47 ] - root@gl-master-01&nbsp;
/var/lib/misc/gluster/gsyncd/mvol1_gl-slave-01-int_svol1/brick1-mvol1/.history
            $ls .processing/ | wc -l<br>
            294669</font></div>
        <div class="moz-forward-container"><br>
        </div>
        <div class="moz-forward-container"><font face="monospace">[
            12:56:31 ] - root@gl-master-01&nbsp; ~ $gluster volume
            geo-replication mvol1 gl-slave-01-int::svol1 status<br>
            <br>
            MASTER NODE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; MASTER VOL&nbsp;&nbsp;&nbsp; MASTER BRICK&nbsp;&nbsp;&nbsp;&nbsp; SLAVE
            USER SLAVE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; SLAVE NODE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; STATUS&nbsp;&nbsp;&nbsp;&nbsp;
            CRAWL STATUS&nbsp;&nbsp;&nbsp;&nbsp; LAST_SYNCED<br>
----------------------------------------------------------------------------------------------------------------------------------------------------<br>
            gl-master-01-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick1/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-05-int&nbsp;&nbsp;&nbsp; Active&nbsp;&nbsp;&nbsp;&nbsp;
            History Crawl&nbsp;&nbsp;&nbsp; 2020-12-29 23:00:48<br>
            gl-master-01-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick2/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-03-int&nbsp;&nbsp;&nbsp; Active&nbsp;&nbsp;&nbsp;&nbsp;
            History Crawl&nbsp;&nbsp;&nbsp; 2020-12-29 23:05:45<br>
            gl-master-05-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick1/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-03-int&nbsp;&nbsp;&nbsp; Active&nbsp;&nbsp;&nbsp;&nbsp;
            History Crawl&nbsp;&nbsp;&nbsp; 2021-02-20 17:38:38<br>
            gl-master-06-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick1/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-06-int&nbsp;&nbsp;&nbsp; Passive &nbsp;&nbsp;
            N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A<br>
            gl-master-03-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick1/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-05-int&nbsp;&nbsp;&nbsp; Passive &nbsp;&nbsp;
            N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A<br>
            gl-master-03-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick2/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-04-int&nbsp;&nbsp;&nbsp; Active&nbsp;&nbsp;&nbsp;&nbsp;
            History Crawl&nbsp;&nbsp;&nbsp; 2020-12-29 23:07:34<br>
            gl-master-04-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick1/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-06-int&nbsp;&nbsp;&nbsp; Active&nbsp;&nbsp;&nbsp;&nbsp;
            History Crawl&nbsp;&nbsp;&nbsp; 2020-12-29 23:07:22<br>
            gl-master-04-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick2/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-01-int&nbsp;&nbsp;&nbsp; Passive &nbsp;&nbsp;
            N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A<br>
            gl-master-02-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick1/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-01-int&nbsp;&nbsp;&nbsp; Passive &nbsp;&nbsp;
            N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A<br>
            gl-master-02-int&nbsp;&nbsp;&nbsp; mvol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; /brick2/mvol1&nbsp;&nbsp;&nbsp; root
            gl-slave-01-int::svol1&nbsp;&nbsp;&nbsp; gl-slave-06-int&nbsp;&nbsp;&nbsp; Passive &nbsp;&nbsp;
            N/A&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; N/A<br>
            [ 13:14:47 ] - root@gl-master-01&nbsp; ~ $</font></div>
        <div class="moz-forward-container"><font face="monospace"><br>
          </font> </div>
        <br>
        <fieldset class="mimeAttachmentHeader"></fieldset>
        <pre class="moz-quote-pre" wrap="">________



Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: <a class="moz-txt-link-freetext" href="https://meet.google.com/cpu-eiue-hvk" moz-do-not-send="true">https://meet.google.com/cpu-eiue-hvk</a>
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org" moz-do-not-send="true">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="https://lists.gluster.org/mailman/listinfo/gluster-users" moz-do-not-send="true">https://lists.gluster.org/mailman/listinfo/gluster-users</a>
</pre>
      </blockquote>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <pre class="moz-quote-pre" wrap="">________



Community Meeting Calendar:

Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: <a class="moz-txt-link-freetext" href="https://meet.google.com/cpu-eiue-hvk">https://meet.google.com/cpu-eiue-hvk</a>
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="https://lists.gluster.org/mailman/listinfo/gluster-users">https://lists.gluster.org/mailman/listinfo/gluster-users</a>
</pre>
    </blockquote>
    <pre class="moz-signature" cols="72">-- 
Mit freundlichen Grüßen / Kind Regards

Dietmar Putz 
Head of Infrastructure
<a class="moz-txt-link-abbreviated" href="mailto:dietmar.putz@3q.video">dietmar.putz@3q.video</a>
<a class="moz-txt-link-abbreviated" href="http://www.3q.video">www.3q.video</a>

3Q GmbH 
Kurfürstendamm 102 | 10711 Berlin 

CEO Julius Thomas
Amtsgericht Charlottenburg
Registernummer HRB 217706 B</pre>
  </body>
</html>