<div dir="ltr">Hi Artem,<div><br></div><div>I think you are running into a different crash. The ones reported which were prevented by turning off write-behind are now fixed.</div><div>We will need to look into the one you are seeing to see why it is happening.</div><div><br></div><div>Regards,</div><div>Nithya</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, 19 Mar 2019 at 20:25, Artem Russakovskii &lt;<a href="mailto:archon810@gmail.com">archon810@gmail.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">The flood is indeed fixed for us on 5.5. However, the crashes are not.<br clear="all"><div><div dir="ltr" class="gmail-m_-7774840206804470237gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><br>Sincerely,<br>Artem<br><br>--<br>Founder, <a href="http://www.androidpolice.com" target="_blank">Android Police</a>, <a href="http://www.apkmirror.com/" style="font-size:12.8px" target="_blank">APK Mirror</a><span style="font-size:12.8px">, Illogical Robot LLC</span></div><div dir="ltr"><a href="http://beerpla.net/" target="_blank">beerpla.net</a> | <a href="https://plus.google.com/+ArtemRussakovskii" target="_blank">+ArtemRussakovskii</a> | <a href="http://twitter.com/ArtemR" target="_blank">@ArtemR</a><br></div></div></div></div></div></div></div></div></div></div></div><br></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Mon, Mar 18, 2019 at 5:41 AM Hu Bert &lt;<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi Amar,<br>
<br>
if you refer to this bug:<br>
<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1674225" rel="noreferrer" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1674225</a> : in the test<br>
setup i haven&#39;t seen those entries, while copying &amp; deleting a few GBs<br>
of data. For a final statement we have to wait until i updated our<br>
live gluster servers - could take place on tuesday or wednesday.<br>
<br>
Maybe other users can do an update to 5.4 as well and report back here.<br>
<br>
<br>
Hubert<br>
<br>
<br>
<br>
Am Mo., 18. März 2019 um 11:36 Uhr schrieb Amar Tumballi Suryanarayan<br>
&lt;<a href="mailto:atumball@redhat.com" target="_blank">atumball@redhat.com</a>&gt;:<br>
&gt;<br>
&gt; Hi Hu Bert,<br>
&gt;<br>
&gt; Appreciate the feedback. Also are the other boiling issues related to logs fixed now?<br>
&gt;<br>
&gt; -Amar<br>
&gt;<br>
&gt; On Mon, Mar 18, 2019 at 3:54 PM Hu Bert &lt;<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a>&gt; wrote:<br>
&gt;&gt;<br>
&gt;&gt; update: upgrade from 5.3 -&gt; 5.5 in a replicate 3 test setup with 2<br>
&gt;&gt; volumes done. In &#39;gluster peer status&#39; the peers stay connected during<br>
&gt;&gt; the upgrade, no &#39;peer rejected&#39; messages. No cksum mismatches in the<br>
&gt;&gt; logs. Looks good :-)<br>
&gt;&gt;<br>
&gt;&gt; Am Mo., 18. März 2019 um 09:54 Uhr schrieb Hu Bert &lt;<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a>&gt;:<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; Good morning :-)<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; for debian the packages are there:<br>
&gt;&gt; &gt; <a href="https://download.gluster.org/pub/gluster/glusterfs/5/5.5/Debian/stretch/amd64/apt/pool/main/g/glusterfs/" rel="noreferrer" target="_blank">https://download.gluster.org/pub/gluster/glusterfs/5/5.5/Debian/stretch/amd64/apt/pool/main/g/glusterfs/</a><br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; I&#39;ll do an upgrade of a test installation 5.3 -&gt; 5.5 and see if there<br>
&gt;&gt; &gt; are some errors etc. and report back.<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; btw: no release notes for 5.4 and 5.5 so far?<br>
&gt;&gt; &gt; <a href="https://docs.gluster.org/en/latest/release-notes/" rel="noreferrer" target="_blank">https://docs.gluster.org/en/latest/release-notes/</a> ?<br>
&gt;&gt; &gt;<br>
&gt;&gt; &gt; Am Fr., 15. März 2019 um 14:28 Uhr schrieb Shyam Ranganathan<br>
&gt;&gt; &gt; &lt;<a href="mailto:srangana@redhat.com" target="_blank">srangana@redhat.com</a>&gt;:<br>
&gt;&gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; We created a 5.5 release tag, and it is under packaging now. It should<br>
&gt;&gt; &gt; &gt; be packaged and ready for testing early next week and should be released<br>
&gt;&gt; &gt; &gt; close to mid-week next week.<br>
&gt;&gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; Thanks,<br>
&gt;&gt; &gt; &gt; Shyam<br>
&gt;&gt; &gt; &gt; On 3/13/19 12:34 PM, Artem Russakovskii wrote:<br>
&gt;&gt; &gt; &gt; &gt; Wednesday now with no update :-/<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt; Sincerely,<br>
&gt;&gt; &gt; &gt; &gt; Artem<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt; --<br>
&gt;&gt; &gt; &gt; &gt; Founder, Android Police &lt;<a href="http://www.androidpolice.com" rel="noreferrer" target="_blank">http://www.androidpolice.com</a>&gt;, APK Mirror<br>
&gt;&gt; &gt; &gt; &gt; &lt;<a href="http://www.apkmirror.com/" rel="noreferrer" target="_blank">http://www.apkmirror.com/</a>&gt;, Illogical Robot LLC<br>
&gt;&gt; &gt; &gt; &gt; <a href="http://beerpla.net" rel="noreferrer" target="_blank">beerpla.net</a> &lt;<a href="http://beerpla.net/" rel="noreferrer" target="_blank">http://beerpla.net/</a>&gt; | +ArtemRussakovskii<br>
&gt;&gt; &gt; &gt; &gt; &lt;<a href="https://plus.google.com/+ArtemRussakovskii" rel="noreferrer" target="_blank">https://plus.google.com/+ArtemRussakovskii</a>&gt; | @ArtemR<br>
&gt;&gt; &gt; &gt; &gt; &lt;<a href="http://twitter.com/ArtemR" rel="noreferrer" target="_blank">http://twitter.com/ArtemR</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt; On Tue, Mar 12, 2019 at 10:28 AM Artem Russakovskii &lt;<a href="mailto:archon810@gmail.com" target="_blank">archon810@gmail.com</a><br>
&gt;&gt; &gt; &gt; &gt; &lt;mailto:<a href="mailto:archon810@gmail.com" target="_blank">archon810@gmail.com</a>&gt;&gt; wrote:<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;     Hi Amar,<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;     Any updates on this? I&#39;m still not seeing it in OpenSUSE build<br>
&gt;&gt; &gt; &gt; &gt;     repos. Maybe later today?<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;     Thanks.<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;     Sincerely,<br>
&gt;&gt; &gt; &gt; &gt;     Artem<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;     --<br>
&gt;&gt; &gt; &gt; &gt;     Founder, Android Police &lt;<a href="http://www.androidpolice.com" rel="noreferrer" target="_blank">http://www.androidpolice.com</a>&gt;, APK Mirror<br>
&gt;&gt; &gt; &gt; &gt;     &lt;<a href="http://www.apkmirror.com/" rel="noreferrer" target="_blank">http://www.apkmirror.com/</a>&gt;, Illogical Robot LLC<br>
&gt;&gt; &gt; &gt; &gt;     <a href="http://beerpla.net" rel="noreferrer" target="_blank">beerpla.net</a> &lt;<a href="http://beerpla.net/" rel="noreferrer" target="_blank">http://beerpla.net/</a>&gt; | +ArtemRussakovskii<br>
&gt;&gt; &gt; &gt; &gt;     &lt;<a href="https://plus.google.com/+ArtemRussakovskii" rel="noreferrer" target="_blank">https://plus.google.com/+ArtemRussakovskii</a>&gt; | @ArtemR<br>
&gt;&gt; &gt; &gt; &gt;     &lt;<a href="http://twitter.com/ArtemR" rel="noreferrer" target="_blank">http://twitter.com/ArtemR</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;     On Wed, Mar 6, 2019 at 10:30 PM Amar Tumballi Suryanarayan<br>
&gt;&gt; &gt; &gt; &gt;     &lt;<a href="mailto:atumball@redhat.com" target="_blank">atumball@redhat.com</a> &lt;mailto:<a href="mailto:atumball@redhat.com" target="_blank">atumball@redhat.com</a>&gt;&gt; wrote:<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;         We are talking days. Not weeks. Considering already it is<br>
&gt;&gt; &gt; &gt; &gt;         Thursday here. 1 more day for tagging, and packaging. May be ok<br>
&gt;&gt; &gt; &gt; &gt;         to expect it on Monday.<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;         -Amar<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;         On Thu, Mar 7, 2019 at 11:54 AM Artem Russakovskii<br>
&gt;&gt; &gt; &gt; &gt;         &lt;<a href="mailto:archon810@gmail.com" target="_blank">archon810@gmail.com</a> &lt;mailto:<a href="mailto:archon810@gmail.com" target="_blank">archon810@gmail.com</a>&gt;&gt; wrote:<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;             Is the next release going to be an imminent hotfix, i.e.<br>
&gt;&gt; &gt; &gt; &gt;             something like today/tomorrow, or are we talking weeks?<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;             Sincerely,<br>
&gt;&gt; &gt; &gt; &gt;             Artem<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;             --<br>
&gt;&gt; &gt; &gt; &gt;             Founder, Android Police &lt;<a href="http://www.androidpolice.com" rel="noreferrer" target="_blank">http://www.androidpolice.com</a>&gt;, APK<br>
&gt;&gt; &gt; &gt; &gt;             Mirror &lt;<a href="http://www.apkmirror.com/" rel="noreferrer" target="_blank">http://www.apkmirror.com/</a>&gt;, Illogical Robot LLC<br>
&gt;&gt; &gt; &gt; &gt;             <a href="http://beerpla.net" rel="noreferrer" target="_blank">beerpla.net</a> &lt;<a href="http://beerpla.net/" rel="noreferrer" target="_blank">http://beerpla.net/</a>&gt; | +ArtemRussakovskii<br>
&gt;&gt; &gt; &gt; &gt;             &lt;<a href="https://plus.google.com/+ArtemRussakovskii" rel="noreferrer" target="_blank">https://plus.google.com/+ArtemRussakovskii</a>&gt; | @ArtemR<br>
&gt;&gt; &gt; &gt; &gt;             &lt;<a href="http://twitter.com/ArtemR" rel="noreferrer" target="_blank">http://twitter.com/ArtemR</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;             On Tue, Mar 5, 2019 at 11:09 AM Artem Russakovskii<br>
&gt;&gt; &gt; &gt; &gt;             &lt;<a href="mailto:archon810@gmail.com" target="_blank">archon810@gmail.com</a> &lt;mailto:<a href="mailto:archon810@gmail.com" target="_blank">archon810@gmail.com</a>&gt;&gt; wrote:<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                 Ended up downgrading to 5.3 just in case. Peer status<br>
&gt;&gt; &gt; &gt; &gt;                 and volume status are OK now.<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                 zypper install --oldpackage glusterfs-5.3-lp150.100.1<br>
&gt;&gt; &gt; &gt; &gt;                 Loading repository data...<br>
&gt;&gt; &gt; &gt; &gt;                 Reading installed packages...<br>
&gt;&gt; &gt; &gt; &gt;                 Resolving package dependencies...<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                 Problem: glusterfs-5.3-lp150.100.1.x86_64 requires<br>
&gt;&gt; &gt; &gt; &gt;                 libgfapi0 = 5.3, but this requirement cannot be provided<br>
&gt;&gt; &gt; &gt; &gt;                   not installable providers:<br>
&gt;&gt; &gt; &gt; &gt;                 libgfapi0-5.3-lp150.100.1.x86_64[glusterfs]<br>
&gt;&gt; &gt; &gt; &gt;                  Solution 1: Following actions will be done:<br>
&gt;&gt; &gt; &gt; &gt;                   downgrade of libgfapi0-5.4-lp150.100.1.x86_64 to<br>
&gt;&gt; &gt; &gt; &gt;                 libgfapi0-5.3-lp150.100.1.x86_64<br>
&gt;&gt; &gt; &gt; &gt;                   downgrade of libgfchangelog0-5.4-lp150.100.1.x86_64 to<br>
&gt;&gt; &gt; &gt; &gt;                 libgfchangelog0-5.3-lp150.100.1.x86_64<br>
&gt;&gt; &gt; &gt; &gt;                   downgrade of libgfrpc0-5.4-lp150.100.1.x86_64 to<br>
&gt;&gt; &gt; &gt; &gt;                 libgfrpc0-5.3-lp150.100.1.x86_64<br>
&gt;&gt; &gt; &gt; &gt;                   downgrade of libgfxdr0-5.4-lp150.100.1.x86_64 to<br>
&gt;&gt; &gt; &gt; &gt;                 libgfxdr0-5.3-lp150.100.1.x86_64<br>
&gt;&gt; &gt; &gt; &gt;                   downgrade of libglusterfs0-5.4-lp150.100.1.x86_64 to<br>
&gt;&gt; &gt; &gt; &gt;                 libglusterfs0-5.3-lp150.100.1.x86_64<br>
&gt;&gt; &gt; &gt; &gt;                  Solution 2: do not install glusterfs-5.3-lp150.100.1.x86_64<br>
&gt;&gt; &gt; &gt; &gt;                  Solution 3: break glusterfs-5.3-lp150.100.1.x86_64 by<br>
&gt;&gt; &gt; &gt; &gt;                 ignoring some of its dependencies<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                 Choose from above solutions by number or cancel<br>
&gt;&gt; &gt; &gt; &gt;                 [1/2/3/c] (c): 1<br>
&gt;&gt; &gt; &gt; &gt;                 Resolving dependencies...<br>
&gt;&gt; &gt; &gt; &gt;                 Resolving package dependencies...<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                 The following 6 packages are going to be downgraded:<br>
&gt;&gt; &gt; &gt; &gt;                   glusterfs libgfapi0 libgfchangelog0 libgfrpc0<br>
&gt;&gt; &gt; &gt; &gt;                 libgfxdr0 libglusterfs0<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                 6 packages to downgrade.<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                 Sincerely,<br>
&gt;&gt; &gt; &gt; &gt;                 Artem<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                 --<br>
&gt;&gt; &gt; &gt; &gt;                 Founder, Android Police<br>
&gt;&gt; &gt; &gt; &gt;                 &lt;<a href="http://www.androidpolice.com" rel="noreferrer" target="_blank">http://www.androidpolice.com</a>&gt;, APK Mirror<br>
&gt;&gt; &gt; &gt; &gt;                 &lt;<a href="http://www.apkmirror.com/" rel="noreferrer" target="_blank">http://www.apkmirror.com/</a>&gt;, Illogical Robot LLC<br>
&gt;&gt; &gt; &gt; &gt;                 <a href="http://beerpla.net" rel="noreferrer" target="_blank">beerpla.net</a> &lt;<a href="http://beerpla.net/" rel="noreferrer" target="_blank">http://beerpla.net/</a>&gt; | +ArtemRussakovskii<br>
&gt;&gt; &gt; &gt; &gt;                 &lt;<a href="https://plus.google.com/+ArtemRussakovskii" rel="noreferrer" target="_blank">https://plus.google.com/+ArtemRussakovskii</a>&gt; | @ArtemR<br>
&gt;&gt; &gt; &gt; &gt;                 &lt;<a href="http://twitter.com/ArtemR" rel="noreferrer" target="_blank">http://twitter.com/ArtemR</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                 On Tue, Mar 5, 2019 at 10:57 AM Artem Russakovskii<br>
&gt;&gt; &gt; &gt; &gt;                 &lt;<a href="mailto:archon810@gmail.com" target="_blank">archon810@gmail.com</a> &lt;mailto:<a href="mailto:archon810@gmail.com" target="_blank">archon810@gmail.com</a>&gt;&gt; wrote:<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                     Noticed the same when upgrading from 5.3 to 5.4, as<br>
&gt;&gt; &gt; &gt; &gt;                     mentioned.<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                     I&#39;m confused though. Is actual replication affected,<br>
&gt;&gt; &gt; &gt; &gt;                     because the 5.4 server and the 3x 5.3 servers still<br>
&gt;&gt; &gt; &gt; &gt;                     show heal info as all 4 connected, and the files<br>
&gt;&gt; &gt; &gt; &gt;                     seem to be replicating correctly as well.<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                     So what&#39;s actually affected - just the status<br>
&gt;&gt; &gt; &gt; &gt;                     command, or leaving 5.4 on one of the nodes is doing<br>
&gt;&gt; &gt; &gt; &gt;                     some damage to the underlying fs? Is it fixable by<br>
&gt;&gt; &gt; &gt; &gt;                     tweaking transport.socket.ssl-enabled? Does<br>
&gt;&gt; &gt; &gt; &gt;                     upgrading all servers to 5.4 resolve it, or should<br>
&gt;&gt; &gt; &gt; &gt;                     we revert back to 5.3?<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                     Sincerely,<br>
&gt;&gt; &gt; &gt; &gt;                     Artem<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                     --<br>
&gt;&gt; &gt; &gt; &gt;                     Founder, Android Police<br>
&gt;&gt; &gt; &gt; &gt;                     &lt;<a href="http://www.androidpolice.com" rel="noreferrer" target="_blank">http://www.androidpolice.com</a>&gt;, APK Mirror<br>
&gt;&gt; &gt; &gt; &gt;                     &lt;<a href="http://www.apkmirror.com/" rel="noreferrer" target="_blank">http://www.apkmirror.com/</a>&gt;, Illogical Robot LLC<br>
&gt;&gt; &gt; &gt; &gt;                     <a href="http://beerpla.net" rel="noreferrer" target="_blank">beerpla.net</a> &lt;<a href="http://beerpla.net/" rel="noreferrer" target="_blank">http://beerpla.net/</a>&gt; |<br>
&gt;&gt; &gt; &gt; &gt;                     +ArtemRussakovskii<br>
&gt;&gt; &gt; &gt; &gt;                     &lt;<a href="https://plus.google.com/+ArtemRussakovskii" rel="noreferrer" target="_blank">https://plus.google.com/+ArtemRussakovskii</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;                     | @ArtemR &lt;<a href="http://twitter.com/ArtemR" rel="noreferrer" target="_blank">http://twitter.com/ArtemR</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                     On Tue, Mar 5, 2019 at 2:02 AM Hu Bert<br>
&gt;&gt; &gt; &gt; &gt;                     &lt;<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a><br>
&gt;&gt; &gt; &gt; &gt;                     &lt;mailto:<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a>&gt;&gt; wrote:<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         fyi: did a downgrade 5.4 -&gt; 5.3 and it worked.<br>
&gt;&gt; &gt; &gt; &gt;                         all replicas are up and<br>
&gt;&gt; &gt; &gt; &gt;                         running. Awaiting updated v5.4.<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         thx :-)<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         Am Di., 5. März 2019 um 09:26 Uhr schrieb Hari<br>
&gt;&gt; &gt; &gt; &gt;                         Gowtham &lt;<a href="mailto:hgowtham@redhat.com" target="_blank">hgowtham@redhat.com</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:hgowtham@redhat.com" target="_blank">hgowtham@redhat.com</a>&gt;&gt;:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; There are plans to revert the patch causing<br>
&gt;&gt; &gt; &gt; &gt;                         this error and rebuilt 5.4.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; This should happen faster. the rebuilt 5.4<br>
&gt;&gt; &gt; &gt; &gt;                         should be void of this upgrade issue.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; In the meantime, you can use 5.3 for this cluster.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; Downgrading to 5.3 will work if it was just<br>
&gt;&gt; &gt; &gt; &gt;                         one node that was upgrade to 5.4<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; and the other nodes are still in 5.3.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; On Tue, Mar 5, 2019 at 1:07 PM Hu Bert<br>
&gt;&gt; &gt; &gt; &gt;                         &lt;<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a>&gt;&gt; wrote:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; Hi Hari,<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; thx for the hint. Do you know when this will<br>
&gt;&gt; &gt; &gt; &gt;                         be fixed? Is a downgrade<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; 5.4 -&gt; 5.3 a possibility to fix this?<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; Hubert<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; Am Di., 5. März 2019 um 08:32 Uhr schrieb<br>
&gt;&gt; &gt; &gt; &gt;                         Hari Gowtham &lt;<a href="mailto:hgowtham@redhat.com" target="_blank">hgowtham@redhat.com</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:hgowtham@redhat.com" target="_blank">hgowtham@redhat.com</a>&gt;&gt;:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; Hi,<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; This is a known issue we are working on.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; As the checksum differs between the<br>
&gt;&gt; &gt; &gt; &gt;                         updated and non updated node, the<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; peers are getting rejected.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; The bricks aren&#39;t coming because of the<br>
&gt;&gt; &gt; &gt; &gt;                         same issue.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; More about the issue:<br>
&gt;&gt; &gt; &gt; &gt;                         <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1685120" rel="noreferrer" target="_blank">https://bugzilla.redhat.com/show_bug.cgi?id=1685120</a><br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; On Tue, Mar 5, 2019 at 12:56 PM Hu Bert<br>
&gt;&gt; &gt; &gt; &gt;                         &lt;<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a>&gt;&gt; wrote:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Interestingly: gluster volume status<br>
&gt;&gt; &gt; &gt; &gt;                         misses gluster1, while heal<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; statistics show gluster1:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; gluster volume status workdata<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Status of volume: workdata<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Gluster process<br>
&gt;&gt; &gt; &gt; &gt;                            TCP Port  RDMA Port  Online  Pid<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         ------------------------------------------------------------------------------<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Brick gluster2:/gluster/md4/workdata<br>
&gt;&gt; &gt; &gt; &gt;                             49153     0          Y       1723<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Brick gluster3:/gluster/md4/workdata<br>
&gt;&gt; &gt; &gt; &gt;                             49153     0          Y       2068<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Self-heal Daemon on localhost<br>
&gt;&gt; &gt; &gt; &gt;                            N/A       N/A        Y       1732<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Self-heal Daemon on gluster3<br>
&gt;&gt; &gt; &gt; &gt;                             N/A       N/A        Y       2077<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; vs.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; gluster volume heal workdata statistics<br>
&gt;&gt; &gt; &gt; &gt;                         heal-count<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Gathering count of entries to be healed<br>
&gt;&gt; &gt; &gt; &gt;                         on volume workdata has been successful<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Brick gluster1:/gluster/md4/workdata<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Number of entries: 0<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Brick gluster2:/gluster/md4/workdata<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Number of entries: 10745<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Brick gluster3:/gluster/md4/workdata<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Number of entries: 10744<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Am Di., 5. März 2019 um 08:18 Uhr<br>
&gt;&gt; &gt; &gt; &gt;                         schrieb Hu Bert &lt;<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a>&gt;&gt;:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Hi Miling,<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; well, there are such entries, but<br>
&gt;&gt; &gt; &gt; &gt;                         those haven&#39;t been a problem during<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; install and the last kernel<br>
&gt;&gt; &gt; &gt; &gt;                         update+reboot. The entries look like:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; PUBLIC_IP  <a href="http://gluster2.alpserver.de" rel="noreferrer" target="_blank">gluster2.alpserver.de</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;<a href="http://gluster2.alpserver.de" rel="noreferrer" target="_blank">http://gluster2.alpserver.de</a>&gt; gluster2<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; 192.168.0.50 gluster1<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; 192.168.0.51 gluster2<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; 192.168.0.52 gluster3<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &#39;ping gluster2&#39; resolves to LAN IP; I<br>
&gt;&gt; &gt; &gt; &gt;                         removed the last entry in the<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; 1st line, did a reboot ... no, didn&#39;t<br>
&gt;&gt; &gt; &gt; &gt;                         help. From<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; /var/log/glusterfs/glusterd.log<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;  on gluster 2:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; [2019-03-05 07:04:36.188128] E [MSGID:<br>
&gt;&gt; &gt; &gt; &gt;                         106010]<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         [glusterd-utils.c:3483:glusterd_compare_friend_volume]<br>
&gt;&gt; &gt; &gt; &gt;                         0-management:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Version of Cksums persistent differ.<br>
&gt;&gt; &gt; &gt; &gt;                         local cksum = 3950307018, remote<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; cksum = 455409345 on peer gluster1<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; [2019-03-05 07:04:36.188314] I [MSGID:<br>
&gt;&gt; &gt; &gt; &gt;                         106493]<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         [glusterd-handler.c:3843:glusterd_xfer_friend_add_resp]<br>
&gt;&gt; &gt; &gt; &gt;                         0-glusterd:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Responded to gluster1 (0), ret: 0,<br>
&gt;&gt; &gt; &gt; &gt;                         op_ret: -1<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Interestingly there are no entries in<br>
&gt;&gt; &gt; &gt; &gt;                         the brick logs of the rejected<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; server. Well, not surprising as no<br>
&gt;&gt; &gt; &gt; &gt;                         brick process is running. The<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; server gluster1 is still in rejected<br>
&gt;&gt; &gt; &gt; &gt;                         state.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &#39;gluster volume start workdata force&#39;<br>
&gt;&gt; &gt; &gt; &gt;                         starts the brick process on<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; gluster1, and some heals are happening<br>
&gt;&gt; &gt; &gt; &gt;                         on gluster2+3, but via &#39;gluster<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; volume status workdata&#39; the volumes<br>
&gt;&gt; &gt; &gt; &gt;                         still aren&#39;t complete.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; gluster1:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         ------------------------------------------------------------------------------<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Brick gluster1:/gluster/md4/workdata<br>
&gt;&gt; &gt; &gt; &gt;                               49152     0          Y       2523<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Self-heal Daemon on localhost<br>
&gt;&gt; &gt; &gt; &gt;                              N/A       N/A        Y       2549<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; gluster2:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Gluster process<br>
&gt;&gt; &gt; &gt; &gt;                              TCP Port  RDMA Port  Online  Pid<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         ------------------------------------------------------------------------------<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Brick gluster2:/gluster/md4/workdata<br>
&gt;&gt; &gt; &gt; &gt;                               49153     0          Y       1723<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Brick gluster3:/gluster/md4/workdata<br>
&gt;&gt; &gt; &gt; &gt;                               49153     0          Y       2068<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Self-heal Daemon on localhost<br>
&gt;&gt; &gt; &gt; &gt;                              N/A       N/A        Y       1732<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Self-heal Daemon on gluster3<br>
&gt;&gt; &gt; &gt; &gt;                               N/A       N/A        Y       2077<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Hubert<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; Am Di., 5. März 2019 um 07:58 Uhr<br>
&gt;&gt; &gt; &gt; &gt;                         schrieb Milind Changire &lt;<a href="mailto:mchangir@redhat.com" target="_blank">mchangir@redhat.com</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:mchangir@redhat.com" target="_blank">mchangir@redhat.com</a>&gt;&gt;:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt; There are probably DNS entries or<br>
&gt;&gt; &gt; &gt; &gt;                         /etc/hosts entries with the public IP Addresses<br>
&gt;&gt; &gt; &gt; &gt;                         that the host names (gluster1, gluster2,<br>
&gt;&gt; &gt; &gt; &gt;                         gluster3) are getting resolved to.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt; /etc/resolv.conf would tell which is<br>
&gt;&gt; &gt; &gt; &gt;                         the default domain searched for the node names<br>
&gt;&gt; &gt; &gt; &gt;                         and the DNS servers which respond to the queries.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt; On Tue, Mar 5, 2019 at 12:14 PM Hu<br>
&gt;&gt; &gt; &gt; &gt;                         Bert &lt;<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:revirii@googlemail.com" target="_blank">revirii@googlemail.com</a>&gt;&gt; wrote:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Good morning,<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; i have a replicate 3 setup with 2<br>
&gt;&gt; &gt; &gt; &gt;                         volumes, running on version 5.3 on<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; debian stretch. This morning i<br>
&gt;&gt; &gt; &gt; &gt;                         upgraded one server to version 5.4 and<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; rebooted the machine; after the<br>
&gt;&gt; &gt; &gt; &gt;                         restart i noticed that:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; - no brick process is running<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; - gluster volume status only shows<br>
&gt;&gt; &gt; &gt; &gt;                         the server itself:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; gluster volume status workdata<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Status of volume: workdata<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Gluster process<br>
&gt;&gt; &gt; &gt; &gt;                                  TCP Port  RDMA Port  Online  Pid<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         ------------------------------------------------------------------------------<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Brick<br>
&gt;&gt; &gt; &gt; &gt;                         gluster1:/gluster/md4/workdata        N/A<br>
&gt;&gt; &gt; &gt; &gt;                          N/A        N       N/A<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; NFS Server on localhost<br>
&gt;&gt; &gt; &gt; &gt;                                  N/A       N/A        N       N/A<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; - gluster peer status on the server<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; gluster peer status<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Number of Peers: 2<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Hostname: gluster3<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Uuid:<br>
&gt;&gt; &gt; &gt; &gt;                         c7b4a448-ca6a-4051-877f-788f9ee9bc4a<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; State: Peer Rejected (Connected)<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Hostname: gluster2<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Uuid:<br>
&gt;&gt; &gt; &gt; &gt;                         162fea82-406a-4f51-81a3-e90235d8da27<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; State: Peer Rejected (Connected)<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; - gluster peer status on the other<br>
&gt;&gt; &gt; &gt; &gt;                         2 servers:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; gluster peer status<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Number of Peers: 2<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Hostname: gluster1<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Uuid:<br>
&gt;&gt; &gt; &gt; &gt;                         9a360776-7b58-49ae-831e-a0ce4e4afbef<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; State: Peer Rejected (Connected)<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Hostname: gluster3<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Uuid:<br>
&gt;&gt; &gt; &gt; &gt;                         c7b4a448-ca6a-4051-877f-788f9ee9bc4a<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; State: Peer in Cluster (Connected)<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; I noticed that, in the brick logs,<br>
&gt;&gt; &gt; &gt; &gt;                         i see that the public IP is used<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; instead of the LAN IP. brick logs<br>
&gt;&gt; &gt; &gt; &gt;                         from one of the volumes:<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; rejected node:<br>
&gt;&gt; &gt; &gt; &gt;                         <a href="https://pastebin.com/qkpj10Sd" rel="noreferrer" target="_blank">https://pastebin.com/qkpj10Sd</a><br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; connected nodes:<br>
&gt;&gt; &gt; &gt; &gt;                         <a href="https://pastebin.com/8SxVVYFV" rel="noreferrer" target="_blank">https://pastebin.com/8SxVVYFV</a><br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Why is the public IP suddenly used<br>
&gt;&gt; &gt; &gt; &gt;                         instead of the LAN IP? Killing all<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; gluster processes and rebooting<br>
&gt;&gt; &gt; &gt; &gt;                         (again) didn&#39;t help.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Thx,<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Hubert<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         _______________________________________________<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; Gluster-users mailing list<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt; <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         <a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt; --<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt; Milind<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         _______________________________________________<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; Gluster-users mailing list<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt; <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         <a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; --<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; Regards,<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; &gt; &gt; Hari Gowtham.<br>
&gt;&gt; &gt; &gt; &gt;                         &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt;<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; --<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; Regards,<br>
&gt;&gt; &gt; &gt; &gt;                         &gt; Hari Gowtham.<br>
&gt;&gt; &gt; &gt; &gt;                         _______________________________________________<br>
&gt;&gt; &gt; &gt; &gt;                         Gluster-users mailing list<br>
&gt;&gt; &gt; &gt; &gt;                         <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
&gt;&gt; &gt; &gt; &gt;                         &lt;mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;                         <a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;             _______________________________________________<br>
&gt;&gt; &gt; &gt; &gt;             Gluster-users mailing list<br>
&gt;&gt; &gt; &gt; &gt;             <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a> &lt;mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a>&gt;<br>
&gt;&gt; &gt; &gt; &gt;             <a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;         --<br>
&gt;&gt; &gt; &gt; &gt;         Amar Tumballi (amarts)<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; &gt; _______________________________________________<br>
&gt;&gt; &gt; &gt; &gt; Gluster-users mailing list<br>
&gt;&gt; &gt; &gt; &gt; <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
&gt;&gt; &gt; &gt; &gt; <a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
&gt;&gt; &gt; &gt; &gt;<br>
&gt;&gt; &gt; &gt; _______________________________________________<br>
&gt;&gt; &gt; &gt; Gluster-users mailing list<br>
&gt;&gt; &gt; &gt; <a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
&gt;&gt; &gt; &gt; <a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt; --<br>
&gt; Amar Tumballi (amarts)<br>
</blockquote></div>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></blockquote></div>