<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>If I might chip in here, this can cause an issue when rebooting
nodes unless you make sure to stop the Gluster processes first. If
you don't stop the processes, then the Gluster volumes can pause
for the default 42 seconds(?) until the other nodes time out the
rebooting node. This is of course long enough to cause any VMs
running their volumes on gluster to show I/O errors and re-mount
them as read-only potentially causing all sorts of mischief.<br>
</p>
<p>I *think* there's a systemd solution to this somewhere, perhaps
the RedHat packages?, that does stop the gluster processes prior
to a reboot or halt.</p>
<p>Certainly the Debian packages *don't* have this solution in
place. I wish they did but I've never mastered enough systemd foo
to sort if out myself. :-).</p>
<p>Ronny<br>
</p>
<p><br>
</p>
<div class="moz-cite-prefix">Aravinda wrote on 05/02/2024 19:09:<br>
</div>
<blockquote type="cite"
cite="mid:18d7aac9a44.5c15c7c797482.6871390599330910025@kadalu.tech">
<meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
<div style="font-family: Verdana, Arial, Helvetica, sans-serif;
font-size: 10pt;">
<div>Hi Anant,<br>
</div>
<div><br>
</div>
<div>It was intentional design decision to not stop any gluster
processes if Glusterd need to be upgraded or if Glusterd
crashes. Because of this Volume availability will not be
affected if any issues with Glusterd or Glusterd is upgraded.
All the mounts will reconnect once the Glusterd comes back up.
CLI operations from that node may not be available but IO will
not be affected if the Glusterd is down (New mounts can't be
created, but existing mounts should work without Glusterd).<br>
</div>
<div><br>
</div>
<div>stop-all-gluster-processes.sh is available as part of
installation, it can be used to stop all the processes (Check
in /usr/share/glusterfs/scripts)</div>
<div><br>
</div>
<div>--<br>
</div>
<div>Thanks and Regards</div>
<div id="Zm-_Id_-Sgn" data-sigid="3848334000000010003"
data-zbluepencil-ignore="true">
<div>Aravinda<br>
</div>
<div>Kadalu Technologies</div>
</div>
<div><br>
</div>
<div class="zmail_extra_hr" style="border-top: 1px solid
rgb(204, 204, 204); height: 0px; margin-top: 10px;
margin-bottom: 10px; line-height: 0px;"><br>
</div>
<div class="zmail_extra" data-zbluepencil-ignore="true">
<div><br>
</div>
<div id="Zm-_Id_-Sgn1">---- On Mon, 05 Feb 2024 22:40:30 +0530
<b>Anant Saraswat <a class="moz-txt-link-rfc2396E" href="mailto:anant.saraswat@techblue.co.uk"><anant.saraswat@techblue.co.uk></a></b>
wrote ---<br>
</div>
<div><br>
</div>
<blockquote id="blockquote_zmail" style="margin: 0px;">
<div dir="ltr"
class="zm_414335516218564369_parse_848289701506616423">
<p class="x_1122416758elementToProof" style="margin-top:
0px; margin-bottom: 0px;"><span class="colour"
style="color:rgb(0, 0, 0)"><span class="font"
style="font-family:Aptos, Aptos_EmbeddedFont,
Aptos_MSFontService, Calibri, Helvetica, sans-serif"><span
class="size" style="font-size:12pt">Hello
Everyone,</span></span></span><br>
</p>
<p class="x_1122416758elementToProof" style="margin-top:
0px; margin-bottom: 0px;"><span class="colour"
style="color:rgb(0, 0, 0)"><span class="font"
style="font-family:Aptos, Aptos_EmbeddedFont,
Aptos_MSFontService, Calibri, Helvetica, sans-serif"><span
class="size" style="font-size:12pt"><br>
</span></span></span></p>
<p class="x_1122416758elementToProof" style="margin-top:
0px; margin-bottom: 0px;"><span class="colour"
style="color:rgb(0, 0, 0)"><span class="font"
style="font-family:Aptos, Aptos_EmbeddedFont,
Aptos_MSFontService, Calibri, Helvetica, sans-serif"><span
class="size" style="font-size:12pt">I am using
GlusterFS 9.4, and whenever we use the systemctl
command to stop the Gluster server, it leaves many
Gluster processes running. So, I just want to
check how to shut down the Gluster server in a
graceful manner.</span></span></span><br>
</p>
<p style="margin-top: 0; margin-bottom: 0;"><span
class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt"><br>
</span></span></span></p>
<p style="margin-top: 0; margin-bottom: 0;"><span
class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">Is there any specific
sequence or trick I need to follow? Currently, I
am using the following command:</span></span></span><br>
</p>
<p style="margin-top: 0; margin-bottom: 0;"><span
class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt"><br>
</span></span></span></p>
<p style="margin-top: 0; margin-bottom: 0;"><span
class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">[root@master2 ~]# systemctl
stop glusterd.service</span></span></span><br>
</p>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">[root@master2 ~]# ps aux |
grep gluster</span></span></span><br>
</div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">root 2710138 14.1 0.0
2968372 216852 ? Ssl Jan27 170:27
/usr/sbin/glusterfsd -s master2 --volfile-id
tier1data.master2.opt-tier1data2019-brick -p
/var/run/gluster/vols/tier1data/master2-opt-tier1data2019-brick.pid
-S /var/run/gluster/97da28e3d5c23317.socket
--brick-name /opt/tier1data2019/brick -l
/var/log/glusterfs/bricks/opt-tier1data2019-brick.log
--xlator-option
*-posix.glusterd-uuid=c1591bde-df1c-41b4-8cc3-5eaa02c5b89d
--process-name brick --brick-port 49152
--xlator-option tier1data-server.listen-port=49152</span></span></span><br>
</div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">root 2710196 0.0 0.0
1298116 11544 ? Ssl Jan27 0:01
/usr/sbin/glusterfs -s localhost --volfile-id
shd/tier1data -p
/var/run/gluster/shd/tier1data/tier1data-shd.pid
-l /var/log/glusterfs/glustershd.log -S
/var/run/gluster/1ac2284f75671ffa.socket
--xlator-option
*replicate*.node-uuid=c1591bde-df1c-41b4-8cc3-5eaa02c5b89d
--process-name glustershd --client-pid=-6</span></span></span><br>
</div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">root 3730742 0.0 0.0
288264 14388 ? Ssl 18:44 0:00
/usr/bin/python3
/usr/libexec/glusterfs/python/syncdaemon/gsyncd.py
--path=/opt/tier1data2019/brick --monitor -c
/var/lib/glusterd/geo-replication/tier1data_drtier1data_drtier1data/gsyncd.conf
--iprefix=/var :tier1data
--glusterd-uuid=c1591bde-df1c-41b4-8cc3-5eaa02c5b89d
drtier1data::drtier1data</span></span></span><br>
</div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">root 3730763 2.4 0.0
2097216 35904 ? Sl 18:44 0:09 python3
/usr/libexec/glusterfs/python/syncdaemon/gsyncd.py
worker tier1data drtier1data::drtier1data
--feedback-fd 9 --local-path
/opt/tier1data2019/brick --local-node master2
--local-node-id
c1591bde-df1c-41b4-8cc3-5eaa02c5b89d --slave-id
eca32e08-c3f8-4883-bef5-84bfb89f4d56 --subvol-num
1 --resource-remote drtier1data
--resource-remote-id
28f3e75b-56aa-43a1-a0ea-a0e5d44d59ea</span></span></span><br>
</div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">root 3730768 0.7 0.0
50796 9668 ? S 18:44 0:02 ssh
-oPasswordAuthentication=no
-oStrictHostKeyChecking=no -i
/var/lib/glusterd/geo-replication/secret.pem -p 22
-oControlMaster=auto -S
/tmp/gsyncd-aux-ssh-ep7a14up/75785990b3233f5dbbab9f43cc3ed895.sock
drtier1data /nonexistent/gsyncd slave tier1data
drtier1data::drtier1data --master-node master2
--master-node-id
c1591bde-df1c-41b4-8cc3-5eaa02c5b89d
--master-brick /opt/tier1data2019/brick
--local-node drtier1data --local-node-id
28f3e75b-56aa-43a1-a0ea-a0e5d44d59ea
--slave-timeout 120 --slave-log-level INFO
--slave-gluster-log-level INFO
--slave-gluster-command-dir /usr/sbin
--master-dist-count 1</span></span></span><br>
</div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">root 3730795 1.1 0.0
1108268 55596 ? Ssl 18:44 0:04
/usr/sbin/glusterfs --aux-gfid-mount --acl
--log-level=INFO
--log-file=/var/log/glusterfs/geo-replication/tier1data_drtier1data_drtier1data/mnt-opt-tier1data2019-brick.log
--volfile-server=localhost --volfile-id=tier1data
--client-pid=-1 /tmp/gsyncd-aux-mount-9210kh43</span></span></span><br>
</div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">root 3772665 0.0 0.0
12208 2400 ? S 18:51 0:00 rsync -aR0
--inplace --files-from=- --super --stats
--numeric-ids --no-implied-dirs --existing
--xattrs --acls --ignore-missing-args . -e ssh
-oPasswordAuthentication=no
-oStrictHostKeyChecking=no -i
/var/lib/glusterd/geo-replication/secret.pem -p 22
-oControlMaster=auto -S
/tmp/gsyncd-aux-ssh-ep7a14up/75785990b3233f5dbbab9f43cc3ed895.sock
drtier1data:/proc/897118/cwd</span></span></span><br>
</div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">root 3772667 0.0 0.0
44156 5640 ? S 18:51 0:00 ssh
-oPasswordAuthentication=no
-oStrictHostKeyChecking=no -i
/var/lib/glusterd/geo-replication/secret.pem -p 22
-oControlMaster=auto -S
/tmp/gsyncd-aux-ssh-ep7a14up/75785990b3233f5dbbab9f43cc3ed895.sock
drtier1data rsync --server -logDtpAXRe.LsfxC
--super --stats --numeric-ids --existing --inplace
--no-implied-dirs . /proc/897118/cwd</span></span></span><br>
</div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt"><br>
</span></span></span></div>
<div><span class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">For now, We are using <a
href="https://github.com/gluster/glusterfs/blob/master/extras/stop-all-gluster-processes.sh"
id="x_1122416758LPlnk466645"
class="x_1122416758OWAAutoLink" target="_blank"
moz-do-not-send="true">
https://github.com/gluster/glusterfs/blob/master/extras/stop-all-gluster-processes.sh</a> to
kill all the remaining processes.</span></span></span><br>
</div>
<div class="x_1122416758elementToProof"><span
class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt"><br>
</span></span></span></div>
<div class="x_1122416758elementToProof"><span
class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">Thanks,</span></span></span><br>
</div>
<div class="x_1122416758elementToProof"><span
class="colour" style="color:rgb(0, 0, 0)"><span
class="font" style="font-family:Aptos,
Aptos_EmbeddedFont, Aptos_MSFontService, Calibri,
Helvetica, sans-serif"><span class="size"
style="font-size:12pt">Anant</span></span></span><br>
</div>
<div id="x_1122416758Signature"><br>
</div>
<p style="margin-top: 0px; margin-bottom: 0px;"><span
class="font" style="font-family:ARIAL"><span
class="size" style="font-size: 10pt; margin-top:
0px; margin-bottom: 0px;"><span class="font"
style="font-family:"Calibri Light""></span></span></span><br>
</p>
<p style="margin-top: 0px; margin-bottom: 0px;"><span
class="font" style="font-family:ARIAL"><span
class="size" style="font-size: 10pt; margin-top:
0px; margin-bottom: 0px;">DISCLAIMER: This email and
any files transmitted with it are confidential and
intended solely for the use of the individual or
entity to whom they are addressed. If you have
received this email in error, please notify the
sender. This message contains confidential
information and is intended only for the individual
named. If you are not the named addressee, you
should not disseminate, distribute or copy this
email. Please notify the sender immediately by email
if you have received this email by mistake and
delete this email from your system. <br>
<br>
If you are not the intended recipient, you are
notified that disclosing, copying, distributing or
taking any action in reliance on the contents of
this information is strictly prohibited. Thanks for
your cooperation.</span></span></p>
</div>
________<br>
<br>
<br>
<br>
Community Meeting Calendar: <br>
<br>
Schedule - <br>
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC <br>
Bridge: <a class="moz-txt-link-freetext" href="https://meet.google.com/cpu-eiue-hvk">https://meet.google.com/cpu-eiue-hvk</a> <br>
Gluster-users mailing list <br>
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a> <br>
<a class="moz-txt-link-freetext" href="https://lists.gluster.org/mailman/listinfo/gluster-users">https://lists.gluster.org/mailman/listinfo/gluster-users</a> <br>
</blockquote>
</div>
</div>
<br>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">________
Community Meeting Calendar:
Schedule -
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC
Bridge: <a class="moz-txt-link-freetext" href="https://meet.google.com/cpu-eiue-hvk">https://meet.google.com/cpu-eiue-hvk</a>
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="https://lists.gluster.org/mailman/listinfo/gluster-users">https://lists.gluster.org/mailman/listinfo/gluster-users</a>
</pre>
</blockquote>
<div class="moz-signature">-- <br>
<pre>Ronny Adsetts
Technical Director
Amazing Internet Ltd, London
t: +44 20 8977 8943
w: <a class="moz-txt-link-abbreviated" href="http://www.amazinginternet.com">www.amazinginternet.com</a>
Registered office: 85 Waldegrave Park, Twickenham, TW1 4TJ
Registered in England. Company No. 4042957
</pre>
</div>
</body>
</html>