<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=koi8-r">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Yaniv:<br>
<br>
I created a directory on a XFS formatted drive and that initially worked with tcp/inet.<br>
<br>
I then went to stop, delete, and tried to recreate the gluster volume with the option "transport tcp,rdma", it failed.<br>
<br>
I had to use the force options for gluster to work.<br>
<br>
But then it failed when trying to mount the volume, but prior to this change, I was able to mount the glusterfs volume using tcp/inet only.<br>
<br>
But now when I try to re-create the volume with "transport tcp,rdma", it fails.<br>
<br>
When I try to recreate the volume without any arguments, it fails as well because it thinks that the mount point/folder/directory has already been associated with a previous gluster volume, which I don't know how to properly resolve and none of the official
documentation on gluster.org explains how to deal with that.<br>
<br>
Thank you.</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Sincerely,</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Ewen<br>
</div>
<div>
<div id="appendonsend"></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Yaniv Kaul <ykaul@redhat.com><br>
<b>Sent:</b> July 11, 2021 4:02 PM<br>
<b>To:</b> Ewen Chan <alpha754293@hotmail.com><br>
<b>Subject:</b> Re: [Gluster-users] distributed glusterfs volume of four ramdisks problems</font>
<div> </div>
</div>
<div>
<div dir="auto">Can you try on a non tmpfs file system?
<div dir="auto">Y. </div>
</div>
<br>
<div class="x_gmail_quote">
<div dir="ltr" class="x_gmail_attr">On Sun, 11 Jul 2021, 22:59 Ewen Chan <<a href="mailto:alpha754293@hotmail.com">alpha754293@hotmail.com</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0 0 0 .8ex; border-left:1px #ccc solid; padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Strahil:</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
I just tried to create an entirely new gluster volume, gv1, instead of trying to use gv0.<br>
<br>
Same error.<br>
<br>
# gluster volume create gv1 node{1..4}:/mnt/ramdisk/gv1<br>
<font size="2"><span style="font-size:11pt">volume create: gv1: success: please start the volume to access data</span></font></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<font size="2"><span style="font-size:11pt">When I tried to start the volume with:<br>
<br>
# gluster volume start gv1<br>
<br>
gluster responds with:<br>
<br>
volume start: gv1: failed: Commit failed on localhost. Please check log file for details.</span></font></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
<font size="2"><span style="font-size:11pt"></span></font></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<font size="2"><span style="font-size:11pt">Attached are the updated glusterd.log and cli.log files.<br>
</span></font></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<font size="2"><span style="font-size:11pt"><br>
</span></font></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<font size="2"><span style="font-size:11pt">I checked and without specifying the options or the transport parameters, it defaults to using tcp/inet, but that still failed, so I am not really sure what's going on here.<br>
<br>
Thanks.</span></font></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<font size="2"><span style="font-size:11pt"><br>
</span></font></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<font size="2"><span style="font-size:11pt">Sincerely,</span></font></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<font size="2"><span style="font-size:11pt">Ewen<br>
</span></font></div>
<div>
<div id="x_m_-5007066308148647135appendonsend"></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr style="display:inline-block; width:98%">
<div id="x_m_-5007066308148647135divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Strahil Nikolov <<a href="mailto:hunter86_bg@yahoo.com" target="_blank" rel="noreferrer">hunter86_bg@yahoo.com</a>><br>
<b>Sent:</b> July 11, 2021 2:49 AM<br>
<b>To:</b> <a href="mailto:gluster-users@gluster.org" target="_blank" rel="noreferrer">
gluster-users@gluster.org</a> <<a href="mailto:gluster-users@gluster.org" target="_blank" rel="noreferrer">gluster-users@gluster.org</a>>; Ewen Chan <<a href="mailto:alpha754293@hotmail.com" target="_blank" rel="noreferrer">alpha754293@hotmail.com</a>><br>
<b>Subject:</b> Re: [Gluster-users] distributed glusterfs volume of four ramdisks problems</font>
<div> </div>
</div>
<div><font size="2"><span style="font-size:11pt">
<div>Does it crash with tcp ?<br>
What happens when you mount on one of the hosts ?<br>
<br>
<br>
Best Regards,<br>
Strahil Nikolov<br>
<br>
<br>
<br>
<br>
<br>
<br>
÷ ÓßÂÏÔÁ, 10 ÀÌÉ 2021 Ç., 18:55:40 Þ. çÒÉÎÕÉÞ+3, Ewen Chan <<a href="mailto:alpha754293@hotmail.com" target="_blank" rel="noreferrer">alpha754293@hotmail.com</a>> ÎÁÐÉÓÁ:
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
Hello everybody.<br>
<br>
I have a cluster with four nodes and I am trying to create a distributed glusterfs volume consisting of four RAM drives, each being 115 GB in size.<br>
<br>
<br>
<br>
<br>
I am running CentOS 7.7.1908.<br>
<br>
<br>
<br>
<br>
I created the ramdrives on each of the four nodes with the following command:<br>
<br>
# mount -t tmpfs -o size=115g tmpfs /mnt/ramdisk<br>
<br>
<br>
<br>
<br>
I then create the mount point for the gluster volume on each of the nodes:<br>
<br>
<br>
# mkdir -p /mnt/ramdisk/gv0<br>
<br>
<br>
<br>
<br>
And then I tried to create the glusterfs distributed volume:<br>
<br>
# gluster volume create gv0 transport tcp,rdma node{1..4}:/mnt/ramdisk/gv0<br>
<br>
And that came back with:<br>
<br>
volume create: gv0: success: pleas start the volume to access data<br>
<br>
<br>
<br>
<br>
When I tried to start the volume with:<br>
<br>
<br>
# gluster volume start gv0<br>
<br>
<br>
<br>
gluster responds with:<br>
<br>
<br>
<br>
<br>
volume start: gv0: failed: Commit failed on localhost. Please check log file for details.<br>
<br>
<br>
<br>
<br>
So I tried forcing the start with:<br>
<br>
# gluster volume start gv0 force<br>
<br>
<br>
<br>
<br>
gluster responds with:<br>
<br>
<br>
<br>
<br>
volume start: gv0: success<br>
<br>
<br>
<br>
<br>
I then created the mount point for the gluster volume:<br>
<br>
# mkdir -p /home/gluster<br>
<br>
<br>
<br>
<br>
And tried to mount the gluster gv0 volume:<br>
<br>
# mount -t glusterfs -o transport=rdma,direct-io-mode=enable node1:/gv0 /home/gluster<br>
<br>
<br>
<br>
<br>
and the system crashes.<br>
<br>
<br>
<br>
<br>
After rebooting the system and switching users back to root, I get this:<br>
<br>
ABRT has detected 1 problem(s). For more info run: abrt-cli list --since 1625929899<br>
<br>
<br>
<br>
<br>
# abrt-cli list --since 1625929899 <br>
id 2a8ae7a1207acc48a6fc4a6cd8c3c88ffcf431be<br>
<br>
reason: glusterfsd killed by SIGSEGV<br>
<br>
time: Sat 10 Jul 2021 10:56:13 AM EDT<br>
<br>
cmdline: /usr/sbin/glusterfsd -s aes1 --volfile-id gv0.aes1.mnt-ramdisk-gv0 -p /var/run/gluster/vols/gv0/aes1-mnt-ramdisk-g<br>
<br>
v0.pid -S /var/run/gluster/5c2a19a097c93ac6.socket --brick-name /mnt/ramdisk/gv0 -l /var/log/glusterfs/bricks/mnt-ramdisk-gv0.log<br>
<br>
--xlator-option *-posix.glusterd-uuid=0a569353-5991-4bc1-a61f-4ca6950f313d --process-name brick --brick-port 49152 49153 --xlator-<br>
<br>
option gv0-server.transport.rdma.listen-port=49153 --xlator-option gv0-server.listen-port=49152 --volfile-server-transport=socket,<br>
<br>
rdma<br>
<br>
package: glusterfs-fuse-9.3-1.el7<br>
<br>
uid: 0 (root)<br>
<br>
count: 4<br>
<br>
Directory: /var/spool/abrt/ccpp-2021-07-10-10:56:13-4935<br>
<br>
<br>
<br>
<br>
The Autoreporting feature is disabled. Please consider enabling it by issuing<br>
'abrt-auto-reporting enabled' as a user with root privileges<br>
<br>
<br>
<br>
<br>
Where do I begin to even remotely try and fix this, and to get this up and running?<br>
<br>
<br>
<br>
<br>
Any help in regards to this is greatly appreciated.<br>
<br>
<br>
<br>
<br>
Thank you.<br>
<br>
<br>
<br>
<br>
Sincerely,<br>
<br>
Ewen<br>
<br>
<br>
<br>
________<br>
<br>
<br>
<br>
Community Meeting Calendar:<br>
<br>
Schedule -<br>
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC<br>
Bridge: <a href="https://meet.google.com/cpu-eiue-hvk" target="_blank" rel="noreferrer">
https://meet.google.com/cpu-eiue-hvk</a><br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank" rel="noreferrer">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank" rel="noreferrer">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
</div>
</span></font></div>
</div>
</div>
________<br>
<br>
<br>
<br>
Community Meeting Calendar:<br>
<br>
Schedule -<br>
Every 2nd and 4th Tuesday at 14:30 IST / 09:00 UTC<br>
Bridge: <a href="https://meet.google.com/cpu-eiue-hvk" rel="noreferrer noreferrer" target="_blank">
https://meet.google.com/cpu-eiue-hvk</a><br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank" rel="noreferrer">Gluster-users@gluster.org</a><br>
<a href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer noreferrer" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br>
</blockquote>
</div>
</div>
</div>
</body>
</html>