<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
.MsoChpDefault
{mso-style-type:export-only;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
--></style>
</head>
<body lang="FR" link="blue" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><a href="https://pastebin.com/YGTcKRyw" target="_blank">https://pastebin.com/YGTcKRyw</a></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="mso-element:para-border-div;border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal" style="border:none;padding:0cm"><b>De : </b><a href="mailto:amukherj@redhat.com">Atin Mukherjee</a><br>
<b>Envoyé le :</b>mardi 6 juin 2017 16:38<br>
<b>À : </b><a href="mailto:merwan19@msn.com">Merwan Ouddane</a><br>
<b>Cc : </b><a href="mailto:gluster-users@gluster.org">gluster-users</a><br>
<b>Objet :</b>Re: [Gluster-users] Adding a new replica to the cluster</p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Can you please send the brick log files from serv3? <o:p></o:p></p>
<div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On Tue, Jun 6, 2017 at 7:56 PM, Merwan Ouddane <<a href="mailto:merwan19@msn.com" target="_blank">merwan19@msn.com</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div id="m_-971768307869833473divtagdefaultwrapper">
<div id="m_-971768307869833473divtagdefaultwrapper">
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">I get a timeout when trying to force start the volume from serv3, but I can stop the volume ...<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">Isn't the error linked to "0-glusterfs: failed to submit rpc-request" ? (from the log i send in the first place)<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">Merwan<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><img border="0" width="688" height="2" style="width:7.1666in;height:.0208in" id="Horizontal_x0020_Line_x0020_1" src="cid:image004.png@01D2DEFC.08C4B640"></span><span style="font-size:12.0pt;color:black"><o:p></o:p></span></p>
<div id="m_-971768307869833473divRplyFwdMsg">
<p class="MsoNormal"><b><span style="color:black">De :</span></b><span style="color:black"> Atin Mukherjee <<a href="mailto:amukherj@redhat.com" target="_blank">amukherj@redhat.com</a>><br>
<b>Envoyé :</b> dimanche 4 juin 2017 15:31:34<br>
<b>À :</b> Merwan Ouddane<br>
<b>Cc :</b> gluster-users <o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span style="color:black"><br>
<b>Objet :</b> Re: [Gluster-users] Adding a new replica to the cluster<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><span style="font-size:12.0pt;color:black">Apologies for the delay!<br>
<br>
>From the logs:<br>
<br>
[2017-05-31 13:06:35.839780] E [MSGID: 106005] [glusterd-utils.c:4877:glusterd_brick_start] 0-management: Unable to start brick 156.125.102.103:/data/br0/vm0
<br>
[2017-05-31 13:06:35.839869] E [MSGID: 106074] [glusterd-brick-ops.c:2493:glusterd_op_add_brick] 0-glusterd: Unable to add bricks<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">This looks like in serv3 the newly added brick failed to come up. You'd have to look at the same brick log file on serv3 to see what was the reason. As a workaround, does gluster v start <volname>
force bring up this brick now? As far as glusterd configuration data is concerned, everything seems fine, no inconsistency.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">On Wed, May 31, 2017 at 6:53 PM, Merwan Ouddane <<a href="mailto:merwan19@msn.com" target="_blank">merwan19@msn.com</a>> wrote:<o:p></o:p></span></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div id="m_-971768307869833473m_-6461643501595845307divtagdefaultwrapper">
<p><span style="font-size:12.0pt;color:black">Hello,<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p><span style="font-size:12.0pt;color:black">Here is a tar gz with the log, and the output of "gluster volume status && gluster volume info && gluster peer status" for each server<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p><span style="font-size:12.0pt;color:black">Thank you,<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black">Merwan<o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><img border="0" width="682" height="2" style="width:7.1041in;height:.0208in" id="Horizontal_x0020_Line_x0020_2" src="cid:image005.png@01D2DEFC.08C4B640"></span><span style="font-size:12.0pt;color:black"><o:p></o:p></span></p>
<div id="m_-971768307869833473m_-6461643501595845307divRplyFwdMsg">
<p class="MsoNormal"><b><span style="color:black">De :</span></b><span style="color:black"> Atin Mukherjee <<a href="mailto:amukherj@redhat.com" target="_blank">amukherj@redhat.com</a>><br>
<b>Envoyé :</b> mercredi 31 mai 2017 12:20:49 <o:p></o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span style="color:black"><br>
<b>À :</b> Merwan Ouddane<br>
<b>Cc :</b> <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br>
<b>Objet :</b> Re: [Gluster-users] Adding a new replica to the cluster<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">On Tue, May 30, 2017 at 2:14 PM, Merwan Ouddane <<a href="mailto:merwan19@msn.com" target="_blank">merwan19@msn.com</a>> wrote:<o:p></o:p></span></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div id="m_-971768307869833473m_-6461643501595845307gmail-m_7378625862639599604divtagdefaultwrapper">
<p><span style="font-size:12.0pt;color:black">Gluster peer status tells me that the peer is connected<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p><span style="font-size:12.0pt;color:black">Here is the log from the servers in the cluster (they are the same for both of them):<o:p></o:p></span></p>
<p style="margin-bottom:12.0pt"><span style="font-size:12.0pt;color:black"><a href="https://pastebin.com/4aM94PJ6" target="_blank">https://pastebin.com/4aM94PJ6</a><o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black">The log from the server i'm trying to add to the cluster:<o:p></o:p></span></p>
<p><span style="font-size:12.0pt;color:black"><a href="https://pastebin.com/YGTcKRyw" target="_blank">https://pastebin.com/YGTcKRyw</a><o:p></o:p></span></p>
</div>
</div>
</blockquote>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">I'm sorry but these log files are for brick and client. What I am looking for is glusterd log ( ls -lrt /var/log/glusterfs/*glusterd* ) from all the nodes. Also please paste the output of gluster
volume status, gluster volume info, gluster peer status from all the nodes.<o:p></o:p></span></p>
</div>
<div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<div id="m_-971768307869833473m_-6461643501595845307gmail-m_7378625862639599604divtagdefaultwrapper">
<p style="margin-bottom:12.0pt"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<p><span style="font-size:12.0pt;color:black">Merwan<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><img border="0" width="675" height="2" style="width:7.0312in;height:.0208in" id="Horizontal_x0020_Line_x0020_3" src="cid:image006.png@01D2DEFC.08C4B640"></span><span style="font-size:12.0pt;color:black"><o:p></o:p></span></p>
<div id="m_-971768307869833473m_-6461643501595845307gmail-m_7378625862639599604divRplyFwdMsg">
<p class="MsoNormal"><b><span style="color:black">De :</span></b><span style="color:black"> Atin Mukherjee <<a href="mailto:amukherj@redhat.com" target="_blank">amukherj@redhat.com</a>><br>
<b>Envoyé :</b> mardi 30 mai 2017 04:51<br>
<b>À :</b> Merwan Ouddane<br>
<b>Cc :</b> <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a><br>
<b>Objet :</b> Re: [Gluster-users] Adding a new replica to the cluster</span><span style="font-size:12.0pt;color:black">
<o:p></o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"> <o:p></o:p></span></p>
</div>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">On Mon, May 29, 2017 at 9:52 PM, Merwan Ouddane <<a href="mailto:merwan19@msn.com" target="_blank">merwan19@msn.com</a>> wrote:<o:p></o:p></span></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">Hello,<br>
<br>
I wanted to play around with gluster and I made a 2 nodes cluster replicated, then I wanted to add a third replica "on the fly".<br>
<br>
I manage to probe my third server from the cluster, but when I try to add the new brick to the volume, I get a "Request timed out"<br>
<br>
My command:<br>
gluster volume add-brick vol0 replica 3 <a href="http://192.168.0.4" target="_blank">
192.168.0.4</a>:/data/br0/vol0<o:p></o:p></span></p>
</div>
</blockquote>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black">This might happen if the originator glusterd lost connection with other peers while this command was in process. Can you check if peer status is healthy by gluster peer status command? If yes,
you'd need to share the glusterd log files from all the nodes with us to further analyse the issue.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><br>
<o:p></o:p></span></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><br>
Does anyone have an idea ? <br>
<br>
Regards,<br>
Merwan <o:p></o:p></span></p>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://lists.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></span></p>
</blockquote>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://lists.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></span></p>
</blockquote>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><span style="font-size:12.0pt;color:black"><o:p> </o:p></span></p>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>