<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
On 12/14/2011 03:06 PM, Changliang Chen wrote:
<blockquote
cite="mid:CAPnto6z-Lu1dyPRFvC0Pd5cCfTC7mRowYDQ5eNssaQGJ9-ON=w@mail.gmail.com"
type="cite">
<meta http-equiv="Content-Type" content="text/html;
charset=ISO-8859-1">
<span class="Apple-style-span"
style="color:rgb(68,68,68);font-family:Ubuntu,sans-serif;font-size:13px;line-height:16px;background-color:rgb(255,255,255)">Hi,we
have use glusterfs for two years. After upgraded to 3.2.5,we
discover that when one of replicate node reboot and startup the
glusterd daemon,the gluster will crash cause by the other </span>
<div>
<span class="Apple-style-span"
style="color:rgb(68,68,68);font-family:Ubuntu,sans-serif;font-size:13px;line-height:16px;background-color:rgb(255,255,255)"><br>
</span></div>
<div><span class="Apple-style-span"
style="color:rgb(68,68,68);font-family:Ubuntu,sans-serif;font-size:13px;line-height:16px;background-color:rgb(255,255,255)">replicate
node cpu usage reach 100%.</span><br
id="yui_3_3_0_13_13238513291571176"
style="color:rgb(68,68,68);font-family:Ubuntu,sans-serif;font-size:13px;line-height:16px;text-align:left;background-color:rgb(255,255,255)">
<br id="yui_3_3_0_13_13238513291571177"
style="color:rgb(68,68,68);font-family:Ubuntu,sans-serif;font-size:13px;line-height:16px;text-align:left;background-color:rgb(255,255,255)">
<span class="Apple-style-span"
style="color:rgb(68,68,68);font-family:Ubuntu,sans-serif;font-size:13px;line-height:16px;text-align:left;background-color:rgb(255,255,255)">Our
gluster info:</span></div>
<div><br id="yui_3_3_0_13_13238513291571178"
style="color:rgb(68,68,68);font-family:Ubuntu,sans-serif;font-size:13px;line-height:16px;text-align:left;background-color:rgb(255,255,255)">
<div id="yui_3_3_0_13_13238513291571179"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:rgb(255,255,255);text-align:left"><font
class="Apple-style-span" color="#444444" face="Ubuntu,
sans-serif"><span class="Apple-style-span"
style="line-height:16px">Type: Distributed-Replicate</span></font>
<div id="yui_3_3_0_13_13238513291571180"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444" face="Ubuntu,
sans-serif"><span class="Apple-style-span"
style="line-height:16px">Status: Started</span></font>
<div id="yui_3_3_0_13_13238513291571181"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444" face="Ubuntu,
sans-serif"><span class="Apple-style-span"
style="line-height:16px">Number of Bricks: 5 x 2 = 10</span></font>
<div id="yui_3_3_0_13_13238513291571182"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444" face="Ubuntu,
sans-serif"><span class="Apple-style-span"
style="line-height:16px">Transport-type: tcp</span></font><br
id="yui_3_3_0_13_13238513291571183">
<div id="yui_3_3_0_13_13238513291571182"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444"
face="Ubuntu, sans-serif"><span
class="Apple-style-span" style="line-height:16px">Options
Reconfigured:</span></font></div>
<div id="yui_3_3_0_13_13238513291571182"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444"
face="Ubuntu, sans-serif"><span
class="Apple-style-span" style="line-height:16px">performance.cache-size:
3GB</span></font></div>
<div id="yui_3_3_0_13_13238513291571182"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444"
face="Ubuntu, sans-serif"><span
class="Apple-style-span" style="line-height:16px">performance.cache-max-file-size:
512KB</span></font></div>
<div id="yui_3_3_0_13_13238513291571182"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444"
face="Ubuntu, sans-serif"><span
class="Apple-style-span" style="line-height:16px">network.frame-timeout:
30</span></font></div>
<div id="yui_3_3_0_13_13238513291571182"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444"
face="Ubuntu, sans-serif"><span
class="Apple-style-span" style="line-height:16px">network.ping-timeout:
25</span></font></div>
<div id="yui_3_3_0_13_13238513291571182"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444"
face="Ubuntu, sans-serif"><span
class="Apple-style-span" style="line-height:16px">cluster.min-free-disk:
10%</span></font></div>
<font class="Apple-style-span" color="#444444"
face="Ubuntu, sans-serif"><span
class="Apple-style-span" style="line-height:16px">
<div id="yui_3_3_0_13_13238513291571182"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><font
class="Apple-style-span" color="#444444"
face="Ubuntu, sans-serif"><span
class="Apple-style-span"
style="line-height:16px"><br>
</span></font></div>
Our device：</span></font></div>
<div id="yui_3_3_0_13_13238513291571182"
style="color:rgb(68,68,68);font-family:Ubuntu,sans-serif;font-size:13px;line-height:16px;margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent"><br
id="yui_3_3_0_13_13238513291571185">
Dell R710<br id="yui_3_3_0_13_13238513291571186">
600Gsas *6<br id="yui_3_3_0_13_13238513291571187">
3*8Gmem<br id="yui_3_3_0_13_13238513291571188">
<br id="yui_3_3_0_13_13238513291571189">
The error info:<br id="yui_3_3_0_13_13238513291571190">
<br id="yui_3_3_0_13_13238513291571191">
<div id="yui_3_3_0_13_13238513291571192"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">[2011-12-14
13:24:10.483812] E [rdma.c:4813:init]
0-rdma.management: Failed to initialize IB Device
<div id="yui_3_3_0_13_13238513291571193"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">[2011-12-14
13:24:10.483828] E
[rpc-transport.c:742:rpc_transport_load]
0-rpc-transport: 'rdma' initialization failed
<div id="yui_3_3_0_13_13238513291571194"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">[2011-12-14
13:24:10.483841] W
[rpcsvc.c:1288:rpcsvc_transport_create]
0-rpc-service: cannot create listener, initing the
transport failed
<div id="yui_3_3_0_13_13238513291571195"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">[2011-12-14
13:24:11.967621] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-0
<div id="yui_3_3_0_13_13238513291571196"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">[2011-12-14
13:24:11.967665] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-1
<div id="yui_3_3_0_13_13238513291571197"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">[2011-12-14
13:24:11.967681] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-2
<div id="yui_3_3_0_13_13238513291571198"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">[2011-12-14
13:24:11.967695] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-3
<div id="yui_3_3_0_13_13238513291571199"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">[2011-12-14
13:24:11.967709] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-4
<div id="yui_3_3_0_13_13238513291571200"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14 13:24:11.967723] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-5
<div
id="yui_3_3_0_13_13238513291571201"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14 13:24:11.967736] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-6
<div
id="yui_3_3_0_13_13238513291571202"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14 13:24:11.967750] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-7
<div
id="yui_3_3_0_13_13238513291571203"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14 13:24:11.967764] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-8
<div
id="yui_3_3_0_13_13238513291571204"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14 13:24:11.967777] E
[glusterd-store.c:1820:glusterd_store_retrieve_volume]
0-: Unknown key: brick-9
<div
id="yui_3_3_0_13_13238513291571205"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14 13:24:12.465565]
W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management: reading
from socket failed. Error
(Transport endpoint is not
connected), peer (<a
moz-do-not-send="true"
href="http://10.1.1.17:1013">10.1.1.17:1013</a>)
<div
id="yui_3_3_0_13_13238513291571206"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:12.465623] W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from socket
failed. Error (Transport
endpoint is not
connected), peer (<a
moz-do-not-send="true"
href="http://10.1.1.8:1013">10.1.1.8:1013</a>)
<div
id="yui_3_3_0_13_13238513291571207"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:12.465656] W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from socket
failed. Error (Transport
endpoint is not
connected), peer (<a
moz-do-not-send="true"
href="http://10.1.1.10:1013">10.1.1.10:1013</a>)
<div
id="yui_3_3_0_13_13238513291571208"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:12.465686] W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from socket
failed. Error
(Transport endpoint is
not connected), peer (<a
moz-do-not-send="true" href="http://10.1.1.11:1013">10.1.1.11:1013</a>)
<div
id="yui_3_3_0_13_13238513291571209"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:12.465716] W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from socket
failed. Error
(Transport endpoint
is not connected),
peer (<a
moz-do-not-send="true"
href="http://10.1.1.125:1013">10.1.1.125:1013</a>)
<div
id="yui_3_3_0_13_13238513291571210"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:12.633288] W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from
socket failed.
Error (Transport
endpoint is not
connected), peer (<a
moz-do-not-send="true" href="http://10.1.1.65:1006">10.1.1.65:1006</a>)
<div
id="yui_3_3_0_13_13238513291571211"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:13.138150]
W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from
socket failed.
Error (Transport
endpoint is not
connected), peer
(<a
moz-do-not-send="true"
href="http://10.1.1.1:1013">10.1.1.1:1013</a>)
<div
id="yui_3_3_0_13_13238513291571212"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:13.284665]
W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from
socket failed.
Error
(Transport
endpoint is
not
connected),
peer (<a
moz-do-not-send="true"
href="http://10.1.1.3:1013">10.1.1.3:1013</a>)
<div
id="yui_3_3_0_13_13238513291571213"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:15.790805]
W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from
socket failed.
Error
(Transport
endpoint is
not
connected),
peer (<a
moz-do-not-send="true"
href="http://10.1.1.8:1013">10.1.1.8:1013</a>)
<div
id="yui_3_3_0_13_13238513291571214"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:16.113430]
W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from
socket failed.
Error
(Transport
endpoint is
not
connected),
peer (<a
moz-do-not-send="true"
href="http://10.1.1.125:1013">10.1.1.125:1013</a>)
<div
id="yui_3_3_0_13_13238513291571215"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:16.259040]
W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from
socket failed.
Error
(Transport
endpoint is
not
connected),
peer (<a
moz-do-not-send="true"
href="http://10.1.1.10:1013">10.1.1.10:1013</a>)
<div
id="yui_3_3_0_13_13238513291571216"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:16.392058]
W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from
socket failed.
Error
(Transport
endpoint is
not
connected),
peer (<a
moz-do-not-send="true"
href="http://10.1.1.17:1013">10.1.1.17:1013</a>)
<div
id="yui_3_3_0_13_13238513291571217"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:24:16.429444]
W
[socket.c:1494:__socket_proto_state_machine]
0-socket.management:
reading from
socket failed.
Error
(Transport
endpoint is
not
connected),
peer (<a
moz-do-not-send="true"
href="http://10.1.1.11:1013">10.1.1.11:1013</a>)
<div
id="yui_3_3_0_13_13238513291571218"
style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px;padding-top:0px;padding-right:0px;padding-bottom:0px;padding-left:0px;border-top-width:0px;border-right-width:0px;border-bottom-width:0px;border-left-width:0px;border-style:initial;border-color:initial;outline-width:0px;outline-style:initial;outline-color:initial;vertical-align:baseline;background-image:initial;background-color:transparent">
[2011-12-14
13:26:05.787680]
W
[glusterfsd.c:727:cleanup_and_exit]
(-->/lib64/libc.so.6(clone+0x6d)
[0x37c8ed3c2d]
(-->/lib64/libpthread.so.0
[0x37c96064a7]
(-->/opt/glusterfs/3.2.5/sbin/glusterd(glusterfs_sigwaiter+0x17c)
[0x40477c])))
0-: received
signum (15),
shutting down</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<div><br>
</div>
-- <br>
<br>
Regards,<br>
<br>
Cocl<br>
<br>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Gluster-users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a>
<a class="moz-txt-link-freetext" href="http://gluster.org/cgi-bin/mailman/listinfo/gluster-users">http://gluster.org/cgi-bin/mailman/listinfo/gluster-users</a>
</pre>
</blockquote>
hi Changliang,<br>
Could you specify which process crashed. Is it glusterd or
glusterfs? Could you provide the stack trace that is present in it's
respective logfile. I dont see any stack trace in the logs you have
provided.<br>
<br>
Pranith<br>
</body>
</html>