<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:3.0cm 2.0cm 3.0cm 2.0cm;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="DA" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">Thanks<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">My plans with the servers is to reinstall them all with rhel7 and the newest gluster-version. So for now my focus is just to free glustertst03
and glustertst04 for reinstallation.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">So glusterfs-rdma is not installed and I guess rdma is not working…. :-).
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">Anyhow. Do I need to install rdma to get rebalance working or is there a way to force using tcp. I thought that failback was tcp?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">Or maybe the problem is that only rdma I mentioned in glu_linux_dr2_oracle-rebalance.vol (see below)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">***** I found this in rebalance log on all nodes *********<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.188978] I [dht-shared.c:337:dht_init_regex] 0-glu_linux_dr2_oracle-dht: using regex rsync-hash-regex = ^\.(.+)\.[^.]+$<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.195108] E [rpc-transport.c:266:rpc_transport_load] 0-rpc-transport: /usr/lib64/glusterfs/3.6.9/rpc-transport/rdma.so:
cannot open shared object file: No such file or directory<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.195135] W [rpc-transport.c:270:rpc_transport_load] 0-rpc-transport: volume 'glu_linux_dr2_oracle-client-7': transport-type
'rdma' is not valid or not found on this machine<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.195143] W [rpc-clnt.c:993:rpc_clnt_connection_init] 0-glu_linux_dr2_oracle-client-7: loading of new rpc-transport
failed<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.195152] I [mem-pool.c:545:mem_pool_destroy] 0-glu_linux_dr2_oracle-client-7: size=588 max=0 total=0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.195184] I [mem-pool.c:545:mem_pool_destroy] 0-glu_linux_dr2_oracle-client-7: size=124 max=0 total=0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.195193] E [client.c:2434:client_init_rpc] 0-glu_linux_dr2_oracle-client-7: failed to initialize RPC<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.195201] E [xlator.c:430:xlator_init] 0-glu_linux_dr2_oracle-client-7: Initialization of volume 'glu_linux_dr2_oracle-client-7'
failed, review your volfile again<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.195208] E [graph.c:322:glusterfs_graph_init] 0-glu_linux_dr2_oracle-client-7: initializing translator failed<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">[2017-05-03 12:22:56.195214] E [graph.c:525:glusterfs_graph_activate] 0-graph: init failed<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">******* Grep transport in rebalance.vol *******<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"># grep -A2 transport-type /var/lib/glusterd/vols/glu_linux_dr2_oracle/glu_linux_dr2_oracle-rebalance.vol<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option transport-type rdma<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-subvolume /bricks/brick2/glu_linux_dr2_oracle<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-host glustoretst01.net.dr.dk<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">--<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option transport-type rdma<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-subvolume /bricks/brick2/glu_linux_dr2_oracle<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-host glustoretst02.net.dr.dk<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">--<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option transport-type rdma<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-subvolume /bricks/brick1/glu_linux_dr2_oracle<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-host glustoretst01.net.dr.dk<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">--<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option transport-type rdma<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-subvolume /bricks/brick1/glu_linux_dr2_oracle<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-host glustoretst02.net.dr.dk<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">--<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option transport-type rdma<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-subvolume /bricks/brick1/glu_linux_dr2_oracle<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-host glustoretst03.net.dr.dk<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">--<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option transport-type rdma<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-subvolume /bricks/brick1/glu_linux_dr2_oracle<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"> option remote-host glustoretst04.net.dr.dk<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">Regards<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US">Jesper<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif;mso-fareast-language:EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0cm 0cm 0cm 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">Fra:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Nithya Balachandran [mailto:nbalacha@redhat.com]
<br>
<b>Sendt:</b> 5. maj 2017 13:16<br>
<b>Til:</b> Jesper Led Lauridsen TS Infra server <JLY@dr.dk><br>
<b>Cc:</b> gluster-users@gluster.org<br>
<b>Emne:</b> Re: [Gluster-users] Remove-brick failed<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<p class="MsoNormal"><span lang="EN-US">H</span>i,<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">You need to check the rebalance logs (<span style="font-size:9.5pt">glu_linux_dr2_oracle-rebalance.log) on </span><a href="http://glustoretst04.net.dr.dk/" target="_blank"><span style="font-size:9.5pt">glustoretst03.net.dr.dk</span></a><span style="font-size:9.5pt">
and </span><a href="http://glustoretst04.net.dr.dk/" target="_blank"><span style="font-size:9.5pt">glustoretst04.net.dr.dk</span></a><span style="font-size:9.5pt"> to see what went wrong.</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">Regards,</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:9.5pt">Nithya</span><o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On 4 May 2017 at 11:46, Jesper Led Lauridsen TS Infra server <<a href="mailto:JLY@dr.dk" target="_blank">JLY@dr.dk</a>> wrote:<o:p></o:p></p>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm">
<p class="MsoNormal">Hi<br>
<br>
I'm trying to remove 2 bricks from a Distributed-Replicate without losing data. But it fails in rebalance<br>
<br>
Any help is appreciated...<br>
<br>
What I do:<br>
# gluster volume remove-brick glu_linux_dr2_oracle replica 2 glustoretst03.net.dr.dk:/bricks/brick1/glu_linux_dr2_oracle glustoretst04.net.dr.dk:/bricks/brick1/glu_linux_dr2_oracle start<br>
volume remove-brick start: success<br>
ID: c2549eb4-e37a-4f0d-9273-3f7c580e9e80<br>
# gluster volume remove-brick glu_linux_dr2_oracle replica 2 glustoretst03.net.dr.dk:/bricks/brick1/glu_linux_dr2_oracle glustoretst04.net.dr.dk:/bricks/brick1/glu_linux_dr2_oracle status<br>
Node Rebalanced-files size scanned failures skipped status run time in secs<br>
--------- ----------- ----------- ----------- ----------- ----------- ------------ --------------<br>
<a href="http://glustoretst04.net.dr.dk" target="_blank">glustoretst04.net.dr.dk</a> 0 0Bytes 0 0 0 failed 0.00<br>
<a href="http://glustoretst03.net.dr.dk" target="_blank">glustoretst03.net.dr.dk</a> 0 0Bytes 0 0 0 failed 0.00<br>
<br>
******** log output *******<br>
# cat etc-glusterfs-glusterd.vol.log<br>
[2017-05-03 12:18:59.423867] I [glusterd-handler.c:1296:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req<br>
[2017-05-03 12:20:21.024213] I [glusterd-handler.c:3836:__glusterd_handle_status_volume] 0-management: Received status volume req for volume glu_int_dr2_dalet<br>
[2017-05-03 12:21:10.813956] I [glusterd-handler.c:1296:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req<br>
[2017-05-03 12:22:45.298742] I [glusterd-brick-ops.c:676:__glusterd_handle_remove_brick] 0-management: Received rem brick req<br>
[2017-05-03 12:22:45.298807] I [glusterd-brick-ops.c:722:__glusterd_handle_remove_brick] 0-management: request to change replica-count to 2<br>
[2017-05-03 12:22:45.311705] I [glusterd-utils.c:11549:glusterd_generate_and_set_task_id] 0-management: Generated task-id c2549eb4-e37a-4f0d-9273-3f7c580e9e80 for key remove-brick-id<br>
[2017-05-03 12:22:45.312296] I [glusterd-op-sm.c:5105:glusterd_bricks_select_remove_brick] 0-management: force flag is not set<br>
[2017-05-03 12:22:46.414038] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.419778] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.425132] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.429469] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.433623] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.439089] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.444048] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.448623] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.457386] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.538115] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.542870] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.547325] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.551742] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.555951] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.560725] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.565692] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.570027] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:46.578645] I [glusterd-volgen.c:1177:get_vol_nfs_transport_type] 0-glusterd: The default transport type for tcp,rdma volume is tcp if option is not defined by the user<br>
[2017-05-03 12:22:47.663980] I [glusterd-utils.c:6316:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV3 successfully<br>
[2017-05-03 12:22:47.664372] I [glusterd-utils.c:6321:glusterd_nfs_pmap_deregister] 0-: De-registered MOUNTV1 successfully<br>
[2017-05-03 12:22:47.664786] I [glusterd-utils.c:6326:glusterd_nfs_pmap_deregister] 0-: De-registered NFSV3 successfully<br>
[2017-05-03 12:22:47.665175] I [glusterd-utils.c:6331:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v4 successfully<br>
[2017-05-03 12:22:47.665559] I [glusterd-utils.c:6336:glusterd_nfs_pmap_deregister] 0-: De-registered NLM v1 successfully<br>
[2017-05-03 12:22:47.665943] I [glusterd-utils.c:6341:glusterd_nfs_pmap_deregister] 0-: De-registered ACL v3 successfully<br>
[2017-05-03 12:22:47.674503] I [rpc-clnt.c:969:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600<br>
[2017-05-03 12:22:47.674655] W [socket.c:3004:socket_connect] 0-management: Ignore failed connection attempt on , (No such file or directory)<br>
[2017-05-03 12:22:48.703206] I [rpc-clnt.c:969:rpc_clnt_connection_init] 0-management: setting frame-timeout to 600<br>
[2017-05-03 12:22:48.703345] W [socket.c:3004:socket_connect] 0-management: Ignore failed connection attempt on , (No such file or directory)<br>
[2017-05-03 12:22:49.458391] I [mem-pool.c:545:mem_pool_destroy] 0-management: size=588 max=0 total=0<br>
[2017-05-03 12:22:49.458429] I [mem-pool.c:545:mem_pool_destroy] 0-management: size=124 max=0 total=0<br>
[2017-05-03 12:22:49.470431] W [socket.c:620:__socket_rwv] 0-socket.management: writev on
<a href="http://127.0.0.1:985" target="_blank">127.0.0.1:985</a> failed (Broken pipe)<br>
[2017-05-03 12:22:49.470450] I [socket.c:2353:socket_event_handler] 0-transport: disconnecting now<br>
[2017-05-03 12:22:49.470929] W [socket.c:620:__socket_rwv] 0-socket.management: writev on
<a href="http://127.0.0.1:988" target="_blank">127.0.0.1:988</a> failed (Broken pipe)<br>
[2017-05-03 12:22:49.470945] I [socket.c:2353:socket_event_handler] 0-transport: disconnecting now<br>
[2017-05-03 12:22:49.473855] W [socket.c:620:__socket_rwv] 0-management: readv on /var/run/b10c65c880e831b5c91cf638e1c0e0e4.socket failed (Invalid argument)<br>
[2017-05-03 12:22:49.473880] I [MSGID: 106006] [glusterd-handler.c:4290:__glusterd_nodesvc_rpc_notify] 0-management: nfs has disconnected from glusterd.<br>
[2017-05-03 12:22:49.473907] I [mem-pool.c:545:mem_pool_destroy] 0-management: size=588 max=0 total=0<br>
[2017-05-03 12:22:49.473930] I [mem-pool.c:545:mem_pool_destroy] 0-management: size=124 max=0 total=0<br>
[2017-05-03 12:22:49.473986] W [socket.c:620:__socket_rwv] 0-management: readv on /var/run/6a75793fc0c76a2c9e9403f63ff38d99.socket failed (Invalid argument)<br>
[2017-05-03 12:22:49.474003] I [MSGID: 106006] [glusterd-handler.c:4290:__glusterd_nodesvc_rpc_notify] 0-management: glustershd has disconnected from glusterd.<br>
[2017-05-03 12:23:23.106811] E [glusterd-op-sm.c:3603:glusterd_op_ac_send_stage_op] 0-management: Staging of operation 'Volume Rebalance' failed on localhost : remove-brick not started.<br>
[2017-05-03 12:29:22.407630] I [glusterd-handler.c:1296:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req<br>
[2017-05-03 12:29:44.157973] I [glusterd-handler.c:1296:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req<br>
[2017-05-03 12:30:23.522501] I [glusterd-handler.c:1296:__glusterd_handle_cli_get_volume] 0-glusterd: Received get vol req<br>
<br>
******** Volume information *******<br>
# gluster volume info glu_linux_dr2_oracle<br>
Volume Name: glu_linux_dr2_oracle<br>
Type: Distributed-Replicate<br>
Volume ID: 3aef9266-0736-45b0-93bb-74248e18e85d<br>
Status: Started<br>
Number of Bricks: 3 x 2 = 6<br>
Transport-type: tcp,rdma<br>
Bricks:<br>
Brick1: glustoretst01.net.dr.dk:/bricks/brick2/glu_linux_dr2_oracle<br>
Brick2: glustoretst02.net.dr.dk:/bricks/brick2/glu_linux_dr2_oracle<br>
Brick3: glustoretst01.net.dr.dk:/bricks/brick1/glu_linux_dr2_oracle<br>
Brick4: glustoretst02.net.dr.dk:/bricks/brick1/glu_linux_dr2_oracle<br>
Brick5: glustoretst03.net.dr.dk:/bricks/brick1/glu_linux_dr2_oracle<br>
Brick6: glustoretst04.net.dr.dk:/bricks/brick1/glu_linux_dr2_oracle<br>
Options Reconfigured:<br>
features.quota: off<br>
storage.owner-gid: 0<br>
storage.owner-uid: 0<br>
cluster.server-quorum-type: server<br>
cluster.quorum-type: none<br>
performance.stat-prefetch: off<br>
performance.io-cache: off<br>
performance.read-ahead: off<br>
performance.quick-read: off<br>
auth.allow: 10.101.*<br>
user.cifs: disable<br>
nfs.disable: on<br>
cluster.server-quorum-ratio: 50%<br>
<br>
******** Gluster Version *******<br>
# rpm -qa | grep glusterfs<br>
glusterfs-3.6.9-1.el6.x86_64<br>
[root@glustertst01 glusterfs]# rpm -qa | grep glusterfs<br>
glusterfs-fuse-3.6.9-1.el6.x86_64<br>
glusterfs-server-3.6.9-1.el6.x86_64<br>
glusterfs-libs-3.6.9-1.el6.x86_64<br>
glusterfs-cli-3.6.9-1.el6.x86_64<br>
glusterfs-api-3.6.9-1.el6.x86_64<br>
glusterfs-3.6.9-1.el6.x86_64<br>
glusterfs-geo-replication-3.6.9-1.el6.x86_64<br>
<br>
Regards<br>
Jesper<br>
<br>
_______________________________________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" target="_blank">http://lists.gluster.org/mailman/listinfo/gluster-users</a><o:p></o:p></p>
</blockquote>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</body>
</html>