<html xmlns="http://www.w3.org/1999/xhtml">
<head>
<title></title>
</head>
<body>
<div name="messageBodySection">
<div dir="auto"><span style="font-family:Overpass;font-size: 12px">Hi all.</span><span style="font-size: 12px"><br /></span><span style="font-size: 12px"><br /></span><span style="font-family:Overpass;font-size: 12px">I acrtually did something like that myself.</span><span style="font-size: 12px"><br /></span><span style="font-size: 12px"><br /></span><span style="font-family:Overpass;font-size: 12px">I started out with a single node HC cluster. I then added another node (and plan to add a third). This is what I did:</span><span style="font-size: 12px"><br /></span><span style="font-size: 12px"><br /></span><span style="font-family:Overpass;font-size: 12px">1) Set up the new node. Make sure that you have all dependencies. (In my case I started with a Centos 8 machine, and installed vdms-gluster and gluster-ansible)</span><br />
<span style="font-family:Overpass;font-size: 12px">2) Configure the bricks. For this I just copied over hc_wizard_inventory.yml over from the first node, edited it to fit the second node, and just ran the gluster.infra role.</span><br />
<span style="font-family:Overpass;font-size: 12px">3) Expand the volume. In this case with the following command:</span><span style="font-size: 12px"><br /></span><span style="font-family:Overpass;font-size: 12px">gluster volume add-brick engine replica 2 <host>:/gluster_bricks/engine/engine</span><span style="font-size: 12px"><br /></span><span style="font-family:Overpass;font-size: 12px">4) now just add the host as a hypervisor using the management console.</span><span style="font-size: 12px"><br /></span><span style="font-size: 12px"><br /></span><span style="font-family:Overpass;font-size: 12px">I plan on adding a third node. Then I want to have full replica on the engine, and replica 2 + arbiter on the vmstore volume.</span> <span style="font-size: 12px"><br /></span><span style="font-size: 12px"><br /></span><span style="font-family:Overpass;font-size: 12px">Expanding gluster volumes, migrating from distributed to replicated and even replacing bricks etc. is rather easy in Gluster once you know how it works. I have even replaced all the servers on a live gluster cluster, without service interruption…</span><span style="font-size: 12px"><br /></span><span style="font-size: 12px"><br /></span><span style="font-family:Overpass;font-size: 12px">Krist</span><span style="font-size: 12px"><br /></span><br /></div>
</div>
<div name="messageReplySection">On Jul 18, 2019, 09:58 +0200, Leo David <leoalex@gmail.com>, wrote:<br />
<blockquote type="cite" style="border-left-color: grey; border-left-width: thin; border-left-style: solid; margin: 5px 5px;padding-left: 10px;">
<div dir="ltr">
<div>Hi,</div>
<div>Looks like the only way arround would be to create a brand-new volume as replicated on other disks, and start moving the vms all around the place between volumes ?</div>
<div>Cheers,</div>
<div><br /></div>
<div>Leo<br /></div>
</div>
<br />
<div class="gmail_quote">
<div class="gmail_attr" dir="ltr">On Mon, May 27, 2019 at 1:53 PM Leo David <<a href="mailto:leoalex@gmail.com">leoalex@gmail.com</a>> wrote:<br /></div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;padding-left:1ex;border-left-color:rgb(204,204,204);border-left-width:1px;border-left-style:solid">
<div dir="ltr">
<div>Hi,</div>
<div>Any suggestions ?</div>
<div>Thank you very much !</div>
<div><br /></div>
<div>Leo<br /></div>
</div>
<br />
<div class="gmail_quote">
<div class="gmail_attr" dir="ltr">On Sun, May 26, 2019 at 4:38 PM Strahil Nikolov <<a href="mailto:hunter86_bg@yahoo.com" target="_blank">hunter86_bg@yahoo.com</a>> wrote:<br /></div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;padding-left:1ex;border-left-color:rgb(204,204,204);border-left-width:1px;border-left-style:solid">
<div>
<div class="gmail-m_8350655719309692731gmail-m_-368479882485809233ydp13cb1d2ayahoo-style-wrap" style="font-family:courier new,courier,monaco,monospace,sans-serif;font-size:16px">
<div>
<div>Yeah,</div>
<div>it seems different from the docs.</div>
<div>I'm adding the gluster users list ,as they are more experienced into that.</div>
<div><br /></div>
<div>@Gluster-users,</div>
<div><br /></div>
<div>can you provide some hint how to add aditional replicas to the below volumes , so they become 'replica 2 arbiter 1' or 'replica 3' type volumes ?</div>
<div><br /></div>
<div><br /></div>
<div>Best Regards,</div>
<div>Strahil Nikolov<br /></div>
<div><br /></div>
</div>
<div class="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yahoo_quoted" id="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yahoo_quoted_9850378863">
<div style="color:rgb(38,40,42);font-family:"Helvetica Neue",Helvetica,Arial,sans-serif;font-size:13px">
<div>В неделя, 26 май 2019 г., 15:16:18 ч. Гринуич+3, Leo David <<a href="mailto:leoalex@gmail.com" target="_blank">leoalex@gmail.com</a>> написа:</div>
<div><br /></div>
<div><br /></div>
<div>
<div id="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yiv4182972734">
<div>
<div>Thank you Strahil,
<div>The engine and ssd-samsung are distributed...</div>
<div>So these are the ones that I need to have replicated accross new nodes.</div>
<div>I am not very sure about the procedure to accomplish this.</div>
<div>Thanks,</div>
<div><br clear="none" /></div>
<div>Leo</div>
</div>
<br clear="none" />
<div class="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yiv4182972734yqt1493494139" id="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yiv4182972734yqt93166">
<div class="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yiv4182972734gmail_quote">
<div class="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yiv4182972734gmail_attr" dir="ltr">On Sun, May 26, 2019, 13:04 Strahil <<a href="mailto:hunter86_bg@yahoo.com" target="_blank" rel="nofollow" shape="rect">hunter86_bg@yahoo.com</a>> wrote:<br clear="none" /></div>
<blockquote class="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yiv4182972734gmail_quote" style="margin:0px 0px 0px 0.8ex;padding-left:1ex;border-left-color:rgb(204,204,204);border-left-width:1px;border-left-style:solid">
<p dir="ltr">Hi Leo,<br clear="none" />
As you do not have a distributed volume , you can easily switch to replica 2 arbiter 1 or replica 3 volumes.</p>
<p dir="ltr">You can use the following for adding the bricks:</p>
<p dir="ltr"><a href="https://access.redhat.com/documentation/en-US/Red_Hat_Storage/2.1/html/Administration_Guide/Expanding_Volumes.html" target="_blank" rel="nofollow" shape="rect">https://access.redhat.com/documentation/en-US/Red_Hat_Storage/2.1/html/Administration_Guide/Expanding_Volumes.html</a></p>
<p dir="ltr">Best Regards,<br clear="none" />
Strahil Nikoliv</p>
<div class="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yiv4182972734m_2531301829819838648quote">On May 26, 2019 10:54, Leo David <<a href="mailto:leoalex@gmail.com" target="_blank" rel="nofollow" shape="rect">leoalex@gmail.com</a>> wrote:<br clear="none" />
<blockquote class="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yiv4182972734m_2531301829819838648quote" style="margin:0px 0px 0px 0.8ex;padding-left:1ex;border-left-color:rgb(204,204,204);border-left-width:1px;border-left-style:solid">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div>Hi Stahil,</div>
<div>Thank you so much for yout input !</div>
<div><br clear="none" /></div>
<div> gluster volume info</div>
<div><br clear="none" /></div>
<div><br clear="none" /></div>
<div>Volume Name: engine<br clear="none" />
Type: Distribute<br clear="none" />
Volume ID: d7449fc2-cc35-4f80-a776-68e4a3dbd7e1<br clear="none" />
Status: Started<br clear="none" />
Snapshot Count: 0<br clear="none" />
Number of Bricks: 1<br clear="none" />
Transport-type: tcp<br clear="none" />
Bricks:<br clear="none" />
Brick1: <a href="http://192.168.80.191" target="_blank" rel="nofollow" shape="rect">192.168.80.191</a>:/gluster_bricks/engine/engine<br clear="none" />
Options Reconfigured:<br clear="none" />
nfs.disable: on<br clear="none" />
transport.address-family: inet<br clear="none" />
storage.owner-uid: 36<br clear="none" />
storage.owner-gid: 36<br clear="none" />
features.shard: on<br clear="none" />
performance.low-prio-threads: 32<br clear="none" />
performance.strict-o-direct: off<br clear="none" />
network.remote-dio: off<br clear="none" />
network.ping-timeout: 30<br clear="none" />
user.cifs: off<br clear="none" />
performance.quick-read: off<br clear="none" />
performance.read-ahead: off<br clear="none" />
<a href="http://performance.io" target="_blank" rel="nofollow" shape="rect">performance.io</a>-cache: off<br clear="none" />
cluster.eager-lock: enable</div>
<div>Volume Name: ssd-samsung<br clear="none" />
Type: Distribute<br clear="none" />
Volume ID: 76576cc6-220b-4651-952d-99846178a19e<br clear="none" />
Status: Started<br clear="none" />
Snapshot Count: 0<br clear="none" />
Number of Bricks: 1<br clear="none" />
Transport-type: tcp<br clear="none" />
Bricks:<br clear="none" />
Brick1: <a href="http://192.168.80.191" target="_blank" rel="nofollow" shape="rect">192.168.80.191</a>:/gluster_bricks/sdc/data<br clear="none" />
Options Reconfigured:<br clear="none" />
cluster.eager-lock: enable<br clear="none" />
<a href="http://performance.io" target="_blank" rel="nofollow" shape="rect">performance.io</a>-cache: off<br clear="none" />
performance.read-ahead: off<br clear="none" />
performance.quick-read: off<br clear="none" />
user.cifs: off<br clear="none" />
network.ping-timeout: 30<br clear="none" />
network.remote-dio: off<br clear="none" />
performance.strict-o-direct: on<br clear="none" />
performance.low-prio-threads: 32<br clear="none" />
features.shard: on<br clear="none" />
storage.owner-gid: 36<br clear="none" />
storage.owner-uid: 36<br clear="none" />
transport.address-family: inet<br clear="none" />
nfs.disable: on</div>
<div><br clear="none" /></div>
<div>The other two hosts will be <a href="http://192.168.80.192/193" target="_blank" rel="nofollow" shape="rect">192.168.80.192/193</a>  - this is gluster dedicated network over 10GB sfp+ switch.</div>
<div>- host 2 wil have identical harware configuration with host 1 ( each disk is actually a raid0 array )</div>
<div>- host 3 has:</div>
<div>   -  1 ssd for OS</div>
<div>   -  1 ssd - for adding to engine volume in a full replica 3</div>
<div>   -  2 ssd's in a raid 1 array to be added as arbiter for the data volume ( ssd-samsung )</div>
<div>So the plan is to have "engine"  scaled in a full replica 3,  and "ssd-samsung" scalled in a replica 3 arbitrated.</div>
<div><br clear="none" /></div>
<div><br clear="none" />
<br clear="none" /></div>
</div>
</div>
</div>
<br clear="none" />
<div class="gmail-m_8350655719309692731gmail-m_-368479882485809233ydpfeef3b2yiv4182972734m_2531301829819838648elided-text">
<div dir="ltr">On Sun, May 26, 2019 at 10:34 AM Strahil <<a href="mailto:hunter86_bg@yahoo.com" target="_blank" rel="nofollow" shape="rect">hunter86_bg@yahoo.com</a>> wrote:<br clear="none" /></div>
<blockquote style="margin:0px 0px 0px 0.8ex;padding-left:1ex;border-left-color:rgb(204,204,204);border-left-width:1px;border-left-style:solid">
<p dir="ltr">Hi Leo,</p>
<p dir="ltr">Gluster is quite smart, but in order to provide any hints , can you provide output of 'gluster volume info <glustervol>'.<br clear="none" />
If you have 2 more systems , keep in mind that it is best to mirror the storage on the second replica (2 disks on 1 machine -> 2 disks on the new machine), while for the arbiter this is not neccessary.</p>
<p dir="ltr">What is your network and NICs ? Based on my experience , I can recommend at least 10 gbit/s  interfase(s).</p>
<p dir="ltr">Best Regards,<br clear="none" />
Strahil Nikolov</p>
<div>On May 26, 2019 07:52, Leo David <<a href="mailto:leoalex@gmail.com" target="_blank" rel="nofollow" shape="rect">leoalex@gmail.com</a>> wrote:<br clear="none" />
<blockquote style="margin:0px 0px 0px 0.8ex;padding-left:1ex;border-left-color:rgb(204,204,204);border-left-width:1px;border-left-style:solid">
<div>Hello Everyone,
<div>Can someone help me to clarify this ?</div>
<div>I have a single-node 4.2.8 installation ( only two gluster storage domains - distributed  single drive volumes ). Now I just got two identintical servers and I would like to go for a 3 nodes bundle.</div>
<div>Is it possible ( after joining the new nodes to the cluster ) to expand the existing volumes across the new nodes and change them to replica 3 arbitrated ?</div>
<div>If so, could you share with me what would it be the procedure ?</div>
<div>Thank you very much !</div>
<div><br clear="none" /></div>
<div>Leo</div>
</div>
</blockquote>
</div>
</blockquote>
</div>
<br clear="all" />
<br clear="none" />
--<br clear="none" />
<div dir="ltr">Best regards, Leo David</div>
</blockquote>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br clear="all" />
<br />
--<br />
<div class="gmail-m_8350655719309692731gmail_signature" dir="ltr">Best regards, Leo David</div>
</blockquote>
</div>
<br clear="all" />
<br />
--<br />
<div class="gmail_signature" dir="ltr">Best regards, Leo David</div>
_______________________________________________<br />
Gluster-users mailing list<br />
Gluster-users@gluster.org<br />
https://lists.gluster.org/mailman/listinfo/gluster-users<br /></blockquote>
</div>
</body>
</html>