<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Vijay:</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I just tried that and the results using this command:</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
# for i in `seq -w 1 4`; do dd if=/dev/zero of=10Gfile$1 bs=1024k count=10240; done</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
is about 1/4th the write performance of a distributed volume.</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
(I'm currently testing with a 64 GB RAM drive on each of my four compute nodes that are then tied together using GlusterFS).</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
With a distributed volume, and with direct-io-mode=enable, at best, I can execute that same task at around 2 GB/s. (The host system could execute that task at around 2.8 GB/s to /dev/shm.)</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
With a dispersed volume with 1 brick for redundancy, it drops to around 500 MB/s at best.</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Is there no other way to be get the kind of performance that stripping should theorectically provide?</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Thank you.</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Sincerely,</div>
<div style="font-family: Calibri, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Ewen<br>
</div>
<div>
<div id="appendonsend"></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Vijay Bellur <vbellur@redhat.com><br>
<b>Sent:</b> August 20, 2019 7:50 PM<br>
<b>To:</b> Ewen Chan <alpha754293@hotmail.com><br>
<b>Cc:</b> gluster-users@gluster.org <gluster-users@gluster.org><br>
<b>Subject:</b> Re: [Gluster-users] Can I create a distributed dispersed volume with RAM drives?</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div dir="ltr"><br>
</div>
<br>
<div class="x_gmail_quote">
<div dir="ltr" class="x_gmail_attr">On Tue, Aug 20, 2019 at 4:47 PM Ewen Chan <<a href="mailto:alpha754293@hotmail.com">alpha754293@hotmail.com</a>> wrote:<br>
</div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Vijay:</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Here is what it says:</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span>[root@node1 brick1]# gluster volume create gv0 stripe 4 node1:/bricks/brick1/gv0 node2:/bricks/brick1/gv0 node3:/bricks/brick1/gv</span>0 node4:/bricks/brick1/gv0<br>
<span></span>
<div>stripe option not supported<br>
</div>
<div><br>
</div>
<div>Usage:<br>
</div>
<div>volume create <NEW-VOLNAME> [stripe <COUNT>] [replica <COUNT> [arbiter <COUNT>]] [disperse [<COUNT>]] [disperse-data <COUNT>] [red<br>
</div>
<span>undancy <COUNT>] [transport <tcp|rdma|tcp,rdma>] <NEW-BRICK>... [force]</span></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span><br>
</span></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span>It says that the stripe option is not supported, but then in the usage right below it, it gives the correct syntax for how to use the gluster volume create command.</span></div>
</div>
</blockquote>
<div><br>
</div>
<div><br>
</div>
<div>Creating stripe volumes has been deprecated in recent releases. You can create a dispersed volume using the following syntax:</div>
<div><br>
</div>
<div><span style="background-color:rgba(236,236,236,0.5); color:rgb(55,71,79); font-family:"Roboto Mono","Courier New",Courier,monospace; font-size:14.96px"># gluster volume create [disperse [<count>]] [redundancy <count>] <brick-list></span></div>
<div><br>
</div>
<div>HTH,</div>
<div>Vijay</div>
<div> </div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span><br>
</span></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span></span>Your help in this matter is greatly appreciated.</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thank you.</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Sincerely,</div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Ewen<br>
</div>
<div>
<div id="x_gmail-m_-5843708855707051269appendonsend"></div>
<div style="font-family:Calibri,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr style="display:inline-block; width:98%">
<div id="x_gmail-m_-5843708855707051269divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Vijay Bellur <<a href="mailto:vbellur@redhat.com" target="_blank">vbellur@redhat.com</a>><br>
<b>Sent:</b> August 20, 2019 6:21 PM<br>
<b>To:</b> Ewen Chan <<a href="mailto:alpha754293@hotmail.com" target="_blank">alpha754293@hotmail.com</a>><br>
<b>Cc:</b> <a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a> <<a href="mailto:gluster-users@gluster.org" target="_blank">gluster-users@gluster.org</a>><br>
<b>Subject:</b> Re: [Gluster-users] Can I create a distributed dispersed volume with RAM drives?</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div dir="ltr"><br>
</div>
<br>
<div class="x_gmail-m_-5843708855707051269x_gmail_quote">
<div dir="ltr" class="x_gmail-m_-5843708855707051269x_gmail_attr">On Tue, Aug 20, 2019 at 8:13 AM Ewen Chan <<a href="mailto:alpha754293@hotmail.com" target="_blank">alpha754293@hotmail.com</a>> wrote:<br>
</div>
<blockquote class="x_gmail-m_-5843708855707051269x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
To Whom It May Concern:<br>
<br>
I am currently using CentOS 7.6.1810 on four compute nodes, where each node has 128 GB of RAM.<br>
<br>
I have created a tmpfs mount point using half of the RAM.<br>
<br>
I read the CentOS SIG Gluster Quickstart wiki/document (<a href="https://wiki.centos.org/SpecialInterestGroup/Storage/gluster-Quickstart" rel="noreferrer" target="_blank">https://wiki.centos.org/SpecialInterestGroup/Storage/gluster-Quickstart</a>). In there,
it was creating a replicated volume.<br>
<br>
Can I create a distributed dispersed volume with RAM drives?<br>
<br>
I was able to create a distributed volume, but I am having difficulties trying to create a distributed dispersed volume.<br>
<br>
<br>
</blockquote>
<div><br>
</div>
<div>Can you provide more details about the problems encountered while creating a distributed dispersed volume?</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Vijay </div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
</div>
</div>
</div>
</body>
</html>