<div dir="ltr">I was mistaken...<br>Genesha wasn't working. Glusters NFS was still on. :-/<div>so i fixed that....</div><div><br></div><div>XenServer (7.1) can't seem to mount NFS-Genesha, nfs v3 or v4, or using the xe command. (sr_backend_failure_73)</div><div><div><div><br></div></div>A Centos 7 box can, but not XenServer... I think thats the last nail :-/ back to the shelf Gluster goes sorry :-(, it works well for generic file server purposes but now a storage server (or cluster) _must_ handle VM images :-/ and with usable speed. I'll probably test it again in a year or so. I keep coming back since I first tested it years ago (and deployed to a few customers) Gluster is cool. maybe oVirt will have a more viable UI then too. But I am testing Proxmox next so ;-).<br><div><br></div><div><br></div></div></div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div><div>Travis Eddy<br></div><div>Smartware IT - Number 2<br></div><br></div>Cell (texts welcome) - 703.981.5765<br></div>Email - Travis@SmartwareIT.com<br></div></div></div>
<br><div class="gmail_quote">On Tue, Apr 4, 2017 at 6:38 PM, Travis Eddy <span dir="ltr"><<a href="mailto:travis@smartwareit.com" target="_blank">travis@smartwareit.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello,<br>The default (+epel) ones that get searched by yum? <br>the package is there after you run<br>yum install centos-release-gluster <div><br></div><div>So: <a href="http://blog.gluster.org/2015/10/linux-scale-out-nfsv4-using-nfs-ganesha-and-glusterfs-one-step-at-a-time/" target="_blank">http://blog.gluster.org/2015/<wbr>10/linux-scale-out-nfsv4-<wbr>using-nfs-ganesha-and-<wbr>glusterfs-one-step-at-a-time/</a></div><div>works if you run " yum install centos-release-gluster " first</div><div><br></div><div>Also is Ganesha is only working with " -o nfsvers=3 "</div><div><br></div><div>So Ganesha is working! :-) annndddd its just as slow as the Gluster internal NFS :-(<br><br><div><img src="cid:ii_j144ah3k0_15b3b16556b0e4e7" width="200" height="190"> (image showing network moving ~31Mb/sec and disk going ~5MB/sec)<br></div><div><br></div><div>So at this point I guess it something in Gluster it self causing the slow down. (again bland kernal NFS goes 100MB+ on the same hardware )</div></div><div><br></div><div><br></div><div>Thanks for the help getting Ganesha running :-) :-) <br><br>Any advice why Gluster isn't working so well as storage for Virtual hosts?<br><br></div><div><br></div><div><br></div><div><br></div></div><div class="gmail_extra"><span class=""><br clear="all"><div><div class="m_-2492125430833500847gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div><div>Travis Eddy<br></div><div>Smartware IT - Number 2<br></div><br></div>Cell (texts welcome) - <a href="tel:(703)%20981-5765" value="+17039815765" target="_blank">703.981.5765</a><br></div>Email - Travis@SmartwareIT.com<br></div></div></div>
<br></span><div><div class="h5"><div class="gmail_quote">On Tue, Apr 4, 2017 at 6:05 PM, Kaleb S. KEITHLEY <span dir="ltr"><<a href="mailto:kkeithle@redhat.com" target="_blank">kkeithle@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><br>
I see glusterfs-ganesha-3.10.0 and -3.10.1 in the Storage SIG repo at <a href="https://buildlogs.centos.org/centos/7/storage/x86_64/gluster-3.10/" rel="noreferrer" target="_blank">https://buildlogs.centos.org/c<wbr>entos/7/storage/x86_64/gluster<wbr>-3.10/</a><br>
<br>
What repos are you looking at?<span><br>
<br>
<br>
On 04/04/2017 02:21 PM, Travis Eddy wrote:<br>
</span><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span>
Centos 7.3 fresh installed this morning.<br>
<br>
current new this morning problem is the guides want<br>
package: glusterfs-ganesha and it doesn't exist anymore in the repos<br>
<br>
Before we would get 'file not found' errors, or permission denied. There<br>
where some differences in how various guides would explain the path,<br>
Pseudo, and volume options. We tried several variations. exporting via<br>
kernal nfs or gluster internal always worked. (selinux is in premissive)<br>
<br>
<br>
<br>
$ sudo yum search ganesha<br>
<br>
Loaded plugins: fastestmirror<br>
Loading mirror speeds from cached hostfile<br></span>
* base: <a href="http://centos.aol.com" rel="noreferrer" target="_blank">centos.aol.com</a> <<a href="http://centos.aol.com" rel="noreferrer" target="_blank">http://centos.aol.com</a>><br>
* epel: <a href="http://mirror.cogentco.com" rel="noreferrer" target="_blank">mirror.cogentco.com</a> <<a href="http://mirror.cogentco.com" rel="noreferrer" target="_blank">http://mirror.cogentco.com</a>><br>
* extras: <a href="http://mirror.rackspace.com" rel="noreferrer" target="_blank">mirror.rackspace.com</a> <<a href="http://mirror.rackspace.com" rel="noreferrer" target="_blank">http://mirror.rackspace.com</a>><br>
* updates: <a href="http://mirror.cs.vt.edu" rel="noreferrer" target="_blank">mirror.cs.vt.edu</a> <<a href="http://mirror.cs.vt.edu" rel="noreferrer" target="_blank">http://mirror.cs.vt.edu</a>><span><br>
==============================<wbr>======== N/S matched: ganesha<br>
==============================<wbr>=========<br>
nfs-ganesha-nullfs.x86_64 : The NFS-GANESHA's NULLFS Stackable FSAL<br>
nfs-ganesha-proxy.x86_64 : The NFS-GANESHA's PROXY FSAL<br>
nfs-ganesha-utils.x86_64 : The NFS-GANESHA's util scripts<br>
nfs-ganesha-vfs.x86_64 : The NFS-GANESHA's VFS FSAL<br>
nfs-ganesha-xfs.x86_64 : The NFS-GANESHA's XFS FSAL<br>
nfs-ganesha.x86_64 : NFS Server running in user space<br>
nfs-ganesha-mount-9P.x86_64 : a 9p mount helper<br>
<br>
Name and summary matches only, use "search all" for everything.<br>
<br>
<br>
<br>
your guide is<br>
: <a href="http://blog.gluster.org/2015/10/linux-scale-out-nfsv4-using-nfs-ganesha-and-glusterfs-one-step-at-a-time/" rel="noreferrer" target="_blank">http://blog.gluster.org/2015/1<wbr>0/linux-scale-out-nfsv4-using-<wbr>nfs-ganesha-and-glusterfs-one-<wbr>step-at-a-time/</a><br>
? correct? I think i'm going to start a list.<br>
<br>
Thanks for your help :-)<br>
<br>
Travis Eddy<br>
Smartware IT - Number 2<br>
<br>
Cell (texts welcome) - <a href="tel:703.981.5765" value="+17039815765" target="_blank">703.981.5765</a><br>
Email - Travis@SmartwareIT.com<br>
<br>
On Tue, Apr 4, 2017 at 2:09 PM, Kaleb S. KEITHLEY <<a href="mailto:kkeithle@redhat.com" target="_blank">kkeithle@redhat.com</a><br></span><div><div class="m_-2492125430833500847h5">
<mailto:<a href="mailto:kkeithle@redhat.com" target="_blank">kkeithle@redhat.com</a>>> wrote:<br>
<br>
On 04/04/2017 01:54 PM, Travis Eddy wrote:<br>
<br>
<br>
Thank you for the response.<br>
<br>
I'm Pretty sure the problem is with the Gluster's NFS and how<br>
XenServer<br>
interacts with it. As I feel like its not running in async mode.<br>
Everything is at-least 10x faster using bland kernel NFS with<br>
the async<br>
option... 90+MB/sec (saturate gigabit) vs 5~7MB/sec I'm pretty sure<br>
there is a default option in the gluster nfs that needs changing.<br>
<br>
I tried the " nfs.trusted-sync off" option.<br>
as well as the "tuned-adm profile rhgs-random-io " (which isn't<br>
aviable<br>
on cent btw)<br>
and using the gluster group virt and the redhat options<br>
<br>
Is there another way to ensure the Gluster NFS sync is in async<br>
mode?<br>
<br>
Also currently following the Gluster and Centos guides GlusterFS and<br>
Ganesha isn't working.<br>
<br>
<br>
What exactly didn't work?<br>
<br>
E.g. my blog article details setting up nfs-ganesha, from a very<br>
simple non-gluster setup, to a simple setup with gluster, and<br>
gluster with pacemaker HA.<br>
<br>
--<br>
<br>
Kaleb<br>
<br>
<br>
<br>
______________________________<wbr>_________________<br>
Gluster-users mailing list<br></div></div>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a> <mailto:<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.<wbr>org</a>><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br>
<<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mail<wbr>man/listinfo/gluster-users</a>><br>
<br>
<br>
</blockquote>
<br>
</blockquote></div><br></div></div></div>
</blockquote></div><br></div>