[Gluster-users] gluster and rocks?

Michael Robbert mrobbert at mines.edu
Wed Oct 13 17:23:28 UTC 2010

The main feature that I'm missing is the ability to change file striping options on a per file or directory basis as a user. This is a power user feature that isn't a show stopper for us, but it is a feature that we had with Lustre. Gluster requires that an administrator creates another volume which assumes that we have LUNs available to do so.

Count Zero,
The reason we're looking at other options from Lustre is that Lustre has been less than stable for us and we've run into problems with Meta Data being a bottleneck for one set of users. We have full support for Lustre, but that is the only reason we've been able to use it at all. I don't have the time to come up to speed enough to support it on my own and we'd like to know if there are other options out there that may allow us to support a filesystem mostly on our own.

Mike Hanby,
We have only looked at the gluster-client so far. I'm not aware of any reason to limit ourselves to NFS as long as it is relatively simple to setup the gluster parallel client. If you're using it for home directories and don't want to mess with FUSE then NFS may be an option.


On Oct 12, 2010, at 6:16 PM, Craig Carl wrote:

Mike -
   If you get a chance I'd like to know what features Gluster is missing that you would like to see. Feel free to give me a call if that is easier for you. Also 3.1 went GA today if you want to try it - http://ftp.gluster.com/pub/gluster/glusterfs/3.1/LATEST/



Craig Carl
Senior Systems Engineer; Gluster, Inc.
Cell - (408) 829-9953<about:blank> (California, USA)
Office - (408) 770-1884<about:blank>
Gtalk - craig.carl at gmail.com<mailto:craig.carl at gmail.com>
Twitter - @gluster
Installing Gluster Storage Platform, the movie!<http://www.youtube.com/user/GlusterStorage>

From: "Michael Robbert" <mrobbert at mines.edu<mailto:mrobbert at mines.edu>>
To: "Lana Deere" <lana.deere at gmail.com<mailto:lana.deere at gmail.com>>
Cc: gluster-users at gluster.org<mailto:gluster-users at gluster.org>
Sent: Tuesday, October 12, 2010 9:13:10 AM
Subject: Re: [Gluster-users] gluster and rocks?

We at Colorado School of Mines are testing Gluster on our 268 node cluster that is running Rocks with Infiniband. There is no Roll for it, but the RPMs install fine when you put them in an extend-compute.xml file. We did have to recompile from source RPMs on Rocks 4.x, but now that we've moved to Rocks 5.x they install fine. The only hangup we had with IB was that we had to manually load some userspace IB modules on our front end (ib_umad, ib_uverbs, etc.). We have hit a couple of bugs with the 3.1 beta code, but we're getting them worked out. I found it very easy to setup a test deployment and encourage you to give it a try. It is much easier to setup than Lustre which is what we're using in production right now, but it doesn't have all the features. If it meets your needs though then it is probably a much better solution for small to medium sites.

Good Luck,
Mike Robbert

On Oct 9, 2010, at 12:45 AM, Lana Deere wrote:

> Is anyone using Gluster with the Rocks cluster system?  If so, do you
> know if there is a Roll for Gluster?  Or, do you have any advice about
> things to do and things to avoid doing?
> We're considering using Gluster with Infiniband on our cluster and
> trying to learn whether other people have done this so we can perhaps
> learn from their experience.
> Thanks.
> .. Lana (lana.deere at gmail.com<mailto:lana.deere at gmail.com>)
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org<mailto:Gluster-users at gluster.org>
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users

Gluster-users mailing list
Gluster-users at gluster.org<mailto:Gluster-users at gluster.org>

More information about the Gluster-users mailing list