[Gluster-users] Can't access volume during self-healing

[Toby Corkindale]

On 10/10/13 05:22, Pruner, Anne (Anne) wrote:
> I’m evaluating gluster for use in our product, and I want to ensure that
> I understand the failover behavior.  What I’m seeing isn’t great, but it
> doesn’t look from the docs I’ve read that this is what everyone else is
> experiencing.
>
> Is this normal?
>
> Setup:
>
> -one volume, distributed, replicated (2), with two bricks on two
> different servers
>
> -35,000 files on volume, about 1MB each, all in one directory (I’m open
> to changing this, if that’s the problem.  ls –l takes a /really/ long time)


I've posted to the list about this issue before actually.
We had/have a similar requirement for storing a very large number of 
fairly small files, and originally had them all in just a few 
directories in glusterfs.
It turns out that Glusterfs is really badly suited to directories with 
large numbers of files in them. If you can split them up, do so, and 
performance will become tolerable again.

But even then it wasn't great.. Self-heal can swamp the network, making 
access for clients so slow as to cause problems.

For your use case (wanting distributed, replicated storage for large 
numbers of 1mb files) I suggest you check out Riak and the Riak CS 
add-on. It's proven to be great for that particular use-case for us.


-Toby