[Gluster-users] slow writes using replicate with 2.0rc1

[Anand Avati]

On Wed, Feb 4, 2009 at 4:58 AM, Ray Speth <speth at mit.edu> wrote:
> I am wondering if anyone knows how to achieve good performance when
> writing to a volume using cluter/replicate. I am getting write speeds of
> about 4 MB/s over Gigabit Ethernet when transferring (single, large)
> files to such a volume. When I remove replication, I get transfer rates
> using "cp" of 21 MB/s. I can get much higher rates using "dd" with large
> block sizes (at least 128KB) -- 34 MB/s for the replicated volume and
> 117 MB/s without replication. Read speeds are over 100 MB/s in all
> cases. The transfer rates for cp are comparable to those using dd with a
> block size between 4KB and 8KB.
>
> I am using Gluster 2.0.0rc1 on Ubuntu 8.10 (Intrepid) systems, running
> the stock 2.6.27 kernel. I have tried a range of things with the various
> performance translators, but have not seen much change in performance. I
>  tried applying the FUSE patch, but it appears that the patch for FUSE
> 2.7.3 modifies sections of the kernel module that have changed in the
> 2.6.27 kernel.
>
> Does anyone know how I can improve the write performance in this type of
> setup? Even the 21 MB/s that I get without replicate would be
> acceptable, even if it's not really making use of all the available
> bandwidth.
>
> My server and client configuration files are below. These include
> cluster/distribute as well, but I don't think that has any effect when
> copying a single file.

We are working on replicate performance. Please check back in a couple of weeks.

Avati