[Gluster-users] GlusterFS performance

[Robert van Leeuwen]

> Mounted with default options by Gluster-FUSE.

Gluster-FUSE client takes care of replication.
So the client makes sure the data is sent to all server nodes.

So with a replicate count of 2 the traffic from the client node doubles.
With 3 replica's you triple network load from a client perspective.
So a client maxes out around 30 MB/sec with a 1Gbit uplink.

You could try to trunk the network on your client but 10Gbit ethernet ( i suggest to use fiber, because of latency issues with copper 10Gbit) 
or Infiniband would be the way to go for high throughput.

Before going that way I would first make sure your real-life load is indeed bandwidth limited and not IOPS limited.
Copying a few files and looking at the speed usually does not say a lot about real-life perfomance.
(unless real-life is also just one person copying big files around)
Most workloads I see hit IOPS limits a long time before throughput.

Cheers,
Robert