[Gluster-users] Writing performance gets slower when write threadsare many

[Maik Kulbe]

-----Original Mail-----
From: Jung Young Seok [jung.youngseok at gmail.com]
Sent: 22.08.13 - 17:19:32
To: gluster-users at gluster.org

Subject: [Gluster-users] Writing performance gets slower when write threadsare many

> Dear gluster users,
>
> We have set up  glusterfs 3.4 on cent 6. 2 Gluster FS servers are
> replicated each (2brick x 2).
> Glusterfs is mounted on WAS as fuse.
>
> We realized when there are more thread to write files on gluster fs, it
> gets slower on writing.
>
> We've set 250 thread to write 1M file each repeatedly. In this case we get
> under 30 TPS. No NW bandwidth problem.
> Is there any way to avoid performance degradation when there are lots of
> write threads?

That depends on a lot of factors - what interconnect are you using? 1GE? 10GE? RDMA? What are your bricks built on? SATA? SSD? RAID?

My first guess would be that interconnect latency and a kernel maximum for some connection count could be the problem.

>
> Look forward any help.
> Thanks.
>
> Regards,
> Youngseok jung