[Gluster-users] Gluster Performance Issues

[Felix Kölzow]

Dear Gluster-Experts,


we created a three-node setup with two bricks each and a dispersed
volume that can be

accessed via the native client (glusterfs --version = 6.0).


The nodes are connected via 10Gbps (cat6,bonding mode 6).


If we running a performance test using the smallfile benchmark tool,

./smallfile_cli.py --top ~/test6/ --file-size 16384 --threads 8 --files
1000 --response-times y --operation create

we observing the

behavior as  shown in the attached figure. For a short time, we can
almost saturated the 10Gbps but

then immediately network traffic is dropping almost to zero for about 5
to 25 seconds.

Actually, we don't have any glue what does causes this strange behavior.
We had a lot of

reconfigured volume options and now we are starting from scratch, i.e.


gluster volume reset dispersed_fuse all


and the current options looks like:

Volume Name: dispersed_fuse
Type: Disperse
Volume ID: 45d3c7c9-526f-45ea-9930-ee7a2274a220
Status: Started
Snapshot Count: 1
Number of Bricks: 1 x (4 + 2) = 6
Transport-type: tcp
Bricks:
Brick1: mimas:/gluster/vg00/dispersed_fuse/brick
Brick2: enceladus:/gluster/vg00/dispersed_fuse/brick
Brick3: tethys:/gluster/vg00/dispersed_fuse/brick
Brick4: mimas:/gluster/vg01/dispersed_fuse/brick
Brick5: enceladus:/gluster/vg01/dispersed_fuse/brick
Brick6: tethys:/gluster/vg01/dispersed_fuse/brick
Options Reconfigured:
client.event-threads: 16
server.event-threads: 16
performance.io-thread-count: 16
geo-replication.ignore-pid-check: on
geo-replication.indexing: on
features.quota: off
features.inode-quota: off
nfs.disable: on
storage.fips-mode-rchecksum: on
server.outstanding-rpc-limit: 512
server.root-squash: off
cluster.server-quorum-ratio: 51%
cluster.enable-shared-storage: enable


Any hints for root cause analysis are appreciated.

Please let me know if you need more information.


Kind Regards,

Felix

-------------- next part --------------
A non-text attachment was scrubbed...
Name: gluster_smallfile_Performance_test_nativeClient_dispersed_fuse.png
Type: image/png
Size: 74264 bytes
Desc: not available
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20200220/c17c4fb1/attachment.png>