[Gluster-users] very bad performance on small files

[Max Ivanov]

Hi! I've deployed glusterfs on 2 nodes using replication mode and done
some tests.

Peroformance drop was significant and I've no idea if its possible to
improve it or not. Volume was mounted on one of nodes using both FUSE
and NFS glusterfs clients.

 1.1G of small files are stored on volume. To make command shorter M
symbol is used as mountpoint label. Native performance is performance
of command issued over native FS on one of the bricks. No other
activities on both node happened.

Here is the results per command:
dd if=/dev/zero of=M/tmp bs=1M count=16384 69.2 MB/se (Native) 69.2
MB/sec(FUSE) 52 MB/sec (NFS)
dd if=/dev/zero of=M/tmp bs=1K count=163840000  88.1 MB/sec  (Native)
1.1MB/sec (FUSE) 52.4 MB/sec (NFS)
time tar cf - M | pv > /dev/null 15.8 MB/sec (native) 3.48MB/sec
(FUSE) 254 Kb/sec (NFS)

I use default configuration, no adjustments to /etc/gluster* where
made. I use ext4 on bricks.