[Gluster-users] Problem: Gluster performance too high..

[Harry Mangalam]

I'm doing some perf tests on a small gluster filesystem - 5 bricks on 
4 servers, all single-homed on the private net.

I've spawned up to 70 simultaneous jobs on our cluster nodes writing 
files of various sizes from /dev/zero to the gluster fs to see what 
the effect on the aggregate bandwith and the data is slightly 
unbelievable in that it seems to exceed the theoretical max of the 
network. (I used /dev/zero instead of /dev/urandom since /dev/urandom 
couldn't generate data fast enough.

The 35,000 files of the right size do hit the filesystem (of course 
they're all zero's) but the speed at which they transfer exceeds (by 
quite a bit) the theoretical max of a 1 Gb network.

Does gluster (or anything else) do transparent compression?  What else 
would explain this oddity?


-- 
Harry Mangalam - Research Computing, OIT, Rm 225 MSTB, UC Irvine
[ZOT 2225] / 92697  Google Voice Multiplexer: (949) 478-4487
415 South Circle View Dr, Irvine, CA, 92697 [shipping]
MSTB Lat/Long: (33.642025,-117.844414) (paste into Google Maps)
--
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20120329/a029b8ad/attachment.html>