[Gluster-users] QEMU

[Kevin Lemonnier]

> Are you willing to share your hardware/network configuration? We are
> planning a cluster
> similiar to yours.

Sure, we are using those : https://www.ovh.com/fr/serveurs_dedies/details-servers.xml?range=ENT&id=2016-SP-64
The last variant with 3 SAS Drives + a Caching SSD with hard RAID.

> > I could send you the bonnie++ results from those two tests tomorrow if you want,
> > kept that at work.
> 
> Yes, this could be interested. If possible, could you please share

On 3.7.6 with 10ms of ping between the nodes :

Version  1.97       ------Sequential Output------ --Sequential Input--
-Random-Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block----Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP /sec %CP
ha1              4G   998  90 34441   3 40618   3  4102  95 2039179  25 2934  24
Latency             12031us     723ms    3632ms    6021us     333us 20238us
Version  1.97       ------Sequential Create------ --------Random Create--------
ha1                 -Create-- --Read--- -Delete-- -Create-- --Read---
-Delete-- files /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP /sec %CP
          1000  5499   5 849370  99  2402   3 26968  26 954899  99 1237   2
 Latency       53555ms    6838uqs    6272ms    1326ms     338us		 14823ms


On 3.7.11 with nodes in the same town :

Version  1.97       ------Sequential Output------ --Sequential Input--
-Random- Concurrency   1     -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
Machine        Size K/sec %CP K/sec %CP K/sec %CP K/sec %CP K/sec %CP  /sec %CP
ha1              4G  1129  97 36847   5 37363   1 +++++ +++ +++++ +++ +++++ +++
Latency              9639us 1607ms    3376ms    1239us     442us    1675us
Version  1.97 ------Sequential Create------ --------Random Create--------
ha1                 -Create-- --Read--- -Delete-- -Create-- --Read---
-Delete-- files  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec %CP  /sec
%CP 16 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
Latency     573us     274us     441us     534us      16us 1145us


As you can see, much better results ! The latency isn't even in the same unit.

> some benchmark for the
> same VM running from gluster and running directly from localstorage ?
>

Sorry, the way I installed those nodes won't allow me to test that for now.
When 3.7.12 is out, if it works as well as I hope, I'm planning to re-install
most of it so I'll probably do a test like that, I'll share the result if you
are still interested then.

> What i've read is that with native gluster connector for QEMU
> performance are almost identical
> to the plain qemu (this looks pretty strange to me)

I doubt that, it works well but I do see a difference when I rsync stuff in the VMs.
Not a huge deal though, the bandwith isn't of great interest to me, the latency is.

-- 
Kevin Lemonnier
PGP Fingerprint : 89A5 2283 04A0 E6E9 0111
-------------- next part --------------
A non-text attachment was scrubbed...
Name: signature.asc
Type: application/pgp-signature
Size: 819 bytes
Desc: Digital signature
URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20160614/71f95e94/attachment.sig>