[Gluster-users] gfs vs nfs: abysmal performance difference

[Paolo Pisati]

Raghavendra G wrote:
> Can you try with write-behind loaded on client side?
>   
i did some more modifications to the client side:

volume client
  type protocol/client
  option transport-type tcp
  option remote-host 10.0.0.1         # IP address of the remote brick
  option remote-subvolume brick        # name of the remote volume
end-volume

### Add readahead feature
volume readahead
  type performance/read-ahead
  option page-size 1MB     # unit in bytes
  option page-count 2       # cache per file  = (page-count x page-size)
  subvolumes client
end-volume

### Add IO-Cache feature
volume iocache
  type performance/io-cache
  option page-size 256KB
  option page-count 2
  subvolumes readahead
end-volume

### Add writeback feature
volume writeback
  type performance/write-behind
  option aggregate-size 1MB
  option window-size 2MB
  option flush-behind off
  subvolumes iocache  
end-volume

and now:

gfs:
 >>> Kernel build for GENERIC started on Tue May 26 10:27:52 CEST 2009
Kernel build directory is /usr/obj/usr/src/sys/GENERIC
 >>> Kernel build for GENERIC completed on Tue May 26 10:41:02 CEST 2009

~14mins

nfs:
 >>> Kernel build for GENERIC started on Mon May 11 11:07:51 CEST 2009
Kernel build directory is /usr/obj/mnt/nfs/usr/src/sys/GENERIC
 >>> Kernel build for GENERIC completed on Mon May 11 11:23:13 CEST 2009

~16mins

it's faster tha NFS now!

but still it can't sustain a bonnie run:

 > sudo bonnie -d /mnt/nfs -m NFS
File '/mnt/nfs/Bonnie.61622', size: 104857600
Writing with putc()...done
Rewriting...done
Writing intelligently...done
Reading with getc()...done
Reading intelligently...done
Seeker 1...Seeker 2...Seeker 3...start 'em...done...done...done...
              -------Sequential Output-------- ---Sequential Input-- 
--Random--
              -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- 
--Seeks---
Machine    MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU  
/sec %CPU
NFS       100  9179  6.4  9195  2.2  6224  4.4 10590  7.6 1599999 99.9 
3980.8 25.7

 > sudo bonnie -d /mnt/gfs -m GFS
File '/mnt/gfs/Bonnie.61618', size: 104857600
Writing with putc()...done
Rewriting...done

Bonnie: drastic I/O error (/mnt/gfs/Bonnie.61618): Input/output error

any idea?

-- 

Paolo Pisati
Reparto Sistemi
---------
ContactLab
Via Natale Battaglia, 10
20127 Milano (Italy)
Tel. +39 02 28 31 181
Fax +39 02 70 03 02 69.
http://www.contactlab.com