[Gluster-users] Performance

[Mohit Anchlia]

Is 128K block size right size given that file sizes I have is from 70K - 2MB?

Please find

[root at dsdb1 ~]# dd if=/dev/zero of=/data/big.file bs=128k count=80k
81920+0 records in
81920+0 records out
10737418240 bytes (11 GB) copied, 14.751 seconds, 728 MB/s
[root at dsdb1 ~]# echo 3 > /proc/sys/vm/drop_caches
[root at dsdb1 ~]# dd of=/dev/null if=/data/big.file bs=128k
81920+0 records in
81920+0 records out
10737418240 bytes (11 GB) copied, 3.10485 seconds, 3.5 GB/s

On Wed, Apr 20, 2011 at 10:49 AM, Joe Landman
<landman at scalableinformatics.com> wrote:
> On 04/20/2011 01:42 PM, Mohit Anchlia wrote:
>>
>>  mount
>> /dev/mapper/VolGroup00-LogVol00 on / type ext3 (rw)
>> proc on /proc type proc (rw)
>> sysfs on /sys type sysfs (rw)
>> devpts on /dev/pts type devpts (rw,gid=5,mode=620)
>> /dev/sdb1 on /boot type ext3 (rw)
>> tmpfs on /dev/shm type tmpfs (rw)
>> none on /proc/sys/fs/binfmt_misc type binfmt_misc (rw)
>> sunrpc on /var/lib/nfs/rpc_pipefs type rpc_pipefs (rw)
>> /dev/sda1 on /data type ext3 (rw)
>> glusterfs#dsdb1:/stress-volume on /data/mnt-stress type fuse
>> (rw,allow_other,default_permissions,max_read=131072)
>
> ok ...
>
> so gluster is running atop /data/mnt-stress, which is on /dev/sda1 and is
> ext3.
>
> Could you do this
>
>        dd if=/dev/zero of=/data/big.file bs=128k count=80k
>        echo 3 > /proc/sys/vm/drop_caches
>        dd of=/dev/null if=/data/big.file bs=128k
>
> so we can see the write and then read performance using 128k blocks?
>
> Also, since you are using the gluster native client, you don't get all the
> nice NFS caching bits.  Gluster native client is somewhat slower than the
> NFS client.
>
> So lets start with the write/read speed of the system before we deal with
> the gluster side of things.
>
>>
>>
>> On Wed, Apr 20, 2011 at 10:39 AM, Joe Landman
>> <landman at scalableinformatics.com>  wrote:
>>>
>>> On 04/20/2011 01:35 PM, Mohit Anchlia wrote:
>>>>
>>>> Should that command be there by default? I couldn't find lsscsi
>>>
>>> How about
>>>
>>>        mount
>>>
>>> output?
>>>
>>>
>>> --
>>> Joseph Landman, Ph.D
>>> Founder and CEO
>>> Scalable Informatics Inc.
>>> email: landman at scalableinformatics.com
>>> web  : http://scalableinformatics.com
>>>       http://scalableinformatics.com/sicluster
>>> phone: +1 734 786 8423 x121
>>> fax  : +1 866 888 3112
>>> cell : +1 734 612 4615
>>>
>
>
> --
> Joseph Landman, Ph.D
> Founder and CEO
> Scalable Informatics Inc.
> email: landman at scalableinformatics.com
> web  : http://scalableinformatics.com
>       http://scalableinformatics.com/sicluster
> phone: +1 734 786 8423 x121
> fax  : +1 866 888 3112
> cell : +1 734 612 4615
>