[Gluster-devel] Performance issue

[Raghavendra G]

Hi Ben,
Can you send us log files of client and server? Do you observe lots of
"bailing transport" kind of messages in the client log file? It seems that
your transport-timeout value in protocol/client is very small and causing
the bailouts of file system operations. In that case, can you try with
default value of transport-timeout (just dont specify the option in
volume-spec file)?

regards,
On Wed, Jul 16, 2008 at 11:33 AM, Ben Mok <benmok at powerallnetworks.com>
wrote:

> Hello ,
>
>
>
> I did the test to generate 100,000 files on glusterfs, each file is 4k, it
> need to take 150m27s . I did the same test in local disk and samba share,
> just 1m14s and 4m35s. Can you tell me how to improve the performance ,
> since
> I want to use glusterfs to handle a large amount of files.
>
> Thank you very much !!
>
>
>
> Ben
>
>
>
> ------------------
>
> Server conf
>
> -----------------
>
> volume storage-ds
>
>           type storage/posix
>
>           option directory /storage
>
>   end-volume
>
>   volume storage-ns
>
>           type storage/posix
>
>           option directory /storage-ns
>
>   end-volume
>
>   volume server
>
>     type protocol/server
>
>     option transport-type tcp/server
>
>     subvolumes storage-ds
>
>     option auth.ip.storage-ds.allow 172.16.*
>
>     option auth.ip.storage-ns.allow 172.16.*
>
>   end-volume
>
>
>
> ---------------
>
> Client conf
>
> ----------------
>
>   volume 01
>
>     type protocol/client
>
>     option transport-type tcp/client
>
>     option remote-host 172.16.40.11
>
>     option transport-timeout 15
>
>     option remote-subvolume storage-ds
>
>   end-volume
>
>
>
>   volume 01-ns
>
>     type protocol/client
>
>     option transport-type tcp/client
>
>     option remote-host 172.16.40.11
>
>     option transport-timeout 15
>
>     option remote-subvolume storage-ns
>
>   end-volume
>
>
>
>   volume 02
>
>     type protocol/client
>
>     option transport-type tcp/client
>
>     option remote-host 172.16.40.12
>
>     option transport-timeout 15
>
>     option remote-subvolume storage-ds
>
>   end-volume
>
>
>
>   volume 02-ns
>
>     type protocol/client
>
>     option transport-type tcp/client
>
>     option remote-host 172.16.40.12
>
>     option transport-timeout 15
>
>     option remote-subvolume storage-ns
>
>   end-volume
>
>
>
>   volume 03
>
>     type protocol/client
>
>     option transport-type tcp/client
>
>     option remote-host 172.16.40.13
>
>     option transport-timeout 15
>
>     option remote-subvolume storage-ds
>
>   end-volume
>
>
>
>
>
>   volume 04
>
>     type protocol/client
>
>     option transport-type tcp/client
>
>     option remote-host 172.16.40.14
>
>     option transport-timeout 15
>
>     option remote-subvolume storage-ds
>
>   end-volume
>
>
>
> volume afr-ns
>
>        type cluster/afr
>
>        subvolumes 01-ns 02-ns
>
>   end-volume
>
>
>
> volume afr01
>
>        type cluster/afr
>
>        subvolumes 01 02
>
>   end-volume
>
>
>
> volume afr02
>
>        type cluster/afr
>
>        subvolumes 03 04
>
>   end-volume
>
>
>
> volume storage-unify
>
>           type cluster/unify
>
>           subvolumes afr01 afr02
>
>           option namespace afr-ns
>
>           option scheduler rr
>
>           option rr.limits.min-free-disk 5%
>
>   end-volume
>
>
>
>   volume readahead
>
>        type performance/read-ahead
>
>        option page-size 128kb ### in bytes
>
>        option page-count 64 ### memory cache size is page-count x page-size
> per file
>
>        subvolumes storage-unify
>
>    end-volume
>
>
>
> volume iothreads
>
>           type performance/io-threads
>
>           option thread-count 8
>
>           option cache-size 128MB
>
>           subvolumes readahead
>
>   end-volume
>
>
>
> volume io-cache
>
> type performance/io-cache
>
> option cache-size 512MB             # default is 32MB
>
> option page-size 256KB               #128KB is default option
>
> option force-revalidate-timeout 7200  # default is 1
>
> subvolumes iothreads
>
> end-volume
>
>
>
> volume writebehind
>
>         type performance/write-behind
>
>         option aggregate-size 131072 # in bytes
>
>         option flush-behind on
>
>         subvolumes io-cache
>
>   end-volume
>
>
>
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>



-- 
Raghavendra G

A centipede was happy quite, until a toad in fun,
Said, "Prey, which leg comes after which?",
This raised his doubts to such a pitch,
He fell flat into the ditch,
Not knowing how to run.
-Anonymous