[Gluster-users] glusterfs 3.0.0 booster help

Raghavendra G raghavendra at gluster.com
Wed Jan 13 05:32:02 UTC 2010


Hi,

What do apache error logs say?

regards,
On Wed, Jan 13, 2010 at 7:23 AM, Jiann-Ming Su <sujiannming at gmail.com>wrote:

> I'm playing around with glusterfs 3.0.0 on a server acting as both the
> glusterfs server and client.  I've got a local directory
> (/mnt/gluster/gfs2) configured in /etc/glusterfs/glusterfsd.vol:
>
> volume posix1
>  type storage/posix
>  option directory /mnt/gluster/gfs2
> end-volume
>
> volume locks1
>    type features/locks
>    subvolumes posix1
> end-volume
>
> volume brick1
>    type performance/io-threads
>    option thread-count 8
>    subvolumes locks1
> end-volume
>
> volume server-tcp
>    type protocol/server
>    option transport-type tcp
>    option auth.addr.brick1.allow 127.0.0.1
>    option transport.socket.listen-port 6996
>    option transport.socket.nodelay on
>    subvolumes brick1
> end-volume
>
> Glusterfsd starts without problems.  The client config is as follows
> (gfs2-tcp.vol):
>
> volume localhost-1
>    type protocol/client
>    option transport-type tcp
>    option remote-host localhost
>    option transport.socket.nodelay on
>    option transport.remote-port 6996
>    option remote-subvolume brick1
> end-volume
>
> volume writebehind
>    type performance/write-behind
>    option cache-size 4MB
>    subvolumes localhost-1
> end-volume
>
> volume readahead
>    type performance/read-ahead
>    option page-count 4
>    subvolumes writebehind
> end-volume
>
> volume iocache
>    type performance/io-cache
>    option cache-size 1GB
>    option cache-timeout 1
>    subvolumes readahead
> end-volume
>
> volume quickread
>    type performance/quick-read
>    option cache-timeout 1
>    option max-file-size 64kB
>    subvolumes iocache
> end-volume
>
> volume statprefetch
>    type performance/stat-prefetch
>    subvolumes quickread
> end-volume
>
> The /etc/booster.fstab:
>
> /etc/glusterfs/gfs2-tcp.vol /var/boot glusterfs
>
> subvolume=brick1,logfile=/var/log/glusterfs/gfs2.log,loglevel=DEBUG,attr_timeout=0
>
> I start apache as follows:
>
> $ export GLUSTERFS_BOOSTER_FSTAB=/etc/booster.fstab
> $ LD_PRELOAD=/usr/lib/glusterfs/glusterfs-booster.so /usr/sbin/httpd
>
> I connect using cadaver and try to upload a file (install.log) and
> here's what I get in the glusterfs log file:
>
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4968:glusterfs_stat]
> libglusterfsclient: path /var/boot/install.log
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1641:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /var/boot/install.log, type:
> LongestPrefix
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry found: path :/var/boot/install.log vmp: /var/boot/
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:896:libgf_resolve_path_light]
> libglusterfsclient: Path: /install.log, Resolved Path: /install.log
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
> libglusterfsclient: path /install.log, op: 2
> [2010-01-12 22:10:16] D
> [libglusterfsclient-dentry.c:247:__do_path_resolve]
> libglusterfsclient-dentry: loc->parent(1) already present. sending
> lookup for 1//install.log
> [2010-01-12 22:10:16] D
> [libglusterfsclient-dentry.c:268:__do_path_resolve]
> libglusterfsclient-dentry: resolved path(/install.log) till 1(/).
> sending lookup for remaining path
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:2110:libgf_client_lookup_cbk]
> libglusterfsclient: 1: (op_num=0) /install.log => -1 (No such file or
> directory)
> [2010-01-12 22:10:16] E [libglusterfsclient.c:4900:__glusterfs_stat]
> libglusterfsclient: path lookup failed for (/install.log)
> [2010-01-12 22:10:16] E [booster.c:1928:booster_xstat64] booster:
> xstat64 failed: No such file or directory
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4998:glusterfs_lstat]
> libglusterfsclient: path /var
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1641:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /var, type: LongestPrefix
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /var
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4998:glusterfs_lstat]
> libglusterfsclient: path /var/boot
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1641:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /var/boot, type: LongestPrefix
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry found: path :/var/boot vmp: /var/boot/
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
> libglusterfsclient: path /, op: 1
> [2010-01-12 22:10:16] D
> [libglusterfsclient-dentry.c:390:libgf_client_path_lookup]
> libglusterfsclient: resolved path(/) to 1/1
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4819:libgf_client_stat]
> libglusterfsclient: path /, status 0, errno 0
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4998:glusterfs_lstat]
> libglusterfsclient: path /var/boot/install.log
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1641:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /var/boot/install.log, type:
> LongestPrefix
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry found: path :/var/boot/install.log vmp: /var/boot/
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:896:libgf_resolve_path_light]
> libglusterfsclient: Path: /install.log, Resolved Path: /install.log
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
> libglusterfsclient: path /install.log, op: 1
> [2010-01-12 22:10:16] D
> [libglusterfsclient-dentry.c:247:__do_path_resolve]
> libglusterfsclient-dentry: loc->parent(1) already present. sending
> lookup for 1//install.log
> [2010-01-12 22:10:16] D
> [libglusterfsclient-dentry.c:268:__do_path_resolve]
> libglusterfsclient-dentry: resolved path(/install.log) till 1(/).
> sending lookup for remaining path
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:2110:libgf_client_lookup_cbk]
> libglusterfsclient: 3: (op_num=0) /install.log => -1 (No such file or
> directory)
> [2010-01-12 22:10:16] E [libglusterfsclient.c:4900:__glusterfs_stat]
> libglusterfsclient: path lookup failed for (/install.log)
> [2010-01-12 22:10:16] E [booster.c:2176:booster_lxstat64] booster:
> lxstat64 failed: No such file or directory
> [2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
> libglusterfsclient: path /var/lib/dav/lockdb.dir
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1641:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.dir, type:
> LongestPrefix
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /var/lib/dav/lockdb.dir
> [2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
> [2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
> MPB: /var/lib/dav/lockdb.dir
> [2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
> libglusterfsclient: path /var/lib/dav/lockdb.pag
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1641:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.pag, type:
> LongestPrefix
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /var/lib/dav/lockdb.pag
> [2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
> [2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
> MPB: /var/lib/dav/lockdb.pag
> [2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4968:glusterfs_stat]
> libglusterfsclient: path /var/boot/install.log
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1641:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /var/boot/install.log, type:
> LongestPrefix
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry found: path :/var/boot/install.log vmp: /var/boot/
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:896:libgf_resolve_path_light]
> libglusterfsclient: Path: /install.log, Resolved Path: /install.log
> [2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
> libglusterfsclient: path /install.log, op: 2
> [2010-01-12 22:10:16] D
> [libglusterfsclient-dentry.c:247:__do_path_resolve]
> libglusterfsclient-dentry: loc->parent(1) already present. sending
> lookup for 1//install.log
> [2010-01-12 22:10:16] D
> [libglusterfsclient-dentry.c:268:__do_path_resolve]
> libglusterfsclient-dentry: resolved path(/install.log) till 1(/).
> sending lookup for remaining path
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:2110:libgf_client_lookup_cbk]
> libglusterfsclient: 4: (op_num=0) /install.log => -1 (No such file or
> directory)
> [2010-01-12 22:10:16] E [libglusterfsclient.c:4900:__glusterfs_stat]
> libglusterfsclient: path lookup failed for (/install.log)
> [2010-01-12 22:10:16] E [booster.c:1928:booster_xstat64] booster:
> xstat64 failed: No such file or directory
> [2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
> libglusterfsclient: path /var/lib/dav/lockdb.dir
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1641:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.dir, type:
> LongestPrefix
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /var/lib/dav/lockdb.dir
> [2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
> [2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
> MPB: /var/lib/dav/lockdb.dir
> [2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
> [2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
> libglusterfsclient: path /var/lib/dav/lockdb.pag
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1641:_libgf_vmp_search_entry]
> libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.pag, type:
> LongestPrefix
> [2010-01-12 22:10:16] D
> [libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
> VMP Entry not found: path: /var/lib/dav/lockdb.pag
> [2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
> [2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
> MPB: /var/lib/dav/lockdb.pag
> [2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
> user.glusterfs-booster-volfile not found: No data available
>
>
> The apache config is fine because if I run apache without glusterfs,
> the upload works without a problem.  I'm guessing I'm missing
> something pretty simple.  Thanks for any help or insight.
>
> --
> Jiann-Ming Su
> "I have to decide between two equally frightening options.
>  If I wanted to do that, I'd vote." --Duckman
> "The system's broke, Hank.  The election baby has peed in
> the bath water.  You got to throw 'em both out."  --Dale Gribble
> "Those who vote decide nothing.
> Those who count the votes decide everything.”  --Joseph Stalin
> _______________________________________________
> Gluster-users mailing list
> Gluster-users at gluster.org
> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>



-- 
Raghavendra G


More information about the Gluster-users mailing list