[Gluster-users] glusterfs 3.0.0 booster help

Jiann-Ming Su sujiannming at gmail.com
Wed Jan 13 03:23:05 UTC 2010 

I'm playing around with glusterfs 3.0.0 on a server acting as both the
glusterfs server and client.  I've got a local directory
(/mnt/gluster/gfs2) configured in /etc/glusterfs/glusterfsd.vol:

volume posix1
  type storage/posix
  option directory /mnt/gluster/gfs2
end-volume

volume locks1
    type features/locks
    subvolumes posix1
end-volume

volume brick1
    type performance/io-threads
    option thread-count 8
    subvolumes locks1
end-volume

volume server-tcp
    type protocol/server
    option transport-type tcp
    option auth.addr.brick1.allow 127.0.0.1
    option transport.socket.listen-port 6996
    option transport.socket.nodelay on
    subvolumes brick1
end-volume

Glusterfsd starts without problems.  The client config is as follows
(gfs2-tcp.vol):

volume localhost-1
    type protocol/client
    option transport-type tcp
    option remote-host localhost
    option transport.socket.nodelay on
    option transport.remote-port 6996
    option remote-subvolume brick1
end-volume

volume writebehind
    type performance/write-behind
    option cache-size 4MB
    subvolumes localhost-1
end-volume

volume readahead
    type performance/read-ahead
    option page-count 4
    subvolumes writebehind
end-volume

volume iocache
    type performance/io-cache
    option cache-size 1GB
    option cache-timeout 1
    subvolumes readahead
end-volume

volume quickread
    type performance/quick-read
    option cache-timeout 1
    option max-file-size 64kB
    subvolumes iocache
end-volume

volume statprefetch
    type performance/stat-prefetch
    subvolumes quickread
end-volume

The /etc/booster.fstab:

/etc/glusterfs/gfs2-tcp.vol /var/boot glusterfs
subvolume=brick1,logfile=/var/log/glusterfs/gfs2.log,loglevel=DEBUG,attr_timeout=0

I start apache as follows:

$ export GLUSTERFS_BOOSTER_FSTAB=/etc/booster.fstab
$ LD_PRELOAD=/usr/lib/glusterfs/glusterfs-booster.so /usr/sbin/httpd

I connect using cadaver and try to upload a file (install.log) and
here's what I get in the glusterfs log file:

[2010-01-12 22:10:16] D [libglusterfsclient.c:4968:glusterfs_stat]
libglusterfsclient: path /var/boot/install.log
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/boot/install.log, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: path :/var/boot/install.log vmp: /var/boot/
[2010-01-12 22:10:16] D
[libglusterfsclient.c:896:libgf_resolve_path_light]
libglusterfsclient: Path: /install.log, Resolved Path: /install.log
[2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
libglusterfsclient: path /install.log, op: 2
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:247:__do_path_resolve]
libglusterfsclient-dentry: loc->parent(1) already present. sending
lookup for 1//install.log
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:268:__do_path_resolve]
libglusterfsclient-dentry: resolved path(/install.log) till 1(/).
sending lookup for remaining path
[2010-01-12 22:10:16] D
[libglusterfsclient.c:2110:libgf_client_lookup_cbk]
libglusterfsclient: 1: (op_num=0) /install.log => -1 (No such file or
directory)
[2010-01-12 22:10:16] E [libglusterfsclient.c:4900:__glusterfs_stat]
libglusterfsclient: path lookup failed for (/install.log)
[2010-01-12 22:10:16] E [booster.c:1928:booster_xstat64] booster:
xstat64 failed: No such file or directory
[2010-01-12 22:10:16] D [libglusterfsclient.c:4998:glusterfs_lstat]
libglusterfsclient: path /var
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var, type: LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var
[2010-01-12 22:10:16] D [libglusterfsclient.c:4998:glusterfs_lstat]
libglusterfsclient: path /var/boot
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/boot, type: LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: path :/var/boot vmp: /var/boot/
[2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
libglusterfsclient: path /, op: 1
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:390:libgf_client_path_lookup]
libglusterfsclient: resolved path(/) to 1/1
[2010-01-12 22:10:16] D [libglusterfsclient.c:4819:libgf_client_stat]
libglusterfsclient: path /, status 0, errno 0
[2010-01-12 22:10:16] D [libglusterfsclient.c:4998:glusterfs_lstat]
libglusterfsclient: path /var/boot/install.log
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/boot/install.log, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: path :/var/boot/install.log vmp: /var/boot/
[2010-01-12 22:10:16] D
[libglusterfsclient.c:896:libgf_resolve_path_light]
libglusterfsclient: Path: /install.log, Resolved Path: /install.log
[2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
libglusterfsclient: path /install.log, op: 1
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:247:__do_path_resolve]
libglusterfsclient-dentry: loc->parent(1) already present. sending
lookup for 1//install.log
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:268:__do_path_resolve]
libglusterfsclient-dentry: resolved path(/install.log) till 1(/).
sending lookup for remaining path
[2010-01-12 22:10:16] D
[libglusterfsclient.c:2110:libgf_client_lookup_cbk]
libglusterfsclient: 3: (op_num=0) /install.log => -1 (No such file or
directory)
[2010-01-12 22:10:16] E [libglusterfsclient.c:4900:__glusterfs_stat]
libglusterfsclient: path lookup failed for (/install.log)
[2010-01-12 22:10:16] E [booster.c:2176:booster_lxstat64] booster:
lxstat64 failed: No such file or directory
[2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
libglusterfsclient: path /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.dir, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
[2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
MPB: /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
user.glusterfs-booster-volfile not found: No data available
[2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
libglusterfsclient: path /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.pag, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
[2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
MPB: /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
user.glusterfs-booster-volfile not found: No data available
[2010-01-12 22:10:16] D [libglusterfsclient.c:4968:glusterfs_stat]
libglusterfsclient: path /var/boot/install.log
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/boot/install.log, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1728:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry found: path :/var/boot/install.log vmp: /var/boot/
[2010-01-12 22:10:16] D
[libglusterfsclient.c:896:libgf_resolve_path_light]
libglusterfsclient: Path: /install.log, Resolved Path: /install.log
[2010-01-12 22:10:16] D [libglusterfsclient.c:4889:__glusterfs_stat]
libglusterfsclient: path /install.log, op: 2
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:247:__do_path_resolve]
libglusterfsclient-dentry: loc->parent(1) already present. sending
lookup for 1//install.log
[2010-01-12 22:10:16] D
[libglusterfsclient-dentry.c:268:__do_path_resolve]
libglusterfsclient-dentry: resolved path(/install.log) till 1(/).
sending lookup for remaining path
[2010-01-12 22:10:16] D
[libglusterfsclient.c:2110:libgf_client_lookup_cbk]
libglusterfsclient: 4: (op_num=0) /install.log => -1 (No such file or
directory)
[2010-01-12 22:10:16] E [libglusterfsclient.c:4900:__glusterfs_stat]
libglusterfsclient: path lookup failed for (/install.log)
[2010-01-12 22:10:16] E [booster.c:1928:booster_xstat64] booster:
xstat64 failed: No such file or directory
[2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
libglusterfsclient: path /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.dir, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
[2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
MPB: /var/lib/dav/lockdb.dir
[2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
user.glusterfs-booster-volfile not found: No data available
[2010-01-12 22:10:16] D [libglusterfsclient.c:3090:glusterfs_open]
libglusterfsclient: path /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1641:_libgf_vmp_search_entry]
libglusterfsclient: VMP Search: path /var/lib/dav/lockdb.pag, type:
LongestPrefix
[2010-01-12 22:10:16] D
[libglusterfsclient.c:1731:libgf_vmp_search_entry] libglusterfsclient:
VMP Entry not found: path: /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] E [booster.c:414:vmp_open] booster: VMP open failed
[2010-01-12 22:10:16] D [booster.c:267:do_open] booster: Opening using
MPB: /var/lib/dav/lockdb.pag
[2010-01-12 22:10:16] E [booster.c:272:do_open] booster: Xattr
user.glusterfs-booster-volfile not found: No data available


The apache config is fine because if I run apache without glusterfs,
the upload works without a problem.  I'm guessing I'm missing
something pretty simple.  Thanks for any help or insight.

-- 
Jiann-Ming Su
"I have to decide between two equally frightening options.
 If I wanted to do that, I'd vote." --Duckman
"The system's broke, Hank.  The election baby has peed in
the bath water.  You got to throw 'em both out."  --Dale Gribble
"Those who vote decide nothing.
Those who count the votes decide everything.”  --Joseph Stalin

More information about the Gluster-users mailing list