[Gluster-devel] Re: AFR between freebsd and debian linux

Sun Jul 27 19:45:26 UTC 2008

Hi Michael,
Over FreeBSD side, client is not tested for 1.3.x releases. You can try
version 1.40qa30 onwards if you want to have cross OS GlusterFS, and client
on any of the MacOS X/BSD (other than GNU/Linux).  Solaris fuse (ie, client
part) is not yet tested even with 1.4.0qa releases.

Regards,
Amar

2008/7/26 Michael Grant <mgrant at grant.org>

> On Sat, Jul 26, 2008 at 3:42 PM, Michael Grant <mgrant at grant.org> wrote:
> > I'm trying to get Brandon Lamb's example from May 1 2008 working on my
> > server.  (
> http://www.mail-archive.com/gluster-devel@nongnu.org/msg04021.html)
> >
> > I started with just a simple client/server though and I'm having some
> trouble.
> >
> > On the debian side of things, I created a client and server to mount
> > the remote brick1 from the freebsd side.  However, when I mount it,
> > this is what I get:
> >
> > # glusterfs -f test.vol /mnt
> > fuse: device not found, try 'modprobe fuse' first
> >
> > When the debian box boots, it dutifully reports this:
> >  Loading kernel modules...fuse init (API version 7.7)
> >
> > I tried the 'modprobe fuse', here's what it says:
> >
> > # modprobe -V fuse
> > module-init-tools version 3.3-pre2
> >
> > but the glusterfs still fails.  What am I missing?
> >
> > Michael Grant
> >
>
> I'm a little farther along.  I had to mknod /dev/fuse manually on the
> linux side:
>
> # cd /dev
> # ./MAKEDEV fuse
> # ls -l /dev/.static/dev/fuse
> crw-rw---- 1 root root 10, 229 Jul 26 16:37 /dev/.static/dev/fuse
> # mknod /dev/fuse c 10 229
>
> however, now I'm having problems on the freebsd side:
>
> I'm trying to mount a simple server like this:
>
> server.vol:
> volume brick1
>        type storage/posix
>        option directory /shared/testdir
> end-volume
>
> volume server
>        type protocol/server
>        option transport-type tcp/server
>        subvolumes brick1
>        option auth.ip.brick1.allow 127.0.0.1
> end-volume
>
> client.vol:
> volume brick
>        type protocol/client
>        option transport-type tcp/client
>        option remote-host localhost
>        option remote-subvolume brick1
> end-volume
>
> When I run:
>
> # glusterfs -f client.vol /mnt
>
> it exits rather quickly.  Also:
>
> #  ls /mnt
> ls: /mnt: Bad file descriptor
>
> which I guess is to be expected.
>
> if I run glusterfs /mnt in the forground (-N) with full debug, here is the
> log:
>
> 2008-07-26 16:46:58 D [glusterfs.c:167:get_spec_fp] glusterfs: loading
> spec from test.vol
> 2008-07-26 16:46:58 D [spec.y:107:new_section] parser: New node for 'brick'
> 2008-07-26 16:46:58 D [xlator.c:115:xlator_set_type] xlator: attempt
> to load file /usr/local/lib/glusterfs/1.3.10/xlator/protocol/client.so
> 2008-07-26 16:46:58 D [spec.y:127:section_type] parser:
> Type:brick:protocol/client
> 2008-07-26 16:46:58 D [spec.y:141:section_option] parser:
> Option:brick:transport-type:tcp/client
> 2008-07-26 16:46:58 D [spec.y:141:section_option] parser:
> Option:brick:remote-host:localhost
> 2008-07-26 16:46:58 D [spec.y:141:section_option] parser:
> Option:brick:remote-subvolume:brick1
> 2008-07-26 16:46:58 D [spec.y:209:section_end] parser: end:brick
> 2008-07-26 16:46:58 D [client-protocol.c:5006:init] brick: defaulting
> transport-timeout to 42
> 2008-07-26 16:46:58 D [transport.c:80:transport_load] transport:
> attempt to load file
> /usr/local/lib/glusterfs/1.3.10/transport/tcp/client.so
> 2008-07-26 16:46:58 D [client-protocol.c:5033:init] brick: defaulting
> limits.transaction-size to 268435456
> 2008-07-26 16:46:58 D [client-protocol.c:5333:notify] brick: got
> GF_EVENT_PARENT_UP, attempting connect on transport
> 2008-07-26 16:46:58 D
> [client-protocol.c:4750:client_protocol_reconnect] brick: attempting
> reconnect
> 2008-07-26 16:46:58 D [tcp-client.c:77:tcp_connect] brick: socket fd = 4
> 2008-07-26 16:46:58 D [tcp-client.c:107:tcp_connect] brick: finalized
> on port `1021'
> 2008-07-26 16:46:58 D [tcp-client.c:128:tcp_connect] brick: defaulting
> remote-port to 6996
> 2008-07-26 16:46:58 D [common-utils.c:179:gf_resolve_ip] resolver: DNS
> cache not present, freshly probing hostname: localhost
> 2008-07-26 16:46:58 D [common-utils.c:204:gf_resolve_ip] resolver:
> returning IP:127.0.0.1[0] for hostname: localhost
> 2008-07-26 16:46:58 D [common-utils.c:212:gf_resolve_ip] resolver:
> flushing DNS cache
> 2008-07-26 16:46:58 D [tcp-client.c:161:tcp_connect] brick: connect on
> 4 in progress (non-blocking)
> 2008-07-26 16:46:58 D [tcp-client.c:205:tcp_connect] brick: connection
> on 4 success
> 2008-07-26 16:46:58 D [client-protocol.c:5355:notify] brick: got
> GF_EVENT_CHILD_UP
> 2008-07-26 16:46:58 D
> [client-protocol.c:5096:client_protocol_handshake_reply] brick: reply
> frame has callid: 424242
> 2008-07-26 16:46:58 D
> [client-protocol.c:5130:client_protocol_handshake_reply] brick:
> SETVOLUME on remote-host succeeded
> 2008-07-26 16:46:59 D
> [client-protocol.c:4756:client_protocol_reconnect] brick: breaking
> reconnect chain
>
>
> on the server side:
>
> 2008-07-26 16:46:58 D [tcp-server.c:145:tcp_server_notify] server:
> Registering socket (5) for new transport object of 127.0.0.1
> 2008-07-26 16:46:58 D [ip.c:120:gf_auth] brick1: allowed =
> "127.0.0.1", received ip addr = "127.0.0.1"
> 2008-07-26 16:46:58 D [server-protocol.c:5667:mop_setvolume] server:
> accepted client from 127.0.0.1:1021
>
> I get "/mnt: Bad file descriptor".
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>

-- 
Amar Tumballi
Gluster/GlusterFS Hacker
[bulde on #gluster/irc.gnu.org]
http://www.zresearch.com - Commoditizing Super Storage!