[Gluster-devel] Re: AFR between freebsd and debian linux

[Michael Grant]

On Sat, Jul 26, 2008 at 3:42 PM, Michael Grant <mgrant at grant.org> wrote:
> I'm trying to get Brandon Lamb's example from May 1 2008 working on my
> server.  (http://www.mail-archive.com/gluster-devel@nongnu.org/msg04021.html)
>
> I started with just a simple client/server though and I'm having some trouble.
>
> On the debian side of things, I created a client and server to mount
> the remote brick1 from the freebsd side.  However, when I mount it,
> this is what I get:
>
> # glusterfs -f test.vol /mnt
> fuse: device not found, try 'modprobe fuse' first
>
> When the debian box boots, it dutifully reports this:
>  Loading kernel modules...fuse init (API version 7.7)
>
> I tried the 'modprobe fuse', here's what it says:
>
> # modprobe -V fuse
> module-init-tools version 3.3-pre2
>
> but the glusterfs still fails.  What am I missing?
>
> Michael Grant
>

I'm a little farther along.  I had to mknod /dev/fuse manually on the
linux side:

# cd /dev
# ./MAKEDEV fuse
# ls -l /dev/.static/dev/fuse
crw-rw---- 1 root root 10, 229 Jul 26 16:37 /dev/.static/dev/fuse
# mknod /dev/fuse c 10 229

however, now I'm having problems on the freebsd side:

I'm trying to mount a simple server like this:

server.vol:
volume brick1
        type storage/posix
        option directory /shared/testdir
end-volume

volume server
        type protocol/server
        option transport-type tcp/server
        subvolumes brick1
        option auth.ip.brick1.allow 127.0.0.1
end-volume

client.vol:
volume brick
        type protocol/client
        option transport-type tcp/client
        option remote-host localhost
        option remote-subvolume brick1
end-volume

When I run:

# glusterfs -f client.vol /mnt

it exits rather quickly.  Also:

#  ls /mnt
ls: /mnt: Bad file descriptor

which I guess is to be expected.

if I run glusterfs /mnt in the forground (-N) with full debug, here is the log:

2008-07-26 16:46:58 D [glusterfs.c:167:get_spec_fp] glusterfs: loading
spec from test.vol
2008-07-26 16:46:58 D [spec.y:107:new_section] parser: New node for 'brick'
2008-07-26 16:46:58 D [xlator.c:115:xlator_set_type] xlator: attempt
to load file /usr/local/lib/glusterfs/1.3.10/xlator/protocol/client.so
2008-07-26 16:46:58 D [spec.y:127:section_type] parser:
Type:brick:protocol/client
2008-07-26 16:46:58 D [spec.y:141:section_option] parser:
Option:brick:transport-type:tcp/client
2008-07-26 16:46:58 D [spec.y:141:section_option] parser:
Option:brick:remote-host:localhost
2008-07-26 16:46:58 D [spec.y:141:section_option] parser:
Option:brick:remote-subvolume:brick1
2008-07-26 16:46:58 D [spec.y:209:section_end] parser: end:brick
2008-07-26 16:46:58 D [client-protocol.c:5006:init] brick: defaulting
transport-timeout to 42
2008-07-26 16:46:58 D [transport.c:80:transport_load] transport:
attempt to load file
/usr/local/lib/glusterfs/1.3.10/transport/tcp/client.so
2008-07-26 16:46:58 D [client-protocol.c:5033:init] brick: defaulting
limits.transaction-size to 268435456
2008-07-26 16:46:58 D [client-protocol.c:5333:notify] brick: got
GF_EVENT_PARENT_UP, attempting connect on transport
2008-07-26 16:46:58 D
[client-protocol.c:4750:client_protocol_reconnect] brick: attempting
reconnect
2008-07-26 16:46:58 D [tcp-client.c:77:tcp_connect] brick: socket fd = 4
2008-07-26 16:46:58 D [tcp-client.c:107:tcp_connect] brick: finalized
on port `1021'
2008-07-26 16:46:58 D [tcp-client.c:128:tcp_connect] brick: defaulting
remote-port to 6996
2008-07-26 16:46:58 D [common-utils.c:179:gf_resolve_ip] resolver: DNS
cache not present, freshly probing hostname: localhost
2008-07-26 16:46:58 D [common-utils.c:204:gf_resolve_ip] resolver:
returning IP:127.0.0.1[0] for hostname: localhost
2008-07-26 16:46:58 D [common-utils.c:212:gf_resolve_ip] resolver:
flushing DNS cache
2008-07-26 16:46:58 D [tcp-client.c:161:tcp_connect] brick: connect on
4 in progress (non-blocking)
2008-07-26 16:46:58 D [tcp-client.c:205:tcp_connect] brick: connection
on 4 success
2008-07-26 16:46:58 D [client-protocol.c:5355:notify] brick: got
GF_EVENT_CHILD_UP
2008-07-26 16:46:58 D
[client-protocol.c:5096:client_protocol_handshake_reply] brick: reply
frame has callid: 424242
2008-07-26 16:46:58 D
[client-protocol.c:5130:client_protocol_handshake_reply] brick:
SETVOLUME on remote-host succeeded
2008-07-26 16:46:59 D
[client-protocol.c:4756:client_protocol_reconnect] brick: breaking
reconnect chain


on the server side:

2008-07-26 16:46:58 D [tcp-server.c:145:tcp_server_notify] server:
Registering socket (5) for new transport object of 127.0.0.1
2008-07-26 16:46:58 D [ip.c:120:gf_auth] brick1: allowed =
"127.0.0.1", received ip addr = "127.0.0.1"
2008-07-26 16:46:58 D [server-protocol.c:5667:mop_setvolume] server:
accepted client from 127.0.0.1:1021

I get "/mnt: Bad file descriptor".