[Gluster-users] trying to launch 1.3.11 on FreeBSD 7.1-PRERELEASE

Dmitry Sukhodoyev raven428 at gmail.com
Mon Aug 31 10:27:14 UTC 2009 

hi. i trying to launch glusterfs 1.3.11 on FreeBSD 7.1-PRERELEASE. i 
don't want to try 2.0.6 because AFR is not working on FreeBSD in 2.0.

server config:
=== cut ===
volume pos1
 type storage/posix
 option directory /home/export/b1
end-volume

volume pos2
 type storage/posix
 option directory /home/export/b2
end-volume

volume pos3
 type storage/posix
 option directory /home/export/b3
end-volume

volume pos4
 type storage/posix
 option directory /home/export/b4
end-volume

volume pl1
 type features/posix-locks
 option mandatory-locks on
 subvolumes pos1
end-volume

volume pl2
 type features/posix-locks
 option mandatory-locks on
 subvolumes pos2
end-volume

volume pl3
 type features/posix-locks
 option mandatory-locks on
 subvolumes pos3
end-volume

volume pl4
 type features/posix-locks
 option mandatory-locks on
 subvolumes pos4
end-volume

volume b1
  type performance/io-threads
  option thread-count 8
  subvolumes pl1
end-volume

volume b2
  type performance/io-threads
  option thread-count 8
  subvolumes pl2
end-volume

volume b3
  type performance/io-threads
  option thread-count 8
  subvolumes pl3
end-volume

volume b4
  type performance/io-threads
  option thread-count 8
  subvolumes pl4
end-volume

volume posn1
 type storage/posix
 option directory /home/export/bn1
end-volume

volume posn2
 type storage/posix
 option directory /home/export/bn2
end-volume

volume pln1
 type features/posix-locks
 option mandatory-locks on
 subvolumes posn1
end-volume

volume pln2
 type features/posix-locks
 option mandatory-locks on
 subvolumes posn2
end-volume

volume bn1
 type performance/io-threads
 option thread-count 8
 subvolumes pln1
end-volume

volume bn2
 type performance/io-threads
 option thread-count 8
 subvolumes pln2
end-volume

volume server
 type protocol/server
 option transport-type tcp/server
 option auth.ip.b1.allow 10.72.0.*
 option auth.ip.b2.allow 10.72.0.*
 option auth.ip.b3.allow 10.72.0.*
 option auth.ip.b4.allow 10.72.0.*
 option auth.ip.bn1.allow 10.72.0.*
 option auth.ip.bn2.allow 10.72.0.*
 subvolumes b1 b2 b3 b4 bn1 bn2
end-volume
=== cut ===

client config:
=== cut ===
volume b1
 type protocol/client
 option transport-type tcp/client
 option remote-host 10.72.0.119
 option remote-subvolume b1
end-volume

#volume bwh1
# type performance/write-behind
# option window-size 1MB
# subvolumes b1
#end-volume

#volume bc1
# type performance/io-cache
# option cache-size 10MB
# subvolumes bwh1
#end-volume
=== cut ===

server launcher:
=== cut ===
#!/bin/sh
/usr/local/gluster1/sbin/glusterfsd \
 -N -L DEBUG \
 -l /var/log/glusterfs-server.log \
 -f /home/raven/temp/gluster/1/etc/glusterfs-server.vol
=== cut ===

client launcher:
=== cut ===
#!/bin/sh
/usr/local/gluster1/sbin/glusterfs \
 -N -L DEBUG \
 -l /var/log/glusterfs-client.log \
 -f /home/raven/temp/gluster/1/etc/glusterfs-client.vol \
 -n b1 \
 /mnt
=== cut ===

server log:
=== cut ===
2009-08-31 16:19:30 E [protocol.c:271:gf_block_unserialize_transport] 
server: EOF from peer (10.72.0.119:1023)
2009-08-31 16:19:30 D [tcp.c:87:tcp_disconnect] server: connection 
disconnected
2009-08-31 16:19:30 D [server-protocol.c:6269:server_protocol_cleanup] 
server: cleaned up transport state for client 10.72.0.119:1023
2009-08-31 16:19:30 D [tcp-server.c:257:gf_transport_fini] server: 
destroying transport object for 10.72.0.119:1023 (fd=5)
2009-08-31 16:20:10 D [glusterfs.c:167:get_spec_fp] glusterfs: loading 
spec from /home/raven/temp/gluster/1/etc/glusterfs-server.vol
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pos1'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pos1:storage/posix
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pos1:directory:/home/export/b1
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pos1
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pos2'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pos2:storage/posix
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pos2:directory:/home/export/b2
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pos2
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pos3'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pos3:storage/posix
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pos3:directory:/home/export/b3
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pos3
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pos4'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pos4:storage/posix
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pos4:directory:/home/export/b4
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pos4
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pl1'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pl1:features/posix-locks
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pl1:mandatory-locks:on
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pl1->pos1
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pl1
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pl2'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pl2:features/posix-locks
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pl2:mandatory-locks:on
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pl2->pos2
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pl2
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pl3'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pl3:features/posix-locks
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pl3:mandatory-locks:on
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pl3->pos3
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pl3
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pl4'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pl4:features/posix-locks
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pl4:mandatory-locks:on
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pl4->pos4
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pl4
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'b1'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:b1:performance/io-threads
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:b1:thread-count:8
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:b1->pl1
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:b1
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'b2'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:b2:performance/io-threads
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:b2:thread-count:8
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:b2->pl2
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:b2
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'b3'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:b3:performance/io-threads
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:b3:thread-count:8
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:b3->pl3
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:b3
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'b4'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:b4:performance/io-threads
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:b4:thread-count:8
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:b4->pl4
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:b4
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'posn1'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:posn1:storage/posix
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:posn1:directory:/home/export/bn1
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:posn1
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'posn2'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/storage/posix.so
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:posn2:storage/posix
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:posn2:directory:/home/export/bn2
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:posn2
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pln1'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pln1:features/posix-locks
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pln1:mandatory-locks:on
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pln1->posn1
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pln1
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'pln2'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/features/posix-locks.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:pln2:features/posix-locks
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:pln2:mandatory-locks:on
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:pln2->posn2
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:pln2
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'bn1'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:bn1:performance/io-threads
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:bn1:thread-count:8
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:bn1->pln1
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:bn1
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'bn2'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/xlator/performance/io-threads.so
2009-08-31 16:20:10 D [xlator.c:145:xlator_set_type] xlator: 
dlsym(notify) on Undefined symbol "notify" -- neglecting
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:bn2:performance/io-threads
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:bn2:thread-count:8
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:bn2->pln2
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:bn2
2009-08-31 16:20:10 D [spec.y:107:new_section] parser: New node for 'server'
2009-08-31 16:20:10 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/protocol/server.so
2009-08-31 16:20:10 D [spec.y:127:section_type] parser: 
Type:server:protocol/server
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:server:transport-type:tcp/server
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:server:auth.ip.b1.allow:10.72.0.*
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:server:auth.ip.b2.allow:10.72.0.*
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:server:auth.ip.b3.allow:10.72.0.*
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:server:auth.ip.b4.allow:10.72.0.*
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:server:auth.ip.bn1.allow:10.72.0.*
2009-08-31 16:20:10 D [spec.y:141:section_option] parser: 
Option:server:auth.ip.bn2.allow:10.72.0.*
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->b1
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->b2
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->b3
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->b4
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->bn1
2009-08-31 16:20:10 D [spec.y:196:section_sub] parser: child:server->bn2
2009-08-31 16:20:10 D [spec.y:209:section_end] parser: end:server
2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using 
conf->thread_count = 8
2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using 
conf->thread_count = 8
2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using 
conf->thread_count = 8
2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using 
conf->thread_count = 8
2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using 
conf->thread_count = 8
2009-08-31 16:20:10 D [io-threads.c:1166:init] io-threads: Using 
conf->thread_count = 8
2009-08-31 16:20:10 D [server-protocol.c:6309:init] server: 
protocol/server xlator loaded
2009-08-31 16:20:10 D [transport.c:80:transport_load] transport: attempt 
to load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/transport/tcp/server.so
2009-08-31 16:20:10 D [server-protocol.c:6350:init] server: defaulting 
limits.transaction-size to 4194304
=== cut ==

client log:
=== cut ===
2009-08-31 16:21:56 D [glusterfs.c:167:get_spec_fp] glusterfs: loading 
spec from /home/raven/temp/gluster/1/etc/glusterfs-client.vol
2009-08-31 16:21:56 D [spec.y:107:new_section] parser: New node for 'b1'
2009-08-31 16:21:56 D [xlator.c:115:xlator_set_type] xlator: attempt to 
load file /usr/local/gluster1/lib/glusterfs/1.3.11/xlator/protocol/client.so
2009-08-31 16:21:56 D [spec.y:127:section_type] parser: 
Type:b1:protocol/client
2009-08-31 16:21:56 D [spec.y:141:section_option] parser: 
Option:b1:transport-type:tcp/client
2009-08-31 16:21:56 D [spec.y:141:section_option] parser: 
Option:b1:remote-host:10.72.0.119
2009-08-31 16:21:56 D [spec.y:141:section_option] parser: 
Option:b1:remote-subvolume:b1
2009-08-31 16:21:56 D [spec.y:209:section_end] parser: end:b1
2009-08-31 16:21:56 D [client-protocol.c:5013:init] b1: defaulting 
transport-timeout to 42
2009-08-31 16:21:56 D [transport.c:80:transport_load] transport: attempt 
to load file 
/usr/local/gluster1/lib/glusterfs/1.3.11/transport/tcp/client.so
2009-08-31 16:21:56 D [client-protocol.c:5040:init] b1: defaulting 
limits.transaction-size to 268435456
2009-08-31 16:21:56 D [client-protocol.c:5340:notify] b1: got 
GF_EVENT_PARENT_UP, attempting connect on transport
2009-08-31 16:21:56 D [client-protocol.c:4757:client_protocol_reconnect] 
b1: attempting reconnect
2009-08-31 16:21:56 D [tcp-client.c:77:tcp_connect] b1: socket fd = 4
2009-08-31 16:21:56 D [tcp-client.c:107:tcp_connect] b1: finalized on 
port `1022'
2009-08-31 16:21:56 D [tcp-client.c:128:tcp_connect] b1: defaulting 
remote-port to 6996
2009-08-31 16:21:56 D [common-utils.c:179:gf_resolve_ip] resolver: DNS 
cache not present, freshly probing hostname: 10.72.0.119
2009-08-31 16:21:56 D [common-utils.c:204:gf_resolve_ip] resolver: 
returning IP:10.72.0.119[0] for hostname: 10.72.0.119
2009-08-31 16:21:56 D [common-utils.c:212:gf_resolve_ip] resolver: 
flushing DNS cache
2009-08-31 16:21:56 D [tcp-client.c:161:tcp_connect] b1: connect on 4 in 
progress (non-blocking)
2009-08-31 16:21:56 D [tcp-client.c:205:tcp_connect] b1: connection on 4 
success
2009-08-31 16:21:56 D [client-protocol.c:5362:notify] b1: got 
GF_EVENT_CHILD_UP
2009-08-31 16:21:56 D 
[client-protocol.c:5103:client_protocol_handshake_reply] b1: reply frame 
has callid: 424242
2009-08-31 16:21:56 D 
[client-protocol.c:5137:client_protocol_handshake_reply] b1: SETVOLUME 
on remote-host succeeded
2009-08-31 16:21:57 D [client-protocol.c:4763:client_protocol_reconnect] 
b1: breaking reconnect chain
=== cut ===

and nothing mounted to /mnt. no references about fuse in client log. 
what is wrong? in 2.0.6 same actions make success mounting, but 
unsuccess to work (crash in threads..).

More information about the Gluster-users mailing list