[Gluster-devel] Buggy writebehind translators !!!
Anand Avati
avati at zresearch.com
Sun Jun 24 20:05:50 UTC 2007
Teo,
If you are using glusterfs--mainline--2.4, please add to the write-behind
'option flush-behind off' and if needed 'option transport-timeout <secs>' to
protocol/client volumes (where <secs> is sufficiently large enough). the
optoin flush-behind should most likely fix your error.
Instead you could just tla update to the latest patch (patch-184) and the
errors should disappear.
thanks,
avati
2007/6/25, Constantin Teodorescu <teo at flex.ro>:
>
> Anand Avati wrote:
> > Teo,
> > can you please send the logs from glusterfs? I'm somehow suspicious that
> > traces of the old installation have been left behind in your system.
> > probably manually deleting the old files (rm -rf
> > ${prefix}/{lib,sbin}/glusterfs*) and try with another make install. Also
> > please send the logs of both client and server running with -LDEBUG.
> >
> > thanks!
> > avati
> I have cleared all the binaries and libraries from previous install.
> Double checked-it with updatedb and "locate glus". Only client.vol
> configuration file waws kept.
>
> Made a fully fresh install, no problem.
> Activated writebehind again, started from scratch, at first attempt to
> vacuum the database, error.
>
> Logs from server:
> [2:26:41] [ERROR/common-utils.c:55/full_rw()] libglusterfs:full_rw: 0
> bytes r/w instead of 113 (errno=2)
> [2:26:41] [DEBUG/protocol.c:244/gf_block_unserialize_transport()]
> libglusterfs/protocol:gf_block_unserialize_transport: full_read of
> header failed
> [2:26:41] [DEBUG/proto-srv.c:2867/proto_srv_cleanup()]
> protocol/server:cleaned up xl_private of 0x804b1d0
> [2:26:41] [CRITICAL/tcp.c:81/tcp_disconnect()] transport/tcp:server:
> connection to server disconnected
> [2:26:41] [DEBUG/tcp-server.c:229/gf_transport_fini()]
> tcp/server:destroying transport object for 89.41.136.2:1018 (fd=5)
> [2:31:50] [DEBUG/tcp-server.c:134/tcp_server_notify()]
> tcp/server:Registering socket (5) for new transport object of 89.41.136.2
> [2:31:51] [DEBUG/proto-srv.c:2417/mop_setvolume()]
> server-protocol:mop_setvolume: received port = 1021
> [2:31:51] [DEBUG/proto-srv.c:2433/mop_setvolume()]
> server-protocol:mop_setvolume: IP addr = 89.41.136.2, received ip addr =
> 89.41.136.2
> [2:31:51] [DEBUG/proto-srv.c:2443/mop_setvolume()]
> server-protocol:mop_setvolume: accepted client from 89.41.136.2
> [2:34:27] [ERROR/common-utils.c:110/full_rwv()] libglusterfs:full_rwv:
> 87367 bytes r/w instead of 131281 (Connection reset by peer)
> [2:34:27] [ERROR/proto-srv.c:117/generic_reply()]
> protocol/server:transport_writev failed
> [2:34:27] [ERROR/tcp.c:110/tcp_except()] transport/tcp:shutdown () -
> error: Transport endpoint is not connected
> [2:34:27] [ERROR/common-utils.c:110/full_rwv()] libglusterfs:full_rwv: 0
> bytes r/w instead of 131283 (Broken pipe)
> [2:34:27] [ERROR/proto-srv.c:117/generic_reply()]
> protocol/server:transport_writev failed
> [2:34:27] [ERROR/tcp.c:110/tcp_except()] transport/tcp:shutdown () -
> error: Transport endpoint is not connected
> [2:34:27] [DEBUG/proto-srv.c:2826/open_file_cleanup_fn()]
> protocol/server:force releaseing file 0x80928c0
> [2:34:27] [DEBUG/proto-srv.c:2826/open_file_cleanup_fn()]
> protocol/server:force releaseing file 0x8051ca0
> [2:34:27] [DEBUG/proto-srv.c:2867/proto_srv_cleanup()]
> protocol/server:cleaned up xl_private of 0x804b1d0
> [2:34:27] [CRITICAL/tcp.c:81/tcp_disconnect()] transport/tcp:server:
> connection to server disconnected
> [2:34:27] [DEBUG/tcp-server.c:229/gf_transport_fini()]
> tcp/server:destroying transport object for 89.41.136.2:1021 (fd=5)
> -------------------------------------------------------------
>
>
> Logs from the client:
>
> [2:28:52] [DEBUG/glusterfs.c:106/get_spec_fp()] glusterfs:loading spec
> from /etc/glusterfs/client.vol
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'client1'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:client1:protocol/client
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option:
> Option:client1:transport-type:tcp/client
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client1:remote-host:89.41.136.4
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client1:remote-port:6996
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client1:remote-subvolume:brick
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:client1
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'client2'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:client2:protocol/client
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option:
> Option:client2:transport-type:tcp/client
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client2:remote-host:89.41.136.5
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client2:remote-port:6996
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client2:remote-subvolume:brick
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:client2
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'client3'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:client3:protocol/client
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option:
> Option:client3:transport-type:tcp/client
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client3:remote-host:89.41.136.6
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client3:remote-port:6996
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client3:remote-subvolume:brick
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:client3
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'afr'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:afr:cluster/afr
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type cluster/afr
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/cluster/afr.so
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:afr->client1
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:afr->client2
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:afr->client3
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:afr:replicate:*:3
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:afr
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'writebehind'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type:
> Type:writebehind:performance/write-behind
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type
> performance/write-behind
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/performance/write-behind.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option:
> Option:writebehind:aggregate-size:131072
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:writebehind->afr
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:writebehind
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'readahead'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:readahead:performance/read-ahead
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type
> performance/read-ahead
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/performance/read-ahead.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:readahead:page-size:131072
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:readahead:page-count:16
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:readahead->writebehind
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:readahead
> [2:28:52] [DEBUG/read-ahead.c:533/init()] read-ahead:Using
> conf->page_size = 0x20000
> [2:28:52] [DEBUG/read-ahead.c:542/init()] read-ahead:Using
> conf->page_count = 0x10
> [2:28:52] [DEBUG/write-behind.c:520/init()] write-behind:using
> aggregate-size = 131072
> [2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client1
> [2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client2
> [2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client3
> [2:28:52] [DEBUG/afr.c:2229/init()] afr:child count 3
> [2:28:52] [DEBUG/afr.c:2246/init()] afr:afr->init: lock node not
> specified, defaulting to client1
> [2:28:52] [DEBUG/client-protocol.c:2801/init()]
> protocol/client:defaulting transport-timeout to 120
> [2:28:52] [DEBUG/transport.c:83/transport_load()]
> libglusterfs/transport:attempt to load type tcp/client
> [2:28:52] [DEBUG/transport.c:88/transport_load()]
> libglusterfs/transport:attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
> [2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
> :try_connect: socket fd = 7
> [2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
> :try_connect: finalized on port `1023'
> [2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 7
> in progress (non-blocking)
> [2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
> on 7 still in progress - try later
> [2:28:52] [DEBUG/client-protocol.c:2801/init()]
> protocol/client:defaulting transport-timeout to 120
> [2:28:52] [DEBUG/transport.c:83/transport_load()]
> libglusterfs/transport:attempt to load type tcp/client
> [2:28:52] [DEBUG/transport.c:88/transport_load()]
> libglusterfs/transport:attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
> [2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
> :try_connect: socket fd = 8
> [2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
> :try_connect: finalized on port `1022'
> [2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 8
> in progress (non-blocking)
> [2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
> on 8 still in progress - try later
> [2:28:52] [DEBUG/client-protocol.c:2801/init()]
> protocol/client:defaulting transport-timeout to 120
> [2:28:52] [DEBUG/transport.c:83/transport_load()]
> libglusterfs/transport:attempt to load type tcp/client
> [2:28:52] [DEBUG/transport.c:88/transport_load()]
> libglusterfs/transport:attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
> [2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
> :try_connect: socket fd = 9
> [2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
> :try_connect: finalized on port `1021'
> [2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 9
> in progress (non-blocking)
> [2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
> on 9 still in progress - try later
> [2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
> on 9 success, attempting to handshake
> [2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
> transport/tcp-client:dictionary length = 50
> [2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
> on 8 success, attempting to handshake
> [2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
> transport/tcp-client:dictionary length = 50
> [2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
> on 7 success, attempting to handshake
> [2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
> transport/tcp-client:dictionary length = 50
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = PG_VERSION,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216695,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216698,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216700,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216703,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216707,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216709,
> [root at bnd-centos glusterfs]# cat /var/log/glusterfsd.log
> [2:28:52] [DEBUG/glusterfs.c:106/get_spec_fp()] glusterfs:loading spec
> from /etc/glusterfs/client.vol
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'client1'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:client1:protocol/client
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option:
> Option:client1:transport-type:tcp/client
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client1:remote-host:89.41.136.4
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client1:remote-port:6996
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client1:remote-subvolume:brick
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:client1
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'client2'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:client2:protocol/client
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option:
> Option:client2:transport-type:tcp/client
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client2:remote-host:89.41.136.5
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client2:remote-port:6996
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client2:remote-subvolume:brick
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:client2
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'client3'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:client3:protocol/client
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type protocol/client
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/protocol/client.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option:
> Option:client3:transport-type:tcp/client
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client3:remote-host:89.41.136.6
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client3:remote-port:6996
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:client3:remote-subvolume:brick
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:client3
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'afr'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:afr:cluster/afr
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type cluster/afr
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/cluster/afr.so
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:afr->client1
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:afr->client2
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:afr->client3
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:afr:replicate:*:3
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:afr
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'writebehind'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type:
> Type:writebehind:performance/write-behind
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type
> performance/write-behind
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/performance/write-behind.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option:
> Option:writebehind:aggregate-size:131072
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:writebehind->afr
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:writebehind
> [2:28:52] [DEBUG/spec.y:116/new_section()]
> libglusterfs/parser:new_section: New node for 'readahead'
> [2:28:52] [DEBUG/spec.y:132/section_type()]
> libglusterfs/parser:section_type: Type:readahead:performance/read-ahead
> [2:28:52] [DEBUG/xlator.c:93/xlator_set_type()]
> libglusterfs/xlator:xlator_set_type: attempt to load type
> performance/read-ahead
> [2:28:52] [DEBUG/xlator.c:100/xlator_set_type()] libglusterfs/xlator:
> xlator_set_type: attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/xlator/performance/read-ahead.so
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:readahead:page-size:131072
> [2:28:52] [DEBUG/spec.y:152/section_option()]
> libglusterfs/parser:section_option: Option:readahead:page-count:16
> [2:28:52] [DEBUG/spec.y:194/section_sub()]
> liglusterfs/parser:section_sub: child:readahead->writebehind
> [2:28:52] [DEBUG/spec.y:209/section_end()]
> libglusterfs/parser:section_end: end:readahead
> [2:28:52] [DEBUG/read-ahead.c:533/init()] read-ahead:Using
> conf->page_size = 0x20000
> [2:28:52] [DEBUG/read-ahead.c:542/init()] read-ahead:Using
> conf->page_count = 0x10
> [2:28:52] [DEBUG/write-behind.c:520/init()] write-behind:using
> aggregate-size = 131072
> [2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client1
> [2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client2
> [2:28:52] [DEBUG/afr.c:2225/init()] afr:xlator name is client3
> [2:28:52] [DEBUG/afr.c:2229/init()] afr:child count 3
> [2:28:52] [DEBUG/afr.c:2246/init()] afr:afr->init: lock node not
> specified, defaulting to client1
> [2:28:52] [DEBUG/client-protocol.c:2801/init()]
> protocol/client:defaulting transport-timeout to 120
> [2:28:52] [DEBUG/transport.c:83/transport_load()]
> libglusterfs/transport:attempt to load type tcp/client
> [2:28:52] [DEBUG/transport.c:88/transport_load()]
> libglusterfs/transport:attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
> [2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
> :try_connect: socket fd = 7
> [2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
> :try_connect: finalized on port `1023'
> [2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 7
> in progress (non-blocking)
> [2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
> on 7 still in progress - try later
> [2:28:52] [DEBUG/client-protocol.c:2801/init()]
> protocol/client:defaulting transport-timeout to 120
> [2:28:52] [DEBUG/transport.c:83/transport_load()]
> libglusterfs/transport:attempt to load type tcp/client
> [2:28:52] [DEBUG/transport.c:88/transport_load()]
> libglusterfs/transport:attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
> [2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
> :try_connect: socket fd = 8
> [2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
> :try_connect: finalized on port `1022'
> [2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 8
> in progress (non-blocking)
> [2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
> on 8 still in progress - try later
> [2:28:52] [DEBUG/client-protocol.c:2801/init()]
> protocol/client:defaulting transport-timeout to 120
> [2:28:52] [DEBUG/transport.c:83/transport_load()]
> libglusterfs/transport:attempt to load type tcp/client
> [2:28:52] [DEBUG/transport.c:88/transport_load()]
> libglusterfs/transport:attempt to load file
> /usr/lib/glusterfs/1.3.0-pre3/transport/tcp/client.so
> [2:28:52] [DEBUG/tcp-client.c:180/tcp_connect()] transport: tcp:
> :try_connect: socket fd = 9
> [2:28:52] [DEBUG/tcp-client.c:202/tcp_connect()] transport: tcp:
> :try_connect: finalized on port `1021'
> [2:28:52] [DEBUG/tcp-client.c:262/tcp_connect()] tcp/client:connect on 9
> in progress (non-blocking)
> [2:28:52] [DEBUG/tcp-client.c:301/tcp_connect()] tcp/client:connection
> on 9 still in progress - try later
> [2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
> on 9 success, attempting to handshake
> [2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
> transport/tcp-client:dictionary length = 50
> [2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
> on 8 success, attempting to handshake
> [2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
> transport/tcp-client:dictionary length = 50
> [2:28:53] [DEBUG/tcp-client.c:310/tcp_connect()] tcp/client:connection
> on 7 success, attempting to handshake
> [2:28:53] [DEBUG/tcp-client.c:54/do_handshake()]
> transport/tcp-client:dictionary length = 50
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = PG_VERSION,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216695,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216698,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216700,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216703,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216707,
> [2:28:54] [DEBUG/afr.c:65/afr_get_num_copies()] afr:matched! pattern =
> *, filename = 533216709,
> [2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
> client/protocol:bailing transport
> [2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
> break on blocked socket (if any)
> [2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
> client/protocol:bailing transport
> [2:31:29] [ERROR/common-utils.c:110/full_rwv()] libglusterfs:full_rwv:
> 6542 bytes r/w instead of 131420 (Broken pipe)
> [2:31:29] [ERROR/client-protocol.c:204/client_protocol_xfer()]
> protocol/client:transport_submit failed
> [2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
> break on blocked socket (if any)
> [2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
> client/protocol:bailing transport
> [2:31:29] [DEBUG/client-protocol.c:2609/client_protocol_cleanup()]
> protocol/client:cleaning up state in transport object 0x2428730
> [2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
> break on blocked socket (if any)
> [2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
> client/protocol:bailing transport
> [2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
> break on blocked socket (if any)
> [2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
> client/protocol:bailing transport
> [2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
> break on blocked socket (if any)
> ...............
> ...............
> [2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
> client/protocol:bailing transport
> [2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
> break on blocked socket (if any)
> [2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
> client/protocol:bailing transport
> [2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
> break on blocked socket (if any)
> [2:31:29] [CRITICAL/client-protocol.c:218/call_bail()]
> client/protocol:bailing transport
> [2:31:29] [DEBUG/tcp.c:123/cont_hand()] tcp:forcing poll/read/write to
> break on blocked socket (if any)
> [2:31:29] [DEBUG/client-protocol.c:2712/client_protocol_interpret()]
> protocol/client:frame not found for blk with callid: 11249
> [2:31:29] [DEBUG/client-protocol.c:2609/client_protocol_cleanup()]
> protocol/client:cleaning up state in transport object 0x2428730
> [2:31:29] [CRITICAL/tcp.c:81/tcp_disconnect()] transport/tcp:client1:
> connection to server disconnected
>
>
--
Anand V. Avati
More information about the Gluster-devel
mailing list