[Gluster-users] md5sum-s of file on different nodes are different.
Pavan Vilas Sondur
pavan at gluster.com
Fri Aug 28 10:14:37 UTC 2009
Thanks a lot for the log files and the script. We'll get back to you once we have an update with the issue.
Pavan
On 28/08/09 12:47 +0400, Ilya Galanin wrote:
> Pavan Vilas Sondur wrote:
>> Hi Ilya,
>> Can you send us the log files of the nodes in use and also the perl
>> script which triggers this problem.
>>
>> Pavan
>>
>> On 28/08/09 10:19 +0400, Ilya Galanin wrote:
>>
>>> Hello Everyone.
>>> I am using gluster 2.0.6 on my ftp-cluster on RHEL5. It contains 3 nodes.
>>>
>>> This is package list from one node. Other nodes have the same
>>> packages installed.
>>> ===============================================
>>> [ftp1:~]:999# rpm -qa | grep gluster
>>> glusterfs-common-2.0.6-1.el5.x86_64
>>> glusterfs-server-2.0.6-1.el5.x86_64
>>> glusterfs-client-2.0.6-1.el5.x86_64
>>> [ftp1:~]:1000# rpm -qa | grep fuse
>>> fuse-libs-2.7.4glfs11-1.x86_64
>>> kernel-module-fuse-2.6.18-128.1.1.el5-2.7.4glfs11-1.x86_64
>>> fuse-2.7.4glfs11-1.x86_64
>>> fuse-devel-2.7.4glfs11-1.x86_64
>>> ===============================================
>>>
>>> My configuration files:
>>> Server config:
>>> ===============================================
>>> volume posix
>>> type storage/posix
>>> option directory /home/automat
>>> end-volume
>>>
>>> volume locks
>>> type features/locks
>>> subvolumes posix
>>> end-volume
>>>
>>> volume brick
>>> type performance/io-threads
>>> option thread-count 8
>>> subvolumes locks
>>> end-volume
>>>
>>> volume server
>>> type protocol/server
>>> option transport-type tcp
>>> option auth.addr.brick.allow *
>>> subvolumes brick
>>> end-volume
>>> ===============================================
>>>
>>> Client Config:
>>> ===============================================
>>> # file: /etc/glusterfs/glusterfs-client.vol
>>> #
>>> volume remote1
>>> type protocol/client
>>> option transport-type tcp
>>> option remote-host 10.7.69.145
>>> option remote-subvolume brick
>>> end-volume
>>>
>>> volume remote2
>>> type protocol/client
>>> option transport-type tcp
>>> option remote-host 10.7.69.146
>>> option remote-subvolume brick
>>> end-volume
>>>
>>> volume remote3
>>> type protocol/client
>>> option transport-type tcp
>>> option remote-host 10.7.69.147
>>> option remote-subvolume brick
>>> end-volume
>>>
>>> volume replicate
>>> type cluster/replicate
>>> subvolumes remote1 remote2 remote3
>>> end-volume
>>>
>>> volume distribute
>>> type cluster/distribute
>>> subvolumes replicate
>>> end-volume
>>>
>>> volume writebehind
>>> type performance/write-behind
>>> option block-size 128KB
>>> option cache-size 100MB
>>> subvolumes distribute
>>> end-volume
>>>
>>> volume cache
>>> type performance/io-cache
>>> option cache-size 1024MB
>>> subvolumes writebehind
>>> end-volume
>>> ===============================================
>>>
>>> Also I have a perl script that check all files in some folders of
>>> ftp-server every 10 minutes and
>>> caclulate their control sum, then write it in xml format to one new
>>> file on ftp (index.xml)
>>>
>>> PS: I run this script on node1 using cron.
>>>
>>> Sometimes after deploying some new files on ftp server (node one).
>>> I see that md5sum of file(index.xml) is different from one node to others.
>>> Usually node one give right md5sum. Others give wrong ... or one of
>>> others gives wrong ....
>>>
>>> May be someone see that different cluster nodes give different files?
>>> Any other suggestions and advices are welcome too.
>>>
>>> PS. Excuse me for my English, I am not a native speaker.
>>>
>>> Thanks in advance.
>>> Ilya.
>>> _______________________________________________
>>> Gluster-users mailing list
>>> Gluster-users at gluster.org
>>> http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
>>>
> Crontab line is
>
> [ftp1:/var/log/glusterfs]:1006# crontab -lu ftpw
> */10 * * * * /usr/local/bin/interface-xml-collector-1.sh 1&>
> /var/log/collector.log
>
>
> Script:
>
> #!/bin/bash
>
> set -x
>
> ROOT_PATH="/home/ftp/automat/"
> XML_NAME="/index-test.xml"
>
> if [ ! -f /tmp/collector.busy ]
> then
> touch /tmp/collector.busy
>
> cd /usr/local/bin
>
> for f in `ls -I *.html $ROOT_PATH`
> do
> rm -f $ROOT_PATH"$f"$XML_NAME
> /usr/bin/perl /usr/local/bin/crc32-collect-1.pl "$ROOT_PATH"$f
> "$ROOT_PATH"$f"$XML_NAME"
> diff -I "update lastchange=" -I index.xml
> "$ROOT_PATH"$f"$XML_NAME" "$ROOT_PATH"$f"/index.xml"
> if [ $? -ne 0 ]
> then mv "$ROOT_PATH"$f"$XML_NAME" "$ROOT_PATH"$f"/index.xml"
> fi;
> done
>
> rm -f /tmp/collector.busy
> fi
>
> Perl script and logs is attached.
>
> There was a described problem on ftp2 two days ago (2009-08-25). Also I
> found some error-s in ftp2-logs at that time after your pointing to see
> logs.
> The problem was eliminate by ftp-daemon stop, restarting gluster(client
> and server) on node2 and startup ftp-daemon again.
> But I can't do it permanently especially when ftp-cluster is working...
>
> Thanks.
> Ilya.
> #!/usr/bin/perl
>
> use String::CRC32;
> use strict;
>
> my $ROOT_PATH=$ARGV[0];
> my $RESULT_FILE=$ARGV[1];
>
> #print $ARGV[0];
>
> #-------------------------------------------------------------------
> # recursively read directory tree
> # ------------------------------------------------------------------
>
> my ($dir) = $ROOT_PATH;
> my($filelist) = [];
> my $resultXML = [];
>
> sub recursedir($$) {
>
> my($dir) = shift @_;
> my($list) = shift @_;
>
> #-----------------------------------------------------------
> # get files, skipping hidden . and ..
> #-----------------------------------------------------------
>
> if( opendir( DIR, "$dir" ) ) {
>
> for my $file( grep { !/^\./ } readdir DIR ) {
>
> if( -d "$dir/$file" ) {
>
> recursedir("$dir/$file", $list);
>
> } elsif( -f "$dir/$file" ) {
>
> #-----------------------------------
> # caclulate CRC32
> # ----------------------------------
>
> my $crc = myMkCRC32( "$dir/$file" );
> $crc = sprintf("%X", $crc);
>
> #-----------------------------------
> # remove ROOT_PATH from file path
> # ----------------------------------
>
> my $path = "$dir/$file";
> $path =~ s/$ROOT_PATH\///g;
>
> #-----------------------------------
> # make XML
> # ----------------------------------
>
> my $length = -s "$dir/$file";
> my $xml_text;
>
> $xml_text = "\t<file crc32=\"$crc\" length=\"$length\">$path</file>";
> push @$resultXML, $xml_text;
> }
> }
>
> closedir DIR;
> } else {
>
> die "Error opening $ROOT_PATH!";
> }
> }
>
> #-------------------------------------------------------------------
> # Make index.xml
> # ------------------------------------------------------------------
>
>
> sub myMakeIndexXML {
>
> #-----------------------------------------------------------
> # make XML head
> # ----------------------------------------------------------
>
> my $timestamp = sprintf("%02d:%02d %02d.%02d.%04d", (localtime)[2,1], (localtime)[3], (localtime)[4]+1, (localtime)[5]+1900);
>
> push @$resultXML, "<update lastchange=\"$timestamp\">";
>
> push @$resultXML, "<default-profile>";
>
> recursedir $dir, $filelist;
>
> push @$resultXML, "</default-profile>";
>
> push @$resultXML, "</update>";
> }
>
> #------------------------------------------------------------------
> # caclulate CRC32 of the requested file
> # -----------------------------------------------------------------
>
> sub myMkCRC32 {
>
> open(SOMEFILE, "@_");
> my $res = crc32(*SOMEFILE);
> close(SOMEFILE);
>
> return $res;
> }
>
> #------------------------------------------------------------------
> # compile results
> # -----------------------------------------------------------------
>
> myMakeIndexXML;
>
> open OUT1, ">$RESULT_FILE" or die "Cannot open file: $!\n";
> print OUT1 $_, "\n" for(@$resultXML);
> close OUT;
> exit;
> ================================================================================
> Version : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
> TLA Revision : v2.0.4
> Starting Time: 2009-08-04 11:48:50
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 15718
> System name : Linux
> Nodename : ftp1
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-04 11:48:50] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-04 11:48:50] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-04 11:48:50] N [afr.c:2204:notify] replicate: Subvolume 'remote1' came back up; going online.
> [2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-20 19:26:08] E [saved-frames.c:165:saved_frames_unwind] remote3: forced unwinding frame type(1) op(LOOKUP)
> [2009-08-20 19:26:08] E [saved-frames.c:165:saved_frames_unwind] remote3: forced unwinding frame type(1) op(LOOKUP)
> [2009-08-20 19:26:08] N [client-protocol.c:6246:notify] remote3: disconnected
> [2009-08-20 19:26:08] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
> [2009-08-20 19:26:08] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
> [2009-08-20 19:26:43] N [client-protocol.c:6246:notify] remote2: disconnected
> [2009-08-20 19:26:46] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-20 19:26:46] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-20 19:27:31] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-20 19:27:34] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-20 19:27:42] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-20 19:27:49] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:27:45] E [saved-frames.c:165:saved_frames_unwind] remote2: forced unwinding frame type(1) op(LOOKUP)
> [2009-08-25 16:27:45] E [saved-frames.c:165:saved_frames_unwind] remote2: forced unwinding frame type(1) op(LOOKUP)
> [2009-08-25 16:27:45] N [client-protocol.c:6246:notify] remote2: disconnected
> [2009-08-25 16:27:45] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-25 16:27:48] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-25 16:27:58] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:28:02] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:32:32] N [client-protocol.c:6246:notify] remote3: disconnected
> [2009-08-25 16:32:35] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:32:35] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:16] N [client-protocol.c:6246:notify] remote2: disconnected
> [2009-08-25 16:48:19] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-25 16:48:19] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-25 16:48:22] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:26] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:53] N [client-protocol.c:6246:notify] remote3: disconnected
> [2009-08-25 16:48:56] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:56] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 17:53:05] N [client-protocol.c:6246:notify] remote3: disconnected
> [2009-08-25 17:53:08] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
> [2009-08-25 17:53:08] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
> [2009-08-25 17:53:39] N [client-protocol.c:6246:notify] remote2: disconnected
> [2009-08-25 17:53:42] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-25 17:53:42] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-25 17:54:55] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 17:54:55] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 17:55:54] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 17:56:01] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 17:57:09] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> [2009-08-25 17:57:09] N [fuse-bridge.c:2830:fini] fuse: Unmounting '/home/ftp'.
> ================================================================================
> Version : glusterfs 2.0.6 built on Aug 18 2009 06:07:41
> TLA Revision : v2.0.6
> Starting Time: 2009-08-25 17:58:19
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 11016
> System name : Linux
> Nodename : ftp1
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 17:58:19] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-25 17:58:19] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 17:58:19] N [afr.c:2203:notify] replicate: Subvolume 'remote1' came back up; going online.
> [2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 17:58:19] N [afr.c:2203:notify] replicate: Subvolume 'remote1' came back up; going online.
> [2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-26 18:14:47] N [client-protocol.c:6246:notify] remote2: disconnected
> [2009-08-26 18:14:50] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-26 18:14:50] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-26 18:14:57] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-26 18:14:58] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> ================================================================================
> Version : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
> TLA Revision : v2.0.4
> Starting Time: 2009-08-04 11:48:48
> Command line : /usr/sbin/glusterfsd -f /etc/glusterfs/glusterfs-server.vol
> PID : 15701
> System name : Linux
> Nodename : ftp1
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: volume posix
> 2: type storage/posix
> 3: option directory /home/automat
> 4: end-volume
> 5:
> 6: volume locks
> 7: type features/locks
> 8: subvolumes posix
> 9: end-volume
> 10:
> 11: volume brick
> 12: type performance/io-threads
> 13: option thread-count 8
> 14: subvolumes locks
> 15: end-volume
> 16:
> 17: volume server
> 18: type protocol/server
> 19: option transport-type tcp
> 20: option auth.addr.brick.allow *
> 21: subvolumes brick
> 22: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-04 11:48:48] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-04 11:48:48] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1023
> [2009-08-04 11:48:48] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1023
> [2009-08-04 11:48:48] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1022
> [2009-08-04 11:48:48] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1022
> [2009-08-04 11:48:50] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.145:1022
> [2009-08-04 11:48:50] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.145:1023
> [2009-08-20 19:26:26] N [server-protocol.c:7815:notify] server: 10.7.69.147:1022 disconnected
> [2009-08-20 19:26:26] N [server-protocol.c:7815:notify] server: 10.7.69.147:1023 disconnected
> [2009-08-20 19:26:26] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp3.osmp.ru-2722-2009/08/04-10:47:30:204449-remote1
> [2009-08-20 19:26:51] N [server-protocol.c:7815:notify] server: 10.7.69.146:1022 disconnected
> [2009-08-20 19:26:51] N [server-protocol.c:7815:notify] server: 10.7.69.146:1023 disconnected
> [2009-08-20 19:26:51] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp2-16395-2009/08/04-11:25:05:355016-remote1
> [2009-08-20 19:27:34] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1020
> [2009-08-20 19:27:34] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1021
> [2009-08-20 19:27:45] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1023
> [2009-08-20 19:27:45] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1022
> [2009-08-25 15:05:35] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.148:1022
> [2009-08-25 15:05:35] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.148:1023
> [2009-08-25 16:27:41] N [server-protocol.c:7815:notify] server: 10.7.69.146:1020 disconnected
> [2009-08-25 16:27:41] N [server-protocol.c:7815:notify] server: 10.7.69.146:1021 disconnected
> [2009-08-25 16:27:41] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp2-31504-2009/08/20-19:27:34:887790-remote1
> [2009-08-25 16:28:01] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1022
> [2009-08-25 16:28:01] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1023
> [2009-08-25 16:32:22] N [server-protocol.c:7815:notify] server: 10.7.69.147:1022 disconnected
> [2009-08-25 16:32:22] N [server-protocol.c:7815:notify] server: 10.7.69.147:1023 disconnected
> [2009-08-25 16:32:22] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp3.osmp.ru-9801-2009/08/20-19:27:45:24249-remote1
> [2009-08-25 16:32:38] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1017
> [2009-08-25 16:32:38] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1016
> [2009-08-25 16:36:05] N [server-protocol.c:7815:notify] server: 10.7.69.146:1022 disconnected
> [2009-08-25 16:36:05] N [server-protocol.c:7815:notify] server: 10.7.69.146:1023 disconnected
> [2009-08-25 16:36:05] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp2-22041-2009/08/25-16:28:01:487557-remote1
> [2009-08-25 16:36:05] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1019
> [2009-08-25 16:36:05] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1018
> [2009-08-25 16:48:11] N [server-protocol.c:7815:notify] server: 10.7.69.146:1018 disconnected
> [2009-08-25 16:48:11] N [server-protocol.c:7815:notify] server: 10.7.69.146:1019 disconnected
> [2009-08-25 16:48:11] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp2-22455-2009/08/25-16:36:05:537272-remote1
> [2009-08-25 16:48:25] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1022
> [2009-08-25 16:48:25] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1023
> [2009-08-25 16:48:50] N [server-protocol.c:7815:notify] server: 10.7.69.147:1016 disconnected
> [2009-08-25 16:48:50] N [server-protocol.c:7815:notify] server: 10.7.69.147:1017 disconnected
> [2009-08-25 16:48:50] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp3.osmp.ru-29039-2009/08/25-16:32:38:867872-remote1
> [2009-08-25 16:48:58] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1021
> [2009-08-25 16:48:58] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1020
> [2009-08-25 17:53:02] N [server-protocol.c:7815:notify] server: 10.7.69.147:1020 disconnected
> [2009-08-25 17:53:02] N [server-protocol.c:7815:notify] server: 10.7.69.147:1021 disconnected
> [2009-08-25 17:53:02] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp3.osmp.ru-29803-2009/08/25-16:48:58:618326-remote1
> [2009-08-25 17:53:34] N [server-protocol.c:7815:notify] server: 10.7.69.146:1022 disconnected
> [2009-08-25 17:53:34] N [server-protocol.c:7815:notify] server: 10.7.69.146:1023 disconnected
> [2009-08-25 17:53:34] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp2-22977-2009/08/25-16:48:25:184369-remote1
> [2009-08-25 17:55:05] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1022
> [2009-08-25 17:55:05] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1023
> [2009-08-25 17:56:04] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1022
> [2009-08-25 17:56:04] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1023
> [2009-08-25 17:57:10] N [server-protocol.c:7815:notify] server: 10.7.69.145:1023 disconnected
> [2009-08-25 17:57:10] N [server-protocol.c:7815:notify] server: 10.7.69.145:1022 disconnected
> [2009-08-25 17:57:10] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp1-15717-2009/08/04-11:48:50:894117-remote1
> [2009-08-25 17:57:18] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> ================================================================================
> Version : glusterfs 2.0.6 built on Aug 18 2009 06:07:41
> TLA Revision : v2.0.6
> Starting Time: 2009-08-25 17:58:15
> Command line : /usr/sbin/glusterfsd -f /etc/glusterfs/glusterfs-server.vol
> PID : 10999
> System name : Linux
> Nodename : ftp1
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: volume posix
> 2: type storage/posix
> 3: option directory /home/automat
> 4: end-volume
> 5:
> 6: volume locks
> 7: type features/locks
> 8: subvolumes posix
> 9: end-volume
> 10:
> 11: volume brick
> 12: type performance/io-threads
> 13: option thread-count 8
> 14: subvolumes locks
> 15: end-volume
> 16:
> 17: volume server
> 18: type protocol/server
> 19: option transport-type tcp
> 20: option auth.addr.brick.allow *
> 21: subvolumes brick
> 22: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 17:58:15] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 17:58:15] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1023
> [2009-08-25 17:58:15] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.147:1023
> [2009-08-25 17:58:18] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1023
> [2009-08-25 17:58:18] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1022
> [2009-08-25 17:58:18] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1022
> [2009-08-25 17:58:18] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.147:1022
> [2009-08-25 17:58:19] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1022
> [2009-08-25 17:58:19] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1023
> [2009-08-25 18:03:06] N [server-protocol.c:7816:notify] server: 10.7.69.148:1022 disconnected
> [2009-08-25 18:03:06] N [server-protocol.c:7816:notify] server: 10.7.69.148:1023 disconnected
> [2009-08-25 18:03:06] N [server-helpers.c:779:server_connection_destroy] server: destroyed connection of site.osmp.ru-3494-2009/08/25-15:05:35:657728-remote1
> [2009-08-25 18:03:07] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1017
> [2009-08-25 18:03:07] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1016
> [2009-08-26 18:14:38] N [server-protocol.c:7816:notify] server: 10.7.69.146:1022 disconnected
> [2009-08-26 18:14:38] N [server-protocol.c:7816:notify] server: 10.7.69.146:1023 disconnected
> [2009-08-26 18:14:38] N [server-helpers.c:779:server_connection_destroy] server: destroyed connection of ftp2-25366-2009/08/25-17:56:04:357261-remote1
> [2009-08-26 18:15:01] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1019
> [2009-08-26 18:15:01] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1017
> ================================================================================
> Version : glusterfs 2.0.6 built on Aug 18 2009 06:07:41
> TLA Revision : v2.0.6
> Starting Time: 2009-08-25 17:55:54
> Command line : /usr/sbin/glusterfsd -f /etc/glusterfs/glusterfs-server.vol
> PID : 25348
> System name : Linux
> Nodename : ftp2
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: volume posix
> 2: type storage/posix
> 3: option directory /home/automat
> 4: end-volume
> 5:
> 6: volume locks
> 7: type features/locks
> 8: subvolumes posix
> 9: end-volume
> 10:
> 11: volume brick
> 12: type performance/io-threads
> 13: option thread-count 8
> 14: subvolumes locks
> 15: end-volume
> 16:
> 17: volume server
> 18: type protocol/server
> 19: option transport-type tcp
> 20: option auth.addr.brick.allow *
> 21: subvolumes brick
> 22: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 17:55:54] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 17:55:54] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1019
> [2009-08-25 17:55:56] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.147:1021
> [2009-08-25 17:55:56] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.147:1020
> [2009-08-25 17:56:01] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1018
> [2009-08-25 17:56:01] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:56:01] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1019
> [2009-08-25 17:56:01] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1018
> [2009-08-25 17:56:03] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:56:04] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1020
> [2009-08-25 17:56:04] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1021
> [2009-08-25 17:56:07] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:56:10] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:56:14] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:56:14] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:56:31] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:56:49] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:56:51] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:10] N [server-protocol.c:7816:notify] server: 10.7.69.145:1018 disconnected
> [2009-08-25 17:57:10] N [server-protocol.c:7816:notify] server: 10.7.69.145:1019 disconnected
> [2009-08-25 17:57:10] N [server-helpers.c:779:server_connection_destroy] server: destroyed connection of ftp1-15717-2009/08/04-11:48:50:894117-remote2
> [2009-08-25 17:58:19] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1020
> [2009-08-25 17:58:19] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1021
> [2009-08-25 18:03:06] N [server-protocol.c:7816:notify] server: 10.7.69.148:1018 disconnected
> [2009-08-25 18:03:06] N [server-protocol.c:7816:notify] server: 10.7.69.148:1019 disconnected
> [2009-08-25 18:03:06] N [server-helpers.c:779:server_connection_destroy] server: destroyed connection of site.osmp.ru-3494-2009/08/25-15:05:35:657728-remote2
> [2009-08-25 18:03:07] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1014
> [2009-08-25 18:03:07] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1015
> [2009-08-26 18:14:38] N [server-protocol.c:7816:notify] server: 10.7.69.146:1021 disconnected
> [2009-08-26 18:14:38] N [server-protocol.c:7816:notify] server: 10.7.69.146:1020 disconnected
> [2009-08-26 18:14:38] N [server-helpers.c:779:server_connection_destroy] server: destroyed connection of ftp2-25366-2009/08/25-17:56:04:357261-remote2
> [2009-08-26 18:14:47] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> ================================================================================
> Version : glusterfs 2.0.6 built on Aug 18 2009 06:07:41
> TLA Revision : v2.0.6
> Starting Time: 2009-08-26 18:14:57
> Command line : /usr/sbin/glusterfsd -f /etc/glusterfs/glusterfs-server.vol
> PID : 19185
> System name : Linux
> Nodename : ftp2
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: volume posix
> 2: type storage/posix
> 3: option directory /home/automat
> 4: end-volume
> 5:
> 6: volume locks
> 7: type features/locks
> 8: subvolumes posix
> 9: end-volume
> 10:
> 11: volume brick
> 12: type performance/io-threads
> 13: option thread-count 8
> 14: subvolumes locks
> 15: end-volume
> 16:
> 17: volume server
> 18: type protocol/server
> 19: option transport-type tcp
> 20: option auth.addr.brick.allow *
> 21: subvolumes brick
> 22: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-26 18:14:57] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-26 18:14:57] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.147:1021
> [2009-08-26 18:14:57] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1021
> [2009-08-26 18:14:58] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1023
> [2009-08-26 18:14:58] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1022
> [2009-08-26 18:14:58] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.147:1020
> [2009-08-26 18:14:58] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1020
> [2009-08-26 18:15:01] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1015
> [2009-08-26 18:15:01] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1016
> ================================================================================
> Version : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
> TLA Revision : v2.0.4
> Starting Time: 2009-08-20 19:27:34
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 31505
> System name : Linux
> Nodename : ftp2
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-20 19:27:34] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-20 19:27:34] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-20 19:27:34] E [socket.c:745:socket_connect_finish] remote3: connection to failed (Connection refused)
> [2009-08-20 19:27:34] E [socket.c:745:socket_connect_finish] remote3: connection to failed (Connection refused)
> [2009-08-20 19:27:34] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-20 19:27:34] N [afr.c:2204:notify] replicate: Subvolume 'remote2' came back up; going online.
> [2009-08-20 19:27:34] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-20 19:27:34] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-20 19:27:34] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-20 19:27:45] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-20 19:27:45] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:27:40] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> [2009-08-25 16:27:40] N [fuse-bridge.c:2830:fini] fuse: Unmounting '/home/ftp'.
> ================================================================================
> Version : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
> TLA Revision : v2.0.4
> Starting Time: 2009-08-25 16:28:01
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 22042
> System name : Linux
> Nodename : ftp2
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 16:28:01] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-25 16:28:01] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 16:28:01] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:28:01] N [afr.c:2204:notify] replicate: Subvolume 'remote2' came back up; going online.
> [2009-08-25 16:28:01] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:28:01] N [afr.c:2204:notify] replicate: Subvolume 'remote2' came back up; going online.
> [2009-08-25 16:28:01] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:28:01] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 16:28:01] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:28:01] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 16:32:32] N [client-protocol.c:6246:notify] remote3: disconnected
> [2009-08-25 16:32:32] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
> [2009-08-25 16:32:32] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
> [2009-08-25 16:32:35] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:32:43] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:36:05] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> [2009-08-25 16:36:05] N [fuse-bridge.c:2830:fini] fuse: Unmounting '/home/ftp'.
> ================================================================================
> Version : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
> TLA Revision : v2.0.4
> Starting Time: 2009-08-25 16:36:05
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 22456
> System name : Linux
> Nodename : ftp2
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 16:36:05] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-25 16:36:05] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 16:36:05] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:36:05] N [afr.c:2204:notify] replicate: Subvolume 'remote2' came back up; going online.
> [2009-08-25 16:36:05] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:36:05] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:36:05] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 16:36:05] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:36:05] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:11] N [fuse-bridge.c:2496:fuse_thread_proc] fuse: unmounting /home/ftp
> [2009-08-25 16:48:11] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> ================================================================================
> Version : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
> TLA Revision : v2.0.4
> Starting Time: 2009-08-25 16:48:25
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 22978
> System name : Linux
> Nodename : ftp2
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 16:48:25] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-25 16:48:25] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 16:48:25] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:25] N [afr.c:2204:notify] replicate: Subvolume 'remote2' came back up; going online.
> [2009-08-25 16:48:25] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:25] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:25] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:25] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:25] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:53] N [client-protocol.c:6246:notify] remote3: disconnected
> [2009-08-25 16:48:56] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:56] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 17:53:05] N [client-protocol.c:6246:notify] remote3: disconnected
> [2009-08-25 17:53:05] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
> [2009-08-25 17:53:08] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
> [2009-08-25 17:53:34] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> [2009-08-25 17:53:34] N [fuse-bridge.c:2830:fini] fuse: Unmounting '/home/ftp'.
> ================================================================================
> Version : glusterfs 2.0.6 built on Aug 18 2009 06:07:41
> TLA Revision : v2.0.6
> Starting Time: 2009-08-25 17:56:04
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 25367
> System name : Linux
> Nodename : ftp2
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 17:56:04] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-25 17:56:04] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 17:56:04] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 17:56:04] N [afr.c:2203:notify] replicate: Subvolume 'remote2' came back up; going online.
> [2009-08-25 17:56:04] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 17:56:04] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 17:56:04] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 17:56:04] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 17:56:04] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 17:57:18] N [client-protocol.c:6246:notify] remote1: disconnected
> [2009-08-25 17:57:21] E [socket.c:745:socket_connect_finish] remote1: connection to 10.7.69.145:6996 failed (Connection refused)
> [2009-08-25 17:57:21] E [socket.c:745:socket_connect_finish] remote1: connection to 10.7.69.145:6996 failed (Connection refused)
> [2009-08-25 17:58:15] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 17:58:18] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-26 18:14:38] N [fuse-bridge.c:2499:fuse_thread_proc] fuse: unmounting /home/ftp
> [2009-08-26 18:14:38] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> ================================================================================
> Version : glusterfs 2.0.6 built on Aug 18 2009 06:07:41
> TLA Revision : v2.0.6
> Starting Time: 2009-08-26 18:15:01
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 19202
> System name : Linux
> Nodename : ftp2
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-26 18:15:01] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-26 18:15:01] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-26 18:15:01] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-26 18:15:01] N [afr.c:2203:notify] replicate: Subvolume 'remote2' came back up; going online.
> [2009-08-26 18:15:01] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-26 18:15:01] N [afr.c:2203:notify] replicate: Subvolume 'remote2' came back up; going online.
> [2009-08-26 18:15:01] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-26 18:15:01] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-26 18:15:01] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-26 18:15:01] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> ================================================================================
> Version : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
> TLA Revision : v2.0.4
> Starting Time: 2009-08-25 16:48:58
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 29804
> System name : Linux
> Nodename : ftp3.osmp.ru
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 16:48:58] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-25 16:48:58] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 16:48:58] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:58] N [afr.c:2204:notify] replicate: Subvolume 'remote3' came back up; going online.
> [2009-08-25 16:48:58] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:58] N [afr.c:2204:notify] replicate: Subvolume 'remote3' came back up; going online.
> [2009-08-25 16:48:58] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:58] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:58] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 16:48:58] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 17:53:02] N [fuse-bridge.c:2496:fuse_thread_proc] fuse: unmounting /home/ftp
> [2009-08-25 17:53:02] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> pending frames:
>
> ================================================================================
> Version : glusterfs 2.0.6 built on Aug 18 2009 06:07:41
> TLA Revision : v2.0.6
> Starting Time: 2009-08-25 17:55:05
> Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp
> PID : 32094
> System name : Linux
> Nodename : ftp3.osmp.ru
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: # file: /etc/glusterfs/glusterfs-client.vol
> 2: #
> 3: volume remote1
> 4: type protocol/client
> 5: option transport-type tcp
> 6: option remote-host 10.7.69.145
> 7: option remote-subvolume brick
> 8: end-volume
> 9:
> 10: volume remote2
> 11: type protocol/client
> 12: option transport-type tcp
> 13: option remote-host 10.7.69.146
> 14: option remote-subvolume brick
> 15: end-volume
> 16:
> 17: volume remote3
> 18: type protocol/client
> 19: option transport-type tcp
> 20: option remote-host 10.7.69.147
> 21: option remote-subvolume brick
> 22: end-volume
> 23:
> 24: volume replicate
> 25: type cluster/replicate
> 26: subvolumes remote1 remote2 remote3
> 27: end-volume
> 28:
> 29: volume distribute
> 30: type cluster/distribute
> 31: subvolumes replicate
> 32: end-volume
> 33:
> 34: volume writebehind
> 35: type performance/write-behind
> 36: option block-size 128KB
> 37: option cache-size 100MB
> 38: subvolumes distribute
> 39: end-volume
> 40:
> 41: volume cache
> 42: type performance/io-cache
> 43: option cache-size 1024MB
> 44: subvolumes writebehind
> 45: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 17:55:05] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
> [2009-08-25 17:55:05] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 17:55:05] E [socket.c:745:socket_connect_finish] remote2: connection to failed (Connection refused)
> [2009-08-25 17:55:05] E [socket.c:745:socket_connect_finish] remote2: connection to failed (Connection refused)
> [2009-08-25 17:55:05] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 17:55:05] N [afr.c:2203:notify] replicate: Subvolume 'remote3' came back up; going online.
> [2009-08-25 17:55:05] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
> [2009-08-25 17:55:05] N [afr.c:2203:notify] replicate: Subvolume 'remote3' came back up; going online.
> [2009-08-25 17:55:05] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 17:55:05] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 17:55:56] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 17:55:56] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-25 17:57:18] N [client-protocol.c:6246:notify] remote1: disconnected
> [2009-08-25 17:57:21] E [socket.c:745:socket_connect_finish] remote1: connection to 10.7.69.145:6996 failed (Connection refused)
> [2009-08-25 17:57:21] E [socket.c:745:socket_connect_finish] remote1: connection to 10.7.69.145:6996 failed (Connection refused)
> [2009-08-25 17:58:15] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-25 17:58:18] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
> [2009-08-26 18:14:47] E [saved-frames.c:165:saved_frames_unwind] remote2: forced unwinding frame type(3) op(RELEASE)
> [2009-08-26 18:14:47] E [saved-frames.c:165:saved_frames_unwind] remote2: forced unwinding frame type(1) op(LOOKUP)
> [2009-08-26 18:14:47] N [client-protocol.c:6246:notify] remote2: disconnected
> [2009-08-26 18:14:47] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-26 18:14:47] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
> [2009-08-26 18:14:57] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> [2009-08-26 18:14:58] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
> ================================================================================
> Version : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
> TLA Revision : v2.0.4
> Starting Time: 2009-08-25 16:32:35
> Command line : /usr/sbin/glusterfsd -f /etc/glusterfs/glusterfs-server.vol
> PID : 29023
> System name : Linux
> Nodename : ftp3.osmp.ru
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: volume posix
> 2: type storage/posix
> 3: option directory /home/automat
> 4: end-volume
> 5:
> 6: volume locks
> 7: type features/locks
> 8: subvolumes posix
> 9: end-volume
> 10:
> 11: volume brick
> 12: type performance/io-threads
> 13: option thread-count 8
> 14: subvolumes locks
> 15: end-volume
> 16:
> 17: volume server
> 18: type protocol/server
> 19: option transport-type tcp
> 20: option auth.addr.brick.allow *
> 21: subvolumes brick
> 22: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 16:32:35] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 16:32:35] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1021
> [2009-08-25 16:32:35] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.148:1019
> [2009-08-25 16:32:35] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.145:1018
> [2009-08-25 16:32:35] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.145:1019
> [2009-08-25 16:32:35] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.148:1018
> [2009-08-25 16:32:36] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:36] W [server-protocol.c:4210:server_fstat] server: fd - 1647: unresolved fd
> [2009-08-25 16:32:36] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:36] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:36] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:36] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:36] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:32:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:37] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:32:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:38] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:32:38] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:38] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:38] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:38] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:38] W [server-protocol.c:4210:server_fstat] server: fd - 1647: unresolved fd
> [2009-08-25 16:32:38] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:38] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:38] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:38] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1012
> [2009-08-25 16:32:38] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1013
> [2009-08-25 16:32:39] W [server-protocol.c:4210:server_fstat] server: fd - 30: unresolved fd
> [2009-08-25 16:32:40] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:40] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:40] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:40] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:40] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:32:40] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:40] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:40] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:41] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:32:43] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:43] W [server-protocol.c:4210:server_fstat] server: fd - 858: unresolved fd
> [2009-08-25 16:32:43] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1020
> [2009-08-25 16:32:44] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:44] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:32:44] W [server-protocol.c:4210:server_fstat] server: fd - 30: unresolved fd
> [2009-08-25 16:32:44] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:44] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:44] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:45] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:32:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:48] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:32:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:48] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:48] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:48] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:48] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:49] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:32:50] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:50] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:50] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:51] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:53] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:32:53] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:53] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:53] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:53] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:53] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:53] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:54] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:54] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:54] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:54] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:54] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:32:56] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:56] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:56] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:32:57] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:32:57] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:57] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:57] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:57] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:57] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:57] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:32:58] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:58] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:58] W [server-protocol.c:4210:server_fstat] server: fd - 1884: unresolved fd
> [2009-08-25 16:32:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:32:59] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:32:59] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:00] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:00] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:00] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:00] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:01] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:33:02] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:02] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:02] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:04] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:04] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:04] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:06] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:33:07] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:07] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:07] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:11] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:33:12] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:12] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:12] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:13] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:13] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:14] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:14] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:14] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:14] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:14] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:15] W [server-protocol.c:4210:server_fstat] server: fd - 22: unresolved fd
> [2009-08-25 16:33:16] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:16] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:16] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:17] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:17] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:17] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:17] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:17] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:17] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:18] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:18] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:18] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:18] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:24] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:24] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:26] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:30] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:31] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:31] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:31] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:31] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:31] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:31] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:32] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:33] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:34] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:34] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:34] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:34] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:34] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:34] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:35] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:35] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:35] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:35] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:35] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:35] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:35] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:35] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:35] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:37] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:38] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:38] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:38] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:38] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:38] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:38] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:38] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:40] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:40] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:40] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:41] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:41] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:41] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:42] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:42] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:44] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:45] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:51] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:51] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:51] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:51] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:51] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:52] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:52] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:52] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:54] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:54] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:55] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:57] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:57] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:57] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:57] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:33:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:59] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:33:59] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:33:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:33:59] W [server-protocol.c:4210:server_fstat] server: fd - 1884: unresolved fd
> [2009-08-25 16:34:00] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:00] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:34:02] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:02] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:02] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:03] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:03] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:03] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:03] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:04] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:04] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:34:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:06] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:06] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:06] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:07] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:07] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:34:08] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:08] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:08] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:09] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:09] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:09] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:09] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:09] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:34:11] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:11] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:11] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:12] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:12] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:34:13] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:13] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:13] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:14] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:14] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:34:16] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:16] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:16] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:16] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:16] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:16] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:18] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:18] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:34:18] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:18] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:18] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:18] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:18] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:18] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:20] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:20] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:20] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:23] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:34:23] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:34:26] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:26] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:34:26] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:26] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:26] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:27] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:27] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:34:29] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:29] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:34:30] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:30] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:34:30] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:30] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:30] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:31] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:31] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:31] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:32] E [posix.c:1566:posix_readv] posix: read failed on fd=0x2aaaac0434d0: Bad file descriptor
> [2009-08-25 16:34:32] E [posix.c:1566:posix_readv] posix: read failed on fd=0x2aaaac0434d0: Bad file descriptor
> [2009-08-25 16:34:33] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:33] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:34:34] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:34] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:34:34] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:34] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:34] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:34] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:36] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:36] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:36] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:39] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:39] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:39] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:41] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:41] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:41] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:42] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:46] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:46] W [server-protocol.c:4210:server_fstat] server: fd - 1469: unresolved fd
> [2009-08-25 16:34:47] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:47] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:34:51] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:51] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:51] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:34:54] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:54] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:34:57] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:34:57] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:34:57] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:00] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:00] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:00] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:05] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:05] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:07] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:07] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:07] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:14] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:14] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:14] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:21] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:21] W [server-protocol.c:4210:server_fstat] server: fd - 568: unresolved fd
> [2009-08-25 16:35:24] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:24] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:35:26] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:26] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:26] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:26] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:27] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:27] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:35:28] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:28] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:28] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:28] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:28] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:28] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:29] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:29] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:29] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:29] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:29] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:35:31] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:31] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:35:31] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:31] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:31] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:32] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:32] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:32] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:33] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:33] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:33] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:34] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:34] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:35:35] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:35] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:35:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:38] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:38] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:35:39] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:39] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:39] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:41] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:41] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:41] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:42] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:35:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:42] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:35:44] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:44] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:44] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:44] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:44] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:44] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:44] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:44] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:44] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:46] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:46] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:35:51] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:51] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:51] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:51] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:51] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:51] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:52] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:52] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:52] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:53] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:53] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:53] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:54] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:54] W [server-protocol.c:4210:server_fstat] server: fd - 1732: unresolved fd
> [2009-08-25 16:35:56] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:56] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:56] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:35:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:35:59] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:35:59] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:01] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:01] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:01] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:01] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:01] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:01] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:01] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:01] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:01] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:03] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:03] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:03] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:05] N [server-protocol.c:7815:notify] server: 10.7.69.146:1020 disconnected
> [2009-08-25 16:36:05] N [server-protocol.c:7815:notify] server: 10.7.69.146:1021 disconnected
> [2009-08-25 16:36:05] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp2-22041-2009/08/25-16:28:01:487557-remote3
> [2009-08-25 16:36:05] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1013
> [2009-08-25 16:36:05] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1012
> [2009-08-25 16:36:06] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:06] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:06] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:24] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:24] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:24] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:27] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:27] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:27] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:46] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:46] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:46] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:46] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:46] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:46] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:46] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:55] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:55] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:55] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:56] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:56] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:56] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:36:56] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:36:56] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:36:56] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:01] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:01] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:01] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:13] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:13] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:13] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:14] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:14] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:14] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:15] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:15] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:15] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:23] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:23] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:23] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:27] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:27] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:37:31] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:31] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:37:32] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:32] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:32] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:34] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:34] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:37:35] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:35] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:35] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:36] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:36] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:37:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:39] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:39] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:39] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:42] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:37:46] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:46] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:37:47] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:47] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:47] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:48] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:48] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:48] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:48] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:48] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:37:50] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:50] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:37:52] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:52] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:52] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:53] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:53] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:37:56] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:56] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:37:57] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:57] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:37:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:59] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:59] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:37:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:37:59] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:37:59] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:01] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:01] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:01] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:02] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:02] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:02] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:04] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:04] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:04] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:05] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:05] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:38:07] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:07] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:07] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:09] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:09] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:38:14] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:14] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:14] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:19] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:19] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:19] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:25] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:25] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:25] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:25] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:25] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:25] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:32] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:32] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:32] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:36] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:36] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:36] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:38] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:41] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:48] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:48] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:48] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:48] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:53] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:53] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:38:54] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:54] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:54] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:38:56] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:56] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:38:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:38:59] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:38:59] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:39:07] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:07] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:39:07] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:39:13] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:13] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:39:13] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:39:17] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:17] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:39:17] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:39:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:39:42] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:39:43] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:43] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:39:43] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:39:44] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:44] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:39:44] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:39:44] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:44] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:39:44] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:39:51] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:51] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:39:52] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:52] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:39:55] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:55] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:39:58] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:58] W [server-protocol.c:4210:server_fstat] server: fd - 951: unresolved fd
> [2009-08-25 16:39:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:39:59] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:40:01] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:01] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:01] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:40:03] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:03] W [server-protocol.c:4210:server_fstat] server: fd - 1104: unresolved fd
> [2009-08-25 16:40:10] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:14] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:14] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:14] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:40:16] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:16] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:16] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:40:20] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:20] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:20] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:40:30] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:30] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:30] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:40:33] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:33] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:33] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:40:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:42] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:40:46] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:46] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:46] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:40:54] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:40:54] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:40:54] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:41:02] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:41:02] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:41:02] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:41:05] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:41:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:41:05] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:41:15] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:41:15] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:41:15] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:41:36] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:41:36] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:41:36] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:41:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:41:48] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:41:48] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:42:38] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:42:38] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:42:38] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:42:54] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:42:54] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:42:54] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:42:58] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:42:58] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:42:58] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:43:11] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:43:11] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:43:11] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:43:49] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:43:49] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:43:49] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:44:05] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:44:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:44:05] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:44:06] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:44:06] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:44:06] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:44:08] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:44:08] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:44:08] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:44:10] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:44:10] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:44:10] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:44:15] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:44:15] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:44:15] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:44:45] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:44:45] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:44:45] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:44:53] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:44:53] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:44:53] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:45:24] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:45:24] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:45:24] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:45:24] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:45:24] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:45:24] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:45:24] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:45:24] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:45:24] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:45:58] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:45:58] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:45:58] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:46:09] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:46:09] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:46:09] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:46:11] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:46:11] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:46:11] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:46:26] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:46:26] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:46:50] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:46:50] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:46:50] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:46:50] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:46:50] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:46:50] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:47:04] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:04] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:04] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:47:04] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:04] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:04] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:47:19] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:19] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:19] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:47:22] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:22] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:22] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:47:24] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:47:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:46] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:46] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:46] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:47:51] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:51] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:51] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:47:52] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:52] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:47:52] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:47:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:59] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:47:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:47:59] W [server-protocol.c:4210:server_fstat] server: fd - 541: unresolved fd
> [2009-08-25 16:48:02] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:48:02] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:02] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:48:10] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:48:10] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:10] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:48:11] N [server-protocol.c:7815:notify] server: 10.7.69.146:1012 disconnected
> [2009-08-25 16:48:11] N [server-protocol.c:7815:notify] server: 10.7.69.146:1013 disconnected
> [2009-08-25 16:48:11] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp2-22455-2009/08/25-16:36:05:537272-remote3
> [2009-08-25 16:48:25] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1015
> [2009-08-25 16:48:25] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1019
> [2009-08-25 16:48:28] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:48:28] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:28] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:48:35] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:48:35] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:35] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:48:50] N [server-protocol.c:7815:notify] server: 10.7.69.147:1013 disconnected
> [2009-08-25 16:48:50] N [server-protocol.c:7815:notify] server: 10.7.69.147:1012 disconnected
> [2009-08-25 16:48:50] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp3.osmp.ru-29039-2009/08/25-16:32:38:867872-remote3
> [2009-08-25 16:48:53] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> ================================================================================
> Version : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
> TLA Revision : v2.0.4
> Starting Time: 2009-08-25 16:48:55
> Command line : /usr/sbin/glusterfsd -f /etc/glusterfs/glusterfs-server.vol
> PID : 29787
> System name : Linux
> Nodename : ftp3.osmp.ru
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: volume posix
> 2: type storage/posix
> 3: option directory /home/automat
> 4: end-volume
> 5:
> 6: volume locks
> 7: type features/locks
> 8: subvolumes posix
> 9: end-volume
> 10:
> 11: volume brick
> 12: type performance/io-threads
> 13: option thread-count 8
> 14: subvolumes locks
> 15: end-volume
> 16:
> 17: volume server
> 18: type protocol/server
> 19: option transport-type tcp
> 20: option auth.addr.brick.allow *
> 21: subvolumes brick
> 22: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 16:48:55] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 16:48:56] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1015
> [2009-08-25 16:48:56] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.145:1019
> [2009-08-25 16:48:56] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.148:1019
> [2009-08-25 16:48:56] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.146:1019
> [2009-08-25 16:48:56] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.145:1018
> [2009-08-25 16:48:56] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.148:1018
> [2009-08-25 16:48:57] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:57] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:48:57] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:57] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:48:57] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:48:57] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:48:57] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:57] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:48:57] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:58] W [server-protocol.c:4210:server_fstat] server: fd - 28: unresolved fd
> [2009-08-25 16:48:58] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1014
> [2009-08-25 16:48:58] N [server-protocol.c:7055:mop_setvolume] server: accepted client from 10.7.69.147:1015
> [2009-08-25 16:48:58] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:59] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:48:59] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:48:59] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:48:59] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:49:00] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:00] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:03] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:04] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:04] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:06] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:49:07] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:08] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:10] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:49:11] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:11] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:49:11] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:11] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:49:13] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:14] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:16] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:18] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:19] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:49:20] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:21] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:21] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:23] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:49:23] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:49:23] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:23] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:49:25] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:27] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:29] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:49:31] W [server-protocol.c:4210:server_fstat] server: fd - 91: unresolved fd
> [2009-08-25 16:49:31] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:32] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:49:32] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:34] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:34] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:36] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:49:38] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:49:39] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:39] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:40] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:49:40] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:49:41] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:41] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:43] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:44] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:49:45] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:45] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:49:46] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:48] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:49] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:49:49] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:51] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:49:53] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:49:54] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:49:54] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:49:57] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:49:57] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:49:58] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:49:58] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:49:58] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:49:59] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:00] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:50:01] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:50:02] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:50:02] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:03] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:50:06] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:50:06] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:08] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:50:08] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:08] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:50:09] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:10] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:12] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:13] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:50:13] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:13] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:50:15] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:50:15] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:16] W [server-protocol.c:4210:server_fstat] server: fd - 91: unresolved fd
> [2009-08-25 16:50:17] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:50:17] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:19] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:50:19] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:50:21] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:50:22] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:50:22] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:23] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:50:23] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:50:23] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:23] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:50:24] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:50:26] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:50:28] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:50:30] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:50:31] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:50:31] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:31] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:50:32] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:50:34] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:35] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:50:36] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:50:38] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:50:39] W [server-protocol.c:4210:server_fstat] server: fd - 91: unresolved fd
> [2009-08-25 16:50:40] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:40] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:50:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:50:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:42] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:50:45] W [server-protocol.c:4210:server_fstat] server: fd - 46: unresolved fd
> [2009-08-25 16:50:45] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:46] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:50:52] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:50:52] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:50:52] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:52] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:50:53] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:50:53] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:53] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:50:53] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:54] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:50:54] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:54] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:50:55] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:50:56] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:50:56] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:50:58] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:51:00] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:02] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:07] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:08] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:51:09] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:51:14] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:51:17] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:51:18] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:51:21] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:51:24] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:51:27] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:51:28] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:51:28] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:28] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:51:29] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:30] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:51:31] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:51:33] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:51:36] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:51:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:51:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:51:38] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:51:38] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:38] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:51:39] W [server-protocol.c:4210:server_fstat] server: fd - 83: unresolved fd
> [2009-08-25 16:51:41] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:50] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:51:50] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:50] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:51:55] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:51:55] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:51:55] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:51:56] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:02] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:52:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:10] W [server-protocol.c:4210:server_fstat] server: fd - 91: unresolved fd
> [2009-08-25 16:52:15] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:52:15] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:15] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:52:25] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:26] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:52:26] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:26] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:52:34] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:52:34] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:34] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:52:39] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:47] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:52:48] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:49] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:52:49] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:52:49] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:49] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:52:49] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:52:53] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:52:58] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 16:53:03] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:53:06] W [server-protocol.c:4210:server_fstat] server: fd - 91: unresolved fd
> [2009-08-25 16:53:08] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:53:08] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:53:08] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:53:10] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:53:13] W [server-protocol.c:4210:server_fstat] server: fd - 91: unresolved fd
> [2009-08-25 16:53:19] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:53:19] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:53:19] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:53:20] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:53:20] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:53:20] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:53:25] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:53:25] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:53:25] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:53:30] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:53:34] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:53:36] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:53:39] W [server-protocol.c:4210:server_fstat] server: fd - 91: unresolved fd
> [2009-08-25 16:53:43] W [server-protocol.c:4210:server_fstat] server: fd - 105: unresolved fd
> [2009-08-25 16:53:50] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:53:51] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:53:51] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:53:51] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:54:05] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:54:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:05] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:54:06] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:12] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:12] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:16] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:17] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:26] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:54:26] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:26] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:54:32] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:39] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:54:39] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:39] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:54:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:54:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:42] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:54:46] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:54:46] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:46] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:54:52] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:54:52] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:54:52] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:55:05] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:55:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:55:05] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:55:15] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:55:15] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:55:15] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:55:34] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:55:37] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:55:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:55:37] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:55:40] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:55:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:55:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:55:42] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:55:43] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:55:43] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:55:43] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:55:48] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:55:48] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:55:48] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:56:13] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:56:14] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:56:14] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:56:14] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:56:14] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:56:26] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:56:26] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:56:26] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:56:44] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:56:44] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:56:44] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:56:44] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:56:50] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:56:50] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:56:50] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:57:01] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:06] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:57:06] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:06] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:57:07] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:09] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:57:09] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:09] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:57:16] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:57:16] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:16] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:57:35] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:40] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:57:40] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:40] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:57:42] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:57:42] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:42] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:57:46] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:57:46] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:46] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:57:47] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:47] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:49] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:57:49] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:49] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:57:49] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:57:49] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:49] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:57:53] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:57:53] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:57:53] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:58:23] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:58:23] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:58:23] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:58:26] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:58:26] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:58:26] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:58:35] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:58:35] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:58:35] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:58:36] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:58:36] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:58:36] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:58:41] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:58:45] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:58:45] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:58:45] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:58:50] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:58:50] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:58:50] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 16:59:52] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 16:59:52] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 16:59:52] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 17:00:07] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:00:32] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:00:36] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 17:00:36] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:00:36] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 17:00:47] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:00:56] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:00:56] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:01:23] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 17:01:23] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:01:23] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 17:02:03] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 17:02:03] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:02:03] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 17:02:20] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 17:02:20] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:02:20] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 17:04:54] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:04:57] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:04:58] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:05:00] W [server-protocol.c:4210:server_fstat] server: fd - 6: unresolved fd
> [2009-08-25 17:05:03] W [server-protocol.c:4210:server_fstat] server: fd - 6: unresolved fd
> [2009-08-25 17:05:03] W [server-protocol.c:4210:server_fstat] server: fd - 2: unresolved fd
> [2009-08-25 17:05:09] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 17:05:09] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:05:09] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 17:05:21] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:05:52] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:05:52] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:05:52] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:06:26] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:06:56] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 17:06:56] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:06:56] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 17:07:37] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:08:46] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:08:50] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:08:56] W [server-protocol.c:4210:server_fstat] server: fd - 17: unresolved fd
> [2009-08-25 17:09:26] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:09:26] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:09:40] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:10:07] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:10:24] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:11:54] E [posix.c:1566:posix_readv] posix: read failed on fd=0xc46c000: Is a directory
> [2009-08-25 17:12:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:12:27] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:12:43] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:12:46] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:13:15] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:14:02] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:14:19] W [server-protocol.c:4210:server_fstat] server: fd - 26: unresolved fd
> [2009-08-25 17:14:23] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:14:26] W [server-protocol.c:4210:server_fstat] server: fd - 26: unresolved fd
> [2009-08-25 17:14:26] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:14:29] W [server-protocol.c:4210:server_fstat] server: fd - 26: unresolved fd
> [2009-08-25 17:14:57] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:14:59] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:17:25] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:17:47] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:19:24] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:20:02] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:21:13] W [server-protocol.c:4210:server_fstat] server: fd - 41: unresolved fd
> [2009-08-25 17:21:16] W [server-protocol.c:4210:server_fstat] server: fd - 41: unresolved fd
> [2009-08-25 17:21:16] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:21:47] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:22:15] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:22:15] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:22:23] W [server-protocol.c:4210:server_fstat] server: fd - 29: unresolved fd
> [2009-08-25 17:22:31] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:23:24] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:23:49] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:24:07] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:24:11] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:24:44] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:24:56] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:25:00] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:25:46] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:25:57] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:26:01] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:26:12] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:26:16] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:26:20] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:27:56] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:28:10] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:28:17] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:28:53] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:29:19] E [server-protocol.c:3903:server_readv] brick: invalid argument: state->fd
> [2009-08-25 17:29:25] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:29:38] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:29:40] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:29:43] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:29:45] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:29:49] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:29:51] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:29:53] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:29:54] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:29:56] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:30:00] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:30:05] W [server-protocol.c:4210:server_fstat] server: fd - 1: unresolved fd
> [2009-08-25 17:30:05] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:30:17] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:30:22] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:30:23] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:30:25] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:30:33] W [server-protocol.c:4210:server_fstat] server: fd - 14: unresolved fd
> [2009-08-25 17:31:50] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:36:51] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:36:51] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:37:40] W [server-protocol.c:4210:server_fstat] server: fd - 2: unresolved fd
> [2009-08-25 17:37:54] W [server-protocol.c:4210:server_fstat] server: fd - 2: unresolved fd
> [2009-08-25 17:38:06] W [server-protocol.c:4210:server_fstat] server: fd - 2: unresolved fd
> [2009-08-25 17:38:08] W [server-protocol.c:4210:server_fstat] server: fd - 2: unresolved fd
> [2009-08-25 17:38:10] W [server-protocol.c:4210:server_fstat] server: fd - 2: unresolved fd
> [2009-08-25 17:38:12] W [server-protocol.c:4210:server_fstat] server: fd - 2: unresolved fd
> [2009-08-25 17:38:13] W [server-protocol.c:4210:server_fstat] server: fd - 2: unresolved fd
> [2009-08-25 17:38:43] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:40:19] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:40:19] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:41:00] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:42:23] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:42:29] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:45:16] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:52:29] E [server-protocol.c:4108:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:53:02] N [server-protocol.c:7815:notify] server: 10.7.69.147:1015 disconnected
> [2009-08-25 17:53:02] N [server-protocol.c:7815:notify] server: 10.7.69.147:1014 disconnected
> [2009-08-25 17:53:02] N [server-helpers.c:782:server_connection_destroy] server: destroyed connection of ftp3.osmp.ru-29803-2009/08/25-16:48:58:618326-remote3
> [2009-08-25 17:53:05] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
> ================================================================================
> Version : glusterfs 2.0.6 built on Aug 18 2009 06:07:41
> TLA Revision : v2.0.6
> Starting Time: 2009-08-25 17:54:55
> Command line : /usr/sbin/glusterfsd -f /etc/glusterfs/glusterfs-server.vol
> PID : 32075
> System name : Linux
> Nodename : ftp3.osmp.ru
> Kernel Release : 2.6.18-128.1.1.el5
> Hardware Identifier: x86_64
>
> Given volfile:
> +------------------------------------------------------------------------------+
> 1: volume posix
> 2: type storage/posix
> 3: option directory /home/automat
> 4: end-volume
> 5:
> 6: volume locks
> 7: type features/locks
> 8: subvolumes posix
> 9: end-volume
> 10:
> 11: volume brick
> 12: type performance/io-threads
> 13: option thread-count 8
> 14: subvolumes locks
> 15: end-volume
> 16:
> 17: volume server
> 18: type protocol/server
> 19: option transport-type tcp
> 20: option auth.addr.brick.allow *
> 21: subvolumes brick
> 22: end-volume
>
> +------------------------------------------------------------------------------+
> [2009-08-25 17:54:55] N [glusterfsd.c:1224:main] glusterfs: Successfully started
> [2009-08-25 17:54:55] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1021
> [2009-08-25 17:54:55] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1020
> [2009-08-25 17:54:56] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1021
> [2009-08-25 17:54:56] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1020
> [2009-08-25 17:55:05] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.147:1018
> [2009-08-25 17:55:05] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.147:1019
> [2009-08-25 17:55:14] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:55:16] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:55:19] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:55:21] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:55:37] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:55:44] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:56:04] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1019
> [2009-08-25 17:56:04] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1018
> [2009-08-25 17:56:10] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [fd.c:326:gf_fd_fdptr_get] fd: invalid argument
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [fd.c:282:gf_fd_put] fd: invalid argument
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:02] E [server-protocol.c:4110:server_flush] brick: invalid argument: state->fd
> [2009-08-25 17:57:10] N [server-protocol.c:7816:notify] server: 10.7.69.145:1020 disconnected
> [2009-08-25 17:57:10] N [server-protocol.c:7816:notify] server: 10.7.69.145:1021 disconnected
> [2009-08-25 17:57:10] N [server-helpers.c:779:server_connection_destroy] server: destroyed connection of ftp1-15717-2009/08/04-11:48:50:894117-remote3
> [2009-08-25 17:58:19] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1018
> [2009-08-25 17:58:19] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.145:1019
> [2009-08-25 18:03:06] N [server-protocol.c:7816:notify] server: 10.7.69.148:1020 disconnected
> [2009-08-25 18:03:06] N [server-protocol.c:7816:notify] server: 10.7.69.148:1021 disconnected
> [2009-08-25 18:03:06] N [server-helpers.c:779:server_connection_destroy] server: destroyed connection of site.osmp.ru-3494-2009/08/25-15:05:35:657728-remote3
> [2009-08-25 18:03:07] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1013
> [2009-08-25 18:03:07] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.148:1012
> [2009-08-26 18:14:38] N [server-protocol.c:7816:notify] server: 10.7.69.146:1018 disconnected
> [2009-08-26 18:14:38] N [server-protocol.c:7816:notify] server: 10.7.69.146:1019 disconnected
> [2009-08-26 18:14:38] N [server-helpers.c:779:server_connection_destroy] server: destroyed connection of ftp2-25366-2009/08/25-17:56:04:357261-remote3
> [2009-08-26 18:15:01] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1014
> [2009-08-26 18:15:01] N [server-protocol.c:7056:mop_setvolume] server: accepted client from 10.7.69.146:1013
More information about the Gluster-users
mailing list