================================================================================
Version      : glusterfs 2.0.4 built on Jul 13 2009 22:12:26
TLA Revision : v2.0.4
Starting Time: 2009-08-04 11:48:50
Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp 
PID          : 15718
System name  : Linux
Nodename     : ftp1
Kernel Release : 2.6.18-128.1.1.el5
Hardware Identifier: x86_64

Given volfile:
+------------------------------------------------------------------------------+
  1: # file: /etc/glusterfs/glusterfs-client.vol
  2: #
  3: volume remote1
  4:   type protocol/client
  5:   option transport-type tcp
  6:   option remote-host 10.7.69.145
  7:   option remote-subvolume brick
  8: end-volume
  9: 
 10: volume remote2
 11:   type protocol/client
 12:   option transport-type tcp
 13:   option remote-host 10.7.69.146
 14:   option remote-subvolume brick
 15: end-volume
 16: 
 17: volume remote3
 18:   type protocol/client
 19:   option transport-type tcp
 20:   option remote-host 10.7.69.147
 21:   option remote-subvolume brick
 22: end-volume
 23: 
 24: volume replicate
 25:   type cluster/replicate
 26:   subvolumes remote1 remote2 remote3
 27: end-volume
 28: 
 29: volume distribute
 30:   type cluster/distribute
 31:   subvolumes replicate
 32: end-volume
 33: 
 34: volume writebehind
 35:   type performance/write-behind
 36:   option block-size 128KB
 37:   option cache-size 100MB
 38:   subvolumes distribute
 39: end-volume
 40: 
 41: volume cache
 42:   type performance/io-cache
 43:   option cache-size 1024MB
 44:   subvolumes writebehind
 45: end-volume

+------------------------------------------------------------------------------+
[2009-08-04 11:48:50] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
[2009-08-04 11:48:50] N [glusterfsd.c:1224:main] glusterfs: Successfully started
[2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
[2009-08-04 11:48:50] N [afr.c:2204:notify] replicate: Subvolume 'remote1' came back up; going online.
[2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
[2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-04 11:48:50] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-20 19:26:08] E [saved-frames.c:165:saved_frames_unwind] remote3: forced unwinding frame type(1) op(LOOKUP)
[2009-08-20 19:26:08] E [saved-frames.c:165:saved_frames_unwind] remote3: forced unwinding frame type(1) op(LOOKUP)
[2009-08-20 19:26:08] N [client-protocol.c:6246:notify] remote3: disconnected
[2009-08-20 19:26:08] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
[2009-08-20 19:26:08] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
[2009-08-20 19:26:43] N [client-protocol.c:6246:notify] remote2: disconnected
[2009-08-20 19:26:46] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-20 19:26:46] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-20 19:27:31] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-20 19:27:34] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-20 19:27:42] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-20 19:27:49] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-25 16:27:45] E [saved-frames.c:165:saved_frames_unwind] remote2: forced unwinding frame type(1) op(LOOKUP)
[2009-08-25 16:27:45] E [saved-frames.c:165:saved_frames_unwind] remote2: forced unwinding frame type(1) op(LOOKUP)
[2009-08-25 16:27:45] N [client-protocol.c:6246:notify] remote2: disconnected
[2009-08-25 16:27:45] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-25 16:27:48] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-25 16:27:58] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-25 16:28:02] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-25 16:32:32] N [client-protocol.c:6246:notify] remote3: disconnected
[2009-08-25 16:32:35] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-25 16:32:35] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-25 16:48:16] N [client-protocol.c:6246:notify] remote2: disconnected
[2009-08-25 16:48:19] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-25 16:48:19] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-25 16:48:22] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-25 16:48:26] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-25 16:48:53] N [client-protocol.c:6246:notify] remote3: disconnected
[2009-08-25 16:48:56] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-25 16:48:56] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-25 17:53:05] N [client-protocol.c:6246:notify] remote3: disconnected
[2009-08-25 17:53:08] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
[2009-08-25 17:53:08] E [socket.c:745:socket_connect_finish] remote3: connection to 10.7.69.147:6996 failed (Connection refused)
[2009-08-25 17:53:39] N [client-protocol.c:6246:notify] remote2: disconnected
[2009-08-25 17:53:42] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-25 17:53:42] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-25 17:54:55] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-25 17:54:55] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-25 17:55:54] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-25 17:56:01] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-25 17:57:09] W [glusterfsd.c:842:cleanup_and_exit] glusterfs: shutting down
[2009-08-25 17:57:09] N [fuse-bridge.c:2830:fini] fuse: Unmounting '/home/ftp'.
================================================================================
Version      : glusterfs 2.0.6 built on Aug 18 2009 06:07:41
TLA Revision : v2.0.6
Starting Time: 2009-08-25 17:58:19
Command line : glusterfs -f /etc/glusterfs/glusterfs-client.vol /home/ftp 
PID          : 11016
System name  : Linux
Nodename     : ftp1
Kernel Release : 2.6.18-128.1.1.el5
Hardware Identifier: x86_64

Given volfile:
+------------------------------------------------------------------------------+
  1: # file: /etc/glusterfs/glusterfs-client.vol
  2: #
  3: volume remote1
  4:   type protocol/client
  5:   option transport-type tcp
  6:   option remote-host 10.7.69.145
  7:   option remote-subvolume brick
  8: end-volume
  9: 
 10: volume remote2
 11:   type protocol/client
 12:   option transport-type tcp
 13:   option remote-host 10.7.69.146
 14:   option remote-subvolume brick
 15: end-volume
 16: 
 17: volume remote3
 18:   type protocol/client
 19:   option transport-type tcp
 20:   option remote-host 10.7.69.147
 21:   option remote-subvolume brick
 22: end-volume
 23: 
 24: volume replicate
 25:   type cluster/replicate
 26:   subvolumes remote1 remote2 remote3
 27: end-volume
 28: 
 29: volume distribute
 30:   type cluster/distribute
 31:   subvolumes replicate
 32: end-volume
 33: 
 34: volume writebehind
 35:   type performance/write-behind
 36:   option block-size 128KB
 37:   option cache-size 100MB
 38:   subvolumes distribute
 39: end-volume
 40: 
 41: volume cache
 42:   type performance/io-cache
 43:   option cache-size 1024MB
 44:   subvolumes writebehind
 45: end-volume

+------------------------------------------------------------------------------+
[2009-08-25 17:58:19] W [glusterfsd.c:470:_log_if_option_is_invalid] writebehind: option 'block-size' is not recognized
[2009-08-25 17:58:19] N [glusterfsd.c:1224:main] glusterfs: Successfully started
[2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
[2009-08-25 17:58:19] N [afr.c:2203:notify] replicate: Subvolume 'remote1' came back up; going online.
[2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote1: Connected to 10.7.69.145:6996, attached to remote volume 'brick'.
[2009-08-25 17:58:19] N [afr.c:2203:notify] replicate: Subvolume 'remote1' came back up; going online.
[2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-25 17:58:19] N [client-protocol.c:5559:client_setvolume_cbk] remote3: Connected to 10.7.69.147:6996, attached to remote volume 'brick'.
[2009-08-26 18:14:47] N [client-protocol.c:6246:notify] remote2: disconnected
[2009-08-26 18:14:50] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-26 18:14:50] E [socket.c:745:socket_connect_finish] remote2: connection to 10.7.69.146:6996 failed (Connection refused)
[2009-08-26 18:14:57] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.
[2009-08-26 18:14:58] N [client-protocol.c:5559:client_setvolume_cbk] remote2: Connected to 10.7.69.146:6996, attached to remote volume 'brick'.