[Gluster-users] cp: skipping file $FILEPATH as it was replaced while being copied
Patrick Regan
patrick.rubbs.regan at gmail.com
Mon Mar 25 12:39:32 UTC 2013
On Sat, Mar 23, 2013 at 9:08 AM, Brian Foster <bfoster at redhat.com> wrote:
> On 03/22/2013 05:11 PM, Patrick Regan wrote:
> > I have a 8-node 2 replica Gluster volume mounted with the fuse client.
> > We also have an in-house Perl script we use for doing block string
> > substitutions. If we run this script on directories on the volume, I
> > get the following error on almost every file:
> >
> > cp: skipping file $FILEPATH as it was replaced while being copied
> >
>
> That error is preceded with the following comment in coreutils:
>
> /* Compare the source dev/ino from the open file to the incoming,
> saved ones obtained via a previous call to stat. */
>
> ... which basically means the source inode has changed between the time
> this particular function runs a stat on the source path and some
> previous call had run the same thing. Had you confirmed which cp command
> in your script results in this error (e.g., it looks like you have a cp
> to temp and a cp to orig)?
>
Actually both cp's cause the error to occur. Both the copy to the temp, and
the copy from the temp to the original.
>
> I know nothing about perl (and the lack of indentation in the script
> post is making my eyes cross :P), but have you thought about the level
> of serialization you're getting in the perl script between the cp
> commands and programmatic file access? In other words, is it possible
> the work your script invokes via print and `` operators is racing with
> the script itself?
>
My apologies for the lack of indentation. I should have known whitespace
would have gotten stripped. Here are links to both the perl and the shell
scripts:
http://pastebin.com/Q9mxSjS0 - Perl
http://pastebin.com/RaS3cxQa - Bash
I too am not that much of a Perl expert, so I'll ask a few of my developers
here. I'll report back with anything else I can find.
Even if it was a race condition, why does it happen with the FUSE client,
but not NFS?
Thanks,
Pat
>
> Brian
>
> > If I mount the volume with NFS, this issue does not arise.
> >
> > I have also tried to replicate the issue using a roughly equivalent
> > shell script, but the shell script does not produce the same result on
> > either the fuse or the nfs client.
> >
> > I'll paste my volume log followed by the perl script, followed by my
> > rough shell script.
> >
> > I would appreciate any feedback.
> >
> > Thanks!
> >
> > -------------
> >
> > [2013-03-22 16:32:52.893362] I [glusterfsd.c:1666:main]
> > 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version
> > 3.3.1
> > [2013-03-22 16:32:52.932157] I [io-cache.c:1549:check_cache_size_ok]
> > 0-usrweb-quick-read: Max cache size is 2124763136
> > [2013-03-22 16:32:52.932634] I [io-cache.c:1549:check_cache_size_ok]
> > 0-usrweb-io-cache: Max cache size is 2124763136
> > [2013-03-22 16:32:53.035759] I [client.c:2142:notify]
> > 0-usrweb-client-0: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:32:53.041228] I [client.c:2142:notify]
> > 0-usrweb-client-1: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:32:53.046270] I [client.c:2142:notify]
> > 0-usrweb-client-2: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:32:53.050863] I [client.c:2142:notify]
> > 0-usrweb-client-3: parent translators are ready, attempting connect on
> > transport
> > Given volfile:
> >
> +------------------------------------------------------------------------------+
> > 1: volume usrweb-client-0
> > 2: type protocol/client
> > 3: option remote-host ak001
> > 4: option remote-subvolume /srv/gluster/volusrweb
> > 5: option transport-type tcp
> > 6: end-volume
> > 7:
> > 8: volume usrweb-client-1
> > 9: type protocol/client
> > 10: option remote-host ak002
> > 11: option remote-subvolume /srv/gluster/volusrweb
> > 12: option transport-type tcp
> > 13: end-volume
> > 14:
> > 15: volume usrweb-client-2
> > 16: type protocol/client
> > 17: option remote-host ak003
> > 18: option remote-subvolume /srv/gluster/volusrweb
> > 19: option transport-type tcp
> > 20: end-volume
> > 21:
> > 22: volume usrweb-client-3
> > 23: type protocol/client
> > 24: option remote-host ak004
> > 25: option remote-subvolume /srv/gluster/volusrweb
> > 26: option transport-type tcp
> > 27: end-volume
> > 28:
> > 29: volume usrweb-replicate-0
> > 30: type cluster/replicate
> > 31: subvolumes usrweb-client-0 usrweb-client-1
> > 32: end-volume
> > 33:
> > 34: volume usrweb-replicate-1
> > 35: type cluster/replicate
> > 36: subvolumes usrweb-client-2 usrweb-client-3
> > 37: end-volume
> > 38:
> > 39: volume usrweb-dht
> > 40: type cluster/distribute
> > 41: subvolumes usrweb-replicate-0 usrweb-replicate-1
> > 42: end-volume
> > 43:
> > 44: volume usrweb-write-behind
> > 45: type performance/write-behind
> > 46: subvolumes usrweb-dht
> > 47: end-volume
> > 48:
> > 49: volume usrweb-read-ahead
> > 50: type performance/read-ahead
> > 51: subvolumes usrweb-write-behind
> > 52: end-volume
> > 53:
> > 54: volume usrweb-io-cache
> > 55: type performance/io-cache
> > 56: subvolumes usrweb-read-ahead
> > 57: end-volume
> > 58:
> > 59: volume usrweb-quick-read
> > 60: type performance/quick-read
> > 61: subvolumes usrweb-io-cache
> > 62: end-volume
> > 63:
> > 64: volume usrweb-md-cache
> > 65: type performance/md-cache
> > 66: subvolumes usrweb-quick-read
> > 67: end-volume
> > 68:
> > 69: volume usrweb
> > 70: type debug/io-stats
> > 71: option latency-measurement off
> > 72: option count-fop-hits off
> > 73: subvolumes usrweb-md-cache
> > 74: end-volume
> >
> >
> +------------------------------------------------------------------------------+
> > [2013-03-22 16:32:53.057710] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 0-usrweb-client-2: changing port to 24010 (from 0)
> > [2013-03-22 16:32:53.057895] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 0-usrweb-client-1: changing port to 24010 (from 0)
> > [2013-03-22 16:32:53.058025] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 0-usrweb-client-0: changing port to 24010 (from 0)
> > [2013-03-22 16:32:53.059259] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 0-usrweb-client-3: changing port to 24010 (from 0)
> > [2013-03-22 16:32:56.933277] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 0-usrweb-client-2: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:32:56.933966] I
> > [client-handshake.c:1433:client_setvolume_cbk] 0-usrweb-client-2:
> > Connected to 10.0.8.242:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:32:56.934012] I
> > [client-handshake.c:1445:client_setvolume_cbk] 0-usrweb-client-2:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:32:56.934161] I [afr-common.c:3628:afr_notify]
> > 0-usrweb-replicate-1: Subvolume 'usrweb-client-2' came back up; going
> > online.
> > [2013-03-22 16:32:56.934400] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 0-usrweb-client-2:
> > Server lk version = 1
> > [2013-03-22 16:32:56.938890] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 0-usrweb-client-1: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:32:56.939504] I
> > [client-handshake.c:1433:client_setvolume_cbk] 0-usrweb-client-1:
> > Connected to 10.0.8.241:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:32:56.939553] I
> > [client-handshake.c:1445:client_setvolume_cbk] 0-usrweb-client-1:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:32:56.939685] I [afr-common.c:3628:afr_notify]
> > 0-usrweb-replicate-0: Subvolume 'usrweb-client-1' came back up; going
> > online.
> > [2013-03-22 16:32:56.939940] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 0-usrweb-client-1:
> > Server lk version = 1
> > [2013-03-22 16:32:56.944004] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 0-usrweb-client-0: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:32:56.944408] I
> > [client-handshake.c:1433:client_setvolume_cbk] 0-usrweb-client-0:
> > Connected to 10.0.8.240:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:32:56.944502] I
> > [client-handshake.c:1445:client_setvolume_cbk] 0-usrweb-client-0:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:32:56.945219] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 0-usrweb-client-0:
> > Server lk version = 1
> > [2013-03-22 16:32:56.949911] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 0-usrweb-client-3: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:32:56.950480] I
> > [client-handshake.c:1433:client_setvolume_cbk] 0-usrweb-client-3:
> > Connected to 10.0.8.243:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:32:56.950524] I
> > [client-handshake.c:1445:client_setvolume_cbk] 0-usrweb-client-3:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:32:56.998230] I [fuse-bridge.c:4191:fuse_graph_setup]
> > 0-fuse: switched to graph 0
> > [2013-03-22 16:32:56.998706] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 0-usrweb-client-3:
> > Server lk version = 1
> > [2013-03-22 16:32:56.999145] I [fuse-bridge.c:3376:fuse_init]
> > 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13
> > kernel 7.10
> > [2013-03-22 16:32:57.000718] I
> > [afr-common.c:1965:afr_set_root_inode_on_first_lookup]
> > 0-usrweb-replicate-0: added root inode
> > [2013-03-22 16:32:57.001914] I
> > [afr-common.c:1965:afr_set_root_inode_on_first_lookup]
> > 0-usrweb-replicate-1: added root inode
> > [2013-03-22 16:42:00.074968] I [glusterfsd-mgmt.c:65:mgmt_cbk_spec]
> > 0-mgmt: Volume file changed
> > [2013-03-22 16:42:02.114686] I [io-cache.c:1549:check_cache_size_ok]
> > 1-usrweb-quick-read: Max cache size is 2124763136
> > [2013-03-22 16:42:02.114945] I [io-cache.c:1549:check_cache_size_ok]
> > 1-usrweb-io-cache: Max cache size is 2124763136
> > [2013-03-22 16:42:02.265593] I [client.c:2142:notify]
> > 1-usrweb-client-0: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:42:02.270654] I [client.c:2142:notify]
> > 1-usrweb-client-1: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:42:02.275012] I [client.c:2142:notify]
> > 1-usrweb-client-2: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:42:02.279133] I [client.c:2142:notify]
> > 1-usrweb-client-3: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:42:02.283267] I [client.c:2142:notify]
> > 1-usrweb-client-4: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:42:02.287310] I [client.c:2142:notify]
> > 1-usrweb-client-5: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:42:02.291472] I [client.c:2142:notify]
> > 1-usrweb-client-6: parent translators are ready, attempting connect on
> > transport
> > [2013-03-22 16:42:02.295771] I [client.c:2142:notify]
> > 1-usrweb-client-7: parent translators are ready, attempting connect on
> > transport
> > Given volfile:
> >
> +------------------------------------------------------------------------------+
> > 1: volume usrweb-client-0
> > 2: type protocol/client
> > 3: option remote-host ak001
> > 4: option remote-subvolume /srv/gluster/volusrweb
> > 5: option transport-type tcp
> > 6: end-volume
> > 7:
> > 8: volume usrweb-client-1
> > 9: type protocol/client
> > 10: option remote-host ak002
> > 11: option remote-subvolume /srv/gluster/volusrweb
> > 12: option transport-type tcp
> > 13: end-volume
> > 14:
> > 15: volume usrweb-client-2
> > 16: type protocol/client
> > 17: option remote-host ak003
> > 18: option remote-subvolume /srv/gluster/volusrweb
> > 19: option transport-type tcp
> > 20: end-volume
> > 21:
> > 22: volume usrweb-client-3
> > 23: type protocol/client
> > 24: option remote-host ak004
> > 25: option remote-subvolume /srv/gluster/volusrweb
> > 26: option transport-type tcp
> > 27: end-volume
> > 28:
> > 29: volume usrweb-client-4
> > 30: type protocol/client
> > 31: option remote-host ak005
> > 32: option remote-subvolume /srv/gluster/volusrweb
> > 33: option transport-type tcp
> > 34: end-volume
> > 35:
> > 36: volume usrweb-client-5
> > 37: type protocol/client
> > 38: option remote-host ak006
> > 39: option remote-subvolume /srv/gluster/volusrweb
> > 40: option transport-type tcp
> > 41: end-volume
> > 42:
> > 43: volume usrweb-client-6
> > 44: type protocol/client
> > 45: option remote-host ak007
> > 46: option remote-subvolume /srv/gluster/volusrweb
> > 47: option transport-type tcp
> > 48: end-volume
> > 49:
> > 50: volume usrweb-client-7
> > 51: type protocol/client
> > 52: option remote-host ak008
> > 53: option remote-subvolume /srv/gluster/volusrweb
> > 54: option transport-type tcp
> > 55: end-volume
> > 56:
> > 57: volume usrweb-replicate-0
> > 58: type cluster/replicate
> > 59: subvolumes usrweb-client-0 usrweb-client-1
> > 60: end-volume
> > 61:
> > 62: volume usrweb-replicate-1
> > 63: type cluster/replicate
> > 64: subvolumes usrweb-client-2 usrweb-client-3
> > 65: end-volume
> > 66:
> > 67: volume usrweb-replicate-2
> > 68: type cluster/replicate
> > 69: subvolumes usrweb-client-4 usrweb-client-5
> > 70: end-volume
> > 71:
> > 72: volume usrweb-replicate-3
> > 73: type cluster/replicate
> > 74: subvolumes usrweb-client-6 usrweb-client-7
> > 75: end-volume
> > 76:
> > 77: volume usrweb-dht
> > 78: type cluster/distribute
> > 79: subvolumes usrweb-replicate-0 usrweb-replicate-1
> > usrweb-replicate-2 usrweb-replicate-3
> > 80: end-volume
> > 81:
> > 82: volume usrweb-write-behind
> > 83: type performance/write-behind
> > 84: subvolumes usrweb-dht
> > 85: end-volume
> > 86:
> > 87: volume usrweb-read-ahead
> > 88: type performance/read-ahead
> > 89: subvolumes usrweb-write-behind
> > 90: end-volume
> > 91:
> > 92: volume usrweb-io-cache
> > 93: type performance/io-cache
> > 94: subvolumes usrweb-read-ahead
> > 95: end-volume
> > 96:
> > 97: volume usrweb-quick-read
> > 98: type performance/quick-read
> > 99: subvolumes usrweb-io-cache
> > 100: end-volume
> > 101:
> > 102: volume usrweb-md-cache
> > 103: type performance/md-cache
> > 104: subvolumes usrweb-quick-read
> > 105: end-volume
> > 106:
> > 107: volume usrweb
> > 108: type debug/io-stats
> > 109: option latency-measurement off
> > 110: option count-fop-hits off
> > 111: subvolumes usrweb-md-cache
> > 112: end-volume
> >
> >
> +------------------------------------------------------------------------------+
> > [2013-03-22 16:42:02.301090] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 1-usrweb-client-0: changing port to 24010 (from 0)
> > [2013-03-22 16:42:04.158794] E
> > [client-handshake.c:1717:client_query_portmap_cbk] 1-usrweb-client-5:
> > failed to get the port number for remote subvolume
> > [2013-03-22 16:42:04.159003] I [client.c:2090:client_rpc_notify]
> > 1-usrweb-client-5: disconnected
> > [2013-03-22 16:42:04.159074] E
> > [client-handshake.c:1717:client_query_portmap_cbk] 1-usrweb-client-7:
> > failed to get the port number for remote subvolume
> > [2013-03-22 16:42:04.159223] I [client.c:2090:client_rpc_notify]
> > 1-usrweb-client-7: disconnected
> > [2013-03-22 16:42:04.161765] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 1-usrweb-client-3: changing port to 24010 (from 0)
> > [2013-03-22 16:42:04.161868] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 1-usrweb-client-2: changing port to 24010 (from 0)
> > [2013-03-22 16:42:04.162355] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 1-usrweb-client-1: changing port to 24010 (from 0)
> > [2013-03-22 16:42:04.162449] E
> > [client-handshake.c:1717:client_query_portmap_cbk] 1-usrweb-client-6:
> > failed to get the port number for remote subvolume
> > [2013-03-22 16:42:04.162529] E
> > [client-handshake.c:1717:client_query_portmap_cbk] 1-usrweb-client-4:
> > failed to get the port number for remote subvolume
> > [2013-03-22 16:42:04.162625] I [client.c:2090:client_rpc_notify]
> > 1-usrweb-client-4: disconnected
> > [2013-03-22 16:42:04.162708] E [afr-common.c:3665:afr_notify]
> > 1-usrweb-replicate-2: All subvolumes are down. Going offline until
> > atleast one of them comes back up.
> > [2013-03-22 16:42:04.162765] I [client.c:2090:client_rpc_notify]
> > 1-usrweb-client-6: disconnected
> > [2013-03-22 16:42:04.162805] E [afr-common.c:3665:afr_notify]
> > 1-usrweb-replicate-3: All subvolumes are down. Going offline until
> > atleast one of them comes back up.
> > [2013-03-22 16:42:05.715027] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 1-usrweb-client-0: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:42:05.715447] I
> > [client-handshake.c:1433:client_setvolume_cbk] 1-usrweb-client-0:
> > Connected to 10.0.8.240:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:42:05.715501] I
> > [client-handshake.c:1445:client_setvolume_cbk] 1-usrweb-client-0:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:42:05.715767] I [afr-common.c:3628:afr_notify]
> > 1-usrweb-replicate-0: Subvolume 'usrweb-client-0' came back up; going
> > online.
> > [2013-03-22 16:42:05.715836] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 1-usrweb-client-0:
> > Server lk version = 1
> > [2013-03-22 16:42:07.722528] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 1-usrweb-client-5: changing port to 24010 (from 0)
> > [2013-03-22 16:42:07.727863] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 1-usrweb-client-7: changing port to 24010 (from 0)
> > [2013-03-22 16:42:07.732813] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 1-usrweb-client-3: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:42:07.733314] I
> > [client-handshake.c:1433:client_setvolume_cbk] 1-usrweb-client-3:
> > Connected to 10.0.8.243:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:42:07.733358] I
> > [client-handshake.c:1445:client_setvolume_cbk] 1-usrweb-client-3:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:42:07.733524] I [afr-common.c:3628:afr_notify]
> > 1-usrweb-replicate-1: Subvolume 'usrweb-client-3' came back up; going
> > online.
> > [2013-03-22 16:42:07.733731] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 1-usrweb-client-3:
> > Server lk version = 1
> > [2013-03-22 16:42:07.738423] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 1-usrweb-client-2: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:42:07.738819] I
> > [client-handshake.c:1433:client_setvolume_cbk] 1-usrweb-client-2:
> > Connected to 10.0.8.242:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:42:07.738860] I
> > [client-handshake.c:1445:client_setvolume_cbk] 1-usrweb-client-2:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:42:07.739276] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 1-usrweb-client-2:
> > Server lk version = 1
> > [2013-03-22 16:42:07.744321] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 1-usrweb-client-1: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:42:07.744874] I
> > [client-handshake.c:1433:client_setvolume_cbk] 1-usrweb-client-1:
> > Connected to 10.0.8.241:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:42:07.744916] I
> > [client-handshake.c:1445:client_setvolume_cbk] 1-usrweb-client-1:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:42:07.798486] I [fuse-bridge.c:4191:fuse_graph_setup]
> > 0-fuse: switched to graph 1
> > [2013-03-22 16:42:07.799081] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 1-usrweb-client-1:
> > Server lk version = 1
> > [2013-03-22 16:42:07.799444] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 1-usrweb-client-6: changing port to 24010 (from 0)
> > [2013-03-22 16:42:07.799591] I [rpc-clnt.c:1657:rpc_clnt_reconfig]
> > 1-usrweb-client-4: changing port to 24010 (from 0)
> > [2013-03-22 16:42:10.771491] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 1-usrweb-client-5: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:42:10.776211] I
> > [client-handshake.c:1433:client_setvolume_cbk] 1-usrweb-client-5:
> > Connected to 10.0.8.245:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:42:10.776323] I
> > [client-handshake.c:1445:client_setvolume_cbk] 1-usrweb-client-5:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:42:10.776500] I [afr-common.c:3628:afr_notify]
> > 1-usrweb-replicate-2: Subvolume 'usrweb-client-5' came back up; going
> > online.
> > [2013-03-22 16:42:10.776836] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 1-usrweb-client-5:
> > Server lk version = 1
> > [2013-03-22 16:42:10.777113] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 1-usrweb-client-7: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:42:10.777615] I
> > [client-handshake.c:1433:client_setvolume_cbk] 1-usrweb-client-7:
> > Connected to 10.0.8.247:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:42:10.777676] I
> > [client-handshake.c:1445:client_setvolume_cbk] 1-usrweb-client-7:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:42:10.777866] I [afr-common.c:3628:afr_notify]
> > 1-usrweb-replicate-3: Subvolume 'usrweb-client-7' came back up; going
> > online.
> > [2013-03-22 16:42:10.778129] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 1-usrweb-client-7:
> > Server lk version = 1
> > [2013-03-22 16:42:11.784150] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 1-usrweb-client-6: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:42:11.787025] I
> > [client-handshake.c:1433:client_setvolume_cbk] 1-usrweb-client-6:
> > Connected to 10.0.8.246:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:42:11.787141] I
> > [client-handshake.c:1445:client_setvolume_cbk] 1-usrweb-client-6:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:42:11.788193] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 1-usrweb-client-6:
> > Server lk version = 1
> > [2013-03-22 16:42:11.789908] I
> > [client-handshake.c:1636:select_server_supported_programs]
> > 1-usrweb-client-4: Using Program GlusterFS 3.3.1, Num (1298437),
> > Version (330)
> > [2013-03-22 16:42:11.790334] I
> > [client-handshake.c:1433:client_setvolume_cbk] 1-usrweb-client-4:
> > Connected to 10.0.8.244:24010, attached to remote volume
> > '/srv/gluster/volusrweb'.
> > [2013-03-22 16:42:11.790398] I
> > [client-handshake.c:1445:client_setvolume_cbk] 1-usrweb-client-4:
> > Server and Client lk-version numbers are not same, reopening the fds
> > [2013-03-22 16:42:11.790726] I
> > [client-handshake.c:453:client_set_lk_version_cbk] 1-usrweb-client-4:
> > Server lk version = 1
> >
> > ------------------------------
> >
> > #!/usr/bin/perl
> >
> > open(FIND, "find . -print |") || die "Coundn't run find: $!\n";
> >
> > $counter = 0;
> > FILE:
> > while ($filename = <FIND>)
> > {
> > chop $filename;
> > next FILE unless -T$filename;
> > if(!open(TEXTFILE, "$filename"))
> > {
> > print STDERR "Can't open $filename - continuing...\n";
> > next FILE;
> > }
> > while (<TEXTFILE>)
> > {
> > $tempfile[$counter] = $_;
> > $counter = $counter + 1;
> > if (index($tempfile[$counter - 1],$ARGV[0]) >= 0)
> > {
> > $totalchanges = $totalchanges +1;
> > $dummy=`cp -p $filename blocktemp.txt\n`;
> > print $dummy;
> > print "$filename\n";
> > open(TEMPFILE, "> blocktemp.txt");
> > $tempfile[$counter -1] =~ s/$ARGV[0]/$ARGV[1]/g;
> > for($i = 0; $i < $counter; $i++)
> > {
> > print TEMPFILE "$tempfile[$i]";
> > }
> > while (<TEXTFILE>)
> > {
> > $storage = $_;
> > if (index($storage,$ARGV[0]) >= 0)
> > {
> > $storage =~ s/$ARGV[0]/$ARGV[1]/g;
> > $totalchanges = $totalchanges +1;
> > }
> > print TEMPFILE "$storage";
> > }
> > close(TEXTFILE);
> > close(TEMPFILE);
> > $dummy2=`cp -p blocktemp.txt $filename`;
> > print $dummy2;
> > $dummy3=`rm blocktemp.txt`;
> > print $dummy3;
> > }
> > }
> > close(TEXTFILE);
> > $counter = 0;
> > }
> > print "$totalchanges lines changed\n";
> >
> > ---------------------------
> >
> > #!/bin/bash
> >
> > FILES=$(find . -type f)
> >
> > for f in $FILES
> > do
> > cp -p $f tempfile.tmp
> > sed -i "s/$1/$2/g" tempfile.tmp
> > cp -p tempfile.tmp $f
> > rm tempfile.tmp
> > done
> >
> > --
> > Patrick Regan
> > _______________________________________________
> > Gluster-users mailing list
> > Gluster-users at gluster.org
> > http://supercolony.gluster.org/mailman/listinfo/gluster-users
> >
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20130325/6b56989a/attachment.html>
More information about the Gluster-users
mailing list