[Bugs] [Bug 1283509] [WORM] Rename operation succeeds on a WORM enabled volume after one brick is added
bugzilla at redhat.com
bugzilla at redhat.com
Sun Nov 29 05:39:55 UTC 2015
https://bugzilla.redhat.com/show_bug.cgi?id=1283509
--- Comment #3 from Fang Huang <fanghuang.data at yahoo.com> ---
Client logs:
cat /var/log/glusterfs/.-client-.log
[2015-11-29 04:04:48.792173] I [MSGID: 100030] [glusterfsd.c:2318:main]
0-/usr/local/sbin/glusterfs: Started running /usr/local/sbin/glusterfs version
3.7.6 (args: /usr/local/sbin/glusterfs --volfile-server=bdfs-node1
--volfile-id=worm-test ./client/)
[2015-11-29 04:04:48.806833] I [MSGID: 101190]
[event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with
index 1
[2015-11-29 04:04:48.813542] I [MSGID: 101190]
[event-epoll.c:632:event_dispatch_epoll_worker] 0-epoll: Started thread with
index 2
[2015-11-29 04:04:48.814130] I [MSGID: 114020] [client.c:2118:notify]
0-worm-test-client-0: parent translators are ready, attempting connect on
transport
Final graph:
+------------------------------------------------------------------------------+
1: volume worm-test-client-0
2: type protocol/client
3: option ping-timeout 42
4: option remote-host bdfs-node1
5: option remote-subvolume /data/br0
6: option transport-type socket
7: option username f5c71cc1-e15e-450d-8a0f-9bb0b65bf9c2
8: option password 6df9bdfe-b597-4cbb-a640-34e8915f1f66
9: option send-gids true
10: end-volume
11:
12: volume worm-test-dht
13: type cluster/distribute
14: subvolumes worm-test-client-0
15: end-volume
16:
17: volume worm-test-write-behind
18: type performance/write-behind
19: subvolumes worm-test-dht
20: end-volume
21:
22: volume worm-test-read-ahead
23: type performance/read-ahead
24: subvolumes worm-test-write-behind
25: end-volume
26:
27: volume worm-test-readdir-ahead
28: type performance/readdir-ahead
29: subvolumes worm-test-read-ahead
30: end-volume
31:
32: volume worm-test-io-cache
33: type performance/io-cache
34: subvolumes worm-test-readdir-ahead
35: end-volume
36:
37: volume worm-test-quick-read
38: type performance/quick-read
39: subvolumes worm-test-io-cache
40: end-volume
41:
42: volume worm-test-open-behind
43: type performance/open-behind
44: subvolumes worm-test-quick-read
45: end-volume
46:
47: volume worm-test-md-cache
48: type performance/md-cache
49: subvolumes worm-test-open-behind
50: end-volume
51:
52: volume worm-test
53: type debug/io-stats
54: option latency-measurement off
55: option count-fop-hits off
56: subvolumes worm-test-md-cache
57: end-volume
58:
59: volume meta-autoload
60: type meta
61: subvolumes worm-test
62: end-volume
63:
+------------------------------------------------------------------------------+
[2015-11-29 04:04:48.815578] I [rpc-clnt.c:1847:rpc_clnt_reconfig]
0-worm-test-client-0: changing port to 49153 (from 0)
[2015-11-29 04:04:48.816906] I [MSGID: 114057]
[client-handshake.c:1437:select_server_supported_programs]
0-worm-test-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2015-11-29 04:04:48.822359] I [MSGID: 114046]
[client-handshake.c:1213:client_setvolume_cbk] 0-worm-test-client-0: Connected
to worm-test-client-0, attached to remote volume '/data/br0'.
[2015-11-29 04:04:48.822437] I [MSGID: 114047]
[client-handshake.c:1224:client_setvolume_cbk] 0-worm-test-client-0: Server and
Client lk-version numbers are not same, reopening the fds
[2015-11-29 04:04:48.830526] I [fuse-bridge.c:5137:fuse_graph_setup] 0-fuse:
switched to graph 0
[2015-11-29 04:04:48.830702] I [MSGID: 114035]
[client-handshake.c:193:client_set_lk_version_cbk] 0-worm-test-client-0: Server
lk version = 1
[2015-11-29 04:04:48.830863] I [fuse-bridge.c:4030:fuse_init] 0-glusterfs-fuse:
FUSE inited with protocol versions: glusterfs 7.22 kernel 7.22
[2015-11-29 04:04:48.832030] I [MSGID: 109063]
[dht-layout.c:702:dht_layout_normalize] 0-worm-test-dht: Found anomalies in /
(gfid = 00000000-0000-0000-0000-000000000001). Holes=1 overlaps=0
[2015-11-29 04:04:48.832982] I [MSGID: 109036]
[dht-common.c:7869:dht_log_new_layout_for_dir_selfheal] 0-worm-test-dht:
Setting layout of / with [Subvol_name: worm-test-client-0, Err: -1 , Start: 0 ,
Stop: 4294967295 , Hash: 1 ],
[2015-11-29 04:07:05.064172] I [glusterfsd-mgmt.c:57:mgmt_cbk_spec] 0-mgmt:
Volume file changed
[2015-11-29 04:07:05.074662] I [MSGID: 114020] [client.c:2118:notify]
2-worm-test-client-0: parent translators are ready, attempting connect on
transport
[2015-11-29 04:07:05.076871] I [MSGID: 114020] [client.c:2118:notify]
2-worm-test-client-1: parent translators are ready, attempting connect on
transport
[2015-11-29 04:07:05.077366] I [rpc-clnt.c:1847:rpc_clnt_reconfig]
2-worm-test-client-0: changing port to 49153 (from 0)
Final graph:
+------------------------------------------------------------------------------+
1: volume worm-test-client-0
2: type protocol/client
3: option ping-timeout 42
4: option remote-host bdfs-node1
5: option remote-subvolume /data/br0
6: option transport-type socket
7: option username f5c71cc1-e15e-450d-8a0f-9bb0b65bf9c2
8: option password 6df9bdfe-b597-4cbb-a640-34e8915f1f66
9: option send-gids true
10: end-volume
11:
12: volume worm-test-client-1
13: type protocol/client
14: option ping-timeout 42
15: option remote-host bdfs-node1
16: option remote-subvolume /data/br1/br1
17: option transport-type socket
18: option username f5c71cc1-e15e-450d-8a0f-9bb0b65bf9c2
19: option password 6df9bdfe-b597-4cbb-a640-34e8915f1f66
20: option send-gids true
21: end-volume
22:
23: volume worm-test-dht
24: type cluster/distribute
25: subvolumes worm-test-client-0 worm-test-client-1
26: end-volume
27:
28: volume worm-test-write-behind
29: type performance/write-behind
30: subvolumes worm-test-dht
31: end-volume
32:
33: volume worm-test-read-ahead
34: type performance/read-ahead
35: subvolumes worm-test-write-behind
36: end-volume
37:
38: volume worm-test-readdir-ahead
39: type performance/readdir-ahead
40: subvolumes worm-test-read-ahead
41: end-volume
42:
43: volume worm-test-io-cache
44: type performance/io-cache
45: subvolumes worm-test-readdir-ahead
46: end-volume
47:
48: volume worm-test-quick-read
49: type performance/quick-read
50: subvolumes worm-test-io-cache
51: end-volume
52:
53: volume worm-test-open-behind
54: type performance/open-behind
55: subvolumes worm-test-quick-read
56: end-volume
57:
58: volume worm-test-md-cache
59: type performance/md-cache
60: subvolumes worm-test-open-behind
61: end-volume
62:
63: volume worm-test
64: type debug/io-stats
65: option latency-measurement off
66: option count-fop-hits off
67: subvolumes worm-test-md-cache
68: end-volume
69:
70: volume meta-autoload
71: type meta
72: subvolumes worm-test
73: end-volume
74:
+------------------------------------------------------------------------------+
[2015-11-29 04:07:05.078032] I [rpc-clnt.c:1847:rpc_clnt_reconfig]
2-worm-test-client-1: changing port to 49154 (from 0)
[2015-11-29 04:07:05.078376] I [MSGID: 114057]
[client-handshake.c:1437:select_server_supported_programs]
2-worm-test-client-0: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2015-11-29 04:07:05.078525] I [MSGID: 114057]
[client-handshake.c:1437:select_server_supported_programs]
2-worm-test-client-1: Using Program GlusterFS 3.3, Num (1298437), Version (330)
[2015-11-29 04:07:05.078670] I [MSGID: 114046]
[client-handshake.c:1213:client_setvolume_cbk] 2-worm-test-client-0: Connected
to worm-test-client-0, attached to remote volume '/data/br0'.
[2015-11-29 04:07:05.078695] I [MSGID: 114047]
[client-handshake.c:1224:client_setvolume_cbk] 2-worm-test-client-0: Server and
Client lk-version numbers are not same, reopening the fds
[2015-11-29 04:07:05.078842] I [MSGID: 114035]
[client-handshake.c:193:client_set_lk_version_cbk] 2-worm-test-client-0: Server
lk version = 1
[2015-11-29 04:07:05.081482] I [MSGID: 114046]
[client-handshake.c:1213:client_setvolume_cbk] 2-worm-test-client-1: Connected
to worm-test-client-1, attached to remote volume '/data/br1/br1'.
[2015-11-29 04:07:05.081549] I [MSGID: 114047]
[client-handshake.c:1224:client_setvolume_cbk] 2-worm-test-client-1: Server and
Client lk-version numbers are not same, reopening the fds
[2015-11-29 04:07:05.090749] I [fuse-bridge.c:5137:fuse_graph_setup] 0-fuse:
switched to graph 2
[2015-11-29 04:07:05.090884] I [MSGID: 114035]
[client-handshake.c:193:client_set_lk_version_cbk] 2-worm-test-client-1: Server
lk version = 1
[2015-11-29 04:07:05.221094] I [MSGID: 114021] [client.c:2127:notify]
0-worm-test-client-0: current graph is no longer active, destroying rpc_client
[2015-11-29 04:07:05.221224] I [MSGID: 114018]
[client.c:2042:client_rpc_notify] 0-worm-test-client-0: disconnected from
worm-test-client-0. Client process will keep trying to connect to glusterd
until brick's port is available
[2015-11-29 04:07:39.845022] I [MSGID: 109064]
[dht-layout.c:808:dht_layout_dir_mismatch] 2-worm-test-dht: subvol:
worm-test-client-0; inode layout - 0 - 4294967295 - 1; disk layout - 216892300
- 4294967295 - 1
[2015-11-29 04:07:39.845095] I [MSGID: 109018]
[dht-common.c:811:dht_revalidate_cbk] 2-worm-test-dht: Mismatching layouts for
/, gfid = 00000000-0000-0000-0000-000000000001
[2015-11-29 04:07:39.845128] I [MSGID: 109064]
[dht-layout.c:808:dht_layout_dir_mismatch] 2-worm-test-dht: subvol:
worm-test-client-1; inode layout - 0 - 0 - 0; disk layout - 0 - 216892299 - 1
[2015-11-29 04:07:39.845164] I [MSGID: 109018]
[dht-common.c:811:dht_revalidate_cbk] 2-worm-test-dht: Mismatching layouts for
/, gfid = 00000000-0000-0000-0000-000000000001
[2015-11-29 04:15:08.834496] I [MSGID: 109066] [dht-rename.c:1411:dht_rename]
2-worm-test-dht: renaming /dummy_0
(hash=worm-test-client-0/cache=worm-test-client-0) => /a.out
(hash=worm-test-client-0/cache=<nul>)
[2015-11-29 04:15:08.835599] W [MSGID: 114031]
[client-rpc-fops.c:2738:client3_3_rename_cbk] 2-worm-test-client-0: remote
operation failed [Read-only file system]
[2015-11-29 04:15:08.835642] W [MSGID: 109030]
[dht-rename.c:715:dht_rename_cbk] 2-worm-test-dht: /dummy_0: Rename on
worm-test-client-0 failed, (gfid = 54ba3d42-3db9-4cb5-91b7-aa104de11593)
[Read-only file system]
[2015-11-29 04:15:08.835964] W [fuse-bridge.c:1777:fuse_rename_cbk]
0-glusterfs-fuse: 2794: /dummy_0 -> /a.out => -1 (Read-only file system)
[2015-11-29 04:15:24.536094] I [MSGID: 109066] [dht-rename.c:1411:dht_rename]
2-worm-test-dht: renaming /dummy_5
(hash=worm-test-client-1/cache=worm-test-client-0) => /dummy_bk
(hash=worm-test-client-0/cache=<nul>)
[2015-11-29 04:15:24.537169] W [MSGID: 109030]
[dht-rename.c:715:dht_rename_cbk] 2-worm-test-dht: /dummy_5: Rename on
worm-test-client-0 failed, (gfid = 443047b0-83cb-40ef-ad8c-c8120de0043a)
[Read-only file system]
[2015-11-29 04:15:24.537419] W [fuse-bridge.c:1777:fuse_rename_cbk]
0-glusterfs-fuse: 2919: /dummy_5 -> /dummy_bk => -1 (Read-only file system)
[2015-11-29 04:16:08.247116] I [MSGID: 109066] [dht-rename.c:1411:dht_rename]
2-worm-test-dht: renaming /dummy_61
(hash=worm-test-client-1/cache=worm-test-client-1) => /dummy_bk
(hash=worm-test-client-0/cache=<nul>)
The message "W [MSGID: 114031] [client-rpc-fops.c:2738:client3_3_rename_cbk]
2-worm-test-client-0: remote operation failed [Read-only file system]" repeated
2 times between [2015-11-29 04:15:08.835599] and [2015-11-29 04:16:08.248904]
[2015-11-29 04:16:08.248913] I [MSGID: 109030]
[dht-rename.c:729:dht_rename_cbk] 2-worm-test-dht: /dummy_61: Rename (linkto
file) on worm-test-client-0 failed, (gfid =
bed7d688-a8ef-4cf8-86a3-d9a133ecca15) [Read-only file system]
[2015-11-29 04:16:08.249222] W [MSGID: 114031]
[client-rpc-fops.c:664:client3_3_unlink_cbk] 2-worm-test-client-1: remote
operation failed [Read-only file system]
[2015-11-29 04:16:08.249252] W [MSGID: 109034]
[dht-rename.c:510:dht_rename_unlink_cbk] 2-worm-test-dht: /dummy_61: Rename:
unlink on worm-test-client-1 failed [Read-only file system]
--
You are receiving this mail because:
You are on the CC list for the bug.
Unsubscribe from this bug https://bugzilla.redhat.com/token.cgi?t=Y0rMcnfAKU&a=cc_unsubscribe
More information about the Bugs
mailing list