[Gluster-users] Failed volume

Thu May 15 09:28:13 UTC 2014

Hi,

Can anyone help.

I have at distibuted volume on 2 node and 4 bricks (two bricks on each node). I lost network connection to  one of the nodes and now I fail to write to volume

Is this by design when using distributed?

Here is some logging
[2014-05-15 09:13:10.684326] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-firmware-depot-client-2: changing port to 49164 (from 0)
[2014-05-15 09:13:10.684405] W [socket.c:514:__socket_rwv] 0-firmware-depot-client-2: readv failed (No data available)
[2014-05-15 09:13:10.690559] I [rpc-clnt.c:1676:rpc_clnt_reconfig] 0-firmware-depot-client-3: changing port to 49165 (from 0)
[2014-05-15 09:13:10.690647] W [socket.c:514:__socket_rwv] 0-firmware-depot-client-3: readv failed (No data available)
[2014-05-15 09:13:10.696681] I [client-handshake.c:1659:select_server_supported_programs] 0-firmware-depot-client-2: Using Program G              lusterFS 3.3, Num (1298437), Version (330)
[2014-05-15 09:13:10.696835] I [client-handshake.c:1659:select_server_supported_programs] 0-firmware-depot-client-3: Using Program G              lusterFS 3.3, Num (1298437), Version (330)
[2014-05-15 09:13:10.697113] I [client-handshake.c:1456:client_setvolume_cbk] 0-firmware-depot-client-2: Connected to 10.101.13.202:              49164, attached to remote volume '/bricks/brick1/firmware-depot'.
[2014-05-15 09:13:10.697176] I [client-handshake.c:1468:client_setvolume_cbk] 0-firmware-depot-client-2: Server and Client lk-versio              n numbers are not same, reopening the fds
[2014-05-15 09:13:10.697382] I [client-handshake.c:1456:client_setvolume_cbk] 0-firmware-depot-client-3: Connected to 10.101.13.202:              49165, attached to remote volume '/bricks/brick2/firmware-depot'.
[2014-05-15 09:13:10.711718] I [client-handshake.c:1468:client_setvolume_cbk] 0-firmware-depot-client-3: Server and Client lk-versio              n numbers are not same, reopening the fds
[2014-05-15 09:13:10.711961] I [client-handshake.c:450:client_set_lk_version_cbk] 0-firmware-depot-client-3: Server lk version = 1
[2014-05-15 09:13:10.712032] I [client-handshake.c:450:client_set_lk_version_cbk] 0-firmware-depot-client-2: Server lk version = 1
[2014-05-15 09:14:13.661184] E [socket.c:2157:socket_connect_finish] 0-firmware-depot-client-0: connection to 10.101.154.101:24007 failed (Connection timed out)
[2014-05-15 09:14:13.661287] W [socket.c:514:__socket_rwv] 0-firmware-depot-client-0: readv failed (No data available)
[2014-05-15 09:14:13.667178] E [socket.c:2157:socket_connect_finish] 0-firmware-depot-client-1: connection to 10.101.154.101:24007 failed (Connection timed out)
[2014-05-15 09:14:13.672873] I [fuse-bridge.c:4769:fuse_graph_setup] 0-fuse: switched to graph 0
[2014-05-15 09:14:13.675164] W [socket.c:514:__socket_rwv] 0-firmware-depot-client-1: readv failed (No data available)
[2014-05-15 09:14:13.675355] I [fuse-bridge.c:3724:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.13 kernel 7.13
[2014-05-15 09:14:13.676456] I [dht-layout.c:638:dht_layout_normalize] 0-firmware-depot-dht: found anomalies in /. holes=1 overlaps=0
[2014-05-15 09:14:13.676506] W [dht-selfheal.c:931:dht_selfheal_directory] 0-firmware-depot-dht: 2 subvolumes down -- not fixing
[2014-05-15 09:14:13.678907] I [dht-layout.c:726:dht_layout_dir_mismatch] 0-firmware-depot-dht: / - disk layout missing
[2014-05-15 09:14:13.678961] I [dht-common.c:623:dht_revalidate_cbk] 0-firmware-depot-dht: mismatching layouts for /
[2014-05-15 09:14:13.679010] I [dht-layout.c:726:dht_layout_dir_mismatch] 0-firmware-depot-dht: / - disk layout missing
[2014-05-15 09:14:13.679031] I [dht-common.c:623:dht_revalidate_cbk] 0-firmware-depot-dht: mismatching layouts for /
[2014-05-15 09:14:13.679449] I [dht-layout.c:638:dht_layout_normalize] 0-firmware-depot-dht: found anomalies in /. holes=1 overlaps=0
[2014-05-15 09:14:13.679491] W [dht-selfheal.c:931:dht_selfheal_directory] 0-firmware-depot-dht: 2 subvolumes down -- not fixing
[2014-05-15 09:14:17.995517] I [dht-layout.c:726:dht_layout_dir_mismatch] 0-firmware-depot-dht: / - disk layout missing
[2014-05-15 09:14:17.995583] I [dht-common.c:623:dht_revalidate_cbk] 0-firmware-depot-dht: mismatching layouts for /
[2014-05-15 09:14:17.995632] I [dht-layout.c:726:dht_layout_dir_mismatch] 0-firmware-depot-dht: / - disk layout missing
[2014-05-15 09:14:17.995654] I [dht-common.c:623:dht_revalidate_cbk] 0-firmware-depot-dht: mismatching layouts for /
[2014-05-15 09:14:17.996097] I [dht-layout.c:638:dht_layout_normalize] 0-firmware-depot-dht: found anomalies in /. holes=1 overlaps=0
[2014-05-15 09:14:17.996187] W [dht-selfheal.c:931:dht_selfheal_directory] 0-firmware-depot-dht: 2 subvolumes down -- not fixing

Regards
Jesper

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20140515/afaf74bf/attachment.html>