[Gluster-devel] add-brick

[Anand Avati]

On Sun, Aug 19, 2012 at 5:43 AM, Emmanuel Dreyfus <manu at netbsd.org> wrote:

> On Sun, Aug 19, 2012 at 12:13:08AM -0700, Anand Avati wrote:
> > Do you see all the protocol/client's connection succeeding on graph 1
> > before 'switched to graph 1' log? In the above excerpt you have shown
> > "client-1" succeeding log. What about other protocol clients?
>
> It succeeds as well: below is the log output without the added sleep(2).
>
> I understand the client is signaled to reload the volume before the
> truster.gluster.dht attributes are set.


The trusted.gluster.dht attribute will not be set for the newly added brick
by default, and that should not be an error condition. The funny part is
that in the new graph it is finding a "hole". Adding a new brick (even
though the new brick does not contribute towards filling the layout) should
not cause a hole as the old bricks are already covering the full hash range.

Oh BTW, did you add-brick from 1 brick to 2 bricks? If so it might be
understandable as with 1 brick DHT is not loaded and there will be no hash
ranges pre-assigned. If so can you try by starting with (volume create)
with 2 bricks and then add-brick a 3rd one?

Avati


> Is it possible there is
> a barrier missing somewhere server side? Where is that supposed to
> happen?
>
>
> [2012-08-19 14:32:09.664064] I [rpc-clnt.c:1660:rpc_clnt_reconfig]
>   1-vndfs-client-0: changing port to 24058 (from 0)
> [2012-08-19 14:32:09.666053] I [rpc-clnt.c:1660:rpc_clnt_reconfig]
>   1-vndfs-client-1: changing port to 24059 (from 0)
> [2012-08-19 14:32:12.807520] I [client-handshake.c:1636:
>   select_server_supported_programs] 1-vndfs-client-0: Using Program
>   GlusterFS 3.3git, Num (1298437), Version (330)
> [2012-08-19 14:32:12.808697] I
> [client-handshake.c:1433:client_setvolume_cbk]
>   1-vndfs-client-0: Connected to 192.0.2.103:24058, attached to remote
>   volume '/export/vnd0a'.
> [2012-08-19 14:32:12.808792] I
> [client-handshake.c:1445:client_setvolume_cbk]
>   1-vndfs-client-0: Server and Client lk-version numbers are not same,
>   reopening the fds
> [2012-08-19 14:32:12.809469] I [client-handshake.c:1636:
>   select_server_supported_programs] 1-vndfs-client-1: Using Program
>   GlusterFS 3.3git, Num (1298437), Version (330)
> [2012-08-19 14:32:12.809827] I [client-handshake.c:453:
>   client_set_lk_version_cbk] 1-vndfs-client-0: Server lk version = 1
> [2012-08-19 14:32:12.819362] I
> [client-handshake.c:1433:client_setvolume_cbk]
>    1-vndfs-client-1: Connected to 192.0.2.103:24059, attached to remote
>   volume '/export/vnd1a'.
> [2012-08-19 14:32:12.819475] I [client-handshake.c:1445:
>   client_setvolume_cbk] 1-vndfs-client-1: Server and Client lk-version
>   numbers are not same, reopening the fds
> [2012-08-19 14:32:12.855737] I [fuse-bridge.c:4195:fuse_graph_setup]
> 0-fuse:
>   switched to graph 1
> [2012-08-19 14:32:12.858810] I [client-handshake.c:453:
>   client_set_lk_version_cbk] 1-vndfs-client-1: Server lk version = 1
> [2012-08-19 14:32:12.899641] I [client.c:2151:notify] 0-vndfs-client-0:
>   current graph is no longer active, destroying rpc_client
> [2012-08-19 14:32:12.902488] I [client.c:2090:client_rpc_notify]
>   0-vndfs-client-0: disconnected
> [2012-08-19 14:32:12.909907] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]
>   0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve
>  (Invalid argument)
> [2012-08-19 14:32:12.910014] E [fuse-bridge.c:353:fuse_lookup_resume]
>   0-fuse: failed to resolve path (null)
> [2012-08-19 14:32:12.912901] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]
>   0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve
>   (Invalid argument)
> [2012-08-19 14:32:12.913002] E [fuse-bridge.c:353:fuse_lookup_resume]
>   0-fuse: failed to resolve path (null)
> [2012-08-19 14:32:12.915572] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]
>   0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve
>   (Invalid argument)
> [2012-08-19 14:32:12.915673] W [fuse-bridge.c:1749:fuse_create_resume]
>   0-glusterfs-fuse: 2063 CREATE
>
> 00000000-0000-0000-0000-000000000000/bb9e267890c23aaa1ada196f222f166d5846f6
>   resolution failed
> [2012-08-19 14:32:12.920535] W [fuse-resolve.c:151:fuse_resolve_gfid_cbk]
>   0-fuse: a10abc68-284d-4768-a65b-be200d965aa5: failed to resolve
>   (Invalid argument)
> [2012-08-19 14:32:12.920645] E [fuse-bridge.c:844:fuse_setattr_resume]
>   0-glusterfs-fuse: 2064: SETATTR 3107999480
>   (a10abc68-284d-4768-a65b-be200d965aa5) resolution failed
>
> --
> Emmanuel Dreyfus
> manu at netbsd.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-devel/attachments/20120819/e0c1a927/attachment-0003.html>