[Gluster-users] Problems with Gluster

[McKenzie, Stan]

I also wanted to note that until now I hadn't checked to see if ..../bash was on the nodes in question and in fact it is not.  Everything in /act/ on down is missing.  Is there a convenient way I can copy from the master node to those missing the files?  Also, what would cause the loss of the dirs/files?  Thanks.

-----Original Message-----
From: gluster-users-bounces at gluster.org [mailto:gluster-users-bounces at gluster.org] On Behalf Of McKenzie, Stan
Sent: Sunday, August 03, 2014 9:56 AM
To: bhubbard at redhat.com; gluster-users at gluster.org
Subject: Re: [Gluster-users] Problems with Gluster

Hi Brad -- 

Thanks for the response.  I've tried what you recommended on node40 and here is the output:


==> /var/log/glusterfs/etc-glusterfs-glusterd.vol.log <==
[2014-08-03 09:25:01.405662] I [glusterfsd.c:1493:main] 0-/opt/glusterfs/3.2.5/sbin/glusterd: Started running /opt/glusterfs/3.2.5/sbin/glusterd version 3.2.5
[2014-08-03 09:25:01.408622] I [glusterd.c:550:init] 0-management: Using /etc/glusterd as working directory
[2014-08-03 09:25:01.410117] E [rpc-transport.c:677:rpc_transport_load] 0-rpc-transport: /opt/glusterfs/3.2.5/lib64/glusterfs/3.2.5/rpc-transport/rdma.so: cannot open shared object file: No such file or directory
[2014-08-03 09:25:01.410141] E [rpc-transport.c:681:rpc_transport_load] 0-rpc-transport: volume 'rdma.management': transport-type 'rdma' is not valid or not found on this machine
[2014-08-03 09:25:01.410156] W [rpcsvc.c:1288:rpcsvc_transport_create] 0-rpc-service: cannot create listener, initing the transport failed
[2014-08-03 09:25:01.410272] I [glusterd.c:88:glusterd_uuid_init] 0-glusterd: retrieved UUID: 7690fd99-5ed4-4a45-bb3d-7ab54831b543
[2014-08-03 09:25:57.414360] E [common-utils.c:125:gf_resolve_ip6] 0-resolver: getaddrinfo failed (Name or service not known)
[2014-08-03 09:25:57.414408] E [name.c:253:af_inet_client_get_remote_sockaddr] 0-management: DNS resolution failed on host nodei.localdomain pending frames:

patchset: git://git.gluster.com/glusterfs.git
signal received: 11
time of crash: 2014-08-03 09:25:57
configuration details:
argp 1
backtrace 1
dlfcn 1
fdatasync 1
libpthread 1
llistxattr 1
setfsid 1
spinlock 1
epoll.h 1
xattr.h 1
st_atim.tv_nsec 1
package-string: glusterfs 3.2.5
/lib64/libc.so.6[0x30844302d0]
/opt/glusterfs/3.2.5/lib64/glusterfs/3.2.5/xlator/mgmt/glusterd.so(glusterd_friend_sm+0x27)[0x2b131fbcd877]
/opt/glusterfs/3.2.5/lib64/glusterfs/3.2.5/xlator/mgmt/glusterd.so(glusterd_peer_rpc_notify+0x1b4)[0x2b131fbb9a04]
/opt/glusterfs/3.2.5/lib64/libgfrpc.so.0(rpc_clnt_start+0x17)[0x2b131df7e8a7]
/opt/glusterfs/3.2.5/lib64/glusterfs/3.2.5/xlator/mgmt/glusterd.so(glusterd_rpc_create+0xff)[0x2b131fbba74f]
/opt/glusterfs/3.2.5/lib64/glusterfs/3.2.5/xlator/mgmt/glusterd.so(glusterd_friend_add+0x2d7)[0x2b131fbbaad7]
/opt/glusterfs/3.2.5/lib64/glusterfs/3.2.5/xlator/mgmt/glusterd.so(glusterd_store_retrieve_peers+0x3d2)[0x2b131fbff4c2]
/opt/glusterfs/3.2.5/lib64/glusterfs/3.2.5/xlator/mgmt/glusterd.so(glusterd_restore+0x78)[0x2b131fc00dd8]
/opt/glusterfs/3.2.5/lib64/glusterfs/3.2.5/xlator/mgmt/glusterd.so(init+0xd12)[0x2b131fbb6312]
/opt/glusterfs/3.2.5/lib64/libglusterfs.so.0(xlator_init+0x58)[0x2b131dd19488]
/opt/glusterfs/3.2.5/lib64/libglusterfs.so.0(glusterfs_graph_init+0x31)[0x2b131dd48501]
/opt/glusterfs/3.2.5/lib64/libglusterfs.so.0(glusterfs_graph_activate+0x88)[0x2b131dd48688]
/opt/glusterfs/3.2.5/sbin/glusterd(glusterfs_process_volfp+0x103)[0x404033]
/opt/glusterfs/3.2.5/sbin/glusterd(glusterfs_volumes_init+0x18b)[0x40424b]
/opt/glusterfs/3.2.5/sbin/glusterd(main+0x419)[0x405299]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x308441d9c4]
/opt/glusterfs/3.2.5/sbin/glusterd[0x403649]
---------

-----Original Message-----
From: Brad Hubbard [mailto:bhubbard at redhat.com]
Sent: Saturday, August 02, 2014 4:37 PM
To: McKenzie, Stan; gluster-users at gluster.org
Subject: Re: [Gluster-users] Problems with Gluster

On 08/02/2014 01:33 AM, McKenzie, Stan wrote:

>
> *When I ssh to some nodes I get an error "-bash:
> /act/Modules/3.2.6/init/bash:  No such file or directory
>
> -bash: module:  command not found".   On other nodes when I ssh I get
> normal login.

Have you verified the file "/act/Modules/3.2.6/init/bash" exists on each peer and is not corrupted/truncated?

You could also try something like this on node40.

# tail -f /var/log/glusterfs/*.log &

Ignore anything output until after you run the following.

# service glusterd start

Paste the output somewhere we can view it if it's too large to post in an email.

Cheers,
Brad


_______________________________________________
Gluster-users mailing list
Gluster-users at gluster.org
http://supercolony.gluster.org/mailman/listinfo/gluster-users