[Gluster-users] glusterfs 3.2 gluster peer probe 192.168.150.30 RPC program not available

[Zhenhua Du]

Hi All,

 

I upgraded glusterfs 2.0.8 to glusterfs 3.2 on CentOS
5.6(2.6.18-238.12.1.el5xen x86_64 GNU/Linux ). We have three glusterfs
servers, using replication volumes.

We use the version 2.0.8's configure files, and it works for us. But there
is a problem, clients can't read some directories. 

 

Client side 

 

# ls

ls: reading directory .: File descriptor in bad state

total 0

 

server side log

[2011-06-10 15:46:20.531495] W [inode.c:647:inode_grep]
(-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(ser
ver_resolve+0x98) [0x2aaaab0f5b18]
(-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(ser
ver_resolve_entry+0x24) [0x2aaaab0f5a24]
(-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(res
olve_entry_simple+0x172) [0x2aaaab0f5452]))) 0-: table || parent || name not
found

[2011-06-10 15:46:20.531716] W [inode.c:647:inode_grep]
(-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(res
olve_deep_cbk+0x27f) [0x2aaaab0f615f]
(-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(res
olve_deep_continue+0x4b) [0x2aaaab0f5e2b]
(-->/opt/glusterfs/3.2.0/lib64/glusterfs/3.2.0/xlator/protocol/server.so(res
olve_entry_simple+0x172) [0x2aaaab0f5452]))) 0-: table || parent || name not
found

[2011-06-10 15:46:20.533320] I [server3_1-fops.c:647:server_opendir_cbk]
0-server: 190468: OPENDIR /client (0) ==> -1 (No such file or directory)

 

 

Server side:

/etc/glusterfs/glusterd.vol

 

volume posix

  type storage/posix

  option directory /d/xvdb/export

end-volume

 

volume locks

  type features/locks

  subvolumes posix

end-volume

 

volume brick

  type performance/io-threads

  option thread-count 8

  subvolumes locks

end-volume

 

volume server

  type protocol/server

  option transport-type tcp

  option auth.addr.brick.allow 192.168.150.*

  subvolumes brick

end-volume

 

 

 

client side: 

/etc/glusterfs/glusterfs.vol

 

volume remote1

  type protocol/client

  option transport-type tcp

  option remote-host 192.168.150.8

  option remote-subvolume brick

end-volume

 

volume remote2

  type protocol/client

  option transport-type tcp

  option remote-host 192.168.150.25

  option remote-subvolume brick

end-volume

 

volume remote3

  type protocol/client

  option transport-type tcp

  option remote-host 192.168.150.30

  option remote-subvolume brick

end-volume

 

volume replicate

  type cluster/replicate

  subvolumes remote1 remote2 remote3

end-volume

 

volume writebehind

  type performance/write-behind

  option window-size 1MB

  subvolumes replicate

end-volume

 

volume cache

  type performance/io-cache

  option cache-size 512MB

  subvolumes writebehind

end-volume

 

 

 

I doubt it is the configure file's problem. So I want to reset glusterfs
with command. But when I using "gluster peer probe  192.168.150.30" to
create storage pool. It failed. 

 

Server side log:

[2011-06-10 15:58:56.801961] W [rpcsvc.c:148:rpcsvc_program_actor]
0-rpc-service: RPC program not available (req 1238463 1)

[2011-06-10 15:58:56.802062] W [rpcsvc.c:1066:rpcsvc_error_reply]
(-->/opt/glusterfs/3.2.0/lib64/libgfrpc.so.0(rpc_transport_notify+0x27)
[0x2b63626fc2e7]
(-->/opt/glusterfs/3.2.0/lib64/libgfrpc.so.0(rpcsvc_notify+0x16c)
[0x2b63626fb3bc]
(-->/opt/glusterfs/3.2.0/lib64/libgfrpc.so.0(rpcsvc_handle_rpc_call+0x140)
[0x2b63626fb060]))) 0-: sending a RPC error reply

[2011-06-10 15:58:56.803906] W [socket.c:1494:__socket_proto_state_machine]
0-tcp.server: reading from socket failed. Error (Transport endpoint is not
connected), peer (127.0.0.1:1023)

[2011-06-10 15:58:56.803996] I [server.c:438:server_rpc_notify] 0-server:
disconnected connection from 127.0.0.1:1023

 

 

I am not sure how to fix it. Anyone can help me?

 

Thanks,

Zhenhua Du

2011/6/10

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://supercolony.gluster.org/pipermail/gluster-users/attachments/20110610/a7da4976/attachment.html>