[Bugs] [Bug 1411281] Ganesha with Gluster transport RDMA does not work

[bugzilla at redhat.com]

https://bugzilla.redhat.com/show_bug.cgi?id=1411281



--- Comment #6 from Andreas Kurzac <a.kurzac at kinetik.de> ---
I tested the fix and it works if the client is not at the same time a server.
When i mount a volume on the server, it freezes, here the details:

Separate client mounts via TCP/Ethernet: OK
Separate client mounts via TCP(IPoIB)/Infiniband:    OK
Local mount (client/server is part of cluster) via TCP/Ethernet: FAILS
ganesha-gfapi.log:
[2017-01-24 13:11:30.183538] W [MSGID: 103004]
[rdma.c:452:gf_rdma_register_arena] 0-rdma: allocation of mr failed
[2017-01-24 13:11:30.184588] W [MSGID: 103004]
[rdma.c:1463:__gf_rdma_create_read_chunks_from_vector] 0-rpc-transport/rdma:
memory registration failed (peer:10.40.1.1:49152) [Keine Berechtigung]
[2017-01-24 13:11:30.184656] W [MSGID: 103029]
[rdma.c:1558:__gf_rdma_create_read_chunks] 0-rpc-transport/rdma: cannot create
read chunks from vector entry->prog_payload
[2017-01-24 13:11:30.184673] W [MSGID: 103033]
[rdma.c:2063:__gf_rdma_ioq_churn_request] 0-rpc-transport/rdma: creation of
read chunks failed
[2017-01-24 13:11:30.184689] W [MSGID: 103040]
[rdma.c:2775:__gf_rdma_ioq_churn_entry] 0-rpc-transport/rdma: failed to process
request ioq entry to peer(10.40.1.1:49152)
[2017-01-24 13:11:30.184710] W [MSGID: 103040] [rdma.c:2859:gf_rdma_writev]
0-vmstor1-client-0: processing ioq entry destined to (10.40.1.1:49152) failed
[2017-01-24 13:11:30.184723] W [MSGID: 103037]
[rdma.c:3016:gf_rdma_submit_request] 0-rpc-transport/rdma: sending request to
peer (10.40.1.1:49152) failed
[2017-01-24 13:11:30.184739] W [rpc-clnt.c:1640:rpc_clnt_submit]
0-vmstor1-client-0: failed to submit rpc-request (XID: 0x2c Program: GlusterFS
3.3, ProgVers: 330, Proc: 13) to rpc-transport (vmstor1-client-0)

Local mount (client/server is part of cluster) via TCP(IPoIB)/Infiniband:   
FAILS
ganesha-gfapi.log:
[2017-01-24 13:59:37.990454] W [MSGID: 103004]
[rdma.c:452:gf_rdma_register_arena] 0-rdma: allocation of mr failed
[2017-01-24 13:59:37.991559] W [MSGID: 103004]
[rdma.c:1463:__gf_rdma_create_read_chunks_from_vector] 0-rpc-transport/rdma:
memory registration failed (peer:10.40.1.1:49152) [Keine Berechtigung]
[2017-01-24 13:59:37.991586] W [MSGID: 103029]
[rdma.c:1558:__gf_rdma_create_read_chunks] 0-rpc-transport/rdma: cannot create
read chunks from vector entry->prog_payload
[2017-01-24 13:59:37.991591] W [MSGID: 103033]
[rdma.c:2063:__gf_rdma_ioq_churn_request] 0-rpc-transport/rdma: creation of
read chunks failed
[2017-01-24 13:59:37.991606] W [MSGID: 103040]
[rdma.c:2775:__gf_rdma_ioq_churn_entry] 0-rpc-transport/rdma: failed to process
request ioq entry to peer(10.40.1.1:49152)
[2017-01-24 13:59:37.991611] W [MSGID: 103040] [rdma.c:2859:gf_rdma_writev]
0-vmstor1-client-0: processing ioq entry destined to (10.40.1.1:49152) failed
[2017-01-24 13:59:37.991615] W [MSGID: 103037]
[rdma.c:3016:gf_rdma_submit_request] 0-rpc-transport/rdma: sending request to
peer (10.40.1.1:49152) failed
[2017-01-24 13:59:37.991622] W [rpc-clnt.c:1640:rpc_clnt_submit]
0-vmstor1-client-0: failed to submit rpc-request (XID: 0x2d Program: GlusterFS
3.3, ProgVers: 330, Proc: 13) to rpc-transport (vmstor1-client-0)
[2017-01-24 13:59:37.991628] W [MSGID: 114031]
[client-rpc-fops.c:854:client3_3_writev_cbk] 0-vmstor1-client-0: remote
operation failed [Der Socket ist nicht verbunden]

-- 
You are receiving this mail because:
You are on the CC list for the bug.
Unsubscribe from this bug https://bugzilla.redhat.com/token.cgi?t=WT9DuEqh69&a=cc_unsubscribe