[Gluster-users] Fedora 11 - 2.6.31 Kernel - Fuse 2.8.0 - Infiniband

[Anand Avati]

> > >  [root at xen1 ~]# ibv_srq_pingpong 10.13.0.220
> > >  local address:  LID 0x000b, QPN 0x300406, PSN 0x1ace41
> > >  local address:  LID 0x000b, QPN 0x300407, PSN 0x6ba197
> > >  local address:  LID 0x000b, QPN 0x300408, PSN 0xa6f895
> > >  local address:  LID 0x000b, QPN 0x300409, PSN 0xf054c0
> > >  local address:  LID 0x000b, QPN 0x30040a, PSN 0xea4bd3
> > >  local address:  LID 0x000b, QPN 0x30040b, PSN 0xfe3039
> > >  local address:  LID 0x000b, QPN 0x30040c, PSN 0x037fa4
> > >  local address:  LID 0x000b, QPN 0x30040d, PSN 0x1feccd
> > >  local address:  LID 0x000b, QPN 0x30040e, PSN 0x22daed
> > >  local address:  LID 0x000b, QPN 0x30040f, PSN 0xcaa26b
> > >  local address:  LID 0x000b, QPN 0x300410, PSN 0xe87f33
> > >  local address:  LID 0x000b, QPN 0x300411, PSN 0x84bb4a
> > >  local address:  LID 0x000b, QPN 0x300412, PSN 0x09286e
> > >  local address:  LID 0x000b, QPN 0x300413, PSN 0xecf483
> > >  local address:  LID 0x000b, QPN 0x300414, PSN 0xd55285
> > >  local address:  LID 0x000b, QPN 0x300415, PSN 0xdd7065
> > >  remote address: LID 0x0004, QPN 0x460406, PSN 0x198bcb
> > >  remote address: LID 0x0004, QPN 0x460407, PSN 0x645159
> > >  remote address: LID 0x0004, QPN 0x460408, PSN 0x4a1a2f
> > >  remote address: LID 0x0004, QPN 0x460409, PSN 0x8dff52
> > >  remote address: LID 0x0004, QPN 0x46040a, PSN 0xe317fd
> > >  remote address: LID 0x0004, QPN 0x46040b, PSN 0x12da1b
> > >  remote address: LID 0x0004, QPN 0x460418, PSN 0xc8e0de
> > >  remote address: LID 0x0004, QPN 0x460419, PSN 0xfc6e7f
> > >  remote address: LID 0x0004, QPN 0x46041a, PSN 0xa3ffb7
> > >  remote address: LID 0x0004, QPN 0x46041b, PSN 0x0cc86d
> > >  remote address: LID 0x0004, QPN 0x46041c, PSN 0x107a0d
> > >  remote address: LID 0x0004, QPN 0x46041d, PSN 0xe2661c
> > >  remote address: LID 0x0004, QPN 0x46041e, PSN 0xfb8fd8
> > >  remote address: LID 0x0004, QPN 0x46041f, PSN 0xc438a5
> > >  remote address: LID 0x0004, QPN 0x460420, PSN 0x0be0ff
> > >  remote address: LID 0x0004, QPN 0x460421, PSN 0x91b657
> > >
> > >  This one ends odd, I think it should tell me more info, but it just
> sits
> > > there.
> > >
> >
> > Just starting ibv_srq_pingpong makes it the "server". You should run
> > "ibv_srq_pingpong <HOST>" from a second server and then the two will
> > ping-pong each other. Can you please post that output as well?
> >
>
>  The above was from the client using the IP address of the server. The
> server showed:

Then I guess even IPoIB is not working for you? I'm not sure if you
might have to upgrade to a new OFED for either libibverbs or the mthca
uverbs driver may not be compatible with the latest kernel IB drivers.
Any hints from the OFED mailing list?

Avati