[Gluster-users] glusterd SIGSEGV crash when create volume with transport=rdma

[Mike Lykov]

07.11.2018 15:01, Mike Lykov пишет:

> RDMA on its own seems working:
> [root at ovirtnode5 log]# ib_write_bw -D 30 --cpu_util ovirtstor1
> ---------------------------------------------------------------------------------------
>                      RDMA_Write BW Test
>   Dual-port       : OFF		Device         : hfi1_0
>   Number of qps   : 1		Transport type : IB
>   Connection type : RC		Using SRQ      : OFF
>   TX depth        : 128
>   CQ Moderation   : 100
>   Mtu             : 4096[B]
>   Link type       : IB
>   Max inline data : 0[B]
>   rdma_cm QPs	 : OFF
>   Data ex. method : Ethernet
> ---------------------------------------------------------------------------------------
>   local address: LID 0x04 QPN 0x00ae PSN 0x15933a RKey 0x60181900 VAddr 0x007fde76ee6000
>   remote address: LID 0x03 QPN 0x0056 PSN 0x7758e RKey 0x40101100 VAddr 0x007fde37488000
> ---------------------------------------------------------------------------------------
>   #bytes     #iterations    BW peak[MB/sec]    BW average[MB/sec]   MsgRate[Mpps]    CPU_Util[%]
> Conflicting CPU frequency values detected: 3692.431000 != 3109.112000. CPU Frequency is not max.
>   65536      1646300          0.00               6430.36		   0.102886	    1.40
> ---------------------------------------------------------------------------------------

This is right test using "RDMA_cm QPs" (server-side output)

[root at ovirtnode1 glusterfs]# ib_write_bw -R -D 30 --cpu_util

************************************
* Waiting for client to connect... *
************************************
---------------------------------------------------------------------------------------
                     RDMA_Write BW Test
  Dual-port       : OFF		Device         : hfi1_0
  Number of qps   : 1		Transport type : IB
  Connection type : RC		Using SRQ      : OFF
  CQ Moderation   : 100
  Mtu             : 4096[B]
  Link type       : IB
  Max inline data : 0[B]
  rdma_cm QPs	 : ON
  Data ex. method : rdma_cm
---------------------------------------------------------------------------------------
  Waiting for client rdma_cm QP to connect
  Please run the same command with the IB/RoCE interface IP
---------------------------------------------------------------------------------------
  local address: LID 0x03 QPN 0x005a PSN 0x69e89
  remote address: LID 0x04 QPN 0x00b2 PSN 0xe70887
---------------------------------------------------------------------------------------
  #bytes     #iterations    BW peak[MB/sec]    BW average[MB/sec] 
MsgRate[Mpps]    CPU_Util[%]
  65536      2982900          0.00               11651.03		   0.186417	 
   0.00
---------------------------------------------------------------------------------------