<div id="yiv1107693715"><div>You didn't specify correctly the IP in the SANS but I'm not sure if that's the root cause.<div><br clear="none"></div><div>In the SANs section Specify all hosts + their IPs: IP.1=1.2.3.4</div><div>IP.2=2.3.4.5</div><div>DNS.1=c01.gluster</div><div>DNS.2=c02.gluster</div><div><br clear="none"></div><div><br clear="none"> What is the output from the client:</div><div><pre>openssl s_client -showcerts -connect c02.gluster:24007​</pre></div><div><br clear="none"></div><div>There is a very good article on the topic:</div><div>https://www.redhat.com/en/blog/hardening-gluster-installations-tls<br clear="none"></div><div><br clear="none"></div><div>Can you check it for a missed step ?</div><div>Can you share the volume settings ?</div><div><br></div><div>Best Regards,</div><div>Strahil Nikolov</div><div id="yiv1107693715yqt58309" class="yiv1107693715yqt8637018275"><div><br clear="none"> <blockquote style="margin:0 0 20px 0;"> <div style="font-family:Roboto, sans-serif;color:#6D00F6;"> <div>On Sun, Jan 28, 2024 at 11:38, Stefan Kania</div><div><stefan@kania-online.de> wrote:</div> </div> <div style="padding:10px 0 0 20px;margin:10px 0 0 0;border-left:1px solid #6D00F6;"> Hi Strahil,<br clear="none"><br clear="none">ok, that's what I did now to create the certificate:<br clear="none">---------------------<br clear="none">openssl req -x509 -sha256 -key glusterfs.key  -out "glusterfs.pem" -days <br clear="none">365 -subj "/C=de/ST=SH/L=St. <br clear="none">Michel/O=stka/OU=gluster-nodes/CN=c01.gluster" -addext "subjectAltName = <br clear="none">DNS:192.168.56.41"<br clear="none">--------------------<br clear="none">still the same. The communication between the gluster-nodes is working <br clear="none">with TLS, but the client can't mount the volume anymore. I now try to <br clear="none">mount the volume with  log-level=trace<br clear="none"><br clear="none">mount -t glusterfs -o log-level=trace  c02.gluster:/gv1 /mnt<br clear="none"><br clear="none"><br clear="none">and got the following:<br clear="none">---------------<br clear="none">[2024-01-28 09:22:38.348905 +0000] I [MSGID: 100030] <br clear="none">[glusterfsd.c:2767:main] 0-/usr/sbin/glusterfs: Started running version <br clear="none">[{arg=/usr/sbin/glusterfs}, {version=10.5}, <br clear="none">{cmdlinestr=/usr/sbin/glusterfs --log-level=TRACE --process-name fuse <br clear="none">--volfile-server=c02.gluster --volfile-id=/gv1 /mnt}]<br clear="none">[2024-01-28 09:22:38.349095 +0000] T [MSGID: 0] <br clear="none">[xlator.c:388:xlator_dynload] 0-xlator: attempt to load file <br clear="none">/usr/lib/x86_64-linux-gnu/glusterfs/10.5/xlator/mount/fuse.so<br clear="none">[2024-01-28 09:22:38.349650 +0000] T [MSGID: 0] <br clear="none">[xlator.c:301:xlator_dynload_apis] 0-xlator: fuse: method missing <br clear="none">(reconfigure)<br clear="none">[2024-01-28 09:22:38.349728 +0000] T [MSGID: 0] <br clear="none">[xlator.c:319:xlator_dynload_apis] 0-xlator: fuse: method missing <br clear="none">(dump_metrics)<br clear="none">[2024-01-28 09:22:38.349854 +0000] T [MSGID: 0] <br clear="none">[xlator.c:325:xlator_dynload_apis] 0-xlator: fuse: method missing <br clear="none">(pass_through_fops), falling back to default<br clear="none">[2024-01-28 09:22:38.349979 +0000] D [MSGID: 0] <br clear="none">[glusterfsd.c:421:set_fuse_mount_options] 0-glusterfsd: fopen-keep-cache <br clear="none">mode 2<br clear="none">[2024-01-28 09:22:38.350111 +0000] D [MSGID: 0] <br clear="none">[glusterfsd.c:465:set_fuse_mount_options] 0-glusterfsd: fuse direct io <br clear="none">type 2<br clear="none">[2024-01-28 09:22:38.350222 +0000] D [MSGID: 0] <br clear="none">[glusterfsd.c:478:set_fuse_mount_options] 0-glusterfsd: fuse <br clear="none">no-root-squash mode 0<br clear="none">[2024-01-28 09:22:38.350347 +0000] D [MSGID: 0] <br clear="none">[glusterfsd.c:519:set_fuse_mount_options] 0-glusterfsd: <br clear="none">kernel-writeback-cache mode 2<br clear="none">[2024-01-28 09:22:38.350458 +0000] D [MSGID: 0] <br clear="none">[glusterfsd.c:537:set_fuse_mount_options] 0-glusterfsd: <br clear="none">fuse-flush-handle-interrupt mode 2<br clear="none">[2024-01-28 09:22:38.350674 +0000] T [MSGID: 0] <br clear="none">[options.c:1239:xlator_option_init_double] 0-fuse: option <br clear="none">attribute-timeout using default value 1.0<br clear="none">[2024-01-28 09:22:38.350792 +0000] T [MSGID: 0] <br clear="none">[options.c:513:xlator_option_validate_double] 0-fuse: no range check <br clear="none">required for 'option attribute-timeout 1.0'<br clear="none">[2024-01-28 09:22:38.350925 +0000] T [MSGID: 0] <br clear="none">[options.c:1230:xlator_option_init_uint32] 0-fuse: option <br clear="none">reader-thread-count using default value 1<br clear="none">[2024-01-28 09:22:38.351133 +0000] D [dict.c:2503:dict_get_str] <br clear="none">(-->/usr/lib/x86_64-linux-gnu/glusterfs/10.5/xlator/mount/fuse.so(+0x1ee10) <br clear="none">[0x7ff51324ce10] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(xlator_option_init_bool+0x60) <br clear="none">[0x7ff513e88bf0] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(dict_get_str+0xdf) <br clear="none">[0x7ff513e358df] ) 0-dict: key auto-invalidation, string type asked, has <br clear="none">unsigned integer type [Das Argument ist ungültig]<br clear="none">[2024-01-28 09:22:38.351262 +0000] D [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option <br clear="none">auto-invalidation using set value 0<br clear="none">[2024-01-28 09:22:38.351514 +0000] T [MSGID: 0] <br clear="none">[options.c:1239:xlator_option_init_double] 0-fuse: option entry-timeout <br clear="none">using default value 1.0<br clear="none">[2024-01-28 09:22:38.351661 +0000] T [MSGID: 0] <br clear="none">[options.c:513:xlator_option_validate_double] 0-fuse: no range check <br clear="none">required for 'option entry-timeout 1.0'<br clear="none">[2024-01-28 09:22:38.351894 +0000] D [dict.c:2503:dict_get_str] <br clear="none">(-->/usr/lib/x86_64-linux-gnu/glusterfs/10.5/xlator/mount/fuse.so(+0x1ee6e) <br clear="none">[0x7ff51324ce6e] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(xlator_option_init_double+0x60) <br clear="none">[0x7ff513e89080] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(dict_get_str+0xdf) <br clear="none">[0x7ff513e358df] ) 0-dict: key negative-timeout, string type asked, has <br clear="none">float type [Das Argument ist ungültig]<br clear="none">[2024-01-28 09:22:38.351970 +0000] D [MSGID: 0] <br clear="none">[options.c:1239:xlator_option_init_double] 0-fuse: option <br clear="none">negative-timeout using set value 0.000000<br clear="none">[2024-01-28 09:22:38.352092 +0000] T [MSGID: 0] <br clear="none">[options.c:513:xlator_option_validate_double] 0-fuse: no range check <br clear="none">required for 'option negative-timeout 0.000000'<br clear="none">[2024-01-28 09:22:38.352283 +0000] T [MSGID: 0] <br clear="none">[options.c:1231:xlator_option_init_int32] 0-fuse: option client-pid not set<br clear="none">[2024-01-28 09:22:38.352402 +0000] T [MSGID: 0] <br clear="none">[options.c:1230:xlator_option_init_uint32] 0-fuse: option uid-map-root <br clear="none">not set<br clear="none">[2024-01-28 09:22:38.352527 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option <br clear="none">strict-volfile-check using default value false<br clear="none">[2024-01-28 09:22:38.352649 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option acl using <br clear="none">default value false<br clear="none">[2024-01-28 09:22:38.352826 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option selinux using <br clear="none">default value false<br clear="none">[2024-01-28 09:22:38.352947 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option capability using <br clear="none">default value false<br clear="none">[2024-01-28 09:22:38.353065 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option read-only not set<br clear="none">[2024-01-28 09:22:38.353169 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option enable-ino32 <br clear="none">using default value false<br clear="none">[2024-01-28 09:22:38.353311 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option use-readdirp <br clear="none">using default value yes<br clear="none">[2024-01-28 09:22:38.353518 +0000] D [dict.c:2503:dict_get_str] <br clear="none">(-->/lib/x86_64-linux-gnu/libglusterfs.so.0(xlator_init+0xc5) <br clear="none">[0x7ff513e38c45] <br clear="none">-->/usr/lib/x86_64-linux-gnu/glusterfs/10.5/xlator/mount/fuse.so(+0x1f0fd) <br clear="none">[0x7ff51324d0fd] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(dict_get_str+0xdf) <br clear="none">[0x7ff513e358df] ) 0-dict: key sync-to-mount, string type asked, has <br clear="none">pointer type [Das Argument ist ungültig]<br clear="none">[2024-01-28 09:22:38.353644 +0000] T [MSGID: 0] <br clear="none">[options.c:1240:xlator_option_init_time] 0-fuse: option gid-timeout <br clear="none">using default value 300<br clear="none">[2024-01-28 09:22:38.353766 +0000] T [MSGID: 0] <br clear="none">[options.c:80:xlator_option_validate_int] 0-fuse: no range check <br clear="none">required for 'option gid-timeout 300'<br clear="none">[2024-01-28 09:22:38.353887 +0000] T [MSGID: 0] <br clear="none">[options.c:1227:xlator_option_init_str] 0-fuse: option fuse-mountopts <br clear="none">not set<br clear="none">[2024-01-28 09:22:38.354028 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option resolve-gids <br clear="none">using default value false<br clear="none">[2024-01-28 09:22:38.354140 +0000] T [MSGID: 0] <br clear="none">[options.c:1231:xlator_option_init_int32] 0-fuse: option background-qlen <br clear="none">using default value 64<br clear="none">[2024-01-28 09:22:38.354311 +0000] T [MSGID: 0] <br clear="none">[options.c:1231:xlator_option_init_int32] 0-fuse: option <br clear="none">congestion-threshold using default value 48<br clear="none">[2024-01-28 09:22:38.354452 +0000] D [dict.c:2503:dict_get_str] <br clear="none">(-->/usr/lib/x86_64-linux-gnu/glusterfs/10.5/xlator/mount/fuse.so(+0x1f2a1) <br clear="none">[0x7ff51324d2a1] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(xlator_option_init_bool+0x60) <br clear="none">[0x7ff513e88bf0] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(dict_get_str+0xdf) <br clear="none">[0x7ff513e358df] ) 0-dict: key no-root-squash, string type asked, has <br clear="none">pointer type [Das Argument ist ungültig]<br clear="none">[2024-01-28 09:22:38.354519 +0000] D [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option no-root-squash <br clear="none">using set value disable<br clear="none">[2024-01-28 09:22:38.354671 +0000] T [MSGID: 0] <br clear="none">[options.c:1230:xlator_option_init_uint32] 0-fuse: option lru-limit <br clear="none">using default value 65536<br clear="none">[2024-01-28 09:22:38.354769 +0000] T [MSGID: 0] <br clear="none">[options.c:80:xlator_option_validate_int] 0-fuse: no range check <br clear="none">required for 'option lru-limit 65536'<br clear="none">[2024-01-28 09:22:38.354974 +0000] D [dict.c:2503:dict_get_str] <br clear="none">(-->/usr/lib/x86_64-linux-gnu/glusterfs/10.5/xlator/mount/fuse.so(+0x1f312) <br clear="none">[0x7ff51324d312] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(xlator_option_init_uint32+0x60) <br clear="none">[0x7ff513e89900] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(dict_get_str+0xdf) <br clear="none">[0x7ff513e358df] ) 0-dict: key invalidate-limit, string type asked, has <br clear="none">integer type [Das Argument ist ungültig]<br clear="none">[2024-01-28 09:22:38.355042 +0000] D [MSGID: 0] <br clear="none">[options.c:1230:xlator_option_init_uint32] 0-fuse: option <br clear="none">invalidate-limit using set value 0<br clear="none">[2024-01-28 09:22:38.355255 +0000] T [MSGID: 0] <br clear="none">[options.c:80:xlator_option_validate_int] 0-fuse: no range check <br clear="none">required for 'option invalidate-limit 0'<br clear="none">[2024-01-28 09:22:38.355366 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option event-history <br clear="none">using default value false<br clear="none">[2024-01-28 09:22:38.355480 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option thin-client <br clear="none">using default value false<br clear="none">[2024-01-28 09:22:38.355581 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option <br clear="none">kernel-writeback-cache using default value false<br clear="none">[2024-01-28 09:22:38.355679 +0000] T [MSGID: 0] <br clear="none">[options.c:1231:xlator_option_init_int32] 0-fuse: option <br clear="none">attr-times-granularity using default value 0<br clear="none">[2024-01-28 09:22:38.355873 +0000] T [MSGID: 0] <br clear="none">[options.c:1236:xlator_option_init_bool] 0-fuse: option <br clear="none">flush-handle-interrupt using default value false<br clear="none">[2024-01-28 09:22:38.356004 +0000] T [MSGID: 0] <br clear="none">[options.c:1230:xlator_option_init_uint32] 0-fuse: option <br clear="none">fuse-dev-eperm-ratelimit-ns using default value 10000000<br clear="none">[2024-01-28 09:22:38.358563 +0000] I [glusterfsd.c:2447:daemonize] <br clear="none">0-glusterfs: Pid of current running process is 792<br clear="none">[2024-01-28 09:22:38.358647 +0000] D <br clear="none">[logging.c:1705:__gf_log_inject_timer_event] 0-logging-infra: Starting <br clear="none">timer now. Timeout = 120, current buf size = 5<br clear="none">[2024-01-28 09:22:38.362664 +0000] D [MSGID: 0] [gf-io.c:513:gf_io_run] <br clear="none">0-io: Trying I/O engine 'io_uring'<br clear="none">[2024-01-28 09:22:38.363447 +0000] D [MSGID: 0] <br clear="none">[gf-io-uring.c:191:gf_io_uring_dump_params] 0-io: I/O URing: SQEs=32768, <br clear="none">CQEs=65536, CPU=0, Idle=0<br clear="none">[2024-01-28 09:22:38.363523 +0000] D [MSGID: 0] <br clear="none">[gf-io-uring.c:196:gf_io_uring_dump_params] 0-io: I/O URing: Flags: <br clear="none">CLAMP(10)<br clear="none">[2024-01-28 09:22:38.363663 +0000] D [MSGID: 0] <br clear="none">[gf-io-uring.c:199:gf_io_uring_dump_params] 0-io: I/O URing: Features: <br clear="none">SINGLE_MMAP(1) NODROP(2) SUBMIT_STABLE(4) RW_CUR_POS(8) <br clear="none">CUR_PERSONALITY(10) FAST_POLL(20) POLL_32BITS(40) SQPOLL_NONFIXED(80) <br clear="none">EXT_ARG(100) NATIVE_WORKERS(200) ?(1c00)<br clear="none">[2024-01-28 09:22:38.363800 +0000] D [MSGID: 0] <br clear="none">[gf-io-uring.c:251:gf_io_uring_dump_ops] 0-io: I/O URing: Max opcode = 48<br clear="none">[2024-01-28 09:22:38.363932 +0000] D [MSGID: 0] <br clear="none">[gf-io-uring.c:270:gf_io_uring_dump_ops] 0-io: I/O URing: Ops: NOP(0) <br clear="none">READV(1) WRITEV(2) FSYNC(3) READ_FIXED(4) WRITE_FIXED(5) POLL_ADD(6) <br clear="none">POLL_REMOVE(7) SYNC_FILE_RANGE(8) SENDMSG(9) RECVMSG(10) TIMEOUT(11) <br clear="none">TIMEOUT_REMOVE(12) ACCEPT(13) ASYNC_CANCEL(14) LINK_TIMEOUT(15) <br clear="none">CONNECT(16) FALLOCATE(17) OPENAT(18) CLOSE(19) FILES_UPDATE(20) <br clear="none">STATX(21) READ(22) WRITE(23) FADVISE(24) MADVISE(25) SEND(26) RECV(27) <br clear="none">OPENAT2(28) EPOLL_CTL(29) SPLICE(30) PROVIDE_BUFFERS(31) <br clear="none">REMOVE_BUFFERS(32) TEE(33) SHUTDOWN(34) RENAMEAT(35) UNLINKAT(36) ?(37) <br clear="none">?(38) ?(39) ?(40) ?(41) ?(42) ?(43) ?(44) ?(45) ?(46) ?(47) ?(48)<br clear="none">[2024-01-28 09:22:38.364281 +0000] D [MSGID: 0] [gf-io.c:517:gf_io_run] <br clear="none">0-io: I/O engine 'io_uring' is ready<br clear="none">[2024-01-28 09:22:38.365254 +0000] D <br clear="none">[rpc-clnt.c:1018:rpc_clnt_connection_init] 0-glusterfs: defaulting <br clear="none">frame-timeout to 30mins<br clear="none">[2024-01-28 09:22:38.365410 +0000] D <br clear="none">[rpc-clnt.c:1030:rpc_clnt_connection_init] 0-glusterfs: disable ping-timeout<br clear="none">[2024-01-28 09:22:38.365501 +0000] D <br clear="none">[rpc-transport.c:278:rpc_transport_load] 0-rpc-transport: attempt to <br clear="none">load file /usr/lib/x86_64-linux-gnu/glusterfs/10.5/rpc-transport/socket.so<br clear="none">[2024-01-28 09:22:38.366186 +0000] D [MSGID: 101233] <br clear="none">[options.c:973:xl_opt_validate] 0-glusterfs: option is deprecated, <br clear="none">continuing with correction [{key=address-family}, <br clear="none">{preferred=transport.address-family}]<br clear="none">[2024-01-28 09:22:38.366264 +0000] T [MSGID: 0] <br clear="none">[options.c:80:xlator_option_validate_int] 0-glusterfs: no range check <br clear="none">required for 'option remote-port 24007'<br clear="none">[2024-01-28 09:22:38.367351 +0000] D [socket.c:4561:socket_init] <br clear="none">0-glusterfs: Configured transport.tcp-user-timeout=42<br clear="none">[2024-01-28 09:22:38.367566 +0000] D [socket.c:4581:socket_init] <br clear="none">0-glusterfs: Reconfigured transport.keepalivecnt=9<br clear="none">[2024-01-28 09:22:38.367629 +0000] D <br clear="none">[rpc-clnt.c:1591:rpcclnt_cbk_program_register] 0-glusterfs: New program <br clear="none">registered: GlusterFS Callback, Num: 52743234, Ver: 1<br clear="none">[2024-01-28 09:22:38.367748 +0000] T [rpc-clnt.c:396:rpc_clnt_reconnect] <br clear="none">0-glusterfs: attempting reconnect<br clear="none">[2024-01-28 09:22:38.367865 +0000] T [socket.c:3377:socket_connect] <br clear="none">0-glusterfs: connecting 0x7ff50c007768, sock=-1<br clear="none">[2024-01-28 09:22:38.368068 +0000] D [dict.c:1290:data_to_uint16] <br clear="none">(-->/usr/lib/x86_64-linux-gnu/glusterfs/10.5/rpc-transport/socket.so(+0x98dd) <br clear="none">[0x7ff5123438dd] <br clear="none">-->/usr/lib/x86_64-linux-gnu/glusterfs/10.5/rpc-transport/socket.so(socket_client_get_remote_sockaddr+0x2c8) <br clear="none">[0x7ff512343448] <br clear="none">-->/lib/x86_64-linux-gnu/libglusterfs.so.0(data_to_uint16+0x146) <br clear="none">[0x7ff513e32676] ) 0-dict: key null, unsigned integer type asked, has <br clear="none">integer type [Das Argument ist ungültig] # --> the argument is invalide<br clear="none">[2024-01-28 09:22:38.368170 +0000] T [MSGID: 0] <br clear="none">[common-utils.c:504:gf_resolve_ip6] 0-resolver: DNS cache not present, <br clear="none">freshly probing hostname: c02.gluster<br clear="none">[2024-01-28 09:22:38.368577 +0000] D [MSGID: 0] <br clear="none">[common-utils.c:542:gf_resolve_ip6] 0-resolver: returning <br clear="none">ip-192.168.57.42 (port-24007) for hostname: c02.gluster and port: 24007<br clear="none">[2024-01-28 09:22:38.368641 +0000] D [socket.c:3294:socket_fix_ssl_opts] <br clear="none">0-glusterfs: disabling SSL for portmapper connection<br clear="none">[2024-01-28 09:22:38.368739 +0000] T [socket.c:1021:__socket_nodelay] <br clear="none">0-glusterfs: NODELAY enabled for socket 11<br clear="none">[2024-01-28 09:22:38.368846 +0000] T [socket.c:1107:__socket_keepalive] <br clear="none">0-glusterfs: Keep-alive enabled for socket: 11, (idle: 20, interval: 2, <br clear="none">max-probes: 9, timeout: 42)<br clear="none">[2024-01-28 09:22:38.368954 +0000] T [socket.c:3495:socket_connect] <br clear="none">0-glusterfs: >>> connect() with non-blocking IO for ALL<br clear="none">[2024-01-28 09:22:38.369071 +0000] T [socket.c:206:socket_dump_info] <br clear="none">0-glusterfs: $$$ client: connecting to (af:2,sock:11) 192.168.57.42 <br clear="none">non-SSL (errno:0:Erfolg)<br clear="none">[2024-01-28 09:22:38.369501 +0000] I [MSGID: 101190] <br clear="none">[event-epoll.c:667:event_dispatch_epoll_worker] 0-epoll: Started thread <br clear="none">with index [{index=1}]<br clear="none">[2024-01-28 09:22:38.369565 +0000] T <br clear="none">[socket.c:2897:socket_event_handler] 0-glusterfs: client (sock:11) in:0, <br clear="none">out:4, err:0<br clear="none">[2024-01-28 09:22:38.369682 +0000] T <br clear="none">[socket.c:2903:socket_event_handler] 0-glusterfs: client (sock:11) <br clear="none">socket is not connected, completing connection<br clear="none">[2024-01-28 09:22:38.369872 +0000] T <br clear="none">[rpc-clnt.c:1443:rpc_clnt_record_build_header] 0-rpc-clnt: Request <br clear="none">fraglen 140, payload: 76, rpc hdr: 64<br clear="none">[2024-01-28 09:22:38.369990 +0000] T [rpc-clnt.c:1729:rpc_clnt_submit] <br clear="none">0-rpc-clnt: submitted request (unique: 0, XID: 0x2, Program: GlusterFS <br clear="none">Handshake, ProgVers: 2, Proc: 2) to rpc-transport (glusterfs)<br clear="none">[2024-01-28 09:22:38.370068 +0000] D <br clear="none">[rpc-clnt-ping.c:296:rpc_clnt_start_ping] 0-glusterfs: ping timeout is <br clear="none">0, returning<br clear="none">[2024-01-28 09:22:38.370207 +0000] T <br clear="none">[socket.c:2803:socket_handle_client_connection_attempt] 0-glusterfs: <br clear="none">socket_connect_finish() returned 0<br clear="none">[2024-01-28 09:22:38.370301 +0000] T <br clear="none">[socket.c:2910:socket_event_handler] 0-glusterfs: (sock:11) <br clear="none">socket_complete_connection() returned 1<br clear="none">[2024-01-28 09:22:38.370471 +0000] T <br clear="none">[socket.c:2916:socket_event_handler] 0-glusterfs: (sock:11) returning to <br clear="none">wait on socket<br clear="none">[2024-01-28 09:22:38.370529 +0000] T <br clear="none">[socket.c:2897:socket_event_handler] 0-glusterfs: client (sock:11) in:0, <br clear="none">out:4, err:0<br clear="none">[2024-01-28 09:22:38.370668 +0000] T <br clear="none">[socket.c:2923:socket_event_handler] 0-glusterfs: Client socket (11) is <br clear="none">already connected<br clear="none">[2024-01-28 09:22:38.370733 +0000] T <br clear="none">[socket.c:2932:socket_event_handler] 0-glusterfs: (sock:11) <br clear="none">socket_event_poll_out returned 0<br clear="none">[2024-01-28 09:22:38.370837 +0000] I [MSGID: 101190] <br clear="none">[event-epoll.c:667:event_dispatch_epoll_worker] 0-epoll: Started thread <br clear="none">with index [{index=0}]<br clear="none">[2024-01-28 09:22:38.374114 +0000] T <br clear="none">[socket.c:2897:socket_event_handler] 0-glusterfs: client (sock:11) in:1, <br clear="none">out:0, err:24<br clear="none">[2024-01-28 09:22:38.374179 +0000] T [socket.c:206:socket_dump_info] <br clear="none">0-glusterfs: $$$ client: disconnecting from (af:2,sock:11) 192.168.57.42 <br clear="none">non-SSL (errno:104:Die Verbindung wurde vom Kommunikationspartner <br clear="none">zurückgesetzt) # --> connection reseted by peer<br clear="none">[2024-01-28 09:22:38.374326 +0000] D <br clear="none">[socket.c:2966:socket_event_handler] 0-transport: EPOLLERR - <br clear="none">disconnecting (sock:11) (non-SSL)<br clear="none">[2024-01-28 09:22:38.374447 +0000] I <br clear="none">[glusterfsd-mgmt.c:2681:mgmt_rpc_notify] 0-glusterfsd-mgmt: disconnected <br clear="none">from remote-host: c02.gluster<br clear="none">[2024-01-28 09:22:38.374529 +0000] I <br clear="none">[glusterfsd-mgmt.c:2720:mgmt_rpc_notify] 0-glusterfsd-mgmt: Exhausted <br clear="none">all volfile servers<br clear="none">[2024-01-28 09:22:38.375599 +0000] D <br clear="none">[logging.c:1675:gf_log_flush_extra_msgs] 0-logging-infra: Log buffer <br clear="none">size reduced. About to flush 5 extra log messages<br clear="none">[2024-01-28 09:22:38.375716 +0000] D <br clear="none">[logging.c:1681:gf_log_flush_extra_msgs] 0-logging-infra: Just flushed 5 <br clear="none">extra log messages<br clear="none">[2024-01-28 09:22:38.375878 +0000] W <br clear="none">[glusterfsd.c:1458:cleanup_and_exit] <br clear="none">(-->/lib/x86_64-linux-gnu/libgfrpc.so.0(+0xfa35) [0x7ff513de8a35] <br clear="none">-->/usr/sbin/glusterfs(+0x14769) [0x564f61e2c769] <br clear="none">-->/usr/sbin/glusterfs(cleanup_and_exit+0x57) [0x564f61e23447] ) 0-: <br clear="none">received signum (1), shutting down<br clear="none">[2024-01-28 09:22:38.375999 +0000] D <br clear="none">[mgmt-pmap.c:90:rpc_clnt_mgmt_pmap_signout] 0-fsd-mgmt: portmapper <br clear="none">signout arguments not given<br clear="none">[2024-01-28 09:22:38.376093 +0000] I [fuse-bridge.c:7065:fini] 0-fuse: <br clear="none">Unmounting '/mnt'.<br clear="none">[2024-01-28 09:22:38.378550 +0000] I [fuse-bridge.c:7069:fini] 0-fuse: <br clear="none">Closing fuse connection to '/mnt'.<br clear="none">[2024-01-28 09:22:38.378765 +0000] W <br clear="none">[glusterfsd.c:1458:cleanup_and_exit] <br clear="none">(-->/lib/x86_64-linux-gnu/libc.so.6(+0x89044) [0x7ff513c6d044] <br clear="none">-->/usr/sbin/glusterfs(glusterfs_sigwaiter+0xc5) [0x564f61e2ae05] <br clear="none">-->/usr/sbin/glusterfs(cleanup_and_exit+0x57) [0x564f61e23447] ) 0-: <br clear="none">received signum (15), shutting down<br clear="none"><br clear="none">---------------<br clear="none">So the client can resolve the hostname aand it fits to the neme of the <br clear="none">gluster-host and it's fqdn.<br clear="none">Still the same on the gluster-host:<br clear="none">----------------<br clear="none">==> /var/log/glusterfs/glusterd.log <==<br clear="none">[2024-01-28 09:32:47.673142 +0000] I <br clear="none">[socket.c:4288:ssl_setup_connection_params] 0-socket.management: SSL <br clear="none">support for MGMT is ENABLED IO path is ENABLED certificate depth is 1 <br clear="none">for peer 192.168.57.51:49151<br clear="none">[2024-01-28 09:32:47.677804 +0000] E [socket.c:224:ssl_dump_error_stack] <br clear="none">0-socket.management:   error:0A00010B:SSL routines::wrong version number<br clear="none">----------------<br clear="none">  :-( still not working. What I don't anderstand: why is it working <br clear="none">between the gluster-host but not between the gluster-client and any of <br clear="none">the gluster-hosts? Atre they manage the TLS connection a different way?<br clear="none"><br clear="none">Stefan<br clear="none"><br clear="none"><br clear="none"><br clear="none">Am 28.01.24 um 08:44 schrieb Strahil Nikolov:<br clear="none">> Usually with Certificates it's always a pain.I would ask you to regenerate the certificates but by adding the FQDN of the system and the IP used by the clients to reach the brick in 'SANS' section of the cert. Also, set the validity to 365 days for the test.<br clear="none">> Best Regards,Strahil Nikolov<br clear="none">>   <br clear="none">>   <br clear="none">>    On Fri, Jan 26, 2024 at 21:37, Stefan Kania<<a rel="nofollow noopener noreferrer" shape="rect" ymailto="mailto:stefan@kania-online.de" target="_blank" href="mailto:stefan@kania-online.de">stefan@kania-online.de</a>> wrote:   Hi Aravinda<br clear="none">> <br clear="none">> Am 26.01.24 um 17:01 schrieb Aravinda:<br clear="none">>> Does the combined glusterfs.ca includes client nodes pem? Also this file<br clear="none">>> need to be placed in Client node as well.<br clear="none">> <br clear="none">> Yes, I put all the Gluster-node Certificates AND the client certificate<br clear="none">> into the glusterfs.ca file. And I put the file to all gluster-nodes and<br clear="none">> clients. I did it twice (delete all certificate and restart all over)the<br clear="none">> result was always the same.<div id="yiv1107693715yqtfd04664" class="yiv1107693715yqt4417493367"><br clear="none">> <br clear="none">> Stefan<br clear="none">> <br clear="none">> <br clear="none">> <br clear="none">>    <br clear="none">> <br clear="none"><br clear="none">-- <br clear="none">Stefan Kania</div><br clear="none">Landweg 13<br clear="none">25693 St. Michaelisdonn<br clear="none"><br clear="none"><br clear="none">Signieren jeder E-Mail hilft Spam zu reduzieren und schützt Ihre <br clear="none">Privatsphäre. Ein kostenfreies Zertifikat erhalten Sie unter <br clear="none"><a rel="nofollow noopener noreferrer" shape="rect" target="_blank" href="https://www.dgn.de/dgncert/index.html">https://www.dgn.de/dgncert/index.html</a><div id="yiv1107693715yqtfd02220" class="yiv1107693715yqt4417493367"><br clear="none"><br clear="none"></div> </div> </blockquote></div></div></div></div>