<div dir="ltr">Hi,<div><br></div><div>On a debian 9 client,</div><div><br></div><div>========</div><div><div>root@kvm01:/var/lib/libvirt# dpkg -l glusterfs-client</div><div>8&gt;&lt;---<br></div><div>ii  glusterfs-client  Â  Â  Â  Â  Â  Â  Â  Â  3.8.8-1  Â  Â  Â  Â  Â  Â  Â amd64  Â  Â  Â  Â  Â  Â  Â  Â clustered file-system (client package)</div><div>root@kvm01:/var/lib/libvirt# </div></div><div>=======</div><div><br></div><div>I am trying to to do a mount to a Centos 7 gluster setup,</div><div><br></div><div>=======</div><div><div>[root@glustep1 libvirt]# rpm -q glusterfs</div><div>glusterfs-4.0.2-1.el7.x86_64</div><div>[root@glustep1 libvirt]# </div></div><div>=======</div><div><br></div><div>mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images /var/lib/libvirt/images<br></div><div><br></div><div><br></div><div>the logs are telling me,</div><div>=========</div><div><div>root@kvm01:/var/lib/libvirt# &gt; /var/log/glusterfs/var-lib-libvirt-images.log </div><div>root@kvm01:/var/lib/libvirt# mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images/ /var/lib/libvirt/images</div><div>Mount failed. Please check the log file for more details.</div><div>root@kvm01:/var/lib/libvirt# more /var/log/glusterfs/var-lib-libvirt-images.log </div><div>[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.8 (args: /usr</div><div>/sbin/glusterfs --volfile-server=<a href="http://glusterp1.graywitch.co.nz">glusterp1.graywitch.co.nz</a> --volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images)</div><div>[2018-05-08 03:33:48.996244] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1</div><div>[2018-05-08 03:33:48.998694] E [glusterfsd-mgmt.c:1590:mgmt_getspec_cbk] 0-glusterfs: failed to get the &#39;volume file&#39; from server</div><div>[2018-05-08 03:33:48.998721] E [glusterfsd-mgmt.c:1690:mgmt_getspec_cbk] 0-mgmt: failed to fetch volume file (key:/gv0/kvm01/images/)</div><div>[2018-05-08 03:33:48.998891] W [glusterfsd.c:1327:cleanup_and_exit] (--&gt;/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_handle_reply+0x90) [0x7f25cd69ba20]</div><div> --&gt;/usr/sbin/glusterfs(mgmt_getspec_cbk+0x494) [0x558e7de496f4] --&gt;/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x558e7de43444] ) 0-: received signum (0), s</div><div>hutting down</div><div>[2018-05-08 03:33:48.998923] I [fuse-bridge.c:5794:fini] 0-fuse: Unmounting &#39;/var/lib/libvirt/images&#39;.</div><div>[2018-05-08 03:33:49.019805] W [glusterfsd.c:1327:cleanup_and_exit] (--&gt;/lib/x86_64-linux-gnu/libpthread.so.0(+0x7494) [0x7f25cc72c494] --&gt;/usr/sbin/gluster</div><div>fs(glusterfs_sigwaiter+0xf5) [0x558e7de435e5] --&gt;/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x558e7de43444] ) 0-: received signum (15), shutting down</div><div>root@kvm01:/var/lib/libvirt# </div></div><div>==========</div><div><br></div><div>though,</div><div><br></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">mount -t glusterfs glusterp1.graywitch.co.nz:/gv0 /isos</span><br></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">works fine.</span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">===========</span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><div>root@kvm01:/var/lib/libvirt# df -h</div><div>Filesystem  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Size  Used Avail Use% Mounted on</div><div>udev  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  7.8G  Â  Â 0  7.8G  Â 0% /dev</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 1.6G  9.2M  1.6G  Â 1% /run</div><div>/dev/mapper/kvm01--vg-root  Â  Â  Â 23G  3.8G  Â 18G  18% /</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 7.8G  Â  Â 0  7.8G  Â 0% /dev/shm</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 5.0M  4.0K  5.0M  Â 1% /run/lock</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 7.8G  Â  Â 0  7.8G  Â 0% /sys/fs/cgroup</div><div>/dev/mapper/kvm01--vg-home  Â  Â  243G  Â 61M  231G  Â 1% /home</div><div>/dev/mapper/kvm01--vg-tmp  Â  Â  Â 1.8G  5.6M  1.7G  Â 1% /tmp</div><div>/dev/mapper/kvm01--vg-var  Â  Â  Â 9.2G  302M  8.4G  Â 4% /var</div><div>/dev/sda1  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 236M  Â 63M  161M  28% /boot</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 1.6G  4.0K  1.6G  Â 1% /run/user/115</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 1.6G  Â  Â 0  1.6G  Â 0% /run/user/1000</div><div>glusterp1.graywitch.co.nz:/gv0  932G  247G  685G  27% /isos</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">also, I can mount the sub-directory fine on the gluster cluster itself,</span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">=======</span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><div>[root@glustep1 libvirt]# df -h</div><div>Filesystem  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â Size  Used Avail Use% Mounted on</div><div>/dev/mapper/centos-root  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 20G  3.4G  Â 17G  17% /</div><div>devtmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 3.8G  Â  Â 0  3.8G  Â 0% /dev</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  3.8G  6.1M  3.8G  Â 1% /dev/shm</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  3.8G  9.0M  3.8G  Â 1% /run</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  3.8G  Â  Â 0  3.8G  Â 0% /sys/fs/cgroup</div><div>/dev/sda1  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  969M  206M  713M  23% /boot</div><div>/dev/mapper/centos-tmp  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 3.9G  Â 33M  3.9G  Â 1% /tmp</div><div>/dev/mapper/centos-home  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 50G  4.3G  Â 46G  Â 9% /home</div><div>/dev/mapper/centos-var  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  20G  341M  Â 20G  Â 2% /var</div><div>/dev/mapper/centos-data1  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â 120G  Â 36M  120G  Â 1% /data1</div><div>/dev/mapper/centos00-var_lib  Â  Â  Â  Â  Â  Â  Â  Â  Â 9.4G  179M  9.2G  Â 2% /var/lib</div><div>/dev/mapper/vg--gluster--prod1-gluster--prod1  932G  233G  699G  25% /bricks/brick1</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  771M  Â 12K  771M  Â 1% /run/user/42</div><div>tmpfs  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  771M  Â 32K  771M  Â 1% /run/user/1000</div><div>glusterp1:gv0/glusterp1/images  Â  Â  Â  Â  Â  Â  Â  Â 932G  247G  685G  27% /var/lib/libvirt/images</div><div>glusterp1:gv0  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  Â  932G  247G  685G  27% /isos</div><div>[root@glustep1 libvirt]# </div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">========</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">Is this a version mis-match thing? or what am I doing wrongly please?</div></span></div></div>