<div dir="ltr">Hi,<div><br></div><div>On a debian 9 client,</div><div><br></div><div>========</div><div><div>root@kvm01:/var/lib/libvirt# dpkg -l glusterfs-client</div><div>8><---<br></div><div>ii glusterfs-client         3.8.8-1        amd64         clustered file-system (client package)</div><div>root@kvm01:/var/lib/libvirt# </div></div><div>=======</div><div><br></div><div>I am trying to to do a mount to a Centos 7 gluster setup,</div><div><br></div><div>=======</div><div><div>[root@glustep1 libvirt]# rpm -q glusterfs</div><div>glusterfs-4.0.2-1.el7.x86_64</div><div>[root@glustep1 libvirt]# </div></div><div>=======</div><div><br></div><div>mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images /var/lib/libvirt/images<br></div><div><br></div><div><br></div><div>the logs are telling me,</div><div>=========</div><div><div>root@kvm01:/var/lib/libvirt# > /var/log/glusterfs/var-lib-libvirt-images.log </div><div>root@kvm01:/var/lib/libvirt# mount -t glusterfs glusterp1.graywitch.co.nz:/gv0/kvm01/images/ /var/lib/libvirt/images</div><div>Mount failed. Please check the log file for more details.</div><div>root@kvm01:/var/lib/libvirt# more /var/log/glusterfs/var-lib-libvirt-images.log </div><div>[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.8 (args: /usr</div><div>/sbin/glusterfs --volfile-server=<a href="http://glusterp1.graywitch.co.nz">glusterp1.graywitch.co.nz</a> --volfile-id=/gv0/kvm01/images/ /var/lib/libvirt/images)</div><div>[2018-05-08 03:33:48.996244] I [MSGID: 101190] [event-epoll.c:628:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1</div><div>[2018-05-08 03:33:48.998694] E [glusterfsd-mgmt.c:1590:mgmt_getspec_cbk] 0-glusterfs: failed to get the 'volume file' from server</div><div>[2018-05-08 03:33:48.998721] E [glusterfsd-mgmt.c:1690:mgmt_getspec_cbk] 0-mgmt: failed to fetch volume file (key:/gv0/kvm01/images/)</div><div>[2018-05-08 03:33:48.998891] W [glusterfsd.c:1327:cleanup_and_exit] (-->/usr/lib/x86_64-linux-gnu/libgfrpc.so.0(rpc_clnt_handle_reply+0x90) [0x7f25cd69ba20]</div><div> -->/usr/sbin/glusterfs(mgmt_getspec_cbk+0x494) [0x558e7de496f4] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x558e7de43444] ) 0-: received signum (0), s</div><div>hutting down</div><div>[2018-05-08 03:33:48.998923] I [fuse-bridge.c:5794:fini] 0-fuse: Unmounting '/var/lib/libvirt/images'.</div><div>[2018-05-08 03:33:49.019805] W [glusterfsd.c:1327:cleanup_and_exit] (-->/lib/x86_64-linux-gnu/libpthread.so.0(+0x7494) [0x7f25cc72c494] -->/usr/sbin/gluster</div><div>fs(glusterfs_sigwaiter+0xf5) [0x558e7de435e5] -->/usr/sbin/glusterfs(cleanup_and_exit+0x54) [0x558e7de43444] ) 0-: received signum (15), shutting down</div><div>root@kvm01:/var/lib/libvirt# </div></div><div>==========</div><div><br></div><div>though,</div><div><br></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">mount -t glusterfs glusterp1.graywitch.co.nz:/gv0 /isos</span><br></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">works fine.</span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">===========</span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><div>root@kvm01:/var/lib/libvirt# df -h</div><div>Filesystem           Size Used Avail Use% Mounted on</div><div>udev              7.8G   0 7.8G  0% /dev</div><div>tmpfs              1.6G 9.2M 1.6G  1% /run</div><div>/dev/mapper/kvm01--vg-root    23G 3.8G  18G 18% /</div><div>tmpfs              7.8G   0 7.8G  0% /dev/shm</div><div>tmpfs              5.0M 4.0K 5.0M  1% /run/lock</div><div>tmpfs              7.8G   0 7.8G  0% /sys/fs/cgroup</div><div>/dev/mapper/kvm01--vg-home   243G  61M 231G  1% /home</div><div>/dev/mapper/kvm01--vg-tmp    1.8G 5.6M 1.7G  1% /tmp</div><div>/dev/mapper/kvm01--vg-var    9.2G 302M 8.4G  4% /var</div><div>/dev/sda1            236M  63M 161M 28% /boot</div><div>tmpfs              1.6G 4.0K 1.6G  1% /run/user/115</div><div>tmpfs              1.6G   0 1.6G  0% /run/user/1000</div><div>glusterp1.graywitch.co.nz:/gv0 932G 247G 685G 27% /isos</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">also, I can mount the sub-directory fine on the gluster cluster itself,</span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">=======</span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><div>[root@glustep1 libvirt]# df -h</div><div>Filesystem                   Size Used Avail Use% Mounted on</div><div>/dev/mapper/centos-root             20G 3.4G  17G 17% /</div><div>devtmpfs                    3.8G   0 3.8G  0% /dev</div><div>tmpfs                     3.8G 6.1M 3.8G  1% /dev/shm</div><div>tmpfs                     3.8G 9.0M 3.8G  1% /run</div><div>tmpfs                     3.8G   0 3.8G  0% /sys/fs/cgroup</div><div>/dev/sda1                   969M 206M 713M 23% /boot</div><div>/dev/mapper/centos-tmp             3.9G  33M 3.9G  1% /tmp</div><div>/dev/mapper/centos-home             50G 4.3G  46G  9% /home</div><div>/dev/mapper/centos-var             20G 341M  20G  2% /var</div><div>/dev/mapper/centos-data1            120G  36M 120G  1% /data1</div><div>/dev/mapper/centos00-var_lib          9.4G 179M 9.2G  2% /var/lib</div><div>/dev/mapper/vg--gluster--prod1-gluster--prod1 932G 233G 699G 25% /bricks/brick1</div><div>tmpfs                     771M  12K 771M  1% /run/user/42</div><div>tmpfs                     771M  32K 771M  1% /run/user/1000</div><div>glusterp1:gv0/glusterp1/images         932G 247G 685G 27% /var/lib/libvirt/images</div><div>glusterp1:gv0                 932G 247G 685G 27% /isos</div><div>[root@glustep1 libvirt]# </div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">========</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">Is this a version mis-match thing? or what am I doing wrongly please?</div></span></div></div>