<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Tue, May 8, 2018 at 9:30 AM, Thing <span dir="ltr"><<a href="mailto:thing.thing@gmail.com" target="_blank">thing.thing@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>On a debian 9 client,</div><div><br></div><div>========</div><div><div>root@kvm01:/var/lib/libvirt# dpkg -l glusterfs-client</div><div>8><---<br></div><div>ii glusterfs-client 3.8.8-1 amd64 clustered file-system (client package)</div><div>root@kvm01:/var/lib/libvirt# </div></div><div>=======</div><div><br></div><div>I am trying to to do a mount to a Centos 7 gluster setup,</div><div><br></div><div>=======</div><div><div>[root@glustep1 libvirt]# rpm -q glusterfs</div><div>glusterfs-4.0.2-1.el7.x86_64</div><div>[root@glustep1 libvirt]# </div></div><div>=======</div><div><br></div><div>mount -t glusterfs glusterp1.graywitch.co.nz:/<wbr>gv0/kvm01/images /var/lib/libvirt/images<br></div><div><br></div></div></blockquote><div><br></div><div>I see that you are trying 'subdir' mount. (as I see '/gv0' was able to mount fine).</div><div> </div><div>If that is the case, please make sure to add a proper 'auth.allow' entry for subdir.</div><div><br></div><div>something like 'gluster volume set gv0 auth.allow "/(*),/kvm01/images(*)"</div><div><br></div><div>But, while typing above, noticed that subdir mount is enabled by default for every directory if none of the options are given. So, looking deeper, I see below line in your client:</div><div><br></div><div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial"><span style="font-weight:400">[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs</span><b> version 3.8.8</b> (args: /usr</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial">/sbin/glusterfs --volfile-server=<a href="http://glusterp1.graywitch.co.nz/" target="_blank" style="color:rgb(17,85,204)">glusterp1.<wbr>graywitch.co.nz</a><span> </span>--volfile-id=/gv0/kvm01/<wbr>images/ /var/lib/libvirt/images)</div><br></div><div>and for that version, we didn't had that particular feature.</div><div><br></div><div>-Amar</div><div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div></div><div><br></div><div>the logs are telling me,</div><div>=========</div><div><div>root@kvm01:/var/lib/libvirt# > /var/log/glusterfs/var-lib-<wbr>libvirt-images.log </div><div>root@kvm01:/var/lib/libvirt# mount -t glusterfs glusterp1.graywitch.co.nz:/<wbr>gv0/kvm01/images/ /var/lib/libvirt/images</div><div>Mount failed. Please check the log file for more details.</div><div>root@kvm01:/var/lib/libvirt# more /var/log/glusterfs/var-lib-<wbr>libvirt-images.log </div><div>[2018-05-08 03:33:48.989219] I [MSGID: 100030] [glusterfsd.c:2454:main] 0-/usr/sbin/glusterfs: Started running /usr/sbin/glusterfs version 3.8.8 (args: /usr</div><div>/sbin/glusterfs --volfile-server=<a href="http://glusterp1.graywitch.co.nz" target="_blank">glusterp1.<wbr>graywitch.co.nz</a> --volfile-id=/gv0/kvm01/<wbr>images/ /var/lib/libvirt/images)</div><div>[2018-05-08 03:33:48.996244] I [MSGID: 101190] [event-epoll.c:628:event_<wbr>dispatch_epoll_worker] 0-epoll: Started thread with index 1</div><div>[2018-05-08 03:33:48.998694] E [glusterfsd-mgmt.c:1590:mgmt_<wbr>getspec_cbk] 0-glusterfs: failed to get the 'volume file' from server</div><div>[2018-05-08 03:33:48.998721] E [glusterfsd-mgmt.c:1690:mgmt_<wbr>getspec_cbk] 0-mgmt: failed to fetch volume file (key:/gv0/kvm01/images/)</div><div>[2018-05-08 03:33:48.998891] W [glusterfsd.c:1327:cleanup_<wbr>and_exit] (-->/usr/lib/x86_64-linux-gnu/<wbr>libgfrpc.so.0(rpc_clnt_handle_<wbr>reply+0x90) [0x7f25cd69ba20]</div><div> -->/usr/sbin/glusterfs(mgmt_<wbr>getspec_cbk+0x494) [0x558e7de496f4] -->/usr/sbin/glusterfs(<wbr>cleanup_and_exit+0x54) [0x558e7de43444] ) 0-: received signum (0), s</div><div>hutting down</div><div>[2018-05-08 03:33:48.998923] I [fuse-bridge.c:5794:fini] 0-fuse: Unmounting '/var/lib/libvirt/images'.</div><div>[2018-05-08 03:33:49.019805] W [glusterfsd.c:1327:cleanup_<wbr>and_exit] (-->/lib/x86_64-linux-gnu/<wbr>libpthread.so.0(+0x7494) [0x7f25cc72c494] -->/usr/sbin/gluster</div><div>fs(glusterfs_sigwaiter+0xf5) [0x558e7de435e5] -->/usr/sbin/glusterfs(<wbr>cleanup_and_exit+0x54) [0x558e7de43444] ) 0-: received signum (15), shutting down</div><div>root@kvm01:/var/lib/libvirt# </div></div><div>==========</div><div><br></div><div>though,</div><div><br></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">mount -t glusterfs glusterp1.graywitch.co.nz:/gv0 /isos</span><br></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">works fine.</span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">===========</span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><div>root@kvm01:/var/lib/libvirt# df -h</div><div>Filesystem Size Used Avail Use% Mounted on</div><div>udev 7.8G 0 7.8G 0% /dev</div><div>tmpfs 1.6G 9.2M 1.6G 1% /run</div><div>/dev/mapper/kvm01--vg-root 23G 3.8G 18G 18% /</div><div>tmpfs 7.8G 0 7.8G 0% /dev/shm</div><div>tmpfs 5.0M 4.0K 5.0M 1% /run/lock</div><div>tmpfs 7.8G 0 7.8G 0% /sys/fs/cgroup</div><div>/dev/mapper/kvm01--vg-home 243G 61M 231G 1% /home</div><div>/dev/mapper/kvm01--vg-tmp 1.8G 5.6M 1.7G 1% /tmp</div><div>/dev/mapper/kvm01--vg-var 9.2G 302M 8.4G 4% /var</div><div>/dev/sda1 236M 63M 161M 28% /boot</div><div>tmpfs 1.6G 4.0K 1.6G 1% /run/user/115</div><div>tmpfs 1.6G 0 1.6G 0% /run/user/1000</div><div>glusterp1.graywitch.co.nz:/<wbr>gv0 932G 247G 685G 27% /isos</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">also, I can mount the sub-directory fine on the gluster cluster itself,</span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><br></span></div><div><span style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline">=======</span></div><div><span style="text-align:start;text-indent:0px;background-color:rgb(255,255,255);text-decoration-style:initial;text-decoration-color:initial;float:none;display:inline"><div>[root@glustep1 libvirt]# df -h</div><div>Filesystem Size Used Avail Use% Mounted on</div><div>/dev/mapper/centos-root 20G 3.4G 17G 17% /</div><div>devtmpfs 3.8G 0 3.8G 0% /dev</div><div>tmpfs 3.8G 6.1M 3.8G 1% /dev/shm</div><div>tmpfs 3.8G 9.0M 3.8G 1% /run</div><div>tmpfs 3.8G 0 3.8G 0% /sys/fs/cgroup</div><div>/dev/sda1 969M 206M 713M 23% /boot</div><div>/dev/mapper/centos-tmp 3.9G 33M 3.9G 1% /tmp</div><div>/dev/mapper/centos-home 50G 4.3G 46G 9% /home</div><div>/dev/mapper/centos-var 20G 341M 20G 2% /var</div><div>/dev/mapper/centos-data1 120G 36M 120G 1% /data1</div><div>/dev/mapper/centos00-var_lib 9.4G 179M 9.2G 2% /var/lib</div><div>/dev/mapper/vg--gluster--<wbr>prod1-gluster--prod1 932G 233G 699G 25% /bricks/brick1</div><div>tmpfs 771M 12K 771M 1% /run/user/42</div><div>tmpfs 771M 32K 771M 1% /run/user/1000</div><div>glusterp1:gv0/glusterp1/<wbr>images 932G 247G 685G 27% /var/lib/libvirt/images</div><div>glusterp1:gv0 932G 247G 685G 27% /isos</div><div>[root@glustep1 libvirt]# </div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">========</div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px"><br></div><div style="color:rgb(34,34,34);font-family:arial,sans-serif;font-size:small;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-transform:none;white-space:normal;word-spacing:0px">Is this a version mis-match thing? or what am I doing wrongly please?</div></span></div></div>
<br>______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/gluster-users</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>Amar Tumballi (amarts)<br></div></div></div></div></div>
</div></div>