<html><head><meta http-equiv="Content-Type" content="text/html charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class="">Dear all,<div class=""><br class=""></div><div class="">I have problem with glusterfs 3.12.4 </div><div class=""><br class=""></div><div class="">mkdir -p fails with "no data available" when umask is 0022, but works when umask is 0002. </div><div class=""><br class=""></div><div class="">Also recursive copy (cp -R or cp -r) fails with "no data available", independly of the umask.</div><div class=""><br class=""></div><div class="">See below for an example to reproduce the error. I already tried to change transport from rdma to tcp. (Changing the transport works, but the error persists.)</div><div class=""><br class=""></div><div class="">I'd be grateful for some insight.</div><div class=""><br class=""></div><div class="">I have small test system that still runs on glusterfs 3.12.3, where everything works fine.</div><div class=""><br class=""></div><div class="">best wishes,</div><div class="">Stefan</div><div class=""><br class=""></div><div class=""><br class=""></div><div class=""><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ mount | grep gluster </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">qloginx:/glurch.rdma on /glurch type fuse.</span><span style="font-variant-ligatures: no-common-ligatures; color: #c0341d" class=""><b class="">gluster</b></span><span style="font-variant-ligatures: no-common-ligatures" class="">fs (rw,relatime,user_id=0,group_id=0,allow_other,max_read=131072)</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ pwd</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">/glurch/test/bug</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ umask 0022 </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ mkdir aa #works</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ mkdir -p aa/bb/cc/dd </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">mkdir: cannot create directory ‘aa/bb’: No data available</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ umask 0002 </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ mkdir -p aa/bb/cc/dd </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">mkdir: cannot create directory ‘aa/bb’: No data available</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ rm -rf aa </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ mkdir -p aa/bb/cc/dd #works now</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""># looks like all directories in the path of mkdir -p ...</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""># have to be group-writable... </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ cp -R aa foo </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">cp: cannot create directory ‘foo/bb’: No data available</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""># I cannot get this to work, independ of the umask...</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ glusterd --version </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">glusterfs 3.12.4</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ glusterfs --version</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">glusterfs 3.12.4</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ glusterfsd --version</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">glusterfs 3.12.4</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">[hpcadmin@pcph00131 bug]$ sudo gluster v status all </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Status of volume: glurch</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Gluster process TCP Port RDMA Port Online Pid</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">------------------------------------------------------------------------------</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Brick qloginx:/gl/lv1osb06/glurchbrick 0 49152 Y 17623</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Brick qloginx:/gl/lv2osb06/glurchbrick 0 49153 Y 17647</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Brick gluster2x:/gl/lv3osb06/glurchbrick 0 49152 Y 2845 </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">Brick gluster2x:/gl/lv4osb06/glurchbrick 0 49153 Y 2868 </span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232);" class=""><span style="font-variant-ligatures: no-common-ligatures" class="">#note: im mounting on the qlogin</span></div><div style="margin: 0px; font-size: 11px; line-height: normal; font-family: Menlo; background-color: rgb(255, 248, 232); min-height: 13px;" class=""><span style="font-variant-ligatures: no-common-ligatures" class=""></span><br class=""></div></div><div class=""><br class=""></div><div class=""><br class=""><div class="">-- <br class="">Dr. Stefan Solbrig<br class="">Universität Regensburg, Fakultät für Physik,<br class="">93040 Regensburg, Germany<br class="">Tel +49-941-943-2097<br class=""><br class=""></div><br class=""></div></body></html>