<html><head></head><body><div class="ydpccd55ecfyahoo-style-wrap" style="font-family:courier new, courier, monaco, monospace, sans-serif;font-size:16px;"><div></div>
        <div>It seems that I got confused.</div><div>So you see the files on the bricks (servers) , but not when you mount glusterfs on the clients ?</div><div><br></div><div>If so - this is not the sharding feature as it works the opposite way.</div><div><br></div><div>Best Regards,</div><div>Strahil Nikolov</div><div><br></div>
        
        </div><div id="ydp8edf2bd0yahoo_quoted_8151609257" class="ydp8edf2bd0yahoo_quoted">
            <div style="font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;font-size:13px;color:#26282a;">
                
                <div>
                    В четвъртък, 16 май 2019 г., 0:35:04 ч. Гринуич+3, Paul van der Vlis &lt;paul@vandervlis.nl&gt; написа:
                </div>
                <div><br></div>
                <div><br></div>
                <div><div dir="ltr">Op 15-05-19 om 15:45 schreef Nithya Balachandran:<br clear="none">&gt; Hi Paul,<br clear="none">&gt; <br clear="none">&gt; A few questions:<br clear="none">&gt; Which version of gluster are you using?<br clear="none"><br clear="none">On the server and some clients: glusterfs 4.1.2<br clear="none">On a new client: glusterfs 5.5<br clear="none"><br clear="none">&gt; Did this behaviour start recently? As in were the contents of that<br clear="none">&gt; directory visible earlier?<br clear="none"><br clear="none">This directory was normally used in the headoffice, and there is direct<br clear="none">access to the files without Glusterfs. So I don't know.<br clear="none"><br clear="none">With regards,<br clear="none">Paul van der Vlis<br clear="none"><br clear="none">&gt; Regards,<br clear="none">&gt; Nithya<br clear="none">&gt; <br clear="none">&gt; <br clear="none">&gt; On Wed, 15 May 2019 at 18:55, Paul van der Vlis &lt;<a shape="rect" href="mailto:paul@vandervlis.nl" rel="nofollow" target="_blank">paul@vandervlis.nl</a><br clear="none">&gt; &lt;mailto:<a shape="rect" href="mailto:paul@vandervlis.nl" rel="nofollow" target="_blank">paul@vandervlis.nl</a>&gt;&gt; wrote:<br clear="none">&gt; <br clear="none">&gt;&nbsp; &nbsp;  Hello Strahil,<br clear="none">&gt; <br clear="none">&gt;&nbsp; &nbsp;  Thanks for your answer. I don't find the word "sharding" in the<br clear="none">&gt;&nbsp; &nbsp;  configfiles. There is not much shared data (24GB), and only 1 brick:<br clear="none">&gt;&nbsp; &nbsp;  ---<br clear="none">&gt;&nbsp; &nbsp;  <a shape="rect" href="mailto:root@xxx" rel="nofollow" target="_blank">root@xxx</a>:/etc/glusterfs# gluster volume info DATA<br clear="none">&gt; <br clear="none">&gt;&nbsp; &nbsp;  Volume Name: DATA<br clear="none">&gt;&nbsp; &nbsp;  Type: Distribute<br clear="none">&gt;&nbsp; &nbsp;  Volume ID: db53ece1-5def-4f7c-b59d-3a230824032a<br clear="none">&gt;&nbsp; &nbsp;  Status: Started<br clear="none">&gt;&nbsp; &nbsp;  Snapshot Count: 0<br clear="none">&gt;&nbsp; &nbsp;  Number of Bricks: 1<br clear="none">&gt;&nbsp; &nbsp;  Transport-type: tcp<br clear="none">&gt;&nbsp; &nbsp;  Bricks:<br clear="none">&gt;&nbsp; &nbsp;  Brick1: xxx-vpn:/DATA<br clear="none">&gt;&nbsp; &nbsp;  Options Reconfigured:<br clear="none">&gt;&nbsp; &nbsp;  transport.address-family: inet<br clear="none">&gt;&nbsp; &nbsp;  nfs.disable: on<br clear="none">&gt;&nbsp; &nbsp;  ----<br clear="none">&gt;&nbsp; &nbsp;  (I have edited this a bit for privacy of my customer).<br clear="none">&gt; <br clear="none">&gt;&nbsp; &nbsp;  I think they have used glusterfs because it can do ACLs.<br clear="none">&gt; <br clear="none">&gt;&nbsp; &nbsp;  With regards,<br clear="none">&gt;&nbsp; &nbsp;  Paul van der Vlis<br clear="none">&gt; <br clear="none">&gt; <br clear="none">&gt;&nbsp; &nbsp;  Op 15-05-19 om 14:59 schreef Strahil Nikolov:<br clear="none">&gt;&nbsp; &nbsp;  &gt; Most probably you use sharding , which splits the files into smaller<br clear="none">&gt;&nbsp; &nbsp;  &gt; chunks so you can fit a 1TB file into gluster nodes with bricks of<br clear="none">&gt;&nbsp; &nbsp;  &gt; smaller size.<br clear="none">&gt;&nbsp; &nbsp;  &gt; So if you have 2 dispersed servers each having 500Gb brick-&gt;&nbsp; without<br clear="none">&gt;&nbsp; &nbsp;  &gt; sharding you won't be able to store files larger than the brick size -<br clear="none">&gt;&nbsp; &nbsp;  &gt; no matter you have free space on the other server.<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; When sharding is enabled - you will see on the brick the first<br clear="none">&gt;&nbsp; &nbsp;  shard as<br clear="none">&gt;&nbsp; &nbsp;  &gt; a file and the rest is in a hidden folder called ".shards" (or<br clear="none">&gt;&nbsp; &nbsp;  something<br clear="none">&gt;&nbsp; &nbsp;  &gt; like that).<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; The benefit is also viewable when you need to do some maintenance on a<br clear="none">&gt;&nbsp; &nbsp;  &gt; gluster node, as you will need to heal only the shards containing<br clear="none">&gt;&nbsp; &nbsp;  &gt; modified by the customers' data.<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; Best Regards,<br clear="none">&gt;&nbsp; &nbsp;  &gt; Strahil Nikolov<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; В сряда, 15 май 2019 г., 7:31:39 ч. Гринуич-4, Paul van der Vlis<br clear="none">&gt;&nbsp; &nbsp;  &gt; &lt;<a shape="rect" href="mailto:paul@vandervlis.nl" rel="nofollow" target="_blank">paul@vandervlis.nl</a> &lt;mailto:<a shape="rect" href="mailto:paul@vandervlis.nl" rel="nofollow" target="_blank">paul@vandervlis.nl</a>&gt;&gt; написа:<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; Hello,<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; I am the new sysadmin of an organization what uses Glusterfs.<br clear="none">&gt;&nbsp; &nbsp;  &gt; I did not set it up, and I don't know much about Glusterfs.<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; What I do not understand is that I do not see all data in the mount.<br clear="none">&gt;&nbsp; &nbsp;  &gt; Not as root, not as a normal user who has privileges.<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; When I do "ls" in one of the subdirectories I don't see any data, but<br clear="none">&gt;&nbsp; &nbsp;  &gt; this data exists at the server!<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; In another subdirectory I see everything fine, the rights of the<br clear="none">&gt;&nbsp; &nbsp;  &gt; directories and files inside are the same.<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; I mount with something like:<br clear="none">&gt;&nbsp; &nbsp;  &gt; /bin/mount -t glusterfs -o acl 10.8.0.1:/data /data<br clear="none">&gt;&nbsp; &nbsp;  &gt; I see data in /data/VOORBEELD/, and I don't see any data in<br clear="none">&gt;&nbsp; &nbsp;  /data/ALGEMEEN/.<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; I don't see something special in /etc/exports or in /etc/glusterfs on<br clear="none">&gt;&nbsp; &nbsp;  &gt; the server.<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; Is there maybe a mechanism in Glusterfs what can exclude data from<br clear="none">&gt;&nbsp; &nbsp;  &gt; export?&nbsp; Or is there a way to debug this problem?<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; With regards,<br clear="none">&gt;&nbsp; &nbsp;  &gt; Paul van der Vlis<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; ----<br clear="none">&gt;&nbsp; &nbsp;  &gt; # file: VOORBEELD<br clear="none">&gt;&nbsp; &nbsp;  &gt; # owner: root<br clear="none">&gt;&nbsp; &nbsp;  &gt; # group: secretariaat<br clear="none">&gt;&nbsp; &nbsp;  &gt; # flags: -s-<br clear="none">&gt;&nbsp; &nbsp;  &gt; user::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; group::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; group:medewerkers:r-x<br clear="none">&gt;&nbsp; &nbsp;  &gt; mask::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; other::---<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:user::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:group::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:group:medewerkers:r-x<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:mask::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:other::---<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; # file: ALGEMEEN<br clear="none">&gt;&nbsp; &nbsp;  &gt; # owner: root<br clear="none">&gt;&nbsp; &nbsp;  &gt; # group: secretariaat<br clear="none">&gt;&nbsp; &nbsp;  &gt; # flags: -s-<br clear="none">&gt;&nbsp; &nbsp;  &gt; user::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; group::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; group:medewerkers:r-x<br clear="none">&gt;&nbsp; &nbsp;  &gt; mask::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; other::---<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:user::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:group::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:group:medewerkers:r-x<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:mask::rwx<br clear="none">&gt;&nbsp; &nbsp;  &gt; default:other::---<br clear="none">&gt;&nbsp; &nbsp;  &gt; ------<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; --<br clear="none">&gt;&nbsp; &nbsp;  &gt; Paul van der Vlis Linux systeembeheer Groningen<br clear="none">&gt;&nbsp; &nbsp;  &gt; <a shape="rect" href="https://www.vandervlis.nl/" rel="nofollow" target="_blank">https://www.vandervlis.nl/</a><br clear="none">&gt;&nbsp; &nbsp;  &gt; _______________________________________________<br clear="none">&gt;&nbsp; &nbsp;  &gt; Gluster-users mailing list<br clear="none">&gt;&nbsp; &nbsp;  &gt; <a shape="rect" href="mailto:Gluster-users@gluster.org" rel="nofollow" target="_blank">Gluster-users@gluster.org</a> &lt;mailto:<a shape="rect" href="mailto:Gluster-users@gluster.org" rel="nofollow" target="_blank">Gluster-users@gluster.org</a>&gt;<br clear="none">&gt;&nbsp; &nbsp;  &lt;mailto:<a shape="rect" href="mailto:Gluster-users@gluster.org" rel="nofollow" target="_blank">Gluster-users@gluster.org</a> &lt;mailto:<a shape="rect" href="mailto:Gluster-users@gluster.org" rel="nofollow" target="_blank">Gluster-users@gluster.org</a>&gt;&gt;<br clear="none">&gt;&nbsp; &nbsp;  &gt; <a shape="rect" href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="nofollow" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><div class="ydp8edf2bd0yqt4897236767" id="ydp8edf2bd0yqtfd69292"><br clear="none">&gt; <br clear="none">&gt; <br clear="none">&gt; <br clear="none">&gt;&nbsp; &nbsp;  -- <br clear="none">&gt;&nbsp; &nbsp;  Paul van der Vlis Linux systeembeheer Groningen<br clear="none">&gt;&nbsp; &nbsp;  <a shape="rect" href="https://www.vandervlis.nl/" rel="nofollow" target="_blank">https://www.vandervlis.nl/</a><br clear="none">&gt;&nbsp; &nbsp;  _______________________________________________<br clear="none">&gt;&nbsp; &nbsp;  Gluster-users mailing list<br clear="none">&gt;&nbsp; &nbsp;  <a shape="rect" href="mailto:Gluster-users@gluster.org" rel="nofollow" target="_blank">Gluster-users@gluster.org</a> &lt;mailto:<a shape="rect" href="mailto:Gluster-users@gluster.org" rel="nofollow" target="_blank">Gluster-users@gluster.org</a>&gt;<br clear="none">&gt;&nbsp; &nbsp;  <a shape="rect" href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="nofollow" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a><br clear="none">&gt; <br clear="none"><br clear="none"><br clear="none"><br clear="none">-- <br clear="none">Paul van der Vlis Linux systeembeheer Groningen<br clear="none"><a shape="rect" href="https://www.vandervlis.nl/" rel="nofollow" target="_blank">https://www.vandervlis.nl/</a><br clear="none">_______________________________________________<br clear="none">Gluster-users mailing list<br clear="none"><a shape="rect" href="mailto:Gluster-users@gluster.org" rel="nofollow" target="_blank">Gluster-users@gluster.org</a><br clear="none"><a shape="rect" href="https://lists.gluster.org/mailman/listinfo/gluster-users" rel="nofollow" target="_blank">https://lists.gluster.org/mailman/listinfo/gluster-users</a></div></div></div>
            </div>
        </div></body></html>