<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On 2 April 2018 at 14:48, Andreas Davour <span dir="ltr"><<a href="mailto:ante@update.uu.se" target="_blank">ante@update.uu.se</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><br>
Hi<br>
<br>
I've found something that works so weird I'm certain I have missed how gluster is supposed to be used, but I can not figure out how. This is my scenario.<br>
<br>
I have a volume, created from 16 nodes, each with a brick of the same size. The total of that volume thus is in the Terabyte scale. It's a distributed volume with a replica count of 2.<br>
<br>
The filesystem when mounted on the clients is not even close to getting full, as displayed by 'df'.<br>
<br>
But, when one of my users try to copy a file from another network storage to the gluster volume, he gets a 'filesystem full' error. What happened? I looked at the bricks and figured out that one big file had ended up on a brick that was half full or so, and the big file did not fit in the space that was left on that brick.<br></blockquote><div><br></div><div>Hi,</div><div><br></div><div>This is working as expected. As files are not split up (unless you are using shards) the size of the file is restricted by the size of the individual bricks.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
This resulted in the absurd situation that the user could see a filesystem with massive amount of free space, but still got a filesystem full error.<br>
<br></blockquote><div>This is misleading, yes. Do you have any numbers for the size of the file vs the size of the brick?</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
The only workaround I've found is to set some values for max free size, but this is a very wonky solution, as those values will fluctuate as the filesystem is used. </blockquote><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
Surely I'm missing something obvious? A filesystem that has much free space should not randomly give an error like that?<br>
<br>
Interested to hear some best practices for this kind of stuff.<br>
<br>
/andreas<br>
<br>
--<br>
"economics is a pseudoscience; the astrology of our time"<br>
Kim Stanley Robinson<br>
______________________________<wbr>_________________<br>
Gluster-users mailing list<br>
<a href="mailto:Gluster-users@gluster.org" target="_blank">Gluster-users@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/gluster-users" rel="noreferrer" target="_blank">http://lists.gluster.org/mailm<wbr>an/listinfo/gluster-users</a><br>
</blockquote></div><br></div></div>