<div dir="ltr"><div><div><div>Sorry about the late reply, I missed seeing your mail.<br><br></div>To begin with, what is your use-case? Sharding is currently supported only for virtual machine image storage use-case.<br>It *could* work in other single-writer use-cases but it's only tested thoroughly for the vm use-case.<br></div><div>If yours is not a vm store use-case, you might want to do some tests first to see if it works fine.<br></div><div>If you find any issues, you can raise a bug. I'll be more than happy to fix them.<br></div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Apr 13, 2018 at 1:19 AM, Andreas Davour <span dir="ltr"><<a href="mailto:ante@update.uu.se" target="_blank">ante@update.uu.se</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">On Tue, 3 Apr 2018, Raghavendra Gowdappa wrote:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
On Mon, Apr 2, 2018 at 11:37 PM, Andreas Davour <<a href="mailto:ante@update.uu.se" target="_blank">ante@update.uu.se</a>> wrote:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
On Mon, 2 Apr 2018, Nithya Balachandran wrote:<br>
<br>
On 2 April 2018 at 14:48, Andreas Davour <<a href="mailto:ante@update.uu.se" target="_blank">ante@update.uu.se</a>> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hi<br>
<br>
I've found something that works so weird I'm certain I have missed how<br>
gluster is supposed to be used, but I can not figure out how. This is my<br>
scenario.<br>
<br>
I have a volume, created from 16 nodes, each with a brick of the same<br>
size. The total of that volume thus is in the Terabyte scale. It's a<br>
distributed volume with a replica count of 2.<br>
<br>
The filesystem when mounted on the clients is not even close to getting<br>
full, as displayed by 'df'.<br>
<br>
But, when one of my users try to copy a file from another network storage<br>
to the gluster volume, he gets a 'filesystem full' error. What happened?<br>
I<br>
looked at the bricks and figured out that one big file had ended up on a<br>
brick that was half full or so, and the big file did not fit in the space<br>
that was left on that brick.<br>
<br>
</blockquote>
Hi,<br>
<br>
This is working as expected. As files are not split up (unless you are<br>
using shards) the size of the file is restricted by the size of the<br>
individual bricks.<br>
<br>
</blockquote>
<br>
Thanks a lot for that definitive answer. Is there a way to manage this?<br>
Can you shard just those files, making them replicated in the process?<br></blockquote></blockquote></div></div></blockquote><div><br></div><div>Is your question about whether you can shard just that big file that caused space to run out and keep the rest of the files unsharded?<br>This is a bit tricky. From the time you enable sharding on your volume, all newly created shards will get sharded once their size<br>exceeds features.shard-block-size value (which is configurable) because it's a volume-wide option.<br><br></div><div>As for volumes which have pre-existing data even before shard is enabled, for you to shard them, you'll need to perform either of the two steps below:<br><br><div>1. move the existing file to a local fs from your glusterfs volume and then move it back into the volume.<br></div><div>2. copy the existing file into a temporary file on the same volume and rename the file back to its original name.<br><br></div><div>-Krutika</div><br></div><div><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
</blockquote>
<br>
+Krutika, xlator/shard maintainer for the answer.<br>
<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
I just can't have users see 15TB free and fail copying a 15GB file. They<br>
will show me the bill they paid for those "disks" and flay me.<br>
</blockquote></blockquote>
<br></div></div>
Any input on that Krutika?<span class="HOEnZb"><font color="#888888"><br>
<br>
/andreas</font></span><div class="HOEnZb"><div class="h5"><br>
--<br>
"economics is a pseudoscience; the astrology of our time"<br>
Kim Stanley Robinson<br>
</div></div></blockquote></div><br></div></div>