<div dir="ltr">In April of this year I reported the problem using sharding on gluster 7.4:<br><br><div>====</div><div><div><div>We're using GlusterFS in a replicated brick setup with 2 bricks with sharding turned on (shardsize 128MB).<br><br></div>There
is something funny going on as we can see that if we copy large VM
files to the volume we can end up with files that are a bit larger than
the source files DEPENDING on the speed with which we copied the files -
e.g.:<br><br></div> dd if=SOURCE bs=1M | pv -L NNm | ssh gluster_server "dd of=/<span class="gmail-il">gluster</span>/VOL_NAME/TARGET bs=1M"<br clear="all"><div><div><div><div><br></div><div>It seems that if NN is <= 25 (i.e. 25 MB/s) the size of SOURCE and TARGET will be the same.<br><br></div><div>If
we crank NN to, say, 50 we sometimes risk that a 25G file ends up
having a slightly larger size, e.g. 26844413952 or 26844233728 - larger
than the expected 26843545600. <br>Unfortunately this is not an illusion ! If we dd the files out of <span class="gmail-il">Gluster</span> we will receive the amount of data that 'ls' showed us.</div><div><br></div><div>In
the brick directory (incl .shard directory) we have the expected amount
of shards for a 25G files (200) with size precisely equal to 128MB -
but there is an additional 0 size shard file created. <br></div><div><br></div><div>Has anyone else seen a phenomenon like this ?</div><div>====</div><div><br></div><div>After upgrade to 7.6 we're still seeing this problem - now, the extra bytes that are appearing can be removed using truncate in the mounted gluster volume, and md5sum can confirm that after truncate the content is identical to the source - however, it may point to an underlying issue.<br><br></div><div>I hope someone can reproduce this behaviour,</div><div><br></div><div>Thanx,</div><div><br></div><div>Claus.<br></div></div></div></div></div><div><div><br>-- <br><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><table style="color:rgb(51,51,51);font-family:DattoDIN,Arial,sans-serif;font-size:14px" width="650" cellspacing="0" cellpadding="0" border="0"><tbody><tr><td width="270" height="17"><b>Claus Jeppesen</b></td></tr><tr><td height="16">Manager, Network Services<br></td></tr><tr><td height="16">Datto, Inc.</td></tr><tr><td height="16">p +45 6170 5901 | Copenhagen Office<br></td></tr><tr><td height="16"><a href="http://www.datto.com/" style="color:rgb(0,128,198)" target="_blank"><span style="color:rgb(11,83,148)">www.datto.com</span></a></td></tr><tr><td height="16"><br><img src="http://www.datto.com/img/emea-email-signature.png"><br></td></tr></tbody></table></div></div></div></div></div></div></div></div></div></div></div></div></div>