[Gluster-users] Corrupted Data From Rsync

[Timothy Orme]

Hi All,

I'm seeing some weird "corruption" like behavior on some binary files that I rysnced to gluster from a different NFS server.

Basically, the file contents are the same, except the destination file in gluster is actually larger than it's source, and is padded with 0 bytes at the end.

I'm suspecting some weird cache behavior but am unsure.  When I initially tried to rsync the file a second time, it still remained with the padded bytes:

[torme at ip-10-10-10-10 ~]$ ls -al /source/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 13 03:14 /source/test.bin
[torme at ip-10-10-10-10 ~]$ ls -al /gluster/test.bin
-rw-rw-r--. 1 torme torme 10404924291 Nov 19 15:58 /gluster/test.bin
[torme at ip-10-10-10-10 ~]$ sudo rsync -av /source/test.bin /gluster/test.bin
sending incremental file list
test.bin

sent 10,406,940,246 bytes  received 35 bytes  174,906,559.34 bytes/sec
total size is 10,404,400,003  speedup is 1.00
[torme at ip-10-10-10-10 ~]$ ls -al /source/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 13 03:14 /source/test.bin
[torme at ip-10-10-10-10 ~]$ ls -al /gluster/test.bin
-rw-rw-r--. 1 torme torme 10404924291 Nov 19 15:58 /gluster/test.bin

You can see the source is still only 10404400003 bytes whereas the gluster copy is 10404924291 bytes.

Copying the file to a different location did the correct operation:

[torme at ip-10-10-10-10 ~]$ sudo cp /source/test.bin /gluster/test.bin.test
[torme at ip-10-10-10-10 ~]$ ls -al /gluster/
-rw-rw-r--. 1 torme torme 10404924291 Nov 19 15:58 /gluster/test.bin
-rw-r--r--. 1 torme torme 10404400003 Nov 19 17:35 /gluster/test.bin.test

When I waited a bit, and retried the rsync command again however, it worked correctly:

[torme at ip-10-10-10-10 ~]$ ls -al /source/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 13 03:14 /source/test.bin
[torme at ip-10-10-10-10 ~]$ ls -al /gluster/test.bin
-rw-rw-r--. 1 torme torme 10404924291 Nov 19 15:58 /gluster/test.bin
[torme at ip-10-10-10-10 ~]$ sudo rsync -av /source/test.bin /gluster/test.bin
sending incremental file list
test.bin

sent 10,406,940,246 bytes  received 35 bytes  174,906,559.34 bytes/sec
total size is 10,404,400,003  speedup is 1.00
[torme at ip-10-10-10-10 ~]$ ls -al /source/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 13 03:14 /source/test.bin
[torme at ip-10-10-10-10 ~]$ ls -al /gluster/test.bin
-rw-rw-r--. 1 torme torme 10404400003 Nov 19 15:58 /gluster/test.bin

So it seems that after some time things are fixed. Any idea what might be causing this?

Let me know what settings are helpful and I can provide them!

Thanks,
Tim
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-users/attachments/20191120/c2c74302/attachment.html>