[Gluster-users] Files end up on both sides of Unify, a bug ?

[Lior Goikhburg]

Hello.

Got a production environment (glusterfs 2.0.0rc1) with 4 servers: 2 
pairs of AFR'ed servers and Unify between the pairs (raid 1+0 
functionality).
There is a problem, that some files, sometimes get written on both AFR 
pairs (all Unify nodes). Here is the log:


2009-02-10 16:38:55 W [unify-self-heal.c:1092:unify_bgsh_checksum_cbk] 
files-unify: Self-heal triggered on directory /storage/photo/96/80/4
2009-02-10 16:38:55 E [unify.c:1238:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: entry_count is 3
2009-02-10 16:38:55 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on ns-afr
2009-02-10 16:38:55 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr1
2009-02-10 16:38:55 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr2
2009-02-10 16:41:36 W [unify-self-heal.c:1092:unify_bgsh_checksum_cbk] 
files-unify: Self-heal triggered on directory /storage/photo/95/95/3
2009-02-10 16:44:21 W [unify-self-heal.c:1092:unify_bgsh_checksum_cbk] 
files-unify: Self-heal triggered on directory /storage/photo/61/01/4
2009-02-10 16:44:21 E [unify.c:1238:unify_open] files-unify: 
/storage/photo/61/01/4/2041016.jpg: entry_count is 3
2009-02-10 16:44:21 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/61/01/4/2041016.jpg: found on ns-afr
2009-02-10 16:44:21 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/61/01/4/2041016.jpg: found on files-afr1
2009-02-10 16:44:21 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/61/01/4/2041016.jpg: found on files-afr2
2009-02-10 16:45:26 W [unify-self-heal.c:1092:unify_bgsh_checksum_cbk] 
files-unify: Self-heal triggered on directory /storage/photo/16/92/3
2009-02-10 16:46:45 E [unify.c:603:unify_lookup] files-unify: 
/storage/photo/96/80/4/2040869.JPG: file count is 3
2009-02-10 16:46:45 E [unify.c:609:unify_lookup] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on ns-afr
2009-02-10 16:46:45 E [unify.c:609:unify_lookup] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr1
2009-02-10 16:46:45 E [unify.c:609:unify_lookup] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr2
2009-02-10 16:46:45 E [unify.c:1238:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: entry_count is 3
2009-02-10 16:46:45 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on ns-afr
2009-02-10 16:46:45 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr1
2009-02-10 16:46:45 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr2
2009-02-10 16:47:53 W [unify-self-heal.c:1092:unify_bgsh_checksum_cbk] 
files-unify: Self-heal triggered on directory /storage/photo/16/11/4
2009-02-10 16:49:06 W [unify-self-heal.c:1092:unify_bgsh_checksum_cbk] 
files-unify: Self-heal triggered on directory /storage/photo/80/76/3
2009-02-10 16:53:46 W [unify-self-heal.c:1092:unify_bgsh_checksum_cbk] 
files-unify: Self-heal triggered on directory /storage/photo/46/21/4
2009-02-10 16:53:46 E [unify.c:1238:unify_open] files-unify: 
/storage/photo/46/21/4/2041264.jpg: entry_count is 3
2009-02-10 16:53:46 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/46/21/4/2041264.jpg: found on files-afr1
2009-02-10 16:53:46 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/46/21/4/2041264.jpg: found on ns-afr
2009-02-10 16:53:46 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/46/21/4/2041264.jpg: found on files-afr2
2009-02-10 16:54:30 E [unify.c:603:unify_lookup] files-unify: 
/storage/photo/96/80/4/2040869.JPG: file count is 3
2009-02-10 16:54:30 E [unify.c:609:unify_lookup] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on ns-afr
2009-02-10 16:54:30 E [unify.c:609:unify_lookup] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr1
2009-02-10 16:54:30 E [unify.c:609:unify_lookup] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr2
2009-02-10 16:54:31 E [unify.c:1238:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: entry_count is 3
2009-02-10 16:54:31 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on ns-afr
2009-02-10 16:54:31 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr1
2009-02-10 16:54:31 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/96/80/4/2040869.JPG: found on files-afr2
2009-02-10 16:56:05 W [unify-self-heal.c:1092:unify_bgsh_checksum_cbk] 
files-unify: Self-heal triggered on directory /storage/photo/44/28/2
2009-02-10 16:56:06 W [unify-self-heal.c:1092:unify_bgsh_checksum_cbk] 
files-unify: Self-heal triggered on directory /storage/photo/06/31/4
2009-02-10 16:56:12 E [unify.c:603:unify_lookup] files-unify: 
/storage/photo/46/21/4/2041264.jpg: file count is 3
2009-02-10 16:56:12 E [unify.c:609:unify_lookup] files-unify: 
/storage/photo/46/21/4/2041264.jpg: found on files-afr1
2009-02-10 16:56:12 E [unify.c:609:unify_lookup] files-unify: 
/storage/photo/46/21/4/2041264.jpg: found on ns-afr
2009-02-10 16:56:12 E [unify.c:609:unify_lookup] files-unify: 
/storage/photo/46/21/4/2041264.jpg: found on files-afr2
2009-02-10 16:56:12 E [unify.c:1238:unify_open] files-unify: 
/storage/photo/46/21/4/2041264.jpg: entry_count is 3
2009-02-10 16:56:12 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/46/21/4/2041264.jpg: found on files-afr1
2009-02-10 16:56:12 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/46/21/4/2041264.jpg: found on ns-afr
2009-02-10 16:56:12 E [unify.c:1241:unify_open] files-unify: 
/storage/photo/46/21/4/2041264.jpg: found on files-afr2




The configs are here: http://glusterfs.pastebin.com/m1744a7a6

Lior.