[Gluster-devel] Strange Error

[Ruslan Bondar]

Hi,

 We found something strange with new glusterfs-2.0.0rc1. Previously, we worked 
on 1.3.12, and some time ago upgraded to 2.0.0.

So our configuration is 2 web servers web1 and web2. On gluster we store only 
webscripts, for High Availability, in case one server down. Glusterfs 
configured in simple single process AFR. All changes we made on first server 
(web1).

After some time we found that some script files on _second_ server have 
content of other files.
Making diff of all files md5sum show some files have different checksum on 
different servers. But this checksums have other files on glusterfs tree. For 
examples 
file 
Web1: /gluster/joinus.php 954fdb7686c1a8836b863fa8a09deeb8
Web1: /gluster/lib.php    9cd1fb4db6021d37f3098d361b089f65
Web2: /gluster/joinus.php 9cd1fb4db6021d37f3098d361b089f65
Web2: /gluster/lib.php    9cd1fb4db6021d37f3098d361b089f65

If we open joinus.php and lib.php they are the same on web2, but on web1 this 
file is different.

The way that this conflict can be solved is:
web1# mv joinus.php joinus.php1
web2# mv joinus.php1 joinus.php

after this we have:
Web1: /gluster/joinus.php 954fdb7686c1a8836b863fa8a09deeb8
Web2: /gluster/joinus.php 954fdb7686c1a8836b863fa8a09deeb8

In logs i found nothing.

Our gluster config web1:
++++++++++++++++++++++++++++++++++
# file: /etc/glusterfs/glusterfs-client.vol
volume store
  type storage/posix
  option directory /export/storage0/glusterfs-test
end-volume

volume store-lock
  type features/posix-locks
  subvolumes store
end-volume

volume brick1
  type performance/io-threads
  option thread-count 4
  subvolumes store-lock
end-volume

volume outserver
  type protocol/server
  option transport-type tcp/server
  option auth.addr.brick1.allow *
  subvolumes brick1
end-volume

volume remote2
  type protocol/client
  option transport-type tcp/client
  option transport-timeout 5
  option remote-host web2
  option remote-subvolume brick2
end-volume

volume server
  type cluster/afr
  subvolumes remote2 brick1
  option read-subvolume brick1
end-volume
+++++++++++++++++++++++++++++++++++++

gluster on web2:
+++++++++++++++++++++++++++++++++++++
# file: /etc/glusterfs/glusterfs-client.vol

volume store
  type storage/posix
  option directory /export/storage0/glusterfs-test
end-volume

volume store-lock
  type features/posix-locks
  subvolumes store
end-volume

volume brick2
  type performance/io-threads
  option thread-count 4
  subvolumes store-lock
end-volume

volume outserver
  type protocol/server
  option transport-type tcp/server
  option auth.addr.brick2.allow *
  subvolumes brick2
end-volume

volume remote1
  type protocol/client
  option transport-type tcp/client
  option transport-timeout 5
  option remote-host web1
  option remote-subvolume brick1
end-volume

volume server
  type cluster/afr
  subvolumes brick2 remote1
  option read-subvolume brick2
end-volume
+++++++++++++++++++++++++++++++++++++


-- 
Best regards,
  Ruslan Bondar
  Ext: 21111
  Skype: b0rland
  mailto:rus at iq-labs.net