[Gluster-devel] Strange Error

[Krishna Srinivas]

Ruslan,

Indeed it is a strange error. Is it an easy bug to reproduce? By the
way, don't use single process server and client, we found issues
regarding locking. If the bug is easy to reproduce you can also check
if it is seen if server and client are different processes.

Krishna

On Thu, Feb 5, 2009 at 4:25 PM, Ruslan Bondar <r.bondar at ctncorp.com> wrote:
> Hi,
>
>  We found something strange with new glusterfs-2.0.0rc1. Previously, we worked
> on 1.3.12, and some time ago upgraded to 2.0.0.
>
> So our configuration is 2 web servers web1 and web2. On gluster we store only
> webscripts, for High Availability, in case one server down. Glusterfs
> configured in simple single process AFR. All changes we made on first server
> (web1).
>
> After some time we found that some script files on _second_ server have
> content of other files.
> Making diff of all files md5sum show some files have different checksum on
> different servers. But this checksums have other files on glusterfs tree. For
> examples
> file
> Web1: /gluster/joinus.php 954fdb7686c1a8836b863fa8a09deeb8
> Web1: /gluster/lib.php    9cd1fb4db6021d37f3098d361b089f65
> Web2: /gluster/joinus.php 9cd1fb4db6021d37f3098d361b089f65
> Web2: /gluster/lib.php    9cd1fb4db6021d37f3098d361b089f65
>
> If we open joinus.php and lib.php they are the same on web2, but on web1 this
> file is different.
>
> The way that this conflict can be solved is:
> web1# mv joinus.php joinus.php1
> web2# mv joinus.php1 joinus.php
>
> after this we have:
> Web1: /gluster/joinus.php 954fdb7686c1a8836b863fa8a09deeb8
> Web2: /gluster/joinus.php 954fdb7686c1a8836b863fa8a09deeb8
>
> In logs i found nothing.
>
> Our gluster config web1:
> ++++++++++++++++++++++++++++++++++
> # file: /etc/glusterfs/glusterfs-client.vol
> volume store
>  type storage/posix
>  option directory /export/storage0/glusterfs-test
> end-volume
>
> volume store-lock
>  type features/posix-locks
>  subvolumes store
> end-volume
>
> volume brick1
>  type performance/io-threads
>  option thread-count 4
>  subvolumes store-lock
> end-volume
>
> volume outserver
>  type protocol/server
>  option transport-type tcp/server
>  option auth.addr.brick1.allow *
>  subvolumes brick1
> end-volume
>
> volume remote2
>  type protocol/client
>  option transport-type tcp/client
>  option transport-timeout 5
>  option remote-host web2
>  option remote-subvolume brick2
> end-volume
>
> volume server
>  type cluster/afr
>  subvolumes remote2 brick1
>  option read-subvolume brick1
> end-volume
> +++++++++++++++++++++++++++++++++++++
>
> gluster on web2:
> +++++++++++++++++++++++++++++++++++++
> # file: /etc/glusterfs/glusterfs-client.vol
>
> volume store
>  type storage/posix
>  option directory /export/storage0/glusterfs-test
> end-volume
>
> volume store-lock
>  type features/posix-locks
>  subvolumes store
> end-volume
>
> volume brick2
>  type performance/io-threads
>  option thread-count 4
>  subvolumes store-lock
> end-volume
>
> volume outserver
>  type protocol/server
>  option transport-type tcp/server
>  option auth.addr.brick2.allow *
>  subvolumes brick2
> end-volume
>
> volume remote1
>  type protocol/client
>  option transport-type tcp/client
>  option transport-timeout 5
>  option remote-host web1
>  option remote-subvolume brick1
> end-volume
>
> volume server
>  type cluster/afr
>  subvolumes brick2 remote1
>  option read-subvolume brick2
> end-volume
> +++++++++++++++++++++++++++++++++++++
>
>
> --
> Best regards,
>  Ruslan Bondar
>  Ext: 21111
>  Skype: b0rland
>   mailto:rus at iq-labs.net
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>