[Gluster-devel] Patch 290 breaks df -h calc on some clients.

Amar S. Tumballi amar at zresearch.com
Tue Jul 10 15:02:19 UTC 2007


Hi Harris,
 Thanks for giving this strace output.

Actually the bug is not in glusterfs's statfs(), but is in the way the 'df'
works in old version and new version.
In new version, it gets every information from statfs() only, where it works
fine. But with Gentoo (ie, the old coreutils), it gets f_bfree field (or say
st_blksize from stat()) is taken from stat(), where it is different as fuse
overrides the values sent by us to 4096.
This reduces your storage's size by 256 times. This change in statfs was
brought as to enhance the read/write as few applications send buffers
depending on this field.

Anyways, reverting it back to how it was earlier. So it should work fine
now. (patch-292)

-amar


On 7/10/07, Harris Landgarten <harrisl at lhjonline.com> wrote:
>
> Relevant strace output.
>
> Ubuntu
>
> statfs64("/mnt/glusterfs", 84, {f_type=0x65735546, f_bsize=1048576,
> f_blocks=300616, f_bfree=278894, f_bavail=263624, f_files=39092224,
> f_ffree=38579410, f_fsid={0, 0}, f_namelen=255,0
> write(1, "glusterfs             294G   22G"..., 59glusterfs
> 294G   22G  258G   8% /mnt/glusterfs
>
> Gentoo
>
> statfs64("/mnt/glusterfs", 84, {f_type=0x65735546, f_bsize=1048576,
> f_blocks=300616, f_bfree=278894, f_bavail=263624, f_files=39092224,
> f_ffree=38579410, f_fsid={0, 0}, f_namelen=255, f_frsize=4096}) = 0
> stat64("/mnt/glusterfs", {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
> open("/proc/mounts", O_RDONLY)          = 3
> fstat64(3, {st_mode=S_IFREG|0444, st_size=0, ...}) = 0
> mmap2(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0)
> = 0xb7fae000
> read(3, "rootfs / rootfs rw 0 0\n/dev/root"..., 1024) = 503
> stat64("/mnt/glusterfs", {st_mode=S_IFDIR|0777, st_size=4096, ...}) = 0
> close(3)                                = 0
> munmap(0xb7fae000, 4096)                = 0
> write(1, "glusterfs             1.2G   85M"..., 59glusterfs
> 1.2G   85M  1.1G   8% /mnt/glusterfs
>
> Harris
>
> ----- Original Message -----
> From: "Harris Landgarten" <harrisl at lhjonline.com>
> To: "Harris Landgarten" <harrisl at lhjonline.com>
> Cc: "gluster-devel" <gluster-devel at nongnu.org>
> Sent: Tuesday, July 10, 2007 10:04:35 AM (GMT-0500) America/New_York
> Subject: Re: [Gluster-devel] Patch 290 breaks df -h calc on some clients.
>
> Ubuntu client is running coreutils-5.96. The Gentoo client is running
> coreutils-6.9-r1
>
> Harris
>
> ----- Original Message -----
> From: "Harris Landgarten" <harrisl at lhjonline.com>
> To: "gluster-devel" <gluster-devel at nongnu.org>
> Sent: Tuesday, July 10, 2007 9:06:46 AM (GMT-0500) America/New_York
> Subject: [Gluster-devel] Patch 290 breaks df -h calc on some clients.
>
> After upgrading all servers and clients to patch 290
>
> Ubuntu-6.06 client
>
> glusterfs             294G   22G  258G   8% /mnt/glusterfs
>
> This is correct.
>
> Gentoo client
>
> glusterfs             1.2G   85M  1.1G   8% /mnt/glusterfs
>
> This bug was fixed earlier and is now broken again.
>
>
> Harris
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>
>
>
>
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at nongnu.org
> http://lists.nongnu.org/mailman/listinfo/gluster-devel
>



-- 
Amar Tumballi
http://amar.80x25.org
[bulde on #gluster/irc.gnu.org]



More information about the Gluster-devel mailing list