[Gluster-devel] [Gluster-users] Fwd: dht_is_subvol_filled messages on client

[Serkan Çoban]

Hi,

I checked with this(1) C program if FS is returning something wrong
but that is not the case.
I also try to understand the source code, somehow in below statement
subvol_filled_inodes sets to true.

if (conf->du_stats[i].avail_inodes <
conf->min_free_inodes) {
subvol_filled_inodes = _gf_true;
break;
}

Can I skip this if statement if I change "conf->min_free_inodes" to 0?



1- https://raw.githubusercontent.com/perusio/linux-programming-by-example/master/book/ch08/ch08-statvfs.c

On Mon, May 2, 2016 at 12:00 PM, Serkan Çoban <cobanserkan at gmail.com> wrote:
> I started a rebalace and it did not fix the issue...
>
> On Mon, May 2, 2016 at 9:11 AM, Serkan Çoban <cobanserkan at gmail.com> wrote:
>>>1. What is the out put of du -hs <back-end-export>? Please get this information for each of the brick that are part of disperse.
>> There are 20 bricks in disperse-56 and the du -hs output is like:
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 1.8M /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>> 80K /bricks/20
>>
>> I see that gluster is not writing to this disperse set. All other
>> disperse sets are filled 13GB but this one is empty. I see directory
>> structure created but no files in directories.
>> How can I fix the issue? I will try to rebalance but I don't think it
>> will write to this disperse set...
>>
>>
>>
>> On Sat, Apr 30, 2016 at 9:22 AM, Raghavendra G <raghavendra at gluster.com> wrote:
>>>
>>>
>>> On Fri, Apr 29, 2016 at 12:32 AM, Serkan Çoban <cobanserkan at gmail.com>
>>> wrote:
>>>>
>>>> Hi, I cannot get an answer from user list, so asking to devel list.
>>>>
>>>> I am getting [dht-diskusage.c:277:dht_is_subvol_filled] 0-v0-dht:
>>>> inodes on subvolume 'v0-disperse-56' are at (100.00 %), consider
>>>> adding more bricks.
>>>>
>>>> message on client logs.My cluster is empty there are only a couple of
>>>> GB files for testing. Why this message appear in syslog?
>>>
>>>
>>> dht uses disk usage information from backend export.
>>>
>>> 1. What is the out put of du -hs <back-end-export>? Please get this
>>> information for each of the brick that are part of disperse.
>>> 2. Once you get du information from each brick, the value seen by dht will
>>> be based on how cluster/disperse aggregates du info (basically statfs fop).
>>>
>>> The reason for 100% disk usage may be,
>>> In case of 1, backend fs might be shared by data other than brick.
>>> In case of 2, some issues with aggregation.
>>>
>>>> Is is safe to
>>>> ignore it?
>>>
>>>
>>> dht will try not to have data files on the subvol in question
>>> (v0-disperse-56). Hence lookup cost will be two hops for files hashing to
>>> disperse-56 (note that other fops like read/write/open still have the cost
>>> of single hop and dont suffer from this penalty). Other than that there is
>>> no significant harm unless disperse-56 is really running out of space.
>>>
>>> regards,
>>> Raghavendra
>>>
>>>> _______________________________________________
>>>> Gluster-devel mailing list
>>>> Gluster-devel at gluster.org
>>>> http://www.gluster.org/mailman/listinfo/gluster-devel
>>>
>>>
>>>
>>>
>>> --
>>> Raghavendra G