[Gluster-users] [Gluster-devel] Fwd: dht_is_subvol_filled messages on client

[Serkan Çoban]

Hi, Can anyone suggest something for this issue? df, du has no issue
for the bricks yet one subvolume not being used by gluster..

On Wed, May 4, 2016 at 4:40 PM, Serkan Çoban <cobanserkan at gmail.com> wrote:
> Hi,
>
> I changed cluster.min-free-inodes to "0". Remount the volume on
> clients. inode full messages not coming to syslog anymore but I see
> disperse-56 subvolume still not being used.
> Anything I can do to resolve this issue? Maybe I can destroy and
> recreate the volume but I am not sure It will fix this issue...
> Maybe the disperse size 16+4 is too big should I change it to 8+2?
>
> On Tue, May 3, 2016 at 2:36 PM, Serkan Çoban <cobanserkan at gmail.com> wrote:
>> I also checked the df output all 20 bricks are same like below:
>> /dev/sdu1 7.3T 34M 7.3T 1% /bricks/20
>>
>> On Tue, May 3, 2016 at 1:40 PM, Raghavendra G <raghavendra at gluster.com> wrote:
>>>
>>>
>>> On Mon, May 2, 2016 at 11:41 AM, Serkan Çoban <cobanserkan at gmail.com> wrote:
>>>>
>>>> >1. What is the out put of du -hs <back-end-export>? Please get this
>>>> > information for each of the brick that are part of disperse.
>>>
>>>
>>> Sorry. I needed df output of the filesystem containing brick. Not du. Sorry
>>> about that.
>>>
>>>>
>>>> There are 20 bricks in disperse-56 and the du -hs output is like:
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 1.8M /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>> 80K /bricks/20
>>>>
>>>> I see that gluster is not writing to this disperse set. All other
>>>> disperse sets are filled 13GB but this one is empty. I see directory
>>>> structure created but no files in directories.
>>>> How can I fix the issue? I will try to rebalance but I don't think it
>>>> will write to this disperse set...
>>>>
>>>>
>>>>
>>>> On Sat, Apr 30, 2016 at 9:22 AM, Raghavendra G <raghavendra at gluster.com>
>>>> wrote:
>>>> >
>>>> >
>>>> > On Fri, Apr 29, 2016 at 12:32 AM, Serkan Çoban <cobanserkan at gmail.com>
>>>> > wrote:
>>>> >>
>>>> >> Hi, I cannot get an answer from user list, so asking to devel list.
>>>> >>
>>>> >> I am getting [dht-diskusage.c:277:dht_is_subvol_filled] 0-v0-dht:
>>>> >> inodes on subvolume 'v0-disperse-56' are at (100.00 %), consider
>>>> >> adding more bricks.
>>>> >>
>>>> >> message on client logs.My cluster is empty there are only a couple of
>>>> >> GB files for testing. Why this message appear in syslog?
>>>> >
>>>> >
>>>> > dht uses disk usage information from backend export.
>>>> >
>>>> > 1. What is the out put of du -hs <back-end-export>? Please get this
>>>> > information for each of the brick that are part of disperse.
>>>> > 2. Once you get du information from each brick, the value seen by dht
>>>> > will
>>>> > be based on how cluster/disperse aggregates du info (basically statfs
>>>> > fop).
>>>> >
>>>> > The reason for 100% disk usage may be,
>>>> > In case of 1, backend fs might be shared by data other than brick.
>>>> > In case of 2, some issues with aggregation.
>>>> >
>>>> >> Is is safe to
>>>> >> ignore it?
>>>> >
>>>> >
>>>> > dht will try not to have data files on the subvol in question
>>>> > (v0-disperse-56). Hence lookup cost will be two hops for files hashing
>>>> > to
>>>> > disperse-56 (note that other fops like read/write/open still have the
>>>> > cost
>>>> > of single hop and dont suffer from this penalty). Other than that there
>>>> > is
>>>> > no significant harm unless disperse-56 is really running out of space.
>>>> >
>>>> > regards,
>>>> > Raghavendra
>>>> >
>>>> >> _______________________________________________
>>>> >> Gluster-devel mailing list
>>>> >> Gluster-devel at gluster.org
>>>> >> http://www.gluster.org/mailman/listinfo/gluster-devel
>>>> >
>>>> >
>>>> >
>>>> >
>>>> > --
>>>> > Raghavendra G
>>>> _______________________________________________
>>>> Gluster-devel mailing list
>>>> Gluster-devel at gluster.org
>>>> http://www.gluster.org/mailman/listinfo/gluster-devel
>>>
>>>
>>>
>>>
>>> --
>>> Raghavendra G