[Gluster-devel] Tests failing for distributed regression framework

[Shyam Ranganathan]

On 07/18/2018 05:42 AM, Deepshikha Khandelwal wrote:
> Hi all,
> 
> There are tests which have been constantly failing for distributed
> regression framework[1]. I would like to draw the maintainer's
> attention to look at these two bugs[2]&[3] and help us to attain the
> RCA for such failures.
> 
> Until then, we're disabling these two blocking tests.
> 
> [1] https://build.gluster.org/job/distributed-regression/
> [2] https://bugzilla.redhat.com/show_bug.cgi?id=1602282
> [3] https://bugzilla.redhat.com/show_bug.cgi?id=1602262

Bug updated with current progress:
https://bugzilla.redhat.com/show_bug.cgi?id=1602262#c1

Pasting it here for others to chime in based on past experience if any.

<snip>
This fails as follows,
=========================
TEST 52 (line 37): ln /mnt/glusterfs/0/file1 /mnt/glusterfs/0/file44
ln: failed to create hard link ‘/mnt/glusterfs/0/file44’: No space left
on device
RESULT 52: 1
=========================
(continues till the last file) IOW, file44-file50 fail creation
=========================
TEST 58 (line 37): ln /mnt/glusterfs/0/file1 /mnt/glusterfs/0/file50
ln: failed to create hard link ‘/mnt/glusterfs/0/file50’: No space left
on device
RESULT 58: 1
=========================

Post this the failures are due to attempts to inspect these files for
metadata and attrs and such, so the failures are due to the above.

At first I suspected max-hardlink setting, but this is at a default of
100, and we do not use any specific site.h or tuning when running in the
distributed environment (as far as I can tell).

Also, the test, when it fails, has only created 1 empty file and 42
links to the same, this should not cause the bricks to run out of space.

The Gluster logs till now did not throw up any surprises, or causes.
</snip>

> 
> Thanks,
> Deepshikha Khandelwal
> _______________________________________________
> Gluster-devel mailing list
> Gluster-devel at gluster.org
> https://lists.gluster.org/mailman/listinfo/gluster-devel
>