[Gluster-devel] tests/bugs/tier/bug-1286974.t failed and dropped a core

[Pranith Kumar Karampuri]

On 01/13/2016 09:14 AM, Dan Lambright wrote:
>
> ----- Original Message -----
>> From: "Niels de Vos" <ndevos at redhat.com>
>> To: "Dan Lambright" <dlambrig at redhat.com>, "Joseph Fernandes" <josferna at redhat.com>
>> Cc: gluster-devel at gluster.org
>> Sent: Tuesday, January 12, 2016 3:52:51 PM
>> Subject: tests/bugs/tier/bug-1286974.t failed and dropped a core
>>
>> Hi guys,
>>
>> could you please have a look at this regression test failure?
> Pranith, could you or someone with EC expertise help us diagnose this problem?
>
> The test script does:
>
> TEST touch /mnt/glusterfs/0/file{1..100};
>
> I see some number of errors such as:
>
> [2016-01-12 20:14:26.888412] E [MSGID: 122063] [ec-common.c:943:ec_prepare_update_cbk] 0-patchy-disperse-0: Unable to get size xattr [No such file or directory]
> [2016-01-12 20:14:26.888493] E [MSGID: 109031] [dht-linkfile.c:301:dht_linkfile_setattr_cbk] 0-patchy-tier-dht: Failed to set attr uid/gid on /file28 :<gfid:00000000-0000-0000-
> 0000-000000000000>  [No such file or directory]
>
> .. right before the crash. The backtrace is in mnt-glusterfs-0.log, it failed in ec function ec_manager_setattr().
>
> It appears to be an assert, if I found the code right.
>
>                      GF_ASSERT(ec_get_inode_size(fop,
>                                                  fop->locks[0].lock->loc.inode,
>                                                  &cbk->iatt[0].ia_size));
>
> /lib64/libc.so.6(+0x2b74e)[0x7f84c62a974e]
> /lib64/libc.so.6(__assert_perror_fail+0x0)[0x7f84c62a9810]
> /build/install/lib/glusterfs/3.8dev/xlator/cluster/disperse.so(+0x312f5)[0x7f84ba5ce2f5]
> /build/install/lib/glusterfs/3.8dev/xlator/cluster/disperse.so(+0x14918)[0x7f84ba5b1918]
> /build/install/lib/glusterfs/3.8dev/xlator/cluster/disperse.so(+0x10756)[0x7f84ba5ad756]
> /build/install/lib/glusterfs/3.8dev/xlator/cluster/disperse.so(+0x1093c)[0x7f84ba5ad93c]
> /build/install/lib/glusterfs/3.8dev/xlator/cluster/disperse.so(+0x2fbe0)[0x7f84ba5ccbe0]
> /build/install/lib/glusterfs/3.8dev/xlator/cluster/disperse.so(+0x30ea9)[0x7f84ba5cdea9]
> /build/install/lib/glusterfs/3.8dev/xlator/protocol/client.so(+0x1f706)[0x7f84ba854706]
> /build/install/lib/libgfrpc.so.0(rpc_clnt_handle_reply+0x1b2)[0x7f84c74e542a]

This is because dht sents setattr on an inode that is not linked. For 
now we are addressing it in EC with http://review.gluster.com/13039. 
Regressions need to pass.

Pranith

>
>>      https://build.gluster.org/job/rackspace-regression-2GB-triggered/17475/consoleFull
>>
>>      [20:14:46] ./tests/bugs/tier/bug-1286974.t ..
>>      not ok 16
>>      Failed 1/24 subtests
>>      [20:14:46]
>>      
>>      Test Summary Report
>>      -------------------
>>      ./tests/bugs/tier/bug-1286974.t (Wstat: 0 Tests: 24 Failed: 1)
>>        Failed test:  16
>>      Files=1, Tests=24, 37 wallclock secs ( 0.03 usr  0.01 sys +  2.38 cusr
>>      0.77 csys =  3.19 CPU)
>>      Result: FAIL
>>      ./tests/bugs/tier/bug-1286974.t: bad status 1
>>      ./tests/bugs/tier/bug-1286974.t: 1 new core files
>>      Ignoring failure from known-bad test ./tests/bugs/tier/bug-1286974.t
>>
>> Failures are ignored as mentioned in the last line, but cores are not
>> allowed. Please prevent this from happening :)
>>
>> Thanks,
>> Niels
>>