[Gluster-Maintainers] Build failed in Jenkins: regression-test-with-multiplex #689

jenkins at build.gluster.org jenkins at build.gluster.org
Thu Mar 22 12:46:51 UTC 2018


See <https://build.gluster.org/job/regression-test-with-multiplex/689/display/redirect?page=changes>

Changes:

[Gaurav Yadav] glusterd: glusterd crash in gd_mgmt_v3_unlock_timer_cbk

[Raghavendra G] cleanup: xlator_t structure's 'client_latency' variable is not used

[Jeff Darcy] glusterd: TLS verification fails while using intermediate CA

[atin] georep : Pause/Resume of geo-replication with wrong user

[Pranith Kumar K] features/shard: Do list_del_init() while list memory is valid

[Xavi Hernandez] cluster/ec: Add test cases for stripe-cache option

[Pranith Kumar K] storage/posix: Add active-fd-count option in gluster

[Pranith Kumar K] cluster/afr: Switch to active-fd-count for open-fd checks

[Xavi Hernandez] cluster/ec: fix SHD crash for null gfid's

[Niklas Hambüchen] socket: Improve error logging when loading SSL files fails

[Amar Tumballi] rpcsvc: enable ownthread feature for glusterfs4_0_fop_prog

[Raghavendra G] client: make fuse direct I/O strategies explicit

------------------------------------------
[...truncated 1.00 MB...]
#1  0x00007fd647db1a17 in posix_fsyncer_pick (this=0x7fd61c5d4590, head=0x7fd5f0deae90) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:2221
        priv = 0x7fd61ca5b870
        count = 0
#2  0x00007fd647db1d2a in posix_fsyncer (d=0x7fd61c5d4590) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:2317
        this = 0x7fd61c5d4590
        priv = 0x7fd61ca5b870
        stub = 0x0
        tmp = 0x0
        list = {next = 0x7fd5f0deae90, prev = 0x7fd5f0deae90}
        count = 0
        do_fsync = true
        __FUNCTION__ = "posix_fsyncer"
#3  0x00007fd6585b6e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007fd657e8334d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 8 (Thread 0x7fd5f15ec700 (LWP 4712)):
#0  0x00007fd6585bacf2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fd647daf829 in janitor_get_next_fd (this=0x7fd61c5d4590) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:1423
        priv = 0x7fd61ca5b870
        pfd = 0x0
        timeout = {tv_sec = 1521717021, tv_nsec = 0}
#2  0x00007fd647daf9dd in posix_janitor_thread_proc (data=0x7fd61c5d4590) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:1478
        this = 0x7fd61c5d4590
        priv = 0x7fd61ca5b870
        pfd = 0x7fd63c069f00
        now = 1521717011
        __FUNCTION__ = "posix_janitor_thread_proc"
#3  0x00007fd6585b6e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007fd657e8334d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 7 (Thread 0x7fd5f1ded700 (LWP 4711)):
#0  0x00007fd657e4a1ad in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fd657e4a044 in sleep () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007fd647db0e1d in posix_health_check_thread_proc (data=0x7fd61c5d4590) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:1973
        this = 0x7fd61c5d4590
        priv = 0x7fd61ca5b870
        interval = 30
        ret = 0
        top = 0x0
        victim = 0x0
        trav_p = 0x0
        count = 0
        victim_found = false
        ctx = 0x122e010
        __FUNCTION__ = "posix_health_check_thread_proc"
#3  0x00007fd6585b6e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007fd657e8334d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 6 (Thread 0x7fd5f25ee700 (LWP 4710)):
#0  0x00007fd657e4a1ad in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fd657e4a044 in sleep () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007fd647db175b in posix_disk_space_check_thread_proc (data=0x7fd61c5d4590) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:2153
        this = 0x7fd61c5d4590
        priv = 0x7fd61ca5b870
        interval = 5
        ret = 0
        __FUNCTION__ = "posix_disk_space_check_thread_proc"
#3  0x00007fd6585b6e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007fd657e8334d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 5 (Thread 0x7fd5f3df1700 (LWP 4701)):
#0  0x00007fd657e7a7a3 in select () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fd646c72857 in changelog_ev_dispatch (data=0x7fd61c6381b8) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/changelog/src/changelog-ev-handle.c>:351
        ret = 3
        opaque = 0x0
        this = 0x7fd61c5d8b40
        c_clnt = 0x7fd61c6381b8
        tv = {tv_sec = 0, tv_usec = 97617}
        __FUNCTION__ = "changelog_ev_dispatch"
#2  0x00007fd6585b6e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x00007fd657e8334d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 4 (Thread 0x7fd5f45f2700 (LWP 4700)):
#0  0x00007fd6585ba945 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fd646c72245 in changelog_ev_connector (data=0x7fd61c6381b8) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/changelog/src/changelog-ev-handle.c>:205
        this = 0x7fd61c5d8b40
        c_clnt = 0x7fd61c6381b8
        crpc = 0x0
        __FUNCTION__ = "changelog_ev_connector"
#2  0x00007fd6585b6e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x00007fd657e8334d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 3 (Thread 0x7fd64033b700 (LWP 4699)):
#0  0x00007fd6585ba945 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fd646a32295 in br_stub_worker (data=0x7fd61c5da490) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/bit-rot/src/stub/bit-rot-stub-helpers.c>:327
        priv = 0x7fd61c6311d0
        this = 0x7fd61c5da490
        stub = 0x0
#2  0x00007fd6585b6e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x00007fd657e8334d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 2 (Thread 0x7fd64047d700 (LWP 4695)):
#0  0x00007fd6585ba945 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fd645303329 in index_worker (data=0x7fd61c5e9fc0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/index/src/index.c>:218
        priv = 0x7fd61c604820
        this = 0x7fd61c5e9fc0
        stub = 0x0
        bye = false
#2  0x00007fd6585b6e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x00007fd657e8334d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 1 (Thread 0x7fd617fff700 (LWP 4662)):
#0  0x00007fd657dc01f7 in raise () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fd657dc18e8 in abort () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007fd657db9266 in __assert_fail_base () from /lib64/libc.so.6
No symbol table info available.
#3  0x00007fd657db9312 in __assert_fail () from /lib64/libc.so.6
No symbol table info available.
#4  0x00007fd6597781ae in __inode_unref (inode=0x7fd64820d048) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/inode.c>:484
        index = 0
        this = 0x7fd64802f810
        __PRETTY_FUNCTION__ = "__inode_unref"
#5  0x00007fd6597783a5 in inode_unref (inode=0x7fd64820d048) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/inode.c>:558
        table = 0x7fd64802b540
#6  0x00007fd6449f00cd in server_loc_wipe (loc=0x7fd638499878) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/protocol/server/src/server-helpers.c>:158
No locals.
#7  0x00007fd6449f02bc in free_state (state=0x7fd638499860) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/protocol/server/src/server-helpers.c>:218
No locals.
#8  0x00007fd6449e82c5 in server_submit_reply (frame=0x7fd6384a8948, req=0x7fd6040b22e8, arg=0x7fd608b52670, payload=0x0, payloadcount=0, iobref=0x7fd608627f20, xdrproc=0x7fd6593092f4 <xdr_gfx_common_rsp>) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/protocol/server/src/server.c>:154
        iob = 0x1249940
        ret = -1
        rsp = {iov_base = 0x7fd659c7eb00, iov_len = 20}
        state = 0x7fd638499860
        new_iobref = 1 '\001'
        client = 0x7fd62c025390
        __FUNCTION__ = "server_submit_reply"
#9  0x00007fd644a30bea in server4_inodelk_cbk (frame=0x7fd6384a8948, cookie=0x7fd63813a1d8, this=0x7fd64802f810, op_ret=-1, op_errno=0, xdata=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/protocol/server/src/server-rpc-fops_v2.c>:286
        rsp = {op_ret = -1, op_errno = 0, xdata = {xdr_size = 0, count = -1, pairs = {pairs_len = 0, pairs_val = 0x0}}}
        state = 0x7fd638499860
        req = 0x7fd6040b22e8
        __FUNCTION__ = "server4_inodelk_cbk"
#10 0x00007fd644eab03c in io_stats_inodelk_cbk (frame=0x7fd63813a1d8, cookie=0x7fd6384ca6c8, this=0x7fd6085f02c0, op_ret=-1, op_errno=0, xdata=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/debug/io-stats/src/io-stats.c>:2677
        fn = 0x7fd644a30a16 <server4_inodelk_cbk>
        _parent = 0x7fd6384a8948
        old_THIS = 0x7fd6085f02c0
        __FUNCTION__ = "io_stats_inodelk_cbk"
#11 0x00007fd659820613 in default_inodelk_cbk (frame=0x7fd6384ca6c8, cookie=0x7fd624002ea8, this=0x7fd6085e9660, op_ret=-1, op_errno=0, xdata=0x0) at defaults.c:1177
        fn = 0x7fd644eaabfc <io_stats_inodelk_cbk>
        _parent = 0x7fd63813a1d8
        old_THIS = 0x7fd6085e9660
        __FUNCTION__ = "default_inodelk_cbk"
#12 0x00007fd6465e8962 in pl_forget (this=0x7fd6085e3080, inode=0x7fd64820d048) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/locks/src/posix.c>:2545
        fn = 0x7fd659820290 <default_inodelk_cbk>
        _parent = 0x7fd6384ca6c8
        old_THIS = 0x7fd6085e3080
        pl_inode = 0x12d1e70
        ext_tmp = 0x7fd608b528a0
        ext_l = 0x7fd608b528a0
        posixlks_released = {next = 0x7fd608b528a0, prev = 0x7fd608b528a0}
        ino_tmp = 0x7fd618066ca0
        ino_l = 0x7fd62405ac10
        inodelks_released = {next = 0x7fd62405ac20, prev = 0x7fd618066cb0}
        rw_tmp = 0x0
        rw_req = 0x0
        entry_tmp = 0x0
        entry_l = 0x0
        entrylks_released = {next = 0x7fd608b52880, prev = 0x7fd608b52880}
        dom = 0x12d1e98
        dom_tmp = 0x12d1e98
        __FUNCTION__ = "pl_forget"
#13 0x00007fd659777b74 in __inode_ctx_free (inode=0x7fd64820d048) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/inode.c>:331
        index = 7
        xl = 0x7fd6085e3080
        old_THIS = 0x7fd659a6e2c0 <global_xlator>
        __FUNCTION__ = "__inode_ctx_free"
#14 0x00007fd659777c3e in __inode_destroy (inode=0x7fd64820d048) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/inode.c>:352
        __FUNCTION__ = "__inode_destroy"
#15 0x00007fd65977a565 in inode_table_prune (table=0x7fd64802b540) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/inode.c>:1578
        ret = 0
        purge = {next = 0x7fd64800e2b0, prev = 0x7fd64800e2b0}
        del = 0x7fd64820d048
        tmp = 0x7fd64800e228
        entry = 0x0
        __FUNCTION__ = "inode_table_prune"
#16 0x00007fd65977af35 in inode_table_destroy (inode_table=0x7fd64802b540) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/inode.c>:1852
        trav = 0x7fd64800e228
        __FUNCTION__ = "inode_table_destroy"
#17 0x000000000040bac1 in ?? ()
No symbol table info available.
#18 0x0000000000000000 in ?? ()
No symbol table info available.
=========================================================
              Finish backtrace
         program name : /build/install/sbin/glusterfsd
         corefile     : /glustersproc3-4640.core
=========================================================

+ rm -f /build/install/cores/gdbout.txt
+ sort /build/install/cores/liblist.txt
+ uniq
+ cat /build/install/cores/liblist.txt.tmp
+ grep -v /build/install
+ tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-689.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores
tar: Removing leading `/' from member names
+ tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-689.tar -T /build/install/cores/liblist.txt
tar: Removing leading `/' from member names
+ bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-689.tar
+ rm -f /build/install/cores/liblist.txt
+ rm -f /build/install/cores/liblist.txt.tmp
+ find /archives -size +1G -delete -type f
+ echo 'Cores and build archived in http://builder104.cloud.gluster.org/archived_builds/build-install-regression-test-with-multiplex-689.tar.bz2'
Cores and build archived in http://builder104.cloud.gluster.org/archived_builds/build-install-regression-test-with-multiplex-689.tar.bz2
+ echo 'Open core using the following command to get a proper stack'
Open core using the following command to get a proper stack
+ echo 'Example: From root of extracted tarball'
Example: From root of extracted tarball
+ echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>'
\t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd>
+ RET=1
+ '[' 1 -ne 0 ']'
+ tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/689/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20180225 /var/log/messages-20180304 /var/log/messages-20180311 /var/log/messages-20180319
tar: Removing leading `/' from member names
+ scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i <https://build.gluster.org/job/regression-test-with-multiplex/ws/> glusterfs-logs.tgz _logs_collector at http.int.rht.gluster.org:/var/www/glusterfs-logs/regression-test-with-multiplex-689.tgz
ssh: connect to host http.int.rht.gluster.org port 22: Connection timed out
lost connection
+ true
+ case $(uname -s) in
++ uname -s
+ /sbin/sysctl -w kernel.core_pattern=/%e-%p.core
kernel.core_pattern = /%e-%p.core
+ exit 1
Build step 'Execute shell' marked build as failure


More information about the maintainers mailing list