[Gluster-Maintainers] Build failed in Jenkins: regression-test-with-multiplex #1693

jenkins at build.gluster.org jenkins at build.gluster.org
Tue Mar 3 19:03:00 UTC 2020


See <https://build.gluster.org/job/regression-test-with-multiplex/1693/display/redirect?page=changes>

Changes:

[Amar Tumballi] protocol/server: structure logging

[Amar Tumballi] protocol/server-rpc-fops_v2: structure logging

[Amar Tumballi] protocol/server-helpers: structure logging

[Amar Tumballi] protocol/client: structure logging

[Amar Tumballi] xlator/dht-helper: structure logging


------------------------------------------
[...truncated 3.73 MB...]
./tests/basic/fencing/afr-lock-heal-advanced.t
./tests/basic/fencing/afr-lock-heal-basic.t
./tests/bugs/glusterd/bug-857330/normal.t
./tests/bugs/glusterd/bug-857330/xml.t
./tests/bugs/glusterfs-server/bug-877992.t
./tests/bugs/replicate/bug-1480525.t

Result is 1

+ gdb -ex 'core-file /glfs_epoll000-14350.core' -ex 'set pagination off' -ex 'info proc exe' -ex q
GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-115.el7
Copyright (C) 2013 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
[New LWP 14357]
[New LWP 14358]
[New LWP 14356]
[New LWP 14350]
[New LWP 14351]
[New LWP 14352]
[New LWP 14353]
[New LWP 14354]
[New LWP 14355]
[New LWP 14359]
Core was generated by `/build/install/sbin/glusterfs -s 127.1.1.3 --volfile-id shd/patchy -p /d/backen'.
Program terminated with signal 11, Segmentation fault.
#0  0x00007fd2e9e3f5bb in ?? ()
exe = '/build/install/sbin/glusterfs -s 127.1.1.3 --volfile-id shd/patchy -p /d/backen'
++ cut -d ' ' -f1
++ tail -1
++ cut -d ''\''' -f2
++ gdb -ex 'core-file /glfs_epoll000-14350.core' -ex 'set pagination off' -ex 'info proc exe' -ex q
+ executable_name=/build/install/sbin/glusterfs
++ which /build/install/sbin/glusterfs
+ executable_path=/build/install/sbin/glusterfs
+ set +x

=========================================================
              Start printing backtrace
         program name : /build/install/sbin/glusterfs
         corefile     : /glfs_epoll000-14350.core
=========================================================

warning: core file may not match specified executable file.
[New LWP 14357]
[New LWP 14358]
[New LWP 14356]
[New LWP 14350]
[New LWP 14351]
[New LWP 14352]
[New LWP 14353]
[New LWP 14354]
[New LWP 14355]
[New LWP 14359]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/build/install/sbin/glusterfs -s 127.1.1.3 --volfile-id shd/patchy -p /d/backen'.
Program terminated with signal 11, Segmentation fault.
#0  0x00007fd2e9e3f5bb in gf_log_flush () at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/logging.c>:143
143	    if (ctx && ctx->log.logger == gf_logger_glusterlog) {

Thread 10 (Thread 0x7fd2da65e700 (LWP 14359)):
#0  0x00007fd2e8534851 in clone () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fd2e8c6eda0 in ?? () from /lib64/libpthread.so.0
No symbol table info available.
#2  0x00007fd2da65e700 in ?? ()
No symbol table info available.
#3  0x0000000000000000 in ?? ()
No symbol table info available.

Thread 9 (Thread 0x7fd2df407700 (LWP 14355)):
#0  0x00007fd2e8c72da2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fd2e9e9189c in syncenv_task (proc=0x1df3f60) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:524
        env = 0x1df3ba0
        task = 0x0
        sleep_till = {tv_sec = 1583257383, tv_nsec = 0}
        ret = 0
#2  0x00007fd2e9e91a91 in syncenv_processor (thdata=0x1df3f60) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:591
        env = 0x1df3ba0
        proc = 0x1df3f60
        task = 0x0
#3  0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007fd2e853488d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 8 (Thread 0x7fd2dfc08700 (LWP 14354)):
#0  0x00007fd2e8c72da2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fd2e9e9189c in syncenv_task (proc=0x1df3ba0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:524
        env = 0x1df3ba0
        task = 0x0
        sleep_till = {tv_sec = 1583257383, tv_nsec = 0}
        ret = 0
#2  0x00007fd2e9e91a91 in syncenv_processor (thdata=0x1df3ba0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:591
        env = 0x1df3ba0
        proc = 0x1df3ba0
        task = 0x0
#3  0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007fd2e853488d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 7 (Thread 0x7fd2e0409700 (LWP 14353)):
#0  0x00007fd2e84fb80d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fd2e84fb6a4 in sleep () from /lib64/libc.so.6
No symbol table info available.
#2  0x00007fd2e9e78e51 in pool_sweeper (arg=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:453
        state = {cold_lists = {0x0 <repeats 1024 times>}, n_cold_lists = 0}
        pool_list = 0x0
        i = 0
        pending = true
#3  0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4  0x00007fd2e853488d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 6 (Thread 0x7fd2e0c0a700 (LWP 14352)):
#0  0x00007fd2e8c76381 in sigwait () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x000000000040b3e6 in ?? ()
No symbol table info available.
#2  0x0000000000000000 in ?? ()
No symbol table info available.

Thread 5 (Thread 0x7fd2e140b700 (LWP 14351)):
#0  0x00007fd2e8c72da2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fd2e9e53987 in gf_timer_proc (data=0x1df2e40) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/timer.c>:141
        now = {tv_sec = 2373372, tv_nsec = 376776019}
        reg = 0x1df2e40
        event = 0x1e3c5e0
        tmp = 0x0
        old_THIS = 0x0
#2  0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x00007fd2e853488d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 4 (Thread 0x7fd2ea3664c0 (LWP 14350)):
#0  0x00007fd2e8c6ffd7 in pthread_join () from /lib64/libpthread.so.0
No symbol table info available.
#1  0x00007fd2e9ebbd84 in event_dispatch_epoll (event_pool=0x1dead50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:835
        i = 2
        t_id = 140543612126976
        pollercount = 2
        ret = 0
        ev_data = 0x1e3c900
        __FUNCTION__ = "event_dispatch_epoll"
#2  0x00007fd2e9e77841 in gf_event_dispatch (event_pool=0x1dead50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event.c>:115
        ret = -1
        __FUNCTION__ = "gf_event_dispatch"
#3  0x000000000040c426 in ?? ()
No symbol table info available.
#4  0x0000000000000000 in ?? ()
No symbol table info available.

Thread 3 (Thread 0x7fd2dec06700 (LWP 14356)):
#0  0x00007fd2e852b953 in select () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fd2e9eda48e in runner (arg=0x1df7d20) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/contrib/timer-wheel/timer-wheel.c>:186
        tv = {tv_sec = 0, tv_usec = 936494}
        base = 0x1df7d20
#2  0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x00007fd2e853488d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 2 (Thread 0x7fd2dc138700 (LWP 14358)):
#0  0x00007fd2e8534e63 in epoll_wait () from /lib64/libc.so.6
No symbol table info available.
#1  0x00007fd2e9ebba9c in event_dispatch_epoll_worker (data=0x1e3c900) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:741
        event = {events = 4, data = {ptr = 0x100000003, fd = 3, u32 = 3, u64 = 4294967299}}
        ret = 0
        ev_data = 0x1e3c900
        event_pool = 0x1dead50
        myindex = 2
        timetodie = 0
        gen = 0
        poller_death_notify = {next = 0x0, prev = 0x0}
        slot = 0x0
        tmp = 0x0
        __FUNCTION__ = "event_dispatch_epoll_worker"
#2  0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3  0x00007fd2e853488d in clone () from /lib64/libc.so.6
No symbol table info available.

Thread 1 (Thread 0x7fd2dc939700 (LWP 14357)):
#0  0x00007fd2e9e3f5bb in gf_log_flush () at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/logging.c>:143
        this = 0x7fd2cc03e080
        ctx = 0x1db559000
#1  0x00007fd2e9e49ba1 in gf_print_trace (signum=11, ctx=0x1db4010) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/common-utils.c>:904
        msg = '\000' <repeats 1023 times>
        timestr = '\000' <repeats 63 times>
        stack = 0x0
#2  0x000000000040b485 in ?? ()
No symbol table info available.
#3  0x0000000000000000 in ?? ()
No symbol table info available.
=========================================================
              Finish backtrace
         program name : /build/install/sbin/glusterfs
         corefile     : /glfs_epoll000-14350.core
=========================================================

+ rm -f /build/install/cores/gdbout.txt
+ uniq
+ sort /build/install/cores/liblist.txt
+ cat /build/install/cores/liblist.txt.tmp
+ grep -v /build/install
+ tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-1693.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores
tar: Removing leading `/' from member names
+ tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-1693.tar -T /build/install/cores/liblist.txt
tar: Removing leading `/' from member names
+ bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-1693.tar
+ rm -f /build/install/cores/liblist.txt
+ rm -f /build/install/cores/liblist.txt.tmp
+ find /archives -size +1G -delete -type f
+ [[ builder200.int.aws.gluster.org == *\a\w\s* ]]
+ scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i **** /archives/archived_builds/build-install-regression-test-with-multiplex-1693.tar.bz2 _logs-collector at logs.aws.gluster.org:/var/www/glusterfs-logs/regression-test-with-multiplex-1693.bz2
Warning: Permanently added 'logs.aws.gluster.org,18.219.45.211' (ECDSA) to the list of known hosts.
+ echo 'Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1693.bz2'
Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1693.bz2
+ echo 'Open core using the following command to get a proper stack'
Open core using the following command to get a proper stack
+ echo 'Example: From root of extracted tarball'
Example: From root of extracted tarball
+ echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>'
\t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd>
+ RET=1
+ '[' 1 -ne 0 ']'
+ tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/1693/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20200209 /var/log/messages-20200216 /var/log/messages-20200223 /var/log/messages-20200301
tar: Removing leading `/' from member names
+ case $(uname -s) in
++ uname -s
+ /sbin/sysctl -w kernel.core_pattern=/%e-%p.core
kernel.core_pattern = /%e-%p.core
+ exit 1
Logs are archived at Build artifacts: https://build.gluster.org/job/regression-test-with-multiplex/
Build step 'Execute shell' marked build as failure


More information about the maintainers mailing list