[Gluster-Maintainers] Build failed in Jenkins: regression-test-with-multiplex #1589
jenkins at build.gluster.org
jenkins at build.gluster.org
Wed Dec 18 19:09:57 UTC 2019
See <https://build.gluster.org/job/regression-test-with-multiplex/1589/display/redirect?page=changes>
Changes:
[Amar Tumballi] call-stub.c: remove redundant validation
[Amar Tumballi] glusterd: unlink the file after killing the process
[Amar Tumballi] [RFC]#ifdef gNFS related code if we are not compiling gNFS
[Amar Tumballi] test: fix non-root test case for geo-rep
------------------------------------------
[...truncated 3.73 MB...]
[New LWP 19951]
[New LWP 19952]
[New LWP 19948]
[New LWP 19946]
[New LWP 19944]
[New LWP 19943]
Core was generated by `/build/install/sbin/glusterfs -s 127.1.1.3 --volfile-id shd/patchy -p /d/backen'.
Program terminated with signal 11, Segmentation fault.
#0 0x00007fbda6dbc567 in ?? ()
exe = '/build/install/sbin/glusterfs -s 127.1.1.3 --volfile-id shd/patchy -p /d/backen'
++ gdb -ex 'core-file /glfs_epoll000-19943.core' -ex 'set pagination off' -ex 'info proc exe' -ex q
++ tail -1
++ cut -d ' ' -f1
++ cut -d ''\''' -f2
+ executable_name=/build/install/sbin/glusterfs
++ which /build/install/sbin/glusterfs
+ executable_path=/build/install/sbin/glusterfs
+ set +x
=========================================================
Start printing backtrace
program name : /build/install/sbin/glusterfs
corefile : /glfs_epoll000-19943.core
=========================================================
warning: core file may not match specified executable file.
[New LWP 19950]
[New LWP 19945]
[New LWP 19947]
[New LWP 19949]
[New LWP 19951]
[New LWP 19952]
[New LWP 19948]
[New LWP 19946]
[New LWP 19944]
[New LWP 19943]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `/build/install/sbin/glusterfs -s 127.1.1.3 --volfile-id shd/patchy -p /d/backen'.
Program terminated with signal 11, Segmentation fault.
#0 0x00007fbda6dbc567 in gf_log_flush () at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/logging.c>:145
145 if (ctx && ctx->log.logger == gf_logger_glusterlog) {
Thread 10 (Thread 0x7fbda72e34c0 (LWP 19943)):
#0 0x00007fbda5becfd7 in pthread_join () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007fbda6e3828a in event_dispatch_epoll (event_pool=0x1419d50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:848
i = 2
t_id = 140452293199616
pollercount = 2
ret = 0
ev_data = 0x146b910
__FUNCTION__ = "event_dispatch_epoll"
#2 0x00007fbda6df42ce in gf_event_dispatch (event_pool=0x1419d50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event.c>:115
ret = -1
__FUNCTION__ = "gf_event_dispatch"
#3 0x000000000040bfc4 in ?? ()
No symbol table info available.
#4 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 9 (Thread 0x7fbd9e388700 (LWP 19944)):
#0 0x00007fbda5befda2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007fbda6dd0535 in gf_timer_proc (data=0x14219a0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/timer.c>:140
now = {tv_sec = 731213, tv_nsec = 515479189}
reg = 0x14219a0
event = 0x146b5f0
tmp = 0x0
old_THIS = 0x0
#2 0x00007fbda5bebe65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007fbda54b188d in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 8 (Thread 0x7fbd9d386700 (LWP 19946)):
#0 0x00007fbda547880d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007fbda54786a4 in sleep () from /lib64/libc.so.6
No symbol table info available.
#2 0x00007fbda6df58d7 in pool_sweeper (arg=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:455
state = {death_row = {next = 0x0, prev = 0x0}, cold_lists = {0x0 <repeats 1024 times>}, n_cold_lists = 0}
pool_list = 0x0
next_pl = 0x0
pt_pool = 0x0
i = 0
poisoned = false
#3 0x00007fbda5bebe65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007fbda54b188d in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 7 (Thread 0x7fbd9c384700 (LWP 19948)):
#0 0x00007fbda5befda2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007fbda6e0e36f in syncenv_task (proc=0x1422f50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:517
env = 0x1422b90
task = 0x0
sleep_till = {tv_sec = 1576691168, tv_nsec = 0}
ret = 0
#2 0x00007fbda6e0e564 in syncenv_processor (thdata=0x1422f50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:584
env = 0x1422b90
proc = 0x1422f50
task = 0x0
#3 0x00007fbda5bebe65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007fbda54b188d in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 6 (Thread 0x7fbd935c7700 (LWP 19952)):
#0 0x00007fbda6df5432 in __gf_mem_invalidate (ptr=0x7fbd93821fe9) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:281
header = 0x7fbd93700010
end = 0x7fbd93ffffd8
inval = {magic = 3735929054, mem_acct = 0x7fbd8c019fd0, type = 123, size = 9437040, baseaddr = 0x7fbd93700060}
#1 0x00007fbda6df576c in __gf_free (free_ptr=0x7fbd93700060) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:359
ptr = 0x7fbd93700010
mem_acct = 0x7fbd8c019fd0
header = 0x7fbd93700010
last_ref = true
__PRETTY_FUNCTION__ = "__gf_free"
#2 0x00007fbd9811adfb in ios_destroy_sample_buf (ios_sample_buf=0x7fbd8c01eea0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/debug/io-stats/src/io-stats.c>:611
No locals.
#3 0x00007fbd9813f420 in ios_conf_destroy (conf=0x7fbd8c01cf20) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/debug/io-stats/src/io-stats.c>:3866
No locals.
#4 0x00007fbd9813fecc in fini (this=0x7fbd8c018040) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/debug/io-stats/src/io-stats.c>:4051
conf = 0x7fbd8c01cf20
__FUNCTION__ = "fini"
#5 0x00007fbda6e0a443 in glusterfs_graph_fini (graph=0x7fbd8c002980) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:1201
trav = 0x7fbd8c018040
#6 0x00007fbda6e0ada1 in glusterfs_graph_cleanup (arg=0x7fbd8c002980) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:1411
graph = 0x7fbd8c002980
ctx = 0x13e3010
ret = 0
__FUNCTION__ = "glusterfs_graph_cleanup"
#7 0x00007fbda5bebe65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#8 0x00007fbda54b188d in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 5 (Thread 0x7fbd990b4700 (LWP 19951)):
#0 0x00007fbda54b1e63 in epoll_wait () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007fbda6e37fc3 in event_dispatch_epoll_worker (data=0x146b910) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:753
event = {events = 1, data = {ptr = 0x100000005, fd = 5, u32 = 5, u64 = 4294967301}}
ret = 0
ev_data = 0x146b910
event_pool = 0x1419d50
myindex = 2
timetodie = 0
gen = 0
poller_death_notify = {next = 0x0, prev = 0x0}
slot = 0x0
tmp = 0x0
__FUNCTION__ = "event_dispatch_epoll_worker"
#2 0x00007fbda5bebe65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007fbda54b188d in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 4 (Thread 0x7fbd9bb83700 (LWP 19949)):
#0 0x00007fbda54a8953 in select () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007fbda6e56993 in runner (arg=0x1426d10) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/contrib/timer-wheel/timer-wheel.c>:186
tv = {tv_sec = 0, tv_usec = 917740}
base = 0x1426d10
#2 0x00007fbda5bebe65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007fbda54b188d in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 3 (Thread 0x7fbd9cb85700 (LWP 19947)):
#0 0x00007fbda5befda2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007fbda6e0e36f in syncenv_task (proc=0x1422b90) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:517
env = 0x1422b90
task = 0x0
sleep_till = {tv_sec = 1576691168, tv_nsec = 0}
ret = 0
#2 0x00007fbda6e0e564 in syncenv_processor (thdata=0x1422b90) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:584
env = 0x1422b90
proc = 0x1422b90
task = 0x0
#3 0x00007fbda5bebe65 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007fbda54b188d in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 2 (Thread 0x7fbd9db87700 (LWP 19945)):
#0 0x00007fbda5bf3381 in sigwait () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x000000000040b00f in ?? ()
No symbol table info available.
#2 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 1 (Thread 0x7fbd998b5700 (LWP 19950)):
#0 0x00007fbda6dbc567 in gf_log_flush () at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/logging.c>:145
this = 0x7fbd8c03df70
ctx = 0x7fbd8c03eed000
#1 0x00007fbda6dc6a07 in gf_print_trace (signum=11, ctx=0x13e3010) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/common-utils.c>:914
msg = '\000' <repeats 1023 times>
timestr = '\000' <repeats 63 times>
stack = 0x0
#2 0x000000000040b0ae in ?? ()
No symbol table info available.
#3 0x0000000000000000 in ?? ()
No symbol table info available.
=========================================================
Finish backtrace
program name : /build/install/sbin/glusterfs
corefile : /glfs_epoll000-19943.core
=========================================================
+ rm -f /build/install/cores/gdbout.txt
+ sort /build/install/cores/liblist.txt
+ uniq
+ cat /build/install/cores/liblist.txt.tmp
+ grep -v /build/install
+ tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-1589.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores
tar: Removing leading `/' from member names
+ tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-1589.tar -T /build/install/cores/liblist.txt
tar: Removing leading `/' from member names
+ bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-1589.tar
+ rm -f /build/install/cores/liblist.txt
+ rm -f /build/install/cores/liblist.txt.tmp
+ find /archives -size +1G -delete -type f
+ [[ builder208.int.aws.gluster.org == *\a\w\s* ]]
+ scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i **** /archives/archived_builds/build-install-regression-test-with-multiplex-1589.tar.bz2 _logs-collector at logs.aws.gluster.org:/var/www/glusterfs-logs/regression-test-with-multiplex-1589.bz2
ssh: connect to host logs.aws.gluster.org port 22: Connection timed out
lost connection
+ true
+ echo 'Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1589.bz2'
Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1589.bz2
+ echo 'Open core using the following command to get a proper stack'
Open core using the following command to get a proper stack
+ echo 'Example: From root of extracted tarball'
Example: From root of extracted tarball
+ echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>'
\t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd>
+ RET=1
+ '[' 1 -ne 0 ']'
+ tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/1589/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20191124 /var/log/messages-20191201 /var/log/messages-20191208 /var/log/messages-20191215
tar: Removing leading `/' from member names
+ case $(uname -s) in
++ uname -s
+ /sbin/sysctl -w kernel.core_pattern=/%e-%p.core
kernel.core_pattern = /%e-%p.core
+ exit 1
Build step 'Execute shell' marked build as failure
More information about the maintainers
mailing list