[Gluster-Maintainers] Build failed in Jenkins: regression-test-with-multiplex #1907
jenkins at build.gluster.org
jenkins at build.gluster.org
Sun Jun 14 23:07:13 UTC 2020
See <https://build.gluster.org/job/regression-test-with-multiplex/1907/display/redirect>
Changes:
------------------------------------------
[...truncated 3.80 MB...]
myindex = 4
timetodie = 0
gen = 0
poller_death_notify = {next = 0x0, prev = 0x801000}
slot = 0x0
tmp = 0x0
__FUNCTION__ = "event_dispatch_epoll_worker"
#2 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 10 (Thread 0x7f0afe7fc700 (LWP 2450)):
#0 0x00007f0b1512aa35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f0b0578a5ce in index_worker (data=0x7f0af4071ad0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/index/src/index.c>:216
priv = 0x7f0af4985190
this = 0x7f0af4071ad0
stub = 0x0
bye = false
#2 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 9 (Thread 0x7f0acffff700 (LWP 2171)):
#0 0x00007f0b1512aa35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f0b16092e89 in rpcsvc_request_handler (arg=0x7f0b04c19148) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-lib/src/rpcsvc.c>:2195
queue = 0x7f0b04c19148
program = 0x7f0b04c19060
req = 0x7f0acfffd680
tmp_req = 0x7f0acfffd680
actor = 0x7f0b052f3720 <glusterfs4_0_fop_actors+1792>
done = false
ret = 0
tmp_list = {next = 0x7f0acfffe140, prev = 0x7f0acfffe140}
__FUNCTION__ = "rpcsvc_request_handler"
#2 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 8 (Thread 0x7f0af3fff700 (LWP 2117)):
#0 0x00007f0b149eceb3 in epoll_wait () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f0b16374290 in event_dispatch_epoll_worker (data=0x7f0af4059f40) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:741
event = {events = 1, data = {ptr = 0x700000004, fd = 4, u32 = 4, u64 = 30064771076}}
ret = 0
ev_data = 0x7f0af4059f40
event_pool = 0x11aece0
myindex = 3
timetodie = 0
gen = 0
poller_death_notify = {next = 0x0, prev = 0x0}
slot = 0x0
tmp = 0x0
__FUNCTION__ = "event_dispatch_epoll_worker"
#2 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 7 (Thread 0x7f0afc8f6700 (LWP 2116)):
#0 0x00007f0b1512aa35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f0b07b7b05b in posix_fsyncer_pick (this=0x7f0af4001b20, head=0x7f0afc8f5150) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:2343
priv = 0x7f0af4058ab0
count = 0
#2 0x00007f0b07b7b377 in posix_fsyncer (d=0x7f0af4001b20) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:2433
this = 0x7f0af4001b20
priv = 0x7f0af4058ab0
stub = 0x0
tmp = 0x0
list = {next = 0x7f0afc8f5150, prev = 0x7f0afc8f5150}
count = 0
do_fsync = true
__FUNCTION__ = "posix_fsyncer"
#3 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 6 (Thread 0x7f0b0407d700 (LWP 2113)):
#0 0x00007f0b1512ade2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f0b05fe8907 in iot_worker (data=0x7f0af4036d60) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/performance/io-threads/src/io-threads.c>:197
conf = 0x7f0af4036d60
this = 0x7f0af40105e0
stub = 0x0
sleep_till = {tv_sec = 1592164611, tv_nsec = 767088135}
ret = 0
pri = -1
bye = false
__FUNCTION__ = "iot_worker"
#2 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 5 (Thread 0x7f0afdafa700 (LWP 2112)):
#0 0x00007f0b1512aa35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f0b0578a5ce in index_worker (data=0x7f0af4016b60) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/index/src/index.c>:216
priv = 0x7f0af402a260
this = 0x7f0af4016b60
stub = 0x0
bye = false
#2 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 4 (Thread 0x7f0b08dd7700 (LWP 2100)):
#0 0x00007f0b149eceb3 in epoll_wait () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f0b16374290 in event_dispatch_epoll_worker (data=0x1200820) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:741
event = {events = 1, data = {ptr = 0x100000001, fd = 1, u32 = 1, u64 = 4294967297}}
ret = 0
ev_data = 0x1200820
event_pool = 0x11aece0
myindex = 1
timetodie = 0
gen = 0
poller_death_notify = {next = 0x0, prev = 0x0}
slot = 0x0
tmp = 0x0
__FUNCTION__ = "event_dispatch_epoll_worker"
#2 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 3 (Thread 0x7f0b0c0a7700 (LWP 2097)):
#0 0x00007f0b1512ade2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f0b16349fe7 in syncenv_task (proc=0x11b8000) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:577
env = 0x11b8000
task = 0x0
sleep_till = {tv_sec = 1592165091, tv_nsec = 0}
ret = 0
#2 0x00007f0b1634a318 in syncenv_processor (thdata=0x11b8000) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:678
proc = 0x11b8000
task = 0x7f0ac0003610
#3 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 2 (Thread 0x7f0b0c8a8700 (LWP 2096)):
#0 0x00007f0b149b385d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f0b149b36f4 in sleep () from /lib64/libc.so.6
No symbol table info available.
#2 0x00007f0b16331321 in pool_sweeper (arg=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:453
state = {cold_lists = {0x7f0ae0003270, 0x7f0ad0246b40, 0x7f0ad0231090, 0x7f0ad0214b50, 0x7f0ad000b620, 0x7f0ac001a2c0, 0x7f0ac40056c0, 0x7f0ae81686d0, 0x7f0ae8167640, 0x7f0ae814e960, 0x7f0af4aeb530, 0x7f0af4aeb150, 0x7f0af405ac80, 0x7f0af405a2f0, 0x7f0af80290e0, 0x7f0af8028660, 0x7f0b00028560, 0x7f0b000026c0, 0x7f0ac4013130, 0x7f0ac400f840, 0x7f0ad000ff70, 0x7f0ac001e870, 0x7f0ac001ad20, 0x7f0abc005a90, 0x7f0abc004dc0, 0x7f0ac0009650, 0x7f0ac000c230, 0x7f0ac0001e80, 0x7f0ac0015dc0, 0x7f0ac00047c0, 0x7f0ac400a670, 0x7f0ac4002280, 0x7f0ac401b880, 0x7f0ac4000a60, 0x7f0ac40189f0, 0x7f0ac8000b40, 0x7f0ac8000a30, 0x7f0ac800b690, 0x7f0ad4000b40, 0x7f0ad4000a30, 0x7f0ad400b690, 0x7f0adc002960, 0x7f0adc000c50, 0x7f0ad8001f90, 0x7f0ad80023c0, 0x7f0aec01b3c0, 0x7f0aec01b040, 0x7f0ae8169460, 0x7f0ae8344760, 0x7f0ae81411e0, 0x7f0af8086080, 0x7f0af8082390, 0x7f0af807e010, 0x7f0b0000c0d0, 0x7f0b00008010, 0x7f0b0000c8e0, 0x0 <repeats 968 times>}, n_cold_lists = 18}
pool_list = 0x7f0b1660b5b0 <pool_threads>
i = 18
pending = false
#3 0x00007f0b15126ea5 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f0b149ec8dd in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 1 (Thread 0x7f0b0d0a9700 (LWP 2095)):
#0 0x00007f0b1493b079 in vfprintf () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f0b149660e9 in vsnprintf () from /lib64/libc.so.6
No symbol table info available.
#2 0x00007f0b16339391 in gf_proc_dump_add_section_fd (key=0x7f0b163df72e "%s.%s - Memory usage", ap=0x7f0b0d0a47a0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/statedump.c>:126
buf = "\n[\000\000\060\000\000\000P8\n\r\v\177\000\000\220\067\n\r\v\177\000\000-ser$\000\000\000- usage-p8\n\r\v\177\000\000pG\a\364\n\177\000\000\001", '\000' <repeats 15 times>, "Ͳ\223\024\v\177\000\000\n\000\000]\n\000\000\000\240\070\n\r\v\177\000\000\340\067\n\r\v\177\000\000\302\357=\026\032\000\000\000\n[arena.8]\n\000eque\000\000\020\000\000\000\000\000\070\030\313\024\000\000\000\000\260\373\023\350\n\177\000\000Ͳ\223\024\001\000\000\000h\373\023\350\n\177\000\000\000\000\000\000\001\000\000\000\213\200\346^\000\000\000\000\240H\n\r\v\177", '\000' <repeats 11 times>, "\020"...
len = 2
__PRETTY_FUNCTION__ = "gf_proc_dump_add_section_fd"
#3 0x00007f0b16339532 in gf_proc_dump_add_section (key=0x7f0b163df72e "%s.%s - Memory usage") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/statedump.c>:153
ap = {{gp_offset = 16, fp_offset = 48, overflow_arg_area = 0x7f0b0d0a4880, reg_save_area = 0x7f0b0d0a47c0}}
ret = 0
#4 0x00007f0b1633980a in gf_proc_dump_xlator_mem_info (xl=0x7f0af8027620) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/statedump.c>:213
i = 0
#5 0x00007f0b1633a311 in gf_proc_dump_single_xlator_info (trav=0x7f0af8027620) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/statedump.c>:490
ctx = 0x7f0af8027f88
itable_key = '\000' <repeats 1023 times>
#6 0x00007f0b1633a49b in gf_proc_dump_per_xlator_info (top=0x7f0af8029f70) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/statedump.c>:519
trav = 0x7f0af8027620
#7 0x00007f0b1633a4fc in gf_proc_dump_xlator_info (top=0x7f0af8029f70, brick_mux=true) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/statedump.c>:534
trav = 0x7f0af8029f70
trav_p = 0x0
#8 0x00007f0b1633b2b9 in gf_proc_dump_info (signum=10, ctx=0x1178010) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/statedump.c>:899
i = 0
ret = 0
trav = 0x0
brick_name = "d-backends-patchy0", '\000' <repeats 4077 times>
timestr = '\000' <repeats 255 times>
sign_string = "DUMP-START-TIME: 2020-06-14 19:54:51.982144\n", '\000' <repeats 467 times>
tmp_dump_name = "/var/run/gluster/dumpnpmJ8k", '\000' <repeats 4068 times>
path = "/var/run/gluster/d-backends-patchy0.2093.dump.1592164491", '\000' <repeats 4039 times>
tv = {tv_sec = 1592164491, tv_usec = 982144}
is_brick_mux = true
top = 0x7f0af8029f70
trav_p = 0x7f0ae4a92438
brick_count = 4
len = 44
__FUNCTION__ = "gf_proc_dump_info"
#9 0x000000000040b43d in ?? ()
No symbol table info available.
#10 0x0000000000000000 in ?? ()
No symbol table info available.
=========================================================
Finish backtrace
program name : /build/install/sbin/glusterfsd
corefile : /glfs_sigwait-2093.core
=========================================================
+ rm -f /build/install/cores/gdbout.txt
+ uniq
+ sort /build/install/cores/liblist.txt
+ grep -v /build/install
+ cat /build/install/cores/liblist.txt.tmp
+ tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-1907.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores
tar: Removing leading `/' from member names
+ tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-1907.tar -T /build/install/cores/liblist.txt
tar: Removing leading `/' from member names
+ bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-1907.tar
+ rm -f /build/install/cores/liblist.txt
+ rm -f /build/install/cores/liblist.txt.tmp
+ find /archives -size +1G -delete -type f
+ [[ builder208.int.aws.gluster.org == *\a\w\s* ]]
+ scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i **** /archives/archived_builds/build-install-regression-test-with-multiplex-1907.tar.bz2 _logs-collector at logs.aws.gluster.org:/var/www/glusterfs-logs/regression-test-with-multiplex-1907.bz2
Warning: Permanently added 'logs.aws.gluster.org,18.219.45.211' (ECDSA) to the list of known hosts.
scp: /var/www/glusterfs-logs/regression-test-with-multiplex-1907.bz2: No space left on device
+ true
+ echo 'Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1907.bz2'
Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1907.bz2
+ echo 'Open core using the following command to get a proper stack'
Open core using the following command to get a proper stack
+ echo 'Example: From root of extracted tarball'
Example: From root of extracted tarball
+ echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>'
\t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd>
+ RET=1
+ '[' 1 -ne 0 ']'
+ tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/1907/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20200524 /var/log/messages-20200531 /var/log/messages-20200607 /var/log/messages-20200614
tar: Removing leading `/' from member names
+ case $(uname -s) in
++ uname -s
+ /sbin/sysctl -w kernel.core_pattern=/%e-%p.core
kernel.core_pattern = /%e-%p.core
+ exit 1
Logs are archived at Build artifacts: https://build.gluster.org/job/regression-test-with-multiplex/
Build step 'Execute shell' marked build as failure
More information about the maintainers
mailing list