[Gluster-devel] Fwd: [Gluster-Maintainers] Build failed in Jenkins: regression-test-burn-in #4067
Atin Mukherjee
amukherj at redhat.com
Sat Aug 18 02:12:59 UTC 2018
C7 nightly has a crash too.
---------- Forwarded message ---------
From: <jenkins at build.gluster.org>
Date: Sat, 18 Aug 2018 at 00:01
Subject: [Gluster-Maintainers] Build failed in Jenkins:
regression-test-burn-in #4067
To: <maintainers at gluster.org>
See <
https://build.gluster.org/job/regression-test-burn-in/4067/display/redirect?page=changes
>
Changes:
[Amar Tumballi] jbr : fix coverity issues in jbr
[Amar Tumballi] statedump : fix coverity issues
[Amar Tumballi] glusterd: coverity defects fix introduced by commit 1f3bfe7
[Amar Tumballi] features/acl: Fix a possible null dereference
[Amar Tumballi] meta : fix coverity in meta-helpers.c
[Amar Tumballi] nfs-server-mount : fix coverity issues in mount3.c
[Amar Tumballi] posix: FORWARD_NULL coverity fix
[Amar Tumballi] locks: FORWARD_NULL coverity fix
[Amar Tumballi] doc: Add details around xlator categories
[Amar Tumballi] features/changelog: Fix missing unlocks
------------------------------------------
[...truncated 981.94 KB...]
this = 0x7f6f2c007e50
priv = 0x7f6f2c0ab440
stub = 0x0
tmp = 0x0
list = {next = 0x7f6f0f7fde90, prev = 0x7f6f0f7fde90}
count = 0
do_fsync = true
__FUNCTION__ = "posix_fsyncer"
#3 0x00007f6f3d561e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f6f3cc26bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 10 (Thread 0x7f6f24233700 (LWP 28244)):
#0 0x00007f6f3d565d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f6f2a810737 in iot_worker (data=0x7f6f2c068f40) at <
https://build.gluster.org/job/regression-test-burn-in/ws/xlators/performance/io-threads/src/io-threads.c
>:195
conf = 0x7f6f2c068f40
this = 0x7f6f2c020020
stub = 0x0
sleep_till = {tv_sec = 1534527479, tv_nsec = 542650613}
ret = 0
pri = -1
bye = false
__FUNCTION__ = "iot_worker"
#2 0x00007f6f3d561e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f6f3cc26bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 9 (Thread 0x7f6f3ea2a780 (LWP 28136)):
#0 0x00007f6f3d562f97 in pthread_join () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f6f3e589159 in event_dispatch_epoll (event_pool=0x770c30) at <
https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/event-epoll.c
>:750
i = 1
t_id = 140115546580736
pollercount = 1
ret = 0
ev_data = 0x7bc6c0
thread_name = "epoll000\000\000"
__FUNCTION__ = "event_dispatch_epoll"
#2 0x00007f6f3e546b4a in event_dispatch (event_pool=0x770c30) at <
https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/event.c
>:124
ret = -1
__FUNCTION__ = "event_dispatch"
#3 0x000000000040b539 in ?? ()
No symbol table info available.
#4 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 8 (Thread 0x7f6f35afe700 (LWP 28137)):
#0 0x00007f6f3d568f3d in nanosleep () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f6f3e520ef4 in gf_timer_proc (data=0x7796f0) at <
https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/timer.c
>:202
now = 516473032615399
now_ts = {tv_sec = 516473, tv_nsec = 32615399}
reg = 0x7796f0
sleepts = {tv_sec = 1, tv_nsec = 0}
event = 0x779700
tmp = 0x779700
old_THIS = 0x7f6f3e81a2c0 <global_xlator>
#2 0x00007f6f3d561e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f6f3cc26bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 7 (Thread 0x7f6f24274700 (LWP 28202)):
#0 0x00007f6f3d565d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f6f2a810737 in iot_worker (data=0x7f6f2c068f40) at <
https://build.gluster.org/job/regression-test-burn-in/ws/xlators/performance/io-threads/src/io-threads.c
>:195
conf = 0x7f6f2c068f40
this = 0x7f6f2c020020
stub = 0x0
sleep_till = {tv_sec = 1534527479, tv_nsec = 542650613}
ret = 0
pri = -1
bye = false
__FUNCTION__ = "iot_worker"
#2 0x00007f6f3d561e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f6f3cc26bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 6 (Thread 0x7f6f2647a700 (LWP 28150)):
#0 0x00007f6f3cc1dc73 in select () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f6f2b92aace in changelog_ev_dispatch (data=0x7f6f2c08c0a8) at <
https://build.gluster.org/job/regression-test-burn-in/ws/xlators/features/changelog/src/changelog-ev-handle.c
>:350
ret = 3
opaque = 0x0
this = 0x7f6f2c0116b0
c_clnt = 0x7f6f2c08c0a8
tv = {tv_sec = 0, tv_usec = 128007}
__FUNCTION__ = "changelog_ev_dispatch"
#2 0x00007f6f3d561e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f6f3cc26bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 5 (Thread 0x7f6f3e8c9700 (LWP 28146)):
#0 0x00007f6f3d565d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f6f2a810737 in iot_worker (data=0x7f6f2c068f40) at <
https://build.gluster.org/job/regression-test-burn-in/ws/xlators/performance/io-threads/src/io-threads.c
>:195
conf = 0x7f6f2c068f40
this = 0x7f6f2c020020
stub = 0x0
sleep_till = {tv_sec = 1534527479, tv_nsec = 543650641}
ret = 0
pri = -1
bye = false
__FUNCTION__ = "iot_worker"
#2 0x00007f6f3d561e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007f6f3cc26bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 4 (Thread 0x7f6f33afa700 (LWP 28141)):
#0 0x00007f6f3d565d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f6f3e55f8a6 in syncenv_task (proc=0x77a2f0) at <
https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/syncop.c
>:603
env = 0x779f30
task = 0x0
sleep_till = {tv_sec = 1534527889, tv_nsec = 0}
ret = 0
#2 0x00007f6f3e55fb41 in syncenv_processor (thdata=0x77a2f0) at <
https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/syncop.c
>:695
env = 0x779f30
proc = 0x77a2f0
task = 0x0
#3 0x00007f6f3d561e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f6f3cc26bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 3 (Thread 0x7f6f34afc700 (LWP 28139)):
#0 0x00007f6f3cbed56d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007f6f3cbed404 in sleep () from /lib64/libc.so.6
No symbol table info available.
#2 0x00007f6f3e54830e in pool_sweeper (arg=0x0) at <
https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/mem-pool.c
>:470
state = {death_row = {next = 0x7f6f34af9e90, prev =
0x7f6f34af9e90}, cold_lists = {0x7f6f18002030, 0x7f6f2c002000,
0x7f6f2c000d70, 0x7ba510, 0x0 <repeats 1020 times>}, n_cold_lists = 4}
pool_list = 0x7f6f34af9e90
next_pl = 0x7f6f34af9e90
pt_pool = 0x0
i = 4
begin_time = {tv_sec = 1534527349, tv_usec = 820624}
end_time = {tv_sec = 1534527349, tv_usec = 820631}
elapsed = {tv_sec = 0, tv_usec = 7}
#3 0x00007f6f3d561e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f6f3cc26bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 2 (Thread 0x7f6f342fb700 (LWP 28140)):
#0 0x00007f6f3d565d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1 0x00007f6f3e55f8a6 in syncenv_task (proc=0x779f30) at <
https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/syncop.c
>:603
env = 0x779f30
task = 0x0
sleep_till = {tv_sec = 1534527889, tv_nsec = 0}
ret = 0
#2 0x00007f6f3e55fb41 in syncenv_processor (thdata=0x779f30) at <
https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/syncop.c
>:695
env = 0x779f30
proc = 0x779f30
task = 0x0
#3 0x00007f6f3d561e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007f6f3cc26bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 1 (Thread 0x7f6f352fd700 (LWP 28138)):
#0 0x00007f6f3e549039 in mem_get (mem_pool=0x73a4d000) at <
https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/mem-pool.c
>:826
pool_list = 0x7f6ee8000980
pt_pool = 0x29383878302b7469
retval = 0x0
__FUNCTION__ = "mem_get"
#1 0x00007f6f3e2d5d83 in rpc_clnt_submit (rpc=0x7ba7f0,
prog=0x7f6f3e4e39e0 <clnt_pmap_signout_prog>, procnum=5,
cbkfn=0x7f6f3e2dadef <mgmt_pmap_signout_cbk>, proghdr=0x7f6f352fbd40,
proghdrcount=1, progpayload=0x0, progpayloadcount=0, iobref=0x7f6ee8000930,
frame=0x7f6ee8001328, rsphdr=0x0, rsphdr_count=0, rsp_payload=0x0,
rsp_payload_count=0, rsp_iobref=0x0) at <
https://build.gluster.org/job/regression-test-burn-in/ws/rpc/rpc-lib/src/rpc-clnt.c
>:1654
conn = 0x7ba820
request_iob = 0x0
rpchdr = {iov_base = 0x0, iov_len = 0}
rpcreq = 0x0
req = {msg = {rpchdr = 0x0, rpchdrcount = 0, proghdr = 0x0,
proghdrcount = 0, progpayload = 0x0, progpayloadcount = 0, iobref = 0x0},
rsp = {rsphdr = 0x0, rsphdr_count = 892320976, rsp_payload = 0x7f6f3e0a20aa
<xdr_serialize_generic+133>, rsp_payload_count = 1040953334, rsp_iobref =
0x7f6f352fcd50}, rpc_req = 0x7f6f3ea29f00}
ret = -1
proglen = 0
new_iobref = 0 '\000'
callid = 0
need_unref = false
__FUNCTION__ = "rpc_clnt_submit"
#2 0x00007f6f3e2db23b in rpc_clnt_mgmt_pmap_signout (ctx=0x739010,
brickname=0x7f6f2c02eff0 "/d/backends/2/patchy") at <
https://build.gluster.org/job/regression-test-burn-in/ws/rpc/rpc-lib/src/mgmt-pmap.c
>:127
ret = 32
req = {brick = 0x7f6f2c02eff0 "/d/backends/2/patchy", port = 49153,
rdma_port = 0}
frame = 0x7f6ee8001328
cmd_args = 0x739010
brick_name = '\000' <repeats 4095 times>
iov = {iov_base = 0x7f6f3ea29f00, iov_len = 32}
iobuf = 0x754c10
iobref = 0x7f6ee8000930
xdr_size = 32
__FUNCTION__ = "rpc_clnt_mgmt_pmap_signout"
#3 0x0000000000408b61 in ?? ()
No symbol table info available.
#4 0x0000000000000001 in ?? ()
No symbol table info available.
#5 0x00000000000186c0 in ?? ()
No symbol table info available.
#6 0x0000000000414880 in ?? ()
No symbol table info available.
#7 0x000000000000000f in ?? ()
No symbol table info available.
#8 0x0000000000000000 in ?? ()
No symbol table info available.
=========================================================
Finish backtrace
program name : /build/install/sbin/glusterfsd
corefile : /glfs_sigwait-28136.core
=========================================================
+ rm -f /build/install/cores/gdbout.txt
+ sort /build/install/cores/liblist.txt
+ uniq
+ cat /build/install/cores/liblist.txt.tmp
+ grep -v /build/install
+ tar -cf
/archives/archived_builds/build-install-regression-test-burn-in-4067.tar
/build/install/sbin /build/install/bin /build/install/lib
/build/install/libexec /build/install/cores
tar: Removing leading `/' from member names
+ tar -rhf
/archives/archived_builds/build-install-regression-test-burn-in-4067.tar -T
/build/install/cores/liblist.txt
tar: Removing leading `/' from member names
+ bzip2
/archives/archived_builds/build-install-regression-test-burn-in-4067.tar
+ rm -f /build/install/cores/liblist.txt
+ rm -f /build/install/cores/liblist.txt.tmp
+ find /archives -size +1G -delete -type f
+ echo 'Cores and build archived in
http://builder103.cloud.gluster.org/archived_builds/build-install-regression-test-burn-in-4067.tar.bz2
'
Cores and build archived in
http://builder103.cloud.gluster.org/archived_builds/build-install-regression-test-burn-in-4067.tar.bz2
+ echo 'Open core using the following command to get a proper stack'
Open core using the following command to get a proper stack
+ echo 'Example: From root of extracted tarball'
Example: From root of extracted tarball
+ echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file
./build/install/cores/xxx.core'\'' <target, say
./build/install/sbin/glusterd>'
\t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core'
<target, say ./build/install/sbin/glusterd>
+ RET=1
+ '[' 1 -ne 0 ']'
+ tar -czf <
https://build.gluster.org/job/regression-test-burn-in/4067/artifact/glusterfs-logs.tgz>
/var/log/glusterfs /var/log/messages /var/log/messages-20180722
/var/log/messages-20180729 /var/log/messages-20180805
/var/log/messages-20180812
tar: Removing leading `/' from member names
+ scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i <
https://build.gluster.org/job/regression-test-burn-in/ws/>
glusterfs-logs.tgz _logs_collector at http.int.rht.gluster.org:
/var/www/glusterfs-logs/regression-test-burn-in-4067.tgz
ssh: connect to host http.int.rht.gluster.org port 22: Connection timed out
lost connection
+ true
+ case $(uname -s) in
++ uname -s
+ /sbin/sysctl -w kernel.core_pattern=/%e-%p.core
kernel.core_pattern = /%e-%p.core
+ exit 1
Build step 'Execute shell' marked build as failure
_______________________________________________
maintainers mailing list
maintainers at gluster.org
https://lists.gluster.org/mailman/listinfo/maintainers
--
- Atin (atinm)
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-devel/attachments/20180818/c7059f77/attachment-0001.html>
More information about the Gluster-devel
mailing list