<div dir="ltr"><div><div>I have posted a patch (<a href="https://review.gluster.org/#/c/20427/">https://review.gluster.org/#/c/20427/</a>) to resolve the same.<br><br></div>Regards<br></div>Mohit Agrawal<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Sat, Jun 30, 2018 at 10:05 AM, Atin Mukherjee <span dir="ltr">&lt;<a href="mailto:amukherj@redhat.com" target="_blank">amukherj@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div dir="auto">+Mohit</div></div><div dir="auto"><br></div><div dir="auto">Is this a new crash? I’ve not seen multiplex regressions dumping core in recent times.</div><div><br><div class="gmail_quote"><div dir="ltr">On Sat, 30 Jun 2018 at 00:25, &lt;<a href="mailto:jenkins@build.gluster.org" target="_blank">jenkins@build.gluster.org</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">See &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/786/display/redirect?page=changes" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/786/display/<wbr>redirect?page=changes</a>&gt;<br>
<br>
Changes:<br>
<br>
[Varsha Rao] xlators/features/barrier: Fix RESOURCE_LEAK<br>
<br>
[Niels de Vos] extras/group : add database workload profile<br>
<br>
[Amar Tumballi] xlators/meta: Fix resource_leak<br>
<br>
[Raghavendra G] cluster/dht: Do not try to use up the readdirp buffer<br>
<br>
------------------------------<wbr>------------<br>
[...truncated 2.63 MB...]<br>
        arguments = {{gp_offset = 0, fp_offset = 0, overflow_arg_area = 0x7f9a3247eb60, reg_save_area = 0x7f9a18144a18}}<br>
        msg = 0x0<br>
        ctx = 0xe1e010<br>
        host = 0x0<br>
        hints = {ai_flags = 0, ai_family = 0, ai_socktype = 0, ai_protocol = 0, ai_addrlen = 0, ai_addr = 0x0, ai_canonname = 0x0, ai_next = 0x0}<br>
        result = 0x0<br>
#12 0x00007f9a3241a394 in server_rpc_notify (rpc=0x7f9a340449a0, xl=0x7f9a3402fd40, event=RPCSVC_EVENT_DISCONNECT, data=0x7f9a1ebd99c0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/protocol/server/src/server.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/xlators/protocol/<wbr>server/src/server.c</a>&gt;:511<br>
        detached = true<br>
        this = 0x7f9a3402fd40<br>
        trans = 0x7f9a1ebd99c0<br>
        conf = 0x7f9a34037320<br>
        client = 0xff6830<br>
        auth_path = 0x7f9a34032210 &quot;/d/backends/vol01/brick0&quot;<br>
        ret = 0<br>
        victim_found = false<br>
        xlator_name = 0x0<br>
        ctx = 0xe1e010<br>
        top = 0x0<br>
        trav_p = 0x0<br>
        travxl = 0x0<br>
        xprtrefcount = 0<br>
        tmp = 0x0<br>
        __FUNCTION__ = &quot;server_rpc_notify&quot;<br>
#13 0x00007f9a46ff597f in rpcsvc_handle_disconnect (svc=0x7f9a340449a0, trans=0x7f9a1ebd99c0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-lib/src/rpcsvc.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-lib/src/<wbr>rpcsvc.c</a>&gt;:772<br>
        event = RPCSVC_EVENT_DISCONNECT<br>
        wrappers = 0x7f9a18da62c0<br>
        wrapper = 0x7f9a34044a30<br>
        ret = -1<br>
        i = 0<br>
        wrapper_count = 1<br>
        listener = 0x0<br>
#14 0x00007f9a46ff5afc in rpcsvc_notify (trans=0x7f9a1ebd99c0, mydata=0x7f9a340449a0, event=RPC_TRANSPORT_<wbr>DISCONNECT, data=0x7f9a1ebd99c0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-lib/src/rpcsvc.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-lib/src/<wbr>rpcsvc.c</a>&gt;:810<br>
        ret = -1<br>
        msg = 0x0<br>
        new_trans = 0x0<br>
        svc = 0x7f9a340449a0<br>
        listener = 0x0<br>
        __FUNCTION__ = &quot;rpcsvc_notify&quot;<br>
#15 0x00007f9a46ffb74b in rpc_transport_notify (this=0x7f9a1ebd99c0, event=RPC_TRANSPORT_<wbr>DISCONNECT, data=0x7f9a1ebd99c0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-lib/src/rpc-transport.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-lib/src/<wbr>rpc-transport.c</a>&gt;:537<br>
        ret = -1<br>
        __FUNCTION__ = &quot;rpc_transport_notify&quot;<br>
#16 0x00007f9a3be07ffb in socket_event_poll_err (this=0x7f9a1ebd99c0, gen=1, idx=140) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-transport/socket/src/socket.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-<wbr>transport/socket/src/socket.c</a>&gt;<wbr>:1209<br>
        priv = 0x7f9a1ebd9f20<br>
        socket_closed = true<br>
        __FUNCTION__ = &quot;socket_event_poll_err&quot;<br>
#17 0x00007f9a3be0d5ad in socket_event_handler (fd=372, idx=140, gen=1, data=0x7f9a1ebd99c0, poll_in=1, poll_out=0, poll_err=0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-transport/socket/src/socket.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-<wbr>transport/socket/src/socket.c</a>&gt;<wbr>:2627<br>
        this = 0x7f9a1ebd99c0<br>
        priv = 0x7f9a1ebd9f20<br>
        ret = -1<br>
        ctx = 0xe1e010<br>
        socket_closed = false<br>
        notify_handled = true<br>
        __FUNCTION__ = &quot;socket_event_handler&quot;<br>
#18 0x00007f9a472b1834 in event_dispatch_epoll_handler (event_pool=0xe55c30, event=0x7f9713f0aea0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/libglusterfs/src/<wbr>event-epoll.c</a>&gt;:587<br>
        ev_data = 0x7f9713f0aea4<br>
        slot = 0xe8a340<br>
        handler = 0x7f9a3be0d278 &lt;socket_event_handler&gt;<br>
        data = 0x7f9a1ebd99c0<br>
        idx = 140<br>
        gen = 1<br>
        ret = -1<br>
        fd = 372<br>
        handled_error_previously = false<br>
        __FUNCTION__ = &quot;event_dispatch_epoll_handler&quot;<br>
#19 0x00007f9a472b1b27 in event_dispatch_epoll_worker (data=0x7f972d6cb8d0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/libglusterfs/src/<wbr>event-epoll.c</a>&gt;:663<br>
        event = {events = 1, data = {ptr = 0x10000008c, fd = 140, u32 = 140, u64 = 4294967436}}<br>
        ret = 1<br>
        ev_data = 0x7f972d6cb8d0<br>
        event_pool = 0xe55c30<br>
        myindex = 106<br>
        timetodie = 0<br>
        __FUNCTION__ = &quot;event_dispatch_epoll_worker&quot;<br>
#20 0x00007f9a4628ce25 in start_thread () from /lib64/libpthread.so.0<br>
No symbol table info available.<br>
#21 0x00007f9a45951bad in clone () from /lib64/libc.so.6<br>
No symbol table info available.<br>
<br>
Thread 1 (Thread 0x7f97caf1a700 (LWP 24553)):<br>
#0  0x00007f9a32b037fc in quota_lookup (frame=0x7f9a2c02f778, this=0x7f99f45e3ad0, loc=0x7f97caf198d0, xattr_req=0x0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/quota/src/quota.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/xlators/features/<wbr>quota/src/quota.c</a>&gt;:1663<br>
        priv = 0x0<br>
        ret = -1<br>
        local = 0x0<br>
        __FUNCTION__ = &quot;quota_lookup&quot;<br>
#1  0x00007f9a328df23b in io_stats_lookup (frame=0x7f9a2c004048, this=0x7f99f45e52c0, loc=0x7f97caf198d0, xdata=0x0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/debug/io-stats/src/io-stats.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/xlators/debug/io-<wbr>stats/src/io-stats.c</a>&gt;:2784<br>
        _new = 0x7f9a2c02f778<br>
        old_THIS = 0x7f99f45e52c0<br>
        next_xl_fn = 0x7f9a32b037a7 &lt;quota_lookup&gt;<br>
        tmp_cbk = 0x7f9a328d30f2 &lt;io_stats_lookup_cbk&gt;<br>
        __FUNCTION__ = &quot;io_stats_lookup&quot;<br>
#2  0x00007f9a4730d76d in default_lookup (frame=0x7f9a2c004048, this=0x7f99f45e6e20, loc=0x7f97caf198d0, xdata=0x0) at defaults.c:2714<br>
        old_THIS = 0x7f99f45e6e20<br>
        next_xl = 0x7f99f45e52c0<br>
        next_xl_fn = 0x7f9a328dee1e &lt;io_stats_lookup&gt;<br>
        opn = 27<br>
        __FUNCTION__ = &quot;default_lookup&quot;<br>
#3  0x00007f9a47289c41 in syncop_lookup (subvol=0x7f99f45e6e20, loc=0x7f97caf198d0, iatt=0x7f97caf19830, parent=0x0, xdata_in=0x0, xdata_out=0x0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/libglusterfs/src/<wbr>syncop.c</a>&gt;:1260<br>
        _new = 0x7f9a2c004048<br>
        old_THIS = 0x7f9a3402fd40<br>
        next_xl_fn = 0x7f9a4730d57f &lt;default_lookup&gt;<br>
        tmp_cbk = 0x7f9a47289683 &lt;syncop_lookup_cbk&gt;<br>
        task = 0x0<br>
        frame = 0x7f9a2c00a4a8<br>
        args = {op_ret = 0, op_errno = 0, iatt1 = {ia_flags = 0, ia_ino = 0, ia_dev = 0, ia_rdev = 0, ia_size = 0, ia_nlink = 0, ia_uid = 0, ia_gid = 0, ia_blksize = 0, ia_blocks = 0, ia_atime = 0, ia_mtime = 0, ia_ctime = 0, ia_btime = 0, ia_atime_nsec = 0, ia_mtime_nsec = 0, ia_ctime_nsec = 0, ia_btime_nsec = 0, ia_attributes = 0, ia_attributes_mask = 0, ia_gfid = &#39;\000&#39; &lt;repeats 15 times&gt;, ia_type = IA_INVAL, ia_prot = {suid = 0 &#39;\000&#39;, sgid = 0 &#39;\000&#39;, sticky = 0 &#39;\000&#39;, owner = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}, group = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}, other = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}}}, iatt2 = {ia_flags = 0, ia_ino = 0, ia_dev = 0, ia_rdev = 0, ia_size = 0, ia_nlink = 0, ia_uid = 0, ia_gid = 0, ia_blksize = 0, ia_blocks = 0, ia_atime = 0, ia_mtime = 0, ia_ctime = 0, ia_btime = 0, ia_atime_nsec = 0, ia_mtime_nsec = 0, ia_ctime_nsec = 0, ia_btime_nsec = 0, ia_attributes = 0, ia_attributes_mask = 0, ia_gf<br>
 id = &#39;\000&#39; &lt;repeats 15 times&gt;, ia_type = IA_INVAL, ia_prot = {suid = 0 &#39;\000&#39;, sgid = 0 &#39;\000&#39;, sticky = 0 &#39;\000&#39;, owner = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}, group = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}, other = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}}}, xattr = 0x0, statvfs_buf = {f_bsize = 0, f_frsize = 0, f_blocks = 0, f_bfree = 0, f_bavail = 0, f_files = 0, f_ffree = 0, f_favail = 0, f_fsid = 0, f_flag = 0, f_namemax = 0, __f_spare = {0, 0, 0, 0, 0, 0}}, vector = 0x0, count = 0, iobref = 0x0, buffer = 0x0, xdata = 0x0, flock = {l_type = 0, l_whence = 0, l_start = 0, l_len = 0, l_pid = 0, l_owner = {len = 0, data = &#39;\000&#39; &lt;repeats 1023 times&gt;}}, lease = {cmd = 0, lease_type = NONE, lease_id = &#39;\000&#39; &lt;repeats 15 times&gt;, lease_flags = 0}, dict_out = 0x0, uuid = &#39;\000&#39; &lt;repeats 15 times&gt;, errstr = 0x0, dict = 0x0, lock_dict = {__data = {__lock = 0, __count = 0, __owner = 0, __nusers = 0, __kind = 0, __spins = 0, __elision = 0,<br>
  __list = {__prev = 0x0, __next = 0x0}}, __size = &#39;\000&#39; &lt;repeats 39 times&gt;, __align = 0}, barrier = {initialized = false, guard = {__data = {__lock = 0, __count = 0, __owner = 0, __nusers = 0, __kind = 0, __spins = 0, __elision = 0, __list = {__prev = 0x0, __next = 0x0}}, __size = &#39;\000&#39; &lt;repeats 39 times&gt;, __align = 0}, cond = {__data = {__lock = 0, __futex = 0, __total_seq = 0, __wakeup_seq = 0, __woken_seq = 0, __mutex = 0x0, __nwaiters = 0, __broadcast_seq = 0}, __size = &#39;\000&#39; &lt;repeats 47 times&gt;, __align = 0}, waitq = {next = 0x0, prev = 0x0}, count = 0, waitfor = 0}, task = 0x0, mutex = {__data = {__lock = 0, __count = 0, __owner = 0, __nusers = 0, __kind = 0, __spins = 0, __elision = 0, __list = {__prev = 0x0, __next = 0x0}}, __size = &#39;\000&#39; &lt;repeats 39 times&gt;, __align = 0}, cond = {__data = {__lock = 0, __futex = 0, __total_seq = 0, __wakeup_seq = 0, __woken_seq = 0, __mutex = 0x0, __nwaiters = 0, __broadcast_seq = 0}, __size = &#39;\000&#39; &lt;repeats 47 times&gt;, __align = 0<br>
 }, done = 0, entries = {{list = {next = 0x0, prev = 0x0}, {next = 0x0, prev = 0x0}}, d_ino = 0, d_off = 0, d_len = 0, d_type = 0, d_stat = {ia_flags = 0, ia_ino = 0, ia_dev = 0, ia_rdev = 0, ia_size = 0, ia_nlink = 0, ia_uid = 0, ia_gid = 0, ia_blksize = 0, ia_blocks = 0, ia_atime = 0, ia_mtime = 0, ia_ctime = 0, ia_btime = 0, ia_atime_nsec = 0, ia_mtime_nsec = 0, ia_ctime_nsec = 0, ia_btime_nsec = 0, ia_attributes = 0, ia_attributes_mask = 0, ia_gfid = &#39;\000&#39; &lt;repeats 15 times&gt;, ia_type = IA_INVAL, ia_prot = {suid = 0 &#39;\000&#39;, sgid = 0 &#39;\000&#39;, sticky = 0 &#39;\000&#39;, owner = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}, group = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}, other = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}}}, dict = 0x0, inode = 0x0, d_name = 0x7f97caf19358 &quot;&quot;}, offset = 0, locklist = {list = {next = 0x0, prev = 0x0}, flock = {l_type = 0, l_whence = 0, l_start = 0, l_len = 0, l_pid = 0, l_owner = {len = 0, data = &#39;\000&#39; &lt;repeats 1023 tim<br>
 es&gt;}}, client_uid = 0x0, lk_flags = 0}}<br>
        __FUNCTION__ = &quot;syncop_lookup&quot;<br>
#4  0x00007f9a3245b582 in server_first_lookup (this=0x7f9a3402fd40, client=0x7f9a2d455980, reply=0x7f9a2c019198) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/protocol/server/src/server-handshake.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/xlators/protocol/<wbr>server/src/server-handshake.c</a>&gt;<wbr>:382<br>
        loc = {path = 0x7f9a32482ae5 &quot;/&quot;, name = 0x7f9a32482bea &quot;&quot;, inode = 0x7f975994e518, parent = 0x0, gfid = &#39;\000&#39; &lt;repeats 15 times&gt;, &quot;\001&quot;, pargfid = &#39;\000&#39; &lt;repeats 15 times&gt;}<br>
        iatt = {ia_flags = 0, ia_ino = 0, ia_dev = 0, ia_rdev = 0, ia_size = 0, ia_nlink = 0, ia_uid = 0, ia_gid = 0, ia_blksize = 0, ia_blocks = 0, ia_atime = 0, ia_mtime = 0, ia_ctime = 0, ia_btime = 0, ia_atime_nsec = 0, ia_mtime_nsec = 0, ia_ctime_nsec = 0, ia_btime_nsec = 0, ia_attributes = 0, ia_attributes_mask = 0, ia_gfid = &#39;\000&#39; &lt;repeats 15 times&gt;, ia_type = IA_INVAL, ia_prot = {suid = 0 &#39;\000&#39;, sgid = 0 &#39;\000&#39;, sticky = 0 &#39;\000&#39;, owner = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}, group = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}, other = {read = 0 &#39;\000&#39;, write = 0 &#39;\000&#39;, exec = 0 &#39;\000&#39;}}}<br>
        dict = 0x0<br>
        ret = 0<br>
        xl = 0x7f99f45e6e20<br>
        msg = 0x0<br>
        inode = 0x0<br>
        bname = 0x0<br>
        str = 0x0<br>
        tmp = 0x0<br>
        saveptr = 0x0<br>
        __FUNCTION__ = &quot;server_first_lookup&quot;<br>
#5  0x00007f9a3245d0ed in server_setvolume (req=0x7f9a2c02ca68) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/protocol/server/src/server-handshake.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/xlators/protocol/<wbr>server/src/server-handshake.c</a>&gt;<wbr>:886<br>
        args = {dict = {dict_len = 841, dict_val = 0x7f9a2d474090 &quot;&quot;}}<br>
        rsp = 0x0<br>
        client = 0x7f9a2d455980<br>
        serv_ctx = 0x7f9a2d455d70<br>
        conf = 0x7f9a34037320<br>
        peerinfo = 0x7f9a2d451ad0<br>
        reply = 0x7f9a2c019198<br>
        config_params = 0x7f9a2c0101c8<br>
        params = 0x7f9a2c010448<br>
        name = 0x7f9a2d4c22f0 &quot;/d/backends/vol02/brick3&quot;<br>
        client_uid = 0x7f9a2d4790e0 &quot;CTX_ID:21c57b5f-40da-4b9b-<wbr>b8e4-a3400fc28deb-GRAPH_ID:0-<wbr>PID:23286-HOST:builder104.<wbr>cloud.gluster.org-PC_NAME:<wbr>patchy-vol02-client-3-RECON_<wbr>NO:-0&quot;<br>
        clnt_version = 0x7f9a2d441360 &quot;4.2dev&quot;<br>
        xl = 0x7f99f45e6e20<br>
        msg = 0x0<br>
        volfile_key = 0x7f9a2d47ca30 &quot;gluster/glustershd&quot;<br>
        this = 0x7f9a3402fd40<br>
        checksum = 0<br>
        ret = 0<br>
        op_ret = 0<br>
        op_errno = 22<br>
        buf = 0x0<br>
        opversion = 40200<br>
        xprt = 0x7f9a34036eb0<br>
        fop_version = 1298437<br>
        mgmt_version = 0<br>
        ctx = 0xe1e010<br>
        tmp = 0x7f99f4b92e50<br>
        subdir_mount = 0x0<br>
        client_name = 0x7f9a2d441560 &quot;glustershd&quot;<br>
        cleanup_starting = false<br>
        __FUNCTION__ = &quot;server_setvolume&quot;<br>
        __PRETTY_FUNCTION__ = &quot;server_setvolume&quot;<br>
#6  0x00007f9a46ff57e2 in rpcsvc_handle_rpc_call (svc=0x7f9a340449a0, trans=0x7f9a2d451a10, msg=0x7f9a2d4ae6b0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-lib/src/rpcsvc.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-lib/src/<wbr>rpcsvc.c</a>&gt;:721<br>
        actor = 0x7f9a326958c0 &lt;gluster_handshake_actors+64&gt;<br>
        actor_fn = 0x7f9a3245b876 &lt;server_setvolume&gt;<br>
        req = 0x7f9a2c02ca68<br>
        ret = -1<br>
        port = 48482<br>
        is_unix = false<br>
        empty = false<br>
        unprivileged = true<br>
        reply = 0x0<br>
        drc = 0x0<br>
        __FUNCTION__ = &quot;rpcsvc_handle_rpc_call&quot;<br>
#7  0x00007f9a46ff5b35 in rpcsvc_notify (trans=0x7f9a2d451a10, mydata=0x7f9a340449a0, event=RPC_TRANSPORT_MSG_<wbr>RECEIVED, data=0x7f9a2d4ae6b0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-lib/src/rpcsvc.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-lib/src/<wbr>rpcsvc.c</a>&gt;:815<br>
        ret = -1<br>
        msg = 0x7f9a2d4ae6b0<br>
        new_trans = 0x0<br>
        svc = 0x7f9a340449a0<br>
        listener = 0x0<br>
        __FUNCTION__ = &quot;rpcsvc_notify&quot;<br>
#8  0x00007f9a46ffb74b in rpc_transport_notify (this=0x7f9a2d451a10, event=RPC_TRANSPORT_MSG_<wbr>RECEIVED, data=0x7f9a2d4ae6b0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-lib/src/rpc-transport.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-lib/src/<wbr>rpc-transport.c</a>&gt;:537<br>
        ret = -1<br>
        __FUNCTION__ = &quot;rpc_transport_notify&quot;<br>
#9  0x00007f9a3be0ced8 in socket_event_poll_in (this=0x7f9a2d451a10, notify_handled=true) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-transport/socket/src/socket.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-<wbr>transport/socket/src/socket.c</a>&gt;<wbr>:2462<br>
        ret = 0<br>
        pollin = 0x7f9a2d4ae6b0<br>
        priv = 0x7f9a2d473db0<br>
        ctx = 0xe1e010<br>
#10 0x00007f9a3be0d546 in socket_event_handler (fd=562, idx=291, gen=1, data=0x7f9a2d451a10, poll_in=1, poll_out=0, poll_err=0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/rpc/rpc-transport/socket/src/socket.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/rpc/rpc-<wbr>transport/socket/src/socket.c</a>&gt;<wbr>:2618<br>
        this = 0x7f9a2d451a10<br>
        priv = 0x7f9a2d473db0<br>
        ret = 0<br>
        ctx = 0xe1e010<br>
        socket_closed = false<br>
        notify_handled = false<br>
        __FUNCTION__ = &quot;socket_event_handler&quot;<br>
#11 0x00007f9a472b1834 in event_dispatch_epoll_handler (event_pool=0xe55c30, event=0x7f97caf19ea0) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/libglusterfs/src/<wbr>event-epoll.c</a>&gt;:587<br>
        ev_data = 0x7f97caf19ea4<br>
        slot = 0xe8dbe0<br>
        handler = 0x7f9a3be0d278 &lt;socket_event_handler&gt;<br>
        data = 0x7f9a2d451a10<br>
        idx = 291<br>
        gen = 1<br>
        ret = -1<br>
        fd = 562<br>
        handled_error_previously = false<br>
        __FUNCTION__ = &quot;event_dispatch_epoll_handler&quot;<br>
#12 0x00007f9a472b1b27 in event_dispatch_epoll_worker (data=0x7f9a11cee770) at &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/libglusterfs/src/<wbr>event-epoll.c</a>&gt;:663<br>
        event = {events = 1, data = {ptr = 0x100000123, fd = 291, u32 = 291, u64 = 4294967587}}<br>
        ret = 1<br>
        ev_data = 0x7f9a11cee770<br>
        event_pool = 0xe55c30<br>
        myindex = 82<br>
        timetodie = 0<br>
        __FUNCTION__ = &quot;event_dispatch_epoll_worker&quot;<br>
#13 0x00007f9a4628ce25 in start_thread () from /lib64/libpthread.so.0<br>
No symbol table info available.<br>
#14 0x00007f9a45951bad in clone () from /lib64/libc.so.6<br>
No symbol table info available.<br>
==============================<wbr>===========================<br>
              Finish backtrace<br>
         program name : /build/install/sbin/glusterfsd<br>
         corefile     : /glusterepoll81-23297.core<br>
==============================<wbr>===========================<br>
<br>
+ rm -f /build/install/cores/gdbout.<wbr>txt<br>
+ sort /build/install/cores/liblist.<wbr>txt<br>
+ uniq<br>
+ cat /build/install/cores/liblist.<wbr>txt.tmp<br>
+ grep -v /build/install<br>
+ tar -cf /archives/archived_builds/<wbr>build-install-regression-test-<wbr>with-multiplex-786.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores<br>
tar: Removing leading `/&#39; from member names<br>
+ tar -rhf /archives/archived_builds/<wbr>build-install-regression-test-<wbr>with-multiplex-786.tar -T /build/install/cores/liblist.<wbr>txt<br>
tar: Removing leading `/&#39; from member names<br>
+ bzip2 /archives/archived_builds/<wbr>build-install-regression-test-<wbr>with-multiplex-786.tar<br>
+ rm -f /build/install/cores/liblist.<wbr>txt<br>
+ rm -f /build/install/cores/liblist.<wbr>txt.tmp<br>
+ find /archives -size +1G -delete -type f<br>
+ echo &#39;Cores and build archived in <a href="http://builder104.cloud.gluster.org/archived_builds/build-install-regression-test-with-multiplex-786.tar.bz2" rel="noreferrer" target="_blank">http://builder104.cloud.<wbr>gluster.org/archived_builds/<wbr>build-install-regression-test-<wbr>with-multiplex-786.tar.bz2</a>&#39;<br>
Cores and build archived in <a href="http://builder104.cloud.gluster.org/archived_builds/build-install-regression-test-with-multiplex-786.tar.bz2" rel="noreferrer" target="_blank">http://builder104.cloud.<wbr>gluster.org/archived_builds/<wbr>build-install-regression-test-<wbr>with-multiplex-786.tar.bz2</a><br>
+ echo &#39;Open core using the following command to get a proper stack&#39;<br>
Open core using the following command to get a proper stack<br>
+ echo &#39;Example: From root of extracted tarball&#39;<br>
Example: From root of extracted tarball<br>
+ echo &#39;\t\tgdb -ex &#39;\&#39;&#39;set sysroot ./&#39;\&#39;&#39; -ex &#39;\&#39;&#39;core-file ./build/install/cores/xxx.<wbr>core&#39;\&#39;&#39; &lt;target, say ./build/install/sbin/glusterd&gt;<wbr>&#39;<br>
\t\tgdb -ex &#39;set sysroot ./&#39; -ex &#39;core-file ./build/install/cores/xxx.<wbr>core&#39; &lt;target, say ./build/install/sbin/glusterd&gt;<br>
+ RET=1<br>
+ &#39;[&#39; 1 -ne 0 &#39;]&#39;<br>
+ tar -czf &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/786/artifact/glusterfs-logs.tgz" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/786/artifact/<wbr>glusterfs-logs.tgz</a>&gt; /var/log/glusterfs /var/log/messages /var/log/messages-20180603 /var/log/messages-20180610 /var/log/messages-20180617 /var/log/messages-20180624<br>
tar: Removing leading `/&#39; from member names<br>
+ scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i &lt;<a href="https://build.gluster.org/job/regression-test-with-multiplex/ws/" rel="noreferrer" target="_blank">https://build.gluster.org/<wbr>job/regression-test-with-<wbr>multiplex/ws/</a>&gt; glusterfs-logs.tgz _logs_collector@http.int.rht.<wbr>gluster.org:/var/www/<wbr>glusterfs-logs/regression-<wbr>test-with-multiplex-786.tgz<br>
ssh: connect to host <a href="http://http.int.rht.gluster.org" rel="noreferrer" target="_blank">http.int.rht.gluster.org</a> port 22: Connection timed out<br>
lost connection<br>
+ true<br>
+ case $(uname -s) in<br>
++ uname -s<br>
+ /sbin/sysctl -w &#39;kernel.core_pattern=|/usr/<wbr>libexec/abrt-hook-ccpp %s %c %p %u %g %t %e %P %I %h&#39;<br>
kernel.core_pattern = |/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t %e %P %I %h<br>
+ exit 1<br>
Build step &#39;Execute shell&#39; marked build as failure<br>
______________________________<wbr>_________________<br>
maintainers mailing list<br>
<a href="mailto:maintainers@gluster.org" target="_blank">maintainers@gluster.org</a><br>
<a href="http://lists.gluster.org/mailman/listinfo/maintainers" rel="noreferrer" target="_blank">http://lists.gluster.org/<wbr>mailman/listinfo/maintainers</a><span class="HOEnZb"><font color="#888888"><br>
</font></span></blockquote></div></div><span class="HOEnZb"><font color="#888888">-- <br><div dir="ltr" class="m_-6372910042309826902gmail_signature" data-smartmail="gmail_signature">- Atin (atinm)</div>
</font></span></blockquote></div><br></div>