[Gluster-devel] Build failed in Jenkins: regression-test-with-multiplex #60

Ashish Pandey aspandey at redhat.com
Mon Jun 12 09:59:30 UTC 2017 

Ok, 

I will check if this is catching the data corruption or not after modifying the code in EC. 
Initially it was not doing so. 


----- Original Message -----

From: "Atin Mukherjee" <amukherj at redhat.com> 
To: "Ashish Pandey" <aspandey at redhat.com> 
Cc: "Gluster Devel" <gluster-devel at gluster.org> 
Sent: Monday, June 12, 2017 3:21:29 PM 
Subject: Re: Build failed in Jenkins: regression-test-with-multiplex #60 



On Mon, Jun 12, 2017 at 11:37 AM, Atin Mukherjee < amukherj at redhat.com > wrote: 





On Mon, Jun 12, 2017 at 11:15 AM, Ashish Pandey < aspandey at redhat.com > wrote: 

<blockquote>


Test is failing because of ENOTCONN. 

-----------------------------------------------------------------------------+ 
[2017-06-11 21:26:04.650497] I [fuse-bridge.c:4210:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.24 kernel 7.14 
[2017-06-11 21:26:04.650546] I [fuse-bridge.c:4840:fuse_graph_sync] 0-fuse: switched to graph 0 
[2017-06-11 21:26:04.650890] E [fuse-bridge.c:4276:fuse_first_lookup] 0-fuse: first lookup on root failed (Transport endpoint is not connected) 
[2017-06-11 21:26:04.651204] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) 
[2017-06-11 21:26:04.651231] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 2: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed 
[2017-06-11 21:26:04.651379] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) 
[2017-06-11 21:26:04.651396] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 3: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed 
[2017-06-11 21:26:05.654880] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) 
[2017-06-11 21:26:05.654921] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 4: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed 
[2017-06-11 21:26:05.655105] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) 
[2017-06-11 21:26:05.655132] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 5: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed 
[2017-06-11 21:26:06.658233] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) 
[2017-06-11 21:26:06.658294] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 6: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed 
[2017-06-11 21:26:06.658445] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) 
[2017-06-11 21:26:06.658471] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 7: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed 
[2017-06-11 21:26:07.661446] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) 
[2017-06-11 21:26:07.661487] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 8: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed 
[2017-06-11 21:26:07.661625] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) 
[2017-06-11 21:26:07.661642] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 9: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed 
[2017-06-11 21:26:08.664545] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) 
[2017-06-11 21:26:08.664598] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 10: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed 



In this test, we are trying to kill a brick and starting it using command line. 
I think that is what actually failing. 
In multiplexing, can we do it? Or is there some other way of doing the same thing? 




What's the reason of starting the brick from cmdline? Why can't we start the volume with force? 

</blockquote>


Posted a patch : https://review.gluster.org/#/c/17508 


<blockquote>



<blockquote>



Ashish 



From: "Atin Mukherjee" < amukherj at redhat.com > 
To: "Ashish Pandey" < aspandey at redhat.com > 
Cc: "Gluster Devel" < gluster-devel at gluster.org > 
Sent: Monday, June 12, 2017 10:10:05 AM 
Subject: Fwd: Build failed in Jenkins: regression-test-with-multiplex #60 


https://review.gluster.org/#/c/16985/ has introduced a new test ec-data-heal.t which is now constantly failing with brick multiplexing. Can this be looked at? 

---------- Forwarded message ---------- 
From: < jenkins at build.gluster.org > 
Date: Mon, Jun 12, 2017 at 6:33 AM 
Subject: Build failed in Jenkins: regression-test-with-multiplex #60 
To: maintainers at gluster.org , jeff at pl.atyp.us , avishwan at redhat.com , pkarampu at redhat.com , amukherj at redhat.com , xhernandez at datalab.es , rgowdapp at redhat.com , ndevos at redhat.com 


See < https://build.gluster.org/job/regression-test-with-multiplex/60/display/redirect > 

------------------------------------------ 
[...truncated 747.65 KB...] 
./tests/basic/glusterd/arbiter-volume-probe.t - 14 second 
./tests/basic/gfid-access.t - 14 second 
./tests/basic/ec/ec-root-heal.t - 14 second 
./tests/basic/afr/stale-file-lookup.t - 14 second 
./tests/bugs/replicate/bug-986905.t - 13 second 
./tests/bugs/replicate/bug-921231.t - 13 second 
./tests/bugs/replicate/bug-1325792.t - 13 second 
./tests/bugs/replicate/bug-1132102.t - 13 second 
./tests/bugs/quota/bug-1250582-volume-reset-should-not-remove-quota-quota-deem-statfs.t - 13 second 
./tests/bugs/quota/bug-1178130.t - 13 second 
./tests/bugs/protocol/bug-762989.t - 13 second 
./tests/bugs/posix/bug-1360679.t - 13 second 
./tests/bugs/glusterd/bug-955588.t - 13 second 
./tests/bugs/glusterd/bug-1242875-do-not-pass-volinfo-quota.t - 13 second 
./tests/bugs/fuse/bug-985074.t - 13 second 
./tests/bugs/bitrot/1207029-bitrot-daemon-should-start-on-valid-node.t - 13 second 
./tests/bitrot/bug-1207627-bitrot-scrub-status.t - 13 second 
./tests/basic/volume-status.t - 13 second 
./tests/basic/stats-dump.t - 13 second 
./tests/basic/inode-quota-enforcing.t - 13 second 
./tests/bugs/replicate/bug-1448804-check-quorum-type-values.t - 12 second 
./tests/bugs/nfs/bug-904065.t - 12 second 
./tests/bugs/nfs/bug-1157223-symlink-mounting.t - 12 second 
./tests/bugs/glusterfs/bug-902610.t - 12 second 
./tests/bugs/glusterfs/bug-872923.t - 12 second 
./tests/bugs/glusterd/bug-949930.t - 12 second 
./tests/bugs/glusterd/bug-889630.t - 12 second 
./tests/bugs/glusterd/bug-1121584-brick-existing-validation-for-remove-brick-status-stop.t - 12 second 
./tests/bugs/distribute/bug-961615.t - 12 second 
./tests/bugs/distribute/bug-1247563.t - 12 second 
./tests/bugs/distribute/bug-1088231.t - 12 second 
./tests/bugs/distribute/bug-1086228.t - 12 second 
./tests/bugs/cli/bug-1087487.t - 12 second 
./tests/bugs/cli/bug-1030580.t - 12 second 
./tests/bugs/cli/bug-1022905.t - 12 second 
./tests/bugs/bitrot/1209818-vol-info-show-scrub-process-properly.t - 12 second 
./tests/basic/quota-nfs.t - 12 second 
./tests/basic/pump.t - 12 second 
./tests/basic/md-cache/bug-1317785.t - 12 second 
./tests/basic/fop-sampling.t - 12 second 
./tests/performance/open-behind.t - 11 second 
./tests/features/ssl-authz.t - 11 second 
./tests/bugs/upcall/bug-1458127.t - 11 second 
./tests/bugs/upcall/bug-1227204.t - 11 second 
./tests/bugs/transport/bug-873367.t - 11 second 
./tests/bugs/snapshot/bug-1260848.t - 11 second 
./tests/bugs/replicate/bug-1250170-fsync.t - 11 second 
./tests/bugs/posix/bug-1122028.t - 11 second 
./tests/bugs/md-cache/bug-1211863.t - 11 second 
./tests/bugs/io-cache/bug-read-hang.t - 11 second 
./tests/bugs/glusterd/bug-948729/bug-948729.t - 11 second 
./tests/bugs/glusterd/bug-948729/bug-948729-mode-script.t - 11 second 
./tests/bugs/glusterd/bug-948729/bug-948729-force.t - 11 second 
./tests/bugs/glusterd/bug-1046308.t - 11 second 
./tests/bugs/ec/bug-1179050.t - 11 second 
./tests/bugs/distribute/bug-1122443.t - 11 second 
./tests/bugs/changelog/bug-1208470.t - 11 second 
./tests/bitrot/br-stub.t - 11 second 
./tests/basic/gfapi/gfapi-dup.t - 11 second 
./tests/basic/gfapi/bug-1241104.t - 11 second 
./tests/basic/ec/ec-read-policy.t - 11 second 
./tests/basic/ec/ec-anonymous-fd.t - 11 second 
./tests/features/readdir-ahead.t - 10 second 
./tests/bugs/tier/bug-1205545-CTR-and-trash-integration.t - 10 second 
./tests/bugs/snapshot/bug-1064768.t - 10 second 
./tests/bugs/replicate/bug-966018.t - 10 second 
./tests/bugs/replicate/bug-1365455.t - 10 second 
./tests/bugs/replicate/bug-1101647.t - 10 second 
./tests/bugs/quota/bug-1287996.t - 10 second 
./tests/bugs/quota/bug-1243798.t - 10 second 
./tests/bugs/quota/bug-1104692.t - 10 second 
./tests/bugs/posix/bug-990028.t - 10 second 
./tests/bugs/md-cache/afr-stale-read.t - 10 second 
./tests/bugs/glusterfs/bug-856455.t - 10 second 
./tests/bugs/glusterd/bug-888752.t - 10 second 
./tests/bugs/glusterd/bug-1179175-uss-option-validation.t - 10 second 
./tests/bugs/glusterd/bug-1102656.t - 10 second 
./tests/bugs/glusterd/bug-1091935-brick-order-check-from-cli-to-glusterd.t - 10 second 
./tests/bugs/glusterd/bug-1022055.t - 10 second 
./tests/bugs/ec/bug-1227869.t - 10 second 
./tests/bugs/core/bug-834465.t - 10 second 
./tests/bugs/bug-1258069.t - 10 second 
./tests/bugs/bitrot/bug-1229134-bitd-not-support-vol-set.t - 10 second 
./tests/basic/tier/ctr-rename-overwrite.t - 10 second 
./tests/basic/gfapi/upcall-cache-invalidate.t - 10 second 
./tests/basic/gfapi/libgfapi-fini-hang.t - 10 second 
./tests/basic/gfapi/glfs_xreaddirplus_r.t - 10 second 
./tests/basic/gfapi/anonymous_fd.t - 10 second 
./tests/basic/afr/gfid-heal.t - 10 second 
./tests/basic/afr/arbiter-remove-brick.t - 10 second 
./tests/bugs/upcall/bug-1369430.t - 9 second 
./tests/bugs/snapshot/bug-1178079.t - 9 second 
./tests/bugs/shard/bug-1342298.t - 9 second 
./tests/bugs/shard/bug-1260637.t - 9 second 
./tests/bugs/shard/bug-1258334.t - 9 second 
./tests/bugs/replicate/bug-767585-gfid.t - 9 second 
./tests/bugs/readdir-ahead/bug-1439640.t - 9 second 
./tests/bugs/posix/bug-1175711.t - 9 second 
./tests/bugs/nfs/bug-915280.t - 9 second 
./tests/bugs/nfs/bug-877885.t - 9 second 
./tests/bugs/nfs/bug-1143880-fix-gNFSd-auth-crash.t - 9 second 
./tests/bugs/nfs/bug-1116503.t - 9 second 
./tests/bugs/io-cache/bug-858242.t - 9 second 
./tests/bugs/glusterfs/bug-895235.t - 9 second 
./tests/bugs/glusterfs/bug-848251.t - 9 second 
./tests/bugs/glusterd/bug-1454418-seg-fault.t - 9 second 
./tests/bugs/glusterd/bug-1446172-brick-mux-reset-brick.t - 9 second 
./tests/bugs/glusterd/bug-1344407-volume-delete-on-node-down.t - 9 second 
./tests/bugs/glusterd/bug-1266818-shared-storage-disable.t - 9 second 
./tests/bugs/distribute/bug-884597.t - 9 second 
./tests/bugs/core/bug-986429.t - 9 second 
./tests/bugs/core/bug-908146.t - 9 second 
./tests/bugs/core/bug-1119582.t - 9 second 
./tests/bugs/bitrot/bug-1210684-scrub-pause-resume-error-handling.t - 9 second 
./tests/bitrot/bug-1221914.t - 9 second 
./tests/basic/ec/nfs.t - 9 second 
./tests/basic/ec/ec-internal-xattrs.t - 9 second 
./tests/basic/ec/ec-fallocate.t - 9 second 
./tests/basic/ec/dht-rename.t - 9 second 
./tests/basic/distribute/bug-1265677-use-readdirp.t - 9 second 
./tests/bugs/upcall/bug-upcall-stat.t - 8 second 
./tests/bugs/unclassified/bug-1034085.t - 8 second 
./tests/bugs/snapshot/bug-1111041.t - 8 second 
./tests/bugs/shard/bug-1259651.t - 8 second 
./tests/bugs/shard/bug-1256580.t - 8 second 
./tests/bugs/shard/bug-1245547.t - 8 second 
./tests/bugs/replicate/bug-976800.t - 8 second 
./tests/bugs/replicate/bug-880898.t - 8 second 
./tests/bugs/nfs/zero-atime.t - 8 second 
./tests/bugs/nfs/socket-as-fifo.t - 8 second 
./tests/bugs/nfs/bug-1166862.t - 8 second 
./tests/bugs/md-cache/bug-1211863_unlink.t - 8 second 
./tests/bugs/glusterfs-server/bug-873549.t - 8 second 
./tests/bugs/glusterfs-server/bug-864222.t - 8 second 
./tests/bugs/glusterfs/bug-893378.t - 8 second 
./tests/bugs/glusterd/bug-839595.t - 8 second 
./tests/bugs/glusterd/bug-1163108-min-free-disk-option-validation.t - 8 second 
./tests/bugs/distribute/bug-912564.t - 8 second 
./tests/bugs/distribute/bug-1368012.t - 8 second 
./tests/bugs/core/io-stats-1322825.t - 8 second 
./tests/bugs/core/bug-913544.t - 8 second 
./tests/bugs/cli/bug-961307.t - 8 second 
./tests/bugs/access-control/bug-1051896.t - 8 second 
./tests/basic/afr/heal-info.t - 8 second 
./tests/performance/quick-read.t - 7 second 
./tests/features/leases.t - 7 second 
./tests/bugs/upcall/bug-1422776.t - 7 second 
./tests/bugs/upcall/bug-1394131.t - 7 second 
./tests/bugs/trace/bug-797171.t - 7 second 
./tests/bugs/shard/bug-1272986.t - 7 second 
./tests/bugs/shard/bug-1250855.t - 7 second 
./tests/bugs/rpc/bug-954057.t - 7 second 
./tests/bugs/replicate/bug-886998.t - 7 second 
./tests/bugs/read-only/bug-1134822-read-only-default-in-graph.t - 7 second 
./tests/bugs/quick-read/bug-846240.t - 7 second 
./tests/bugs/posix/bug-765380.t - 7 second 
./tests/bugs/nl-cache/bug-1451588.t - 7 second 
./tests/bugs/nfs/subdir-trailing-slash.t - 7 second 
./tests/bugs/nfs/showmount-many-clients.t - 7 second 
./tests/bugs/nfs/bug-847622.t - 7 second 
./tests/bugs/nfs/bug-1210338.t - 7 second 
./tests/bugs/nfs/bug-1161092-nfs-acls.t - 7 second 
./tests/bugs/glusterfs-server/bug-861542.t - 7 second 
./tests/bugs/glusterd/bug-878004.t - 7 second 
./tests/bugs/glusterd/bug-1095097.t - 7 second 
./tests/bugs/glusterd/bug-1094119-remove-replace-brick-support-from-glusterd.t - 7 second 
./tests/bugs/glusterd/bug-1092841.t - 7 second 
./tests/bugs/glusterd/bug-1085330.t - 7 second 
./tests/bugs/geo-replication/bug-1296496.t - 7 second 
./tests/bugs/fuse/bug-1283103.t - 7 second 
./tests/bugs/fuse/bug-1126048.t - 7 second 
./tests/bugs/distribute/bug-907072.t - 7 second 
./tests/bugs/core/bug-1168803-snapd-option-validation-fix.t - 7 second 
./tests/bugs/core/949327.t - 7 second 
./tests/bugs/cli/bug-983317-volume-get.t - 7 second 
./tests/bugs/cli/bug-867252.t - 7 second 
./tests/bugs/cli/bug-1004218.t - 7 second 
./tests/bugs/access-control/bug-1387241.t - 7 second 
./tests/bitrot/bug-internal-xattrs-check-1243391.t - 7 second 
./tests/basic/nl-cache.t - 7 second 
./tests/basic/gfapi/glfs_sysrq.t - 7 second 
./tests/basic/gfapi/gfapi-trunc.t - 7 second 
./tests/basic/gfapi/gfapi-async-calls-test.t - 7 second 
./tests/features/ipc.t - 6 second 
./tests/bugs/shard/bug-1261773.t - 6 second 
./tests/bugs/readdir-ahead/bug-1446516.t - 6 second 
./tests/bugs/nfs/bug-970070.t - 6 second 
./tests/bugs/nfs/bug-1302948.t - 6 second 
./tests/bugs/glusterfs-server/bug-889996.t - 6 second 
./tests/bugs/glusterfs-server/bug-877992.t - 6 second 
./tests/bugs/glusterfs/bug-869724.t - 6 second 
./tests/bugs/glusterfs/bug-844688.t - 6 second 
./tests/bugs/glusterd/bug-958790.t - 6 second 
./tests/bugs/glusterd/bug-905307.t - 6 second 
./tests/bugs/glusterd/bug-862834.t - 6 second 
./tests/bugs/glusterd/bug-1314649-group-virt.t - 6 second 
./tests/bugs/glusterd/bug-1199451-op-version-retrieving-fix.t - 6 second 
./tests/bugs/fuse/bug-1336818.t - 6 second 
./tests/bugs/fuse/bug-1309462.t - 6 second 
./tests/bugs/distribute/bug-924265.t - 6 second 
./tests/bugs/distribute/bug-1204140.t - 6 second 
./tests/bugs/core/log-bug-1362520.t - 6 second 
./tests/bugs/core/bug-903336.t - 6 second 
./tests/bugs/core/bug-1421721-mpx-toggle.t - 6 second 
./tests/bugs/core/bug-1135514-allow-setxattr-with-null-value.t - 6 second 
./tests/bugs/cli/bug-1378842-volume-get-all.t - 6 second 
./tests/basic/quota-rename.t - 6 second 
./tests/basic/md-cache/bug-1418249.t - 6 second 
./tests/basic/gfapi/gfapi-load-volfile.t - 6 second 
./tests/basic/fops-sanity.t - 6 second 
./tests/bugs/unclassified/bug-991622.t - 5 second 
./tests/bugs/replicate/bug-884328.t - 5 second 
./tests/bugs/logging/bug-823081.t - 5 second 
./tests/bugs/glusterfs/bug-892730.t - 5 second 
./tests/bugs/glusterfs/bug-860297.t - 5 second 
./tests/bugs/glusterfs/bug-811493.t - 5 second 
./tests/bugs/glusterd/bug-916549.t - 5 second 
./tests/bugs/glusterd/bug-913487.t - 5 second 
./tests/bugs/glusterd/bug-1433578-invalid-peer-glusterd-crash.t - 5 second 
./tests/bugs/glusterd/bug-1321836-fix-opret-for-volume-info-xml-output.t - 5 second 
./tests/bugs/glusterd/bug-1315186-reject-lowering-down-op-version.t - 5 second 
./tests/bugs/glusterd/bug-1238135-lazy-daemon-initialization-on-demand.t - 5 second 
./tests/bugs/glusterd/bug-000000.t - 5 second 
./tests/bugs/core/bug-924075.t - 5 second 
./tests/bugs/core/bug-845213.t - 5 second 
./tests/bugs/core/bug-1117951.t - 5 second 
./tests/bugs/core/bug-1111557.t - 5 second 
./tests/bugs/cli/bug-977246.t - 5 second 
./tests/bugs/cli/bug-969193.t - 5 second 
./tests/bugs/cli/bug-949298.t - 5 second 
./tests/bugs/cli/bug-764638.t - 5 second 
./tests/bugs/cli/bug-1047378.t - 5 second 
./tests/basic/afr/arbiter-cli.t - 5 second 
./tests/bugs/glusterfs/bug-853690.t - 4 second 
./tests/bugs/cli/bug-921215.t - 4 second 
./tests/basic/gfapi/sink.t - 2 second 
./tests/features/glupy.t - 1 second 
./tests/bugs/shard/zero-flag.t - 1 second 
./tests/basic/posixonly.t - 1 second 
./tests/basic/netgroup_parsing.t - 1 second 
./tests/basic/exports_parsing.t - 1 second 
./tests/basic/first-test.t - 0 second 

Result is 1 

tar: Removing leading `/' from member names 
Logs archived in http://slave26.cloud.gluster.org/logs/glusterfs-logs-regression-test-with-multiplex-60.tgz 
kernel.core_pattern = /%e-%p.core 
Build step 'Execute shell' marked build as failure 



</blockquote>



</blockquote>



-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.gluster.org/pipermail/gluster-devel/attachments/20170612/528ae741/attachment-0001.html>

More information about the Gluster-devel mailing list