[Bugs] [Bug 1379673] Creation of file hangs while doing ls from another mount.

bugzilla at redhat.com bugzilla at redhat.com
Wed Nov 23 06:42:32 UTC 2016


https://bugzilla.redhat.com/show_bug.cgi?id=1379673



--- Comment #10 from Soumya Koduri <skoduri at redhat.com> ---
Thanks for re-checking Arthy.

Interval1: 

Thread 198 (Thread 0x7f56e78ab700 (LWP 20792)):
#0  0x00007f571a4db6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00007f568df26b1b in syncop_lookup (subvol=subvol at entry=0x7f5648026b40,
loc=loc at entry=0x7f56e78a95c0, iatt=iatt at entry=0x7f56e78a9600,
parent=parent at entry=0x0, xdata_in=xdata_in at entry=0x7f56889dfc54,
xdata_out=xdata_out at entry=0x0) at syncop.c:1223
#2  0x00007f568e1ceb27 in glfs_resolve_component (fs=fs at entry=0x7f5688098b20,
subvol=subvol at entry=0x7f5648026b40, parent=parent at entry=0x7f563c00a47c,
component=component at entry=0x7f561083dd10 "def_4911787",
iatt=iatt at entry=0x7f56e78a9780, force_lookup=<optimized out>) at
glfs-resolve.c:311
#3  0x00007f568e1cf2d3 in priv_glfs_resolve_at (fs=fs at entry=0x7f5688098b20,
subvol=subvol at entry=0x7f5648026b40, at=at at entry=0x7f563c00a47c,
origpath=origpath at entry=0x7f56e78a9be3 "def_4911787",
loc=loc at entry=0x7f56e78a9880, iatt=iatt at entry=0x7f56e78a98c0,
follow=follow at entry=0, reval=reval at entry=0) at glfs-resolve.c:417
#4  0x00007f568e1d0c18 in pub_glfs_h_lookupat (fs=0x7f5688098b20,
parent=<optimized out>, path=path at entry=0x7f56e78a9be3 "def_4911787",
stat=stat at entry=0x7f56e78a99a0, follow=follow at entry=0) at glfs-handleops.c:102
#5  0x00007f568e1d0d18 in pub_glfs_h_lookupat34 (fs=<optimized out>,
parent=<optimized out>, path=path at entry=0x7f56e78a9be3 "def_4911787",
stat=stat at entry=0x7f56e78a99a0) at glfs-handleops.c:133
#6  0x00007f568e5ec8bb in lookup (parent=parent at entry=0x7f5688c9dc08,
path=path at entry=0x7f56e78a9be3 "def_4911787",
handle=handle at entry=0x7f56e78a9ae8, attrs_out=attrs_out at entry=0x7f56e78a9af0)
at /usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/FSAL_GLUSTER/handle.c:112
#7  0x00007f568e5ecc38 in read_dirents (dir_hdl=0x7f5688c9dc08,
whence=<optimized out>, dir_state=0x7f56e78a9d60, cb=0x7f571c024690
<mdc_populate_dirent>, attrmask=9223372036855160782, eof=0x7f56e78a9d4f) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/FSAL_GLUSTER/handle.c:201
#8  0x00007f571c024c70 in mdcache_dirent_populate
(dir=dir at entry=0x7f5688c9dec0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:1475
#9  0x00007f571c01a016 in mdcache_readdir (dir_hdl=0x7f5688c9def8,
whence=0x7f56e78a9e78, dir_state=0x7f56e78a9e90, cb=0x7f571bf519a0
<populate_dirent>, attrmask=<optimized out>, eod_met=0x7f56e78a9f5b) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_handle.c:577
#10 0x00007f571bf537ad in fsal_readdir
(directory=directory at entry=0x7f5688c9def8,
cookie=cookie at entry=578627923506410052, nbfound=nbfound at entry=0x7f56e78a9f5c,
eod_met=eod_met at entry=0x7f56e78a9f5b, attrmask=122830,
cb=cb at entry=0x7f571bf8d520 <nfs4_readdir_callback>,
opaque=opaque at entry=0x7f56e78a9f60) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/fsal_helper.c:1505
#11 0x00007f571bf8e4eb in nfs4_op_readdir (op=0x7f5640592b70,
data=0x7f56e78aa180, resp=0x7f56108b1130) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_op_readdir.c:631
#12 0x00007f571bf7af7d in nfs4_Compound (arg=<optimized out>, req=<optimized
out>, res=0x7f5610038770) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_Compound.c:734
#13 0x00007f571bf6c12c in nfs_rpc_execute
(reqdata=reqdata at entry=0x7f56405894a0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1281
#14 0x00007f571bf6d78a in worker_run (ctx=0x7f571d00f5e0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1548
#15 0x00007f571bff7189 in fridgethr_start_routine (arg=0x7f571d00f5e0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/support/fridgethr.c:550
#16 0x00007f571a4d7dc5 in start_thread () from /lib64/libpthread.so.0
#17 0x00007f5719ba673d in clone () from /lib64/libc.so.6
Thread 197 (Thread 0x7f56e70aa700 (LWP 20793)):


Interval 2:
Thread 30 (Thread 0x7f5693803700 (LWP 20960)):
#0  0x00007f571a4db6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00007f568df26b1b in syncop_lookup (subvol=subvol at entry=0x7f5648026b40,
loc=loc at entry=0x7f56938015c0, iatt=iatt at entry=0x7f5693801600,
parent=parent at entry=0x0, xdata_in=xdata_in at entry=0x7f56889e7090,
xdata_out=xdata_out at entry=0x0) at syncop.c:1223
#2  0x00007f568e1ceb27 in glfs_resolve_component (fs=fs at entry=0x7f5688098b20,
subvol=subvol at entry=0x7f5648026b40, parent=parent at entry=0x7f563c00a47c,
component=component at entry=0x7f563060cc10 "def7468",
iatt=iatt at entry=0x7f5693801780, force_lookup=<optimized out>) at
glfs-resolve.c:311
#3  0x00007f568e1cf2d3 in priv_glfs_resolve_at (fs=fs at entry=0x7f5688098b20,
subvol=subvol at entry=0x7f5648026b40, at=at at entry=0x7f563c00a47c,
origpath=origpath at entry=0x7f5693801be3 "def7468", loc=loc at entry=0x7f5693801880,
iatt=iatt at entry=0x7f56938018c0, follow=follow at entry=0, reval=reval at entry=0) at
glfs-resolve.c:417
#4  0x00007f568e1d0c18 in pub_glfs_h_lookupat (fs=0x7f5688098b20,
parent=<optimized out>, path=path at entry=0x7f5693801be3 "def7468",
stat=stat at entry=0x7f56938019a0, follow=follow at entry=0) at glfs-handleops.c:102
#5  0x00007f568e1d0d18 in pub_glfs_h_lookupat34 (fs=<optimized out>,
parent=<optimized out>, path=path at entry=0x7f5693801be3 "def7468",
stat=stat at entry=0x7f56938019a0) at glfs-handleops.c:133
#6  0x00007f568e5ec8bb in lookup (parent=parent at entry=0x7f5688c9dc08,
path=path at entry=0x7f5693801be3 "def7468", handle=handle at entry=0x7f5693801ae8,
attrs_out=attrs_out at entry=0x7f5693801af0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/FSAL_GLUSTER/handle.c:112
#7  0x00007f568e5ecc38 in read_dirents (dir_hdl=0x7f5688c9dc08,
whence=<optimized out>, dir_state=0x7f5693801d60, cb=0x7f571c024690
<mdc_populate_dirent>, attrmask=9223372036855160782, eof=0x7f5693801d4f) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/FSAL_GLUSTER/handle.c:201
#8  0x00007f571c024c70 in mdcache_dirent_populate
(dir=dir at entry=0x7f5688c9dec0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:1475
#9  0x00007f571c01a016 in mdcache_readdir (dir_hdl=0x7f5688c9def8,
whence=0x7f5693801e78, dir_state=0x7f5693801e90, cb=0x7f571bf519a0
<populate_dirent>, attrmask=<optimized out>, eod_met=0x7f5693801f5b) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_handle.c:577
#10 0x00007f571bf537ad in fsal_readdir
(directory=directory at entry=0x7f5688c9def8,
cookie=cookie at entry=1729522091335920037, nbfound=nbfound at entry=0x7f5693801f5c,
eod_met=eod_met at entry=0x7f5693801f5b, attrmask=122830,
cb=cb at entry=0x7f571bf8d520 <nfs4_readdir_callback>,
opaque=opaque at entry=0x7f5693801f60) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/fsal_helper.c:1505
#11 0x00007f571bf8e4eb in nfs4_op_readdir (op=0x7f567c1900e0,
data=0x7f5693802180, resp=0x7f5630171b20) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_op_readdir.c:631
#12 0x00007f571bf7af7d in nfs4_Compound (arg=<optimized out>, req=<optimized
out>, res=0x7f563004bf60) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_Compound.c:734
#13 0x00007f571bf6c12c in nfs_rpc_execute
(reqdata=reqdata at entry=0x7f567c26af50) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1281
#14 0x00007f571bf6d78a in worker_run (ctx=0x7f571d040a60) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1548
#15 0x00007f571bff7189 in fridgethr_start_routine (arg=0x7f571d040a60) at
/usr/src/debug/nfs-ganesha-2.4.1/src/support/fridgethr.c:550
#16 0x00007f571a4d7dc5 in start_thread () from /lib64/libpthread.so.0
#17 0x00007f5719ba673d in clone () from /lib64/libc.so.6
Thread 29 (Thread 0x7f5693002700 (LWP 20961)):

Thread 76 (Thread 0x7f56aa831700 (LWP 20914)):
#0  0x00007f571a4dae24 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0
#1  0x00007f571c023080 in mdc_lookup (mdc_parent=0x7f5688c9dec0,
name=0x7f571d22f170 "def_176420", uncached=uncached at entry=true,
new_entry=new_entry at entry=0x7f56aa82f4c0, attrs_out=0x0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:916
#2  0x00007f571c01a9eb in mdcache_lookup (parent=<optimized out>,
name=<optimized out>, handle=0x7f56aa82f578, attrs_out=<optimized out>) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_handle.c:166
#3  0x00007f571bf52c97 in fsal_lookup (parent=parent at entry=0x7f5688c9def8,
name=0x7f571d22f170 "def_176420", obj=obj at entry=0x7f56aa82f578,
attrs_out=attrs_out at entry=0x0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/fsal_helper.c:712
#4  0x00007f571bf3fe0c in open4_ex (arg=arg at entry=0x7f567c36ad28,
data=data at entry=0x7f56aa830180, res_OPEN4=res_OPEN4 at entry=0x7f571d055668,
clientid=<optimized out>, owner=0x7f56840f7d90,
file_state=file_state at entry=0x7f56aa82ffa0,
new_state=new_state at entry=0x7f56aa82ff8f) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_op_open.c:1257
#5  0x00007f571bf88a39 in nfs4_op_open (op=0x7f567c36ad20, data=0x7f56aa830180,
resp=0x7f571d055660) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_op_open.c:1844
#6  0x00007f571bf7af7d in nfs4_Compound (arg=<optimized out>, req=<optimized
out>, res=0x7f571d0c3360) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_Compound.c:734
#7  0x00007f571bf6c12c in nfs_rpc_execute
(reqdata=reqdata at entry=0x7f567c21a0c0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1281
#8  0x00007f571bf6d78a in worker_run (ctx=0x7f571d032fe0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1548
#9  0x00007f571bff7189 in fridgethr_start_routine (arg=0x7f571d032fe0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/support/fridgethr.c:550
#10 0x00007f571a4d7dc5 in start_thread () from /lib64/libpthread.so.0
#11 0x00007f5719ba673d in clone () from /lib64/libc.so.6
Thread 75 (Thread 0x7f56aa030700 (LWP 20915)):


Interval 3:
Thread 109 (Thread 0x7f56bb052700 (LWP 20881)):
#0  0x00007f571a4dae24 in pthread_rwlock_rdlock () from /lib64/libpthread.so.0
#1  0x00007f571c023080 in mdc_lookup (mdc_parent=0x7f5688c9dec0,
name=0x7f568016d790 "def_176inew7", uncached=uncached at entry=true,
new_entry=new_entry at entry=0x7f56bb0504c0, attrs_out=0x0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:916
#2  0x00007f571c01a9eb in mdcache_lookup (parent=<optimized out>,
name=<optimized out>, handle=0x7f56bb050578, attrs_out=<optimized out>) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_handle.c:166
#3  0x00007f571bf52c97 in fsal_lookup (parent=parent at entry=0x7f5688c9def8,
name=0x7f568016d790 "def_176inew7", obj=obj at entry=0x7f56bb050578,
attrs_out=attrs_out at entry=0x0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/fsal_helper.c:712
#4  0x00007f571bf3fe0c in open4_ex (arg=arg at entry=0x7f564008d5a8,
data=data at entry=0x7f56bb051180, res_OPEN4=res_OPEN4 at entry=0x7f56801fe808,
clientid=<optimized out>, owner=0x7f56840f7d90,
file_state=file_state at entry=0x7f56bb050fa0,
new_state=new_state at entry=0x7f56bb050f8f) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_op_open.c:1257
#5  0x00007f571bf88a39 in nfs4_op_open (op=0x7f564008d5a0, data=0x7f56bb051180,
resp=0x7f56801fe800) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_op_open.c:1844
#6  0x00007f571bf7af7d in nfs4_Compound (arg=<optimized out>, req=<optimized
out>, res=0x7f5680229bd0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_Compound.c:734
#7  0x00007f571bf6c12c in nfs_rpc_execute
(reqdata=reqdata at entry=0x7f56405894a0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1281
#8  0x00007f571bf6d78a in worker_run (ctx=0x7f571d029320) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1548
#9  0x00007f571bff7189 in fridgethr_start_routine (arg=0x7f571d029320) at
/usr/src/debug/nfs-ganesha-2.4.1/src/support/fridgethr.c:550
#10 0x00007f571a4d7dc5 in start_thread () from /lib64/libpthread.so.0
#11 0x00007f5719ba673d in clone () from /lib64/libc.so.6
Thread 108 (Thread 0x7f56ba851700 (LWP 20882)):


Thread 85 (Thread 0x7f56af03a700 (LWP 20905)):
#0  0x00007f571a4db6d5 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
#1  0x00007f568df26b1b in syncop_lookup (subvol=subvol at entry=0x7f5648026b40,
loc=loc at entry=0x7f56af0385c0, iatt=iatt at entry=0x7f56af038600,
parent=parent at entry=0x0, xdata_in=xdata_in at entry=0x0,
xdata_out=xdata_out at entry=0x0) at syncop.c:1223
#2  0x00007f568e1ceb27 in glfs_resolve_component (fs=fs at entry=0x7f5688098b20,
subvol=subvol at entry=0x7f5648026b40, parent=parent at entry=0x7f563c00a47c,
component=component at entry=0x7f566c4c7b50 "def_492600",
iatt=iatt at entry=0x7f56af038780, force_lookup=<optimized out>) at
glfs-resolve.c:311
#3  0x00007f568e1cf2d3 in priv_glfs_resolve_at (fs=fs at entry=0x7f5688098b20,
subvol=subvol at entry=0x7f5648026b40, at=at at entry=0x7f563c00a47c,
origpath=origpath at entry=0x7f56af038be3 "def_492600",
loc=loc at entry=0x7f56af038880, iatt=iatt at entry=0x7f56af0388c0,
follow=follow at entry=0, reval=reval at entry=0) at glfs-resolve.c:417
#4  0x00007f568e1d0c18 in pub_glfs_h_lookupat (fs=0x7f5688098b20,
parent=<optimized out>, path=path at entry=0x7f56af038be3 "def_492600",
stat=stat at entry=0x7f56af0389a0, follow=follow at entry=0) at glfs-handleops.c:102
#5  0x00007f568e1d0d18 in pub_glfs_h_lookupat34 (fs=<optimized out>,
parent=<optimized out>, path=path at entry=0x7f56af038be3 "def_492600",
stat=stat at entry=0x7f56af0389a0) at glfs-handleops.c:133
#6  0x00007f568e5ec8bb in lookup (parent=parent at entry=0x7f5688c9dc08,
path=path at entry=0x7f56af038be3 "def_492600",
handle=handle at entry=0x7f56af038ae8, attrs_out=attrs_out at entry=0x7f56af038af0)
at /usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/FSAL_GLUSTER/handle.c:112
#7  0x00007f568e5ecc38 in read_dirents (dir_hdl=0x7f5688c9dc08,
whence=<optimized out>, dir_state=0x7f56af038d60, cb=0x7f571c024690
<mdc_populate_dirent>, attrmask=9223372036855160782, eof=0x7f56af038d4f) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/FSAL_GLUSTER/handle.c:201
#8  0x00007f571c024c70 in mdcache_dirent_populate
(dir=dir at entry=0x7f5688c9dec0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_helpers.c:1475
#9  0x00007f571c01a016 in mdcache_readdir (dir_hdl=0x7f5688c9def8,
whence=0x7f56af038e78, dir_state=0x7f56af038e90, cb=0x7f571bf519a0
<populate_dirent>, attrmask=<optimized out>, eod_met=0x7f56af038f5b) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/Stackable_FSALs/FSAL_MDCACHE/mdcache_handle.c:577
#10 0x00007f571bf537ad in fsal_readdir
(directory=directory at entry=0x7f5688c9def8,
cookie=cookie at entry=3995323130471280627, nbfound=nbfound at entry=0x7f56af038f5c,
eod_met=eod_met at entry=0x7f56af038f5b, attrmask=122830,
cb=cb at entry=0x7f571bf8d520 <nfs4_readdir_callback>,
opaque=opaque at entry=0x7f56af038f60) at
/usr/src/debug/nfs-ganesha-2.4.1/src/FSAL/fsal_helper.c:1505
#11 0x00007f571bf8e4eb in nfs4_op_readdir (op=0x7f564046dc40,
data=0x7f56af039180, resp=0x7f566c29db00) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_op_readdir.c:631
#12 0x00007f571bf7af7d in nfs4_Compound (arg=<optimized out>, req=<optimized
out>, res=0x7f566c115cb0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/Protocols/NFS/nfs4_Compound.c:734
#13 0x00007f571bf6c12c in nfs_rpc_execute
(reqdata=reqdata at entry=0x7f5640489ed0) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1281
#14 0x00007f571bf6d78a in worker_run (ctx=0x7f571d030520) at
/usr/src/debug/nfs-ganesha-2.4.1/src/MainNFSD/nfs_worker_thread.c:1548
#15 0x00007f571bff7189 in fridgethr_start_routine (arg=0x7f571d030520) at
/usr/src/debug/nfs-ganesha-2.4.1/src/support/fridgethr.c:550
#16 0x00007f571a4d7dc5 in start_thread () from /lib64/libpthread.so.0
#17 0x00007f5719ba673d in clone () from /lib64/libc.so.6
Thread 84 (Thread 0x7f56ae839700 (LWP 20906)):



readdir+lookup consuming lot of time.

-- 
You are receiving this mail because:
You are on the CC list for the bug.
Unsubscribe from this bug https://bugzilla.redhat.com/token.cgi?t=MwUHa1NHD5&a=cc_unsubscribe


More information about the Bugs mailing list