Help with DiagDebug report

Help with DiagDebug report

am 09.11.2007 18:04:00 von SteveZohn

I have been having intermittent hangs on iis6 in my envirorment. The server
runs a combination of asp.net applications and ISAPI extensions. The asp.net
applications are DotNetnuke, and there are about 20 sites running on this
server. We are running a modified version of DNN 3.2.2, and the most used
component is a custom iFrame module that makes web calls to both local and
remote servers. I mention this as I'm wondering if this is a result of
hanging because it is running out of connections.

Here is the summary from the report:

Detected a serious critical section related problem in
IIS_COM+__Date__11_06_2007__Time_06_19_51PM__w3wp.exe__Defau ltAppPool-DNN__PID__8640__509__Manual Dump.dmp

Lock at mscorsvr!CorMap::m_pCorMapCrst owned by thread 31 is Deadlocked with
lock at ntdll!LdrpLoaderLock owned by thread 30

Impact analysis
0.47% of threads blocked

(Threads 19 30 32)

The following functions are involved in the root cause
mscorsvr!EE_EnterCriticalSection+c

The following modules are involved in the root cause
C:\WINDOWS\Microsoft.NET\Framework\v1.1.4322\mscorsvr.dll from Microsoft
Corporation


Here are the threads mentioned, if more are needed, i'll gladly post.


Thread 19 - System ID 8232
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:01.453
Time spent in kernel mode 0 Days 00:00:03.453




This thread is waiting on critical section mscorsvr!CorMap::m_pCorMapCrst
owned by thread 31.

Thread 31 in turn is deadlocked with another thread.





Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
ntdll!RtlpWaitOnCriticalSection+1a3
ntdll!RtlEnterCriticalSection+a8
mscorsvr!EE_EnterCriticalSection+c
mscorsvr!CorMap::Enter+13
mscorsvr!CorMap::OpenFile+73
mscorsvr!RuntimeOpenImageInternal+1c
mscorsvr!GetAssemblyMDInternalImport+5f
mscoree!GetAssemblyMDImport+45
fusion!CreateMetaDataImport+1d
fusion!CAssemblyManifestImport::CopyMetaData+1e
fusion!CAssemblyManifestImport::Init+8d
fusion!CreateAssemblyManifestImport+36
fusion!ValidateAssembly+61
fusion!CAssemblyCacheItem::MoveAssemblyToFinalLocation+272
fusion!CAssemblyCacheItem::Commit+24f
fusion!CAsmDownloadMgr::CreateAssembly+4db
fusion!CAsmDownloadMgr::DoSetupPushToCache+50
fusion!CAsmDownloadMgr::DoSetup+225
fusion!CAssemblyDownload::DoSetup+7a
fusion!CAssemblyDownload::DownloadComplete+b6
fusion!CAssemblyDownload::KickOffDownload+1a1
fusion!CAssemblyName::BindToObject+404
mscorsvr!FusionBind::RemoteLoad+a6
mscorsvr!FusionBind::GetAssemblyFromFusion+5e
mscorsvr!AssemblySpec::GetAssemblyFromFusion+154
mscorsvr!AssemblySpec::LowLevelLoadManifestFile+17d
mscorsvr!AppDomain::BindAssemblySpec+50
mscorsvr!AssemblySpec::LoadAssembly+98
mscorsvr!AssemblyNative::Load+407
0x030fbaac
0x03aad23e
0x02fdf804




Back to Top


Thread 20 - System ID 844
Entry point mscorsvr!DebuggerRCThread::ThreadProcStatic
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
kernel32!WaitForMultipleObjects+18
mscorsvr!DebuggerRCThread::MainLoop+90
mscorsvr!DebuggerRCThread::ThreadProc+68
mscorsvr!DebuggerRCThread::ThreadProcStatic+b
kernel32!BaseThreadStart+34




Back to Top


Thread 21 - System ID 3548
Entry point mscorsvr!gc_heap::gc_thread_stub
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!gc_heap::gc_thread_function+2f
mscorsvr!gc_heap::gc_thread_stub+1e
kernel32!BaseThreadStart+34




Back to Top


Thread 22 - System ID 2652
Entry point mscorsvr!gc_heap::gc_thread_stub
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!gc_heap::gc_thread_function+2f
mscorsvr!gc_heap::gc_thread_stub+1e
kernel32!BaseThreadStart+34




Back to Top


Thread 23 - System ID 9432
Entry point mscorsvr!gc_heap::gc_thread_stub
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!gc_heap::gc_thread_function+2f
mscorsvr!gc_heap::gc_thread_stub+1e
kernel32!BaseThreadStart+34




Back to Top


Thread 24 - System ID 9744
Entry point mscorsvr!gc_heap::gc_thread_stub
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!gc_heap::gc_thread_function+2f
mscorsvr!gc_heap::gc_thread_stub+1e
kernel32!BaseThreadStart+34




Back to Top


Thread 25 - System ID 4300
Entry point mscorsvr!Thread::intermediateThreadProc
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
kernel32!WaitForMultipleObjects+18
mscorsvr!WaitForFinalizerEvent+5a
mscorsvr!GCHeap::FinalizerThreadStart+96
mscorsvr!Thread::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 26 - System ID 1468
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




This thread is waiting on critical section ntdll!LdrpLoaderLock owned by
thread 30.

Thread 30 in turn is deadlocked with another thread.





Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
ntdll!RtlpWaitOnCriticalSection+1a3
ntdll!RtlEnterCriticalSection+a8
ntdll!LdrpGetProcedureAddress+128
ntdll!LdrGetProcedureAddress+18
kernel32!GetProcAddress+44
mscorsvr!__delayLoadHelper2+1ed
mscorsvr!_tailMerge_ole32+d
mscorsvr!ThreadpoolMgr::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 27 - System ID 6796
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




This thread is waiting on critical section ntdll!LdrpLoaderLock owned by
thread 30.

Thread 30 in turn is deadlocked with another thread.





Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
ntdll!RtlpWaitOnCriticalSection+1a3
ntdll!RtlEnterCriticalSection+a8
ntdll!LdrpGetProcedureAddress+128
ntdll!LdrGetProcedureAddress+18
kernel32!GetProcAddress+44
mscorsvr!__delayLoadHelper2+1ed
mscorsvr!_tailMerge_ole32+d
mscorsvr!ThreadpoolMgr::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 28 - System ID 6720
Entry point mscorsvr!ThreadpoolMgr::TimerThreadStart
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtDelayExecution+c
kernel32!SleepEx+68
mscorsvr!ThreadpoolMgr::TimerThreadStart+23
kernel32!BaseThreadStart+34




Back to Top


Thread 29 - System ID 7300
Entry point ntdll!RtlpWorkerThread
Create time 11/6/2007 5:44:19 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
ntdll!RtlpWorkerThread+3d
kernel32!BaseThreadStart+34




Back to Top


Thread 30 - System ID 4976
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 11/6/2007 5:44:20 PM
Time spent in user mode 0 Days 00:00:00.343
Time spent in kernel mode 0 Days 00:00:02.250




This thread is waiting on critical section mscorsvr!CorMap::m_pCorMapCrst
owned by thread 31.

Thread 31 in turn is deadlocked with another thread.





Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
ntdll!RtlpWaitOnCriticalSection+1a3
ntdll!RtlEnterCriticalSection+a8
mscorsvr!EE_EnterCriticalSection+c
mscorsvr!CorMap::Enter+13
mscorsvr!CorMap::OpenFile+73
mscorsvr!PEFile::Create+43
mscorsvr!AssemblySpec::LowLevelLoadManifestFile+ad
mscorsvr!AppDomain::BindAssemblySpec+50
mscorsvr!AssemblySpec::LoadAssembly+98
mscorsvr!Assembly::LoadExternalAssembly+1a8
mscorsvr!Assembly::FindExternalAssembly+3c
mscorsvr!Assembly::FindAssemblyByTypeRef+be
mscorsvr!ClassLoader::LoadTypeHandle+8c
mscorsvr!ClassLoader::LoadParent+54
mscorsvr!ClassLoader::LoadTypeHandleFromToken+a5
mscorsvr!ClassLoader::LoadTypeHandle+2ee
mscorsvr!ClassLoader::LoadTypeHandle+23a
mscorsvr!EEClass::InitializeFieldDescs+2fe
mscorsvr!EEClass::BuildMethodTable+46c
mscorsvr!ClassLoader::LoadTypeHandleFromToken+636
mscorsvr!Module::BuildClassForModule+ae
mscorsvr!Module::SetContainer+71
mscorsvr!Assembly::AddModule+19f
mscorsvr!BaseDomain::SetAssemblyManifestModule+21
mscorsvr!BaseDomain::LoadAssembly+f8b
mscorsvr!ExecuteDLL+281
mscoree!CorDllMainWorker+6c
mscoree!_CorDllMain+106
ntdll!LdrpCallInitRoutine+14
ntdll!LdrpRunInitializeRoutines+367
ntdll!LdrpLoadDll+3cd
ntdll!LdrLoadDll+198
kernel32!LoadLibraryExW+1b2
mscorsvr!WszLoadLibraryEx+5f
mscorsvr!CorMap::BaseAddress+8b
mscorsvr!PEFile::Setup+45
mscorsvr!PEFile::VerifyModule+195
mscorsvr!PEFile::Create+11a
mscorsvr!SystemDomain::LoadFile+184
mscorsvr!AssemblySpec::GetAssemblyFromFusion+630
mscorsvr!AssemblySpec::LowLevelLoadManifestFile+17d
mscorsvr!AppDomain::BindAssemblySpec+50
mscorsvr!AssemblySpec::LoadAssembly+98
mscorsvr!AssemblyNative::Load+407
0x030fbaac
kernel32!WaitForSingleObjectEx+dc




Back to Top


Thread 31 - System ID 4060
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 11/6/2007 5:44:24 PM
Time spent in user mode 0 Days 00:00:00.343
Time spent in kernel mode 0 Days 00:00:02.218




This thread is waiting on critical section ntdll!LdrpLoaderLock owned by
thread 30.

Thread 30 in turn is deadlocked with another thread.





Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
ntdll!RtlpWaitOnCriticalSection+1a3
ntdll!RtlEnterCriticalSection+a8
ntdll!LdrUnloadDll+35
kernel32!FreeLibrary+41
mscorsvr!CorMap::ReleaseHandleResources+70
mscorsvr!CorMapInfo::Release+63
mscorsvr!CorMap::ReleaseHandle+e
mscorsvr!PEFile::~PEFile+37
mscorsvr!PEFile::`scalar deleting destructor'+b
mscorsvr!BaseDomain::LoadAssembly+28b
mscorsvr!AssemblySpec::LoadAssembly+4da
mscorsvr!AssemblyNative::Load+407
0x030fbaac
kernel32!WaitForSingleObjectEx+dc




Back to Top


Thread 32 - System ID 9172
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 11/6/2007 5:44:25 PM
Time spent in user mode 0 Days 00:00:00.328
Time spent in kernel mode 0 Days 00:00:01.703

This thread is waiting on critical section mscorsvr!CorMap::m_pCorMapCrst
owned by thread 31.

Thread 31 in turn is deadlocked with another thread.





Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
ntdll!RtlpWaitOnCriticalSection+1a3
ntdll!RtlEnterCriticalSection+a8
mscorsvr!EE_EnterCriticalSection+c
mscorsvr!CorMap::Enter+13
mscorsvr!CorMap::OpenFile+73
mscorsvr!RuntimeOpenImageInternal+1c
mscorsvr!GetAssemblyMDInternalImport+5f
mscoree!GetAssemblyMDImport+45
fusion!CreateMetaDataImport+1d
fusion!CAssemblyManifestImport::CopyMetaData+1e
fusion!CAssemblyManifestImport::Init+8d
fusion!CreateAssemblyManifestImport+36
fusion!CAsmDownloadMgr::CreateAssembly+ab
fusion!CAsmDownloadMgr::DoSetupPushToCache+50
fusion!CAsmDownloadMgr::DoSetup+225
fusion!CAssemblyDownload::DoSetup+7a
fusion!CAssemblyDownload::DownloadComplete+b6
fusion!CAssemblyDownload::KickOffDownload+1a1
fusion!CAssemblyName::BindToObject+404
mscorsvr!FusionBind::RemoteLoad+a6
mscorsvr!FusionBind::GetAssemblyFromFusion+5e
mscorsvr!AssemblySpec::GetAssemblyFromFusion+154
mscorsvr!AssemblySpec::LowLevelLoadManifestFile+17d
mscorsvr!AppDomain::BindAssemblySpec+50
mscorsvr!AssemblySpec::LoadAssembly+98
mscorsvr!AssemblyNative::Load+407
0x030fbaac
kernel32!WaitForSingleObjectEx+dc




Back to Top


Thread 33 - System ID 10036
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 11/6/2007 5:44:27 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




This thread is waiting on critical section ntdll!LdrpLoaderLock owned by
thread 30.

Thread 30 in turn is deadlocked with another thread.





Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
ntdll!RtlpWaitOnCriticalSection+1a3
ntdll!RtlEnterCriticalSection+a8
ntdll!LdrLockLoaderLock+133
ntdll!LdrGetDllHandleEx+94
ntdll!LdrGetDllHandle+18
kernel32!GetModuleHandleForUnicodeString+20
kernel32!BasepGetModuleHandleExW+17f
kernel32!GetModuleHandleW+29
mscorsvr!COMSecurityConfig::GetMachineDirectory+49
mscorsvr!COMSecurityConfig::EcallGetMachineDirectory+22
0x037a060b
mscorsvr!CallDescrWorker+30
mscorsvr!MethodDesc::CallDescr+1b8
mscorsvr!MethodDesc::Call+c5
mscorsvr!Security::ResolvePolicy+a5
mscorsvr!SecurityDescriptor::ResolveWorker+202
mscorsvr!AppDomainNative::SetupDomainSecurity+e4
0x037a0586
0x10224970
0x000e44c8


Back to Top