Could anyone help me to analyse w3wp and IIS DUMP report

Could anyone help me to analyse w3wp and IIS DUMP report

am 29.10.2007 00:00:00 von Gobi

Please anyone help me to identify the issue causing my iis hang and not
responding for user search pages, our app is running in web farm of 9
servers, sporadically the hang occurs on different servers, while the server
was in hung state worker process was running at around 300MB, not showing any
event logs..i took the dump but couldnt interepret what is in it.. attaching
the dump analyse report createb by debugdiag..please help me in identifying
any issues in my report and server
---------------------DUMP REPORT--------------------------
Report for
IIS_COM+__Date__10_26_2007__Time_04_51_40PM__w3wp.exe__Defau ltAppPool__PID__3648__899__Manual Dump.dmp
Type of Analysis Performed Hang Analysis
Machine Name MHC-PNP-PROD12
Operating System Windows Server 2003 Service Pack 1
Number Of Processors 4
Process ID 3648
Process Image c:\WINDOWS\system32\inetsrv\w3wp.exe
System Up-Time 36 day(s) 07:39:35
Process Up-Time 03:46:26



Top 5 Threads by CPU time
Note - Times include both user mode and kernel mode for each thread Thread
ID: 27 Total CPU Time: 00:04:31.874 Entry Point for Thread:
mscorsvr!ThreadpoolMgr::intermediateThreadProc
Thread ID: 22 Total CPU Time: 00:04:01.921 Entry Point for Thread:
mscorsvr!gc_heap::gc_thread_stub
Thread ID: 19 Total CPU Time: 00:03:57.655 Entry Point for Thread:
mscorsvr!ThreadpoolMgr::intermediateThreadProc
Thread ID: 24 Total CPU Time: 00:03:56.593 Entry Point for Thread:
mscorsvr!gc_heap::gc_thread_stub
Thread ID: 21 Total CPU Time: 00:03:52.015 Entry Point for Thread:
mscorsvr!gc_heap::gc_thread_stub





Thread report

Thread 0 - System ID 3076
Entry point w3wp!wmainCRTStartup
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.078
Time spent in kernel mode 0 Days 00:00:00.046




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
w3dt!WP_CONTEXT::RunMainThreadLoop+10
w3dt!UlAtqStartListen+2d
w3core!W3_SERVER::StartListen+bd
w3core!UlW3Start+26e
w3wp!wmain+22a
w3wp!wmainCRTStartup+12b
kernel32!BaseProcessStart+23




Back to Top


Thread 1 - System ID 2676
Entry point ntdll!RtlpTimerThread
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtDelayExecution+c
ntdll!RtlpTimerThread+47
kernel32!BaseThreadStart+34




Back to Top


Thread 2 - System ID 336
Entry point rpcrt4!ThreadStartRoutine
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
rpcrt4!COMMON_ProcessCalls+a1
rpcrt4!LOADABLE_TRANSPORT::ProcessIOEvents+117
rpcrt4!ProcessIOEventsWrapper+d
rpcrt4!BaseCachedThreadRoutine+9d
rpcrt4!ThreadStartRoutine+1b
kernel32!BaseThreadStart+34




Back to Top


Thread 3 - System ID 2888
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:03.093
Time spent in kernel mode 0 Days 00:00:01.359




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34




Back to Top


Thread 4 - System ID 2736
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:01.281
Time spent in kernel mode 0 Days 00:00:00.703




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34




Back to Top


Thread 5 - System ID 528
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.875
Time spent in kernel mode 0 Days 00:00:00.296




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34




Back to Top


Thread 6 - System ID 4044
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:02.671
Time spent in kernel mode 0 Days 00:00:01.218




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34




Back to Top


Thread 7 - System ID 2740
Entry point ntdll!RtlpWaitThread
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.281
Time spent in kernel mode 0 Days 00:00:00.875




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
ntdll!RtlpWaitThread+161
kernel32!BaseThreadStart+34




Back to Top


Thread 8 - System ID 1832
Entry point msvcrt!_endthreadex+2f
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:01.453
Time spent in kernel mode 0 Days 00:00:04.984




This thread is not fully resolved and may or may not be a problem. Further
analysis of these threads may be required.



Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
user32!RealMsgWaitForMultipleObjectsEx+141
user32!MsgWaitForMultipleObjects+1f
acsrtl!RemoveWorkItem+27b
msvcrt!free+c8
kernel32!BaseThreadStart+34




Back to Top


Thread 9 - System ID 3124
Entry point msvcrt!_endthreadex+2f
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




This thread is not fully resolved and may or may not be a problem. Further
analysis of these threads may be required.



Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
user32!RealMsgWaitForMultipleObjectsEx+141
user32!MsgWaitForMultipleObjects+1f
acsrtl!RemoveWorkItem+27b
kernel32!BaseThreadStart+34




Back to Top


Thread 10 - System ID 3904
Entry point msvcrt!_endthreadex+2f
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




This thread is not fully resolved and may or may not be a problem. Further
analysis of these threads may be required.



Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
user32!RealMsgWaitForMultipleObjectsEx+141
user32!MsgWaitForMultipleObjects+1f
acsrtl!RemoveWorkItem+27b
kernel32!BaseThreadStart+34




Back to Top


Thread 11 - System ID 1364
Entry point msvcrt!_endthreadex+2f
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




This thread is not fully resolved and may or may not be a problem. Further
analysis of these threads may be required.



Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
user32!RealMsgWaitForMultipleObjectsEx+141
user32!MsgWaitForMultipleObjects+1f
acsrtl!RemoveWorkItem+27b
kernel32!BaseThreadStart+34




Back to Top


Thread 12 - System ID 3104
Entry point msatq!AtqInitialize+1354
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




This thread is not fully resolved and may or may not be a problem. Further
analysis of these threads may be required.



Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
msatq!AtqInitialize+1392
kernel32!BaseThreadStart+34




Back to Top


Thread 13 - System ID 3676
Entry point wmisink!CWMIEventSinkWrapper::SetupSubscription+30b
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.015
Time spent in kernel mode 0 Days 00:00:00.00




This thread is not fully resolved and may or may not be a problem. Further
analysis of these threads may be required.



Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
kernel32!WaitForMultipleObjects+18
wmisink!CWMIEventSinkWrapper::SetupSubscription+48e




Back to Top


Thread 14 - System ID 1620
Entry point RfFilExt!CMBData::~CMBData+c2
Create time 10/26/2007 1:05:15 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




This thread is calling an ISAPI Filter RfFilExt



Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
RfFilExt!CMBData::~CMBData+f6




Back to Top


Thread 15 - System ID 3100
Entry point w3core!HTTP_COMPRESSION::CompressionThread
Create time 10/26/2007 1:05:16 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
w3core!HTTP_COMPRESSION::CompressionThread+126
kernel32!BaseThreadStart+34




Back to Top


Thread 16 - System ID 3300
Entry point ntdll!RtlpIOWorkerThread
Create time 10/26/2007 1:05:16 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtDelayExecution+c
ntdll!RtlpIOWorkerThread+3f
kernel32!BaseThreadStart+34




Back to Top


Thread 17 - System ID 2064
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:00:00.203
Time spent in kernel mode 0 Days 00:00:00.031




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
mscorsvr!ThreadpoolMgr::CompletionPortThreadStart+49
mscorsvr!ThreadpoolMgr::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 18 - System ID 2300
Entry point mscorsvr!ThreadpoolMgr::GateThreadStart
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtDelayExecution+c
kernel32!SleepEx+68
kernel32!Sleep+f
mscorsvr!ThreadpoolMgr::GateThreadStart+54
kernel32!BaseThreadStart+34




Back to Top


Thread 19 - System ID 3972
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:03:44.140
Time spent in kernel mode 0 Days 00:00:13.515




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!ThreadpoolMgr::WorkerThreadStart+3a
mscorsvr!ThreadpoolMgr::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 20 - System ID 3232
Entry point mscorsvr!DebuggerRCThread::ThreadProcStatic
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
kernel32!WaitForMultipleObjects+18
mscorsvr!DebuggerRCThread::MainLoop+90
mscorsvr!DebuggerRCThread::ThreadProc+68
mscorsvr!DebuggerRCThread::ThreadProcStatic+b
kernel32!BaseThreadStart+34




Back to Top


Thread 21 - System ID 244
Entry point mscorsvr!gc_heap::gc_thread_stub
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:03:48.906
Time spent in kernel mode 0 Days 00:00:03.109




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!gc_heap::gc_thread_function+2f
mscorsvr!gc_heap::gc_thread_stub+1e
kernel32!BaseThreadStart+34




Back to Top


Thread 22 - System ID 3108
Entry point mscorsvr!gc_heap::gc_thread_stub
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:04:00.312
Time spent in kernel mode 0 Days 00:00:01.609




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!gc_heap::gc_thread_function+2f
mscorsvr!gc_heap::gc_thread_stub+1e
kernel32!BaseThreadStart+34




Back to Top


Thread 23 - System ID 3204
Entry point mscorsvr!gc_heap::gc_thread_stub
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:03:23.046
Time spent in kernel mode 0 Days 00:00:02.171




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!gc_heap::gc_thread_function+2f
mscorsvr!gc_heap::gc_thread_stub+1e
kernel32!BaseThreadStart+34




Back to Top


Thread 24 - System ID 3336
Entry point mscorsvr!gc_heap::gc_thread_stub
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:03:55.062
Time spent in kernel mode 0 Days 00:00:01.531




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!gc_heap::gc_thread_function+2f
mscorsvr!gc_heap::gc_thread_stub+1e
kernel32!BaseThreadStart+34




Back to Top


Thread 25 - System ID 2592
Entry point mscorsvr!Thread::intermediateThreadProc
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:00:01.562
Time spent in kernel mode 0 Days 00:00:00.062




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
kernel32!WaitForMultipleObjects+18
mscorsvr!WaitForFinalizerEvent+5a
mscorsvr!GCHeap::FinalizerThreadStart+96
mscorsvr!Thread::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 26 - System ID 2812
Entry point mscorsvr!ThreadpoolMgr::TimerThreadStart
Create time 10/26/2007 1:05:18 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.015




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtDelayExecution+c
kernel32!SleepEx+68
mscorsvr!ThreadpoolMgr::TimerThreadStart+30
kernel32!BaseThreadStart+34




Back to Top


Thread 27 - System ID 976
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 10/26/2007 1:05:19 PM
Time spent in user mode 0 Days 00:04:16.078
Time spent in kernel mode 0 Days 00:00:15.796




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!ThreadpoolMgr::WorkerThreadStart+3a
mscorsvr!ThreadpoolMgr::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 28 - System ID 3132
Create time 12:00:00 AM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwReplyWaitReceivePortEx+c
rpcrt4!LRPC_ADDRESS::ReceiveLotsaCalls+198
rpcrt4!RecvLotsaCallsWrapper+d
rpcrt4!BaseCachedThreadRoutine+9d
rpcrt4!ThreadStartRoutine+1b
kernel32!BaseThreadStart+34




Back to Top


Thread 29 - System ID 3616
Entry point mscorsvr!ThreadpoolMgr::WaitThreadStart
Create time 10/26/2007 1:05:35 PM
Time spent in user mode 0 Days 00:00:00.015
Time spent in kernel mode 0 Days 00:00:00.046




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtDelayExecution+c
kernel32!SleepEx+68
mscorsvr!ThreadpoolMgr::WaitThreadStart+45
kernel32!BaseThreadStart+34




Back to Top


Thread 30 - System ID 3428
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 10/26/2007 1:32:00 PM
Time spent in user mode 0 Days 00:03:26.968
Time spent in kernel mode 0 Days 00:00:12.156




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!ThreadpoolMgr::WorkerThreadStart+3a
mscorsvr!ThreadpoolMgr::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 31 - System ID 144
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 10/26/2007 2:06:29 PM
Time spent in user mode 0 Days 00:02:46.859
Time spent in kernel mode 0 Days 00:00:11.156




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForSingleObject+c
kernel32!WaitForSingleObjectEx+ac
kernel32!WaitForSingleObject+12
mscorsvr!ThreadpoolMgr::WorkerThreadStart+3a
mscorsvr!ThreadpoolMgr::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 32 - System ID 3080
Entry point userenv!NotificationThread
Create time 10/26/2007 2:23:52 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtWaitForMultipleObjects+c
kernel32!WaitForMultipleObjectsEx+11a
kernel32!WaitForMultipleObjects+18
userenv!NotificationThread+5f
kernel32!BaseThreadStart+34




Back to Top


Thread 33 - System ID 3480
Create time 12:00:00 AM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwReplyWaitReceivePortEx+c
rpcrt4!LRPC_ADDRESS::ReceiveLotsaCalls+198
rpcrt4!RecvLotsaCallsWrapper+d
rpcrt4!BaseCachedThreadRoutine+9d
rpcrt4!ThreadStartRoutine+1b
kernel32!BaseThreadStart+34




Back to Top


Thread 34 - System ID 3340
Create time 12:00:00 AM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwReplyWaitReceivePortEx+c
rpcrt4!LRPC_ADDRESS::ReceiveLotsaCalls+198
rpcrt4!RecvLotsaCallsWrapper+d
rpcrt4!BaseCachedThreadRoutine+9d
rpcrt4!ThreadStartRoutine+1b
kernel32!BaseThreadStart+34




Back to Top


Thread 35 - System ID 4012
Entry point ntdll!RtlpWorkerThread
Create time 10/26/2007 4:45:42 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.031




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
ntdll!RtlpWorkerThread+3d
kernel32!BaseThreadStart+34




Back to Top


Thread 36 - System ID 320
Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
Create time 10/26/2007 4:50:00 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
mscorsvr!ThreadpoolMgr::CompletionPortThreadStart+49
mscorsvr!ThreadpoolMgr::intermediateThreadProc+44
kernel32!BaseThreadStart+34




Back to Top


Thread 37 - System ID 2392
Entry point ntdll!RtlpWorkerThread
Create time 10/26/2007 4:50:42 PM
Time spent in user mode 0 Days 00:00:00.00
Time spent in kernel mode 0 Days 00:00:00.00




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtRemoveIoCompletion+c
ntdll!RtlpWorkerThread+3d
kernel32!BaseThreadStart+34




Back to Top

HTTP report
IIS ATQ worker thread count 4 Thread(s)
Available ATQ worker thread count 4 Thread(s)
Active client connections 31 client connection(s)



Client Connections
Client connection from 75.20.255.174:61901 to 172.16.12.71:80
Host Header network.construction.com:80
GET request for /CNSearchPage.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:00:09
QueryString
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS

30 connection(s) waiting for the next request.

Re: Could anyone help me to analyse w3wp and IIS DUMP report

am 29.10.2007 08:45:11 von David Wang

On Oct 28, 4:00 pm, Gobi wrote:
> Please anyone help me to identify the issue causing my iis hang and not
> responding for user search pages, our app is running in web farm of 9
> servers, sporadically the hang occurs on different servers, while the ser=
ver
> was in hung state worker process was running at around 300MB, not showing=
any
> event logs..i took the dump but couldnt interepret what is in it.. attach=
ing
> the dump analyse report createb by debugdiag..please help me in identifyi=
ng
> any issues in my report and server
> ---------------------DUMP REPORT--------------------------
> Report for
> IIS_COM+__Date__10_26_2007__Time_04_51_40PM__w3wp.exe__Defau ltAppPool__PI=
D_=AD_3648__899__Manual Dump.dmp
> Type of Analysis Performed Hang Analysis
> Machine Name MHC-PNP-PROD12
> Operating System Windows Server 2003 Service Pack 1
> Number Of Processors 4
> Process ID 3648
> Process Image c:\WINDOWS\system32\inetsrv\w3wp.exe
> System Up-Time 36 day(s) 07:39:35
> Process Up-Time 03:46:26
>
> Top 5 Threads by CPU time
> Note - Times include both user mode and kernel mode for each thread Thread
> ID: 27 Total CPU Time: 00:04:31.874 Entry Point for Thread:
> mscorsvr!ThreadpoolMgr::intermediateThreadProc
> Thread ID: 22 Total CPU Time: 00:04:01.921 Entry Point for Thread:
> mscorsvr!gc_heap::gc_thread_stub
> Thread ID: 19 Total CPU Time: 00:03:57.655 Entry Point for Thread:
> mscorsvr!ThreadpoolMgr::intermediateThreadProc
> Thread ID: 24 Total CPU Time: 00:03:56.593 Entry Point for Thread:
> mscorsvr!gc_heap::gc_thread_stub
> Thread ID: 21 Total CPU Time: 00:03:52.015 Entry Point for Thread:
> mscorsvr!gc_heap::gc_thread_stub
>
> Thread report
>
> Thread 0 - System ID 3076
> Entry point w3wp!wmainCRTStartup
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.078
> Time spent in kernel mode 0 Days 00:00:00.046
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> w3dt!WP_CONTEXT::RunMainThreadLoop+10 =20
> w3dt!UlAtqStartListen+2d =20
> w3core!W3_SERVER::StartListen+bd =20
> w3core!UlW3Start+26e =20
> w3wp!wmain+22a =20
> w3wp!wmainCRTStartup+12b =20
> kernel32!BaseProcessStart+23 =20
>
> Back to Top
>
> Thread 1 - System ID 2676
> Entry point ntdll!RtlpTimerThread
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtDelayExecution+c =20
> ntdll!RtlpTimerThread+47 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 2 - System ID 336
> Entry point rpcrt4!ThreadStartRoutine
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> kernel32!GetQueuedCompletionStatus+29 =20
> rpcrt4!COMMON_ProcessCalls+a1 =20
> rpcrt4!LOADABLE_TRANSPORT::ProcessIOEvents+117 =20
> rpcrt4!ProcessIOEventsWrapper+d =20
> rpcrt4!BaseCachedThreadRoutine+9d =20
> rpcrt4!ThreadStartRoutine+1b =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 3 - System ID 2888
> Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:03.093
> Time spent in kernel mode 0 Days 00:00:01.359
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> kernel32!GetQueuedCompletionStatus+29 =20
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+33 =20
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+24 =20
> w3tp!THREAD_MANAGER::ThreadManagerThread+39 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 4 - System ID 2736
> Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:01.281
> Time spent in kernel mode 0 Days 00:00:00.703
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> kernel32!GetQueuedCompletionStatus+29 =20
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+33 =20
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+24 =20
> w3tp!THREAD_MANAGER::ThreadManagerThread+39 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 5 - System ID 528
> Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.875
> Time spent in kernel mode 0 Days 00:00:00.296
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> kernel32!GetQueuedCompletionStatus+29 =20
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+33 =20
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+24 =20
> w3tp!THREAD_MANAGER::ThreadManagerThread+39 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 6 - System ID 4044
> Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:02.671
> Time spent in kernel mode 0 Days 00:00:01.218
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> kernel32!GetQueuedCompletionStatus+29 =20
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+33 =20
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+24 =20
> w3tp!THREAD_MANAGER::ThreadManagerThread+39 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 7 - System ID 2740
> Entry point ntdll!RtlpWaitThread
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.281
> Time spent in kernel mode 0 Days 00:00:00.875
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForMultipleObjects+c =20
> ntdll!RtlpWaitThread+161 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 8 - System ID 1832
> Entry point msvcrt!_endthreadex+2f
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:01.453
> Time spent in kernel mode 0 Days 00:00:04.984
>
> This thread is not fully resolved and may or may not be a problem. Further
> analysis of these threads may be required.
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForMultipleObjects+c =20
> kernel32!WaitForMultipleObjectsEx+11a =20
> user32!RealMsgWaitForMultipleObjectsEx+141 =20
> user32!MsgWaitForMultipleObjects+1f =20
> acsrtl!RemoveWorkItem+27b =20
> msvcrt!free+c8 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 9 - System ID 3124
> Entry point msvcrt!_endthreadex+2f
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> This thread is not fully resolved and may or may not be a problem. Further
> analysis of these threads may be required.
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForMultipleObjects+c =20
> kernel32!WaitForMultipleObjectsEx+11a =20
> user32!RealMsgWaitForMultipleObjectsEx+141 =20
> user32!MsgWaitForMultipleObjects+1f =20
> acsrtl!RemoveWorkItem+27b =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 10 - System ID 3904
> Entry point msvcrt!_endthreadex+2f
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> This thread is not fully resolved and may or may not be a problem. Further
> analysis of these threads may be required.
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForMultipleObjects+c =20
> kernel32!WaitForMultipleObjectsEx+11a =20
> user32!RealMsgWaitForMultipleObjectsEx+141 =20
> user32!MsgWaitForMultipleObjects+1f =20
> acsrtl!RemoveWorkItem+27b =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 11 - System ID 1364
> Entry point msvcrt!_endthreadex+2f
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> This thread is not fully resolved and may or may not be a problem. Further
> analysis of these threads may be required.
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForMultipleObjects+c =20
> kernel32!WaitForMultipleObjectsEx+11a =20
> user32!RealMsgWaitForMultipleObjectsEx+141 =20
> user32!MsgWaitForMultipleObjects+1f =20
> acsrtl!RemoveWorkItem+27b =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 12 - System ID 3104
> Entry point msatq!AtqInitialize+1354
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> This thread is not fully resolved and may or may not be a problem. Further
> analysis of these threads may be required.
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> kernel32!GetQueuedCompletionStatus+29 =20
> msatq!AtqInitialize+1392 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 13 - System ID 3676
> Entry point wmisink!CWMIEventSinkWrapper::SetupSubscription+30b
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.015
> Time spent in kernel mode 0 Days 00:00:00.00
>
> This thread is not fully resolved and may or may not be a problem. Further
> analysis of these threads may be required.
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForMultipleObjects+c =20
> kernel32!WaitForMultipleObjectsEx+11a =20
> kernel32!WaitForMultipleObjects+18 =20
> wmisink!CWMIEventSinkWrapper::SetupSubscription+48e =20
>
> Back to Top
>
> Thread 14 - System ID 1620
> Entry point RfFilExt!CMBData::~CMBData+c2
> Create time 10/26/2007 1:05:15 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> This thread is calling an ISAPI Filter RfFilExt
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> RfFilExt!CMBData::~CMBData+f6 =20
>
> Back to Top
>
> Thread 15 - System ID 3100
> Entry point w3core!HTTP_COMPRESSION::CompressionThread
> Create time 10/26/2007 1:05:16 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> w3core!HTTP_COMPRESSION::CompressionThread+126 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 16 - System ID 3300
> Entry point ntdll!RtlpIOWorkerThread
> Create time 10/26/2007 1:05:16 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtDelayExecution+c =20
> ntdll!RtlpIOWorkerThread+3f =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 17 - System ID 2064
> Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:00:00.203
> Time spent in kernel mode 0 Days 00:00:00.031
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> kernel32!GetQueuedCompletionStatus+29 =20
> mscorsvr!ThreadpoolMgr::CompletionPortThreadStart+49 =20
> mscorsvr!ThreadpoolMgr::intermediateThreadProc+44 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 18 - System ID 2300
> Entry point mscorsvr!ThreadpoolMgr::GateThreadStart
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtDelayExecution+c =20
> kernel32!SleepEx+68 =20
> kernel32!Sleep+f =20
> mscorsvr!ThreadpoolMgr::GateThreadStart+54 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 19 - System ID 3972
> Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:03:44.140
> Time spent in kernel mode 0 Days 00:00:13.515
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> mscorsvr!ThreadpoolMgr::WorkerThreadStart+3a =20
> mscorsvr!ThreadpoolMgr::intermediateThreadProc+44 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 20 - System ID 3232
> Entry point mscorsvr!DebuggerRCThread::ThreadProcStatic
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForMultipleObjects+c =20
> kernel32!WaitForMultipleObjectsEx+11a =20
> kernel32!WaitForMultipleObjects+18 =20
> mscorsvr!DebuggerRCThread::MainLoop+90 =20
> mscorsvr!DebuggerRCThread::ThreadProc+68 =20
> mscorsvr!DebuggerRCThread::ThreadProcStatic+b =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 21 - System ID 244
> Entry point mscorsvr!gc_heap::gc_thread_stub
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:03:48.906
> Time spent in kernel mode 0 Days 00:00:03.109
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> mscorsvr!gc_heap::gc_thread_function+2f =20
> mscorsvr!gc_heap::gc_thread_stub+1e =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 22 - System ID 3108
> Entry point mscorsvr!gc_heap::gc_thread_stub
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:04:00.312
> Time spent in kernel mode 0 Days 00:00:01.609
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> mscorsvr!gc_heap::gc_thread_function+2f =20
> mscorsvr!gc_heap::gc_thread_stub+1e =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 23 - System ID 3204
> Entry point mscorsvr!gc_heap::gc_thread_stub
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:03:23.046
> Time spent in kernel mode 0 Days 00:00:02.171
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> mscorsvr!gc_heap::gc_thread_function+2f =20
> mscorsvr!gc_heap::gc_thread_stub+1e =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 24 - System ID 3336
> Entry point mscorsvr!gc_heap::gc_thread_stub
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:03:55.062
> Time spent in kernel mode 0 Days 00:00:01.531
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> mscorsvr!gc_heap::gc_thread_function+2f =20
> mscorsvr!gc_heap::gc_thread_stub+1e =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 25 - System ID 2592
> Entry point mscorsvr!Thread::intermediateThreadProc
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:00:01.562
> Time spent in kernel mode 0 Days 00:00:00.062
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForMultipleObjects+c =20
> kernel32!WaitForMultipleObjectsEx+11a =20
> kernel32!WaitForMultipleObjects+18 =20
> mscorsvr!WaitForFinalizerEvent+5a =20
> mscorsvr!GCHeap::FinalizerThreadStart+96 =20
> mscorsvr!Thread::intermediateThreadProc+44 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 26 - System ID 2812
> Entry point mscorsvr!ThreadpoolMgr::TimerThreadStart
> Create time 10/26/2007 1:05:18 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.015
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtDelayExecution+c =20
> kernel32!SleepEx+68 =20
> mscorsvr!ThreadpoolMgr::TimerThreadStart+30 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 27 - System ID 976
> Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
> Create time 10/26/2007 1:05:19 PM
> Time spent in user mode 0 Days 00:04:16.078
> Time spent in kernel mode 0 Days 00:00:15.796
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> mscorsvr!ThreadpoolMgr::WorkerThreadStart+3a =20
> mscorsvr!ThreadpoolMgr::intermediateThreadProc+44 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 28 - System ID 3132
> Create time 12:00:00 AM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!ZwReplyWaitReceivePortEx+c =20
> rpcrt4!LRPC_ADDRESS::ReceiveLotsaCalls+198 =20
> rpcrt4!RecvLotsaCallsWrapper+d =20
> rpcrt4!BaseCachedThreadRoutine+9d =20
> rpcrt4!ThreadStartRoutine+1b =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 29 - System ID 3616
> Entry point mscorsvr!ThreadpoolMgr::WaitThreadStart
> Create time 10/26/2007 1:05:35 PM
> Time spent in user mode 0 Days 00:00:00.015
> Time spent in kernel mode 0 Days 00:00:00.046
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtDelayExecution+c =20
> kernel32!SleepEx+68 =20
> mscorsvr!ThreadpoolMgr::WaitThreadStart+45 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 30 - System ID 3428
> Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
> Create time 10/26/2007 1:32:00 PM
> Time spent in user mode 0 Days 00:03:26.968
> Time spent in kernel mode 0 Days 00:00:12.156
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> mscorsvr!ThreadpoolMgr::WorkerThreadStart+3a =20
> mscorsvr!ThreadpoolMgr::intermediateThreadProc+44 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 31 - System ID 144
> Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
> Create time 10/26/2007 2:06:29 PM
> Time spent in user mode 0 Days 00:02:46.859
> Time spent in kernel mode 0 Days 00:00:11.156
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForSingleObject+c =20
> kernel32!WaitForSingleObjectEx+ac =20
> kernel32!WaitForSingleObject+12 =20
> mscorsvr!ThreadpoolMgr::WorkerThreadStart+3a =20
> mscorsvr!ThreadpoolMgr::intermediateThreadProc+44 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 32 - System ID 3080
> Entry point userenv!NotificationThread
> Create time 10/26/2007 2:23:52 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtWaitForMultipleObjects+c =20
> kernel32!WaitForMultipleObjectsEx+11a =20
> kernel32!WaitForMultipleObjects+18 =20
> userenv!NotificationThread+5f =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 33 - System ID 3480
> Create time 12:00:00 AM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!ZwReplyWaitReceivePortEx+c =20
> rpcrt4!LRPC_ADDRESS::ReceiveLotsaCalls+198 =20
> rpcrt4!RecvLotsaCallsWrapper+d =20
> rpcrt4!BaseCachedThreadRoutine+9d =20
> rpcrt4!ThreadStartRoutine+1b =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 34 - System ID 3340
> Create time 12:00:00 AM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!ZwReplyWaitReceivePortEx+c =20
> rpcrt4!LRPC_ADDRESS::ReceiveLotsaCalls+198 =20
> rpcrt4!RecvLotsaCallsWrapper+d =20
> rpcrt4!BaseCachedThreadRoutine+9d =20
> rpcrt4!ThreadStartRoutine+1b =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 35 - System ID 4012
> Entry point ntdll!RtlpWorkerThread
> Create time 10/26/2007 4:45:42 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.031
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> ntdll!RtlpWorkerThread+3d =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 36 - System ID 320
> Entry point mscorsvr!ThreadpoolMgr::intermediateThreadProc
> Create time 10/26/2007 4:50:00 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> kernel32!GetQueuedCompletionStatus+29 =20
> mscorsvr!ThreadpoolMgr::CompletionPortThreadStart+49 =20
> mscorsvr!ThreadpoolMgr::intermediateThreadProc+44 =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> Thread 37 - System ID 2392
> Entry point ntdll!RtlpWorkerThread
> Create time 10/26/2007 4:50:42 PM
> Time spent in user mode 0 Days 00:00:00.00
> Time spent in kernel mode 0 Days 00:00:00.00
>
> Function Source
> ntdll!KiFastSystemCallRet =20
> ntdll!NtRemoveIoCompletion+c =20
> ntdll!RtlpWorkerThread+3d =20
> kernel32!BaseThreadStart+34 =20
>
> Back to Top
>
> HTTP report
> IIS ATQ worker thread count 4 Thread(s)
> Available ATQ worker thread count 4 Thread(s)
> Active client connections 31 client connection(s)
>
> Client Connections
> Client connection from 75.20.255.174:61901 to 172.16.12.71:80 =20
> Host Header network.construction.com:80
> GET request for /CNSearchPage.aspx
> HTTP Version HTTP/1.1
> SSL Request False
> Time alive 00:00:09
> QueryString =20
> Request mapped to =20
> HTTP Request State HTR_READING_CLIENT_REQUEST
> Native Request State NREQ_STATE_PROCESS
>
> 30 connection(s) waiting for the next request.


Your ASP.Net application is likely causing a lot of Garbage
Collection, which is not cheap and will stall manage code in the
entire process, along with using CPU, while memory is recollected.


//David
http://w3-4u.blogspot.com
http://blogs.msdn.com/David.Wang
//

Re: Could anyone help me to analyse w3wp and IIS DUMP report

am 29.10.2007 18:20:22 von gobinathan

Thank you for your reply..
So How do i prove this to developers and where should i ask them to check in
theri code, the Garbage collection of application ASP.NET is causing the hang,
is there any way i can point out where the issue is? any performance counters?
any help would be appreciated

Thanks
Gobi

David Wang wrote:
>> Please anyone help me to identify the issue causing my iis hang and not
>> responding for user search pages, our app is running in web farm of 9
>[quoted text clipped - 690 lines]
>>
>> 30 connection(s) waiting for the next request.
>
>Your ASP.Net application is likely causing a lot of Garbage
>Collection, which is not cheap and will stall manage code in the
>entire process, along with using CPU, while memory is recollected.
>
>//David
>http://w3-4u.blogspot.com
>http://blogs.msdn.com/David.Wang
>//

--
Message posted via WinServerKB.com
http://www.winserverkb.com/Uwe/Forums.aspx/iis-general/20071 0/1

Re: Could anyone help me to analyse w3wp and IIS DUMP report

am 30.10.2007 23:49:37 von David Wang

You really don't need to prove anything.

You need to tell the developers that their applications are stalling
in production because they are causing too many garbage collections.
It is their job to translate that feedback into changing the correct
places in code. It is also these developers' job to figure out how to
debug your hanging server if they don't know where to fix.

If they ask you how you determined it, tell them exactly what
happened. You don't need to provide them any perf counters because
you've already empirically noticed the hang, took memory dumps during
that time, and we came to this conclusion. The ball is in the
developers' court to prove otherwise. You just have to allow them to
debug and do whatever they want, not hand everything to them on a
silver platter.


//David
http://w3-4u.blogspot.com
http://blogs.msdn.com/David.Wang
//





On Oct 29, 10:20 am, "gobinathan via WinServerKB.com"
wrote:
> Thank you for your reply..
> So How do i prove this to developers and where should i ask them to check in
> theri code, the Garbage collection of application ASP.NET is causing the hang,
> is there any way i can point out where the issue is? any performance counters?
> any help would be appreciated
>
> Thanks
> Gobi
>
> David Wang wrote:
> >> Please anyone help me to identify the issue causing my iis hang and not
> >> responding for user search pages, our app is running in web farm of 9
> >[quoted text clipped - 690 lines]
>
> >> 30 connection(s) waiting for the next request.
>
> >Your ASP.Net application is likely causing a lot of Garbage
> >Collection, which is not cheap and will stall manage code in the
> >entire process, along with using CPU, while memory is recollected.
>
> >//David
> >http://w3-4u.blogspot.com
> >http://blogs.msdn.com/David.Wang
> >//
>
> --
> Message posted via WinServerKB.comhttp://www.winserverkb.com/Uwe/Forums.aspx/ii s-general/200710/1