IIS 6.0 hangs on 2003 server
am 10.08.2007 06:13:15 von akghoraHi,
I have my IIS server hang every day and have to restart to restore verything.
I have taken a dump and the IISState.log
If the experts could shed some light onto the thread stacks, it would be a
great help.
Contents of IISState.log. (I have taken 5 of them with some time interval.
The latest one is attached)
---------------------------------------------------------
Opened log file 'C:\\output\IISState-3880.log'
***********************
Starting new log output
IISState version 3.3.1
Wed Aug 08 17:19:37 2007
OS = Windows 2003 Server
Executable: inetinfo.exe
PID = 3880
Note: Thread times are formatted as HH:MM:SS.ms
***********************
Thread ID: 0
System Thread ID: 208
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0006f99c 7c82776b ntdll!KiFastSystemCallRet
01 0006f9a0 77e418b2 ntdll!NtReadFile+0xc
02 0006fa08 77f65edb kernel32!ReadFile+0x16c
03 0006fa34 77f65f82 ADVAPI32!ScGetPipeInput+0x2a
04 0006faa8 77fb75af ADVAPI32!ScDispatcherLoop+0x51
05 0006fcec 010027be ADVAPI32!StartServiceCtrlDispatcherA+0x93
06 0006fe1c 01002969 inetinfo!StartDispatchTable+0x277
07 0006ff44 0100339d inetinfo!main+0x117
08 0006ffc0 77e6f23b inetinfo!mainCRTStartup+0x12f
09 0006fff0 00000000 kernel32!BaseProcessStart+0x23
Thread ID: 1
System Thread ID: e50
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0097fe14 7c827d0b ntdll!KiFastSystemCallRet
01 0097fe18 77e61d1e ntdll!NtWaitForSingleObject+0xc
02 0097fe88 77e61c8d kernel32!WaitForSingleObjectEx+0xac
03 0097fe9c 01002ebf kernel32!WaitForSingleObject+0x12
04 0097ffb8 77e64829 inetinfo!W3SVCThreadEntry+0x3d
05 0097ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 2
System Thread ID: c20
Kernel Time: 0:0:0.78
User Time: 0:0:0.78
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 009bfcb8 7c827d0b ntdll!KiFastSystemCallRet
01 009bfcbc 77e61d1e ntdll!NtWaitForSingleObject+0xc
02 009bfd2c 77e61c8d kernel32!WaitForSingleObjectEx+0xac
03 009bfd40 649f2674 kernel32!WaitForSingleObject+0x12
04 009bfd68 010024b3 iisadmin!ServiceEntry+0x28a
05 009bffa4 77f65e91 inetinfo!InetinfoStartService+0x2cc
06 009bffb8 77e64829 ADVAPI32!ScSvcctrlThreadW+0x21
07 009bffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 3
System Thread ID: be4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 00bbff9c 7c826f4b ntdll!KiFastSystemCallRet
01 00bbffa0 7c83d424 ntdll!NtDelayExecution+0xc
02 00bbffb8 77e64829 ntdll!RtlpTimerThread+0x47
03 00bbffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 4
System Thread ID: d10
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00f9feac 7c827cfb ntdll!KiFastSystemCallRet
01 00f9feb0 77e6202c ntdll!NtWaitForMultipleObjects+0xc
02 00f9ff58 77e62fbe kernel32!WaitForMultipleObjectsEx+0x11a
03 00f9ff74 56f951df kernel32!WaitForMultipleObjects+0x18
04 00f9ffa0 56f969f6 COADMIN!NOTIFY_CONTEXT::GetNextContext+0x67
05 00f9ffb8 77e64829 COADMIN!NOTIFY_CONTEXT::NotifyThreadProc+0x5f
06 00f9ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 5
System Thread ID: 8c
Kernel Time: 0:0:0.62
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0192fbb8 7c827cfb ntdll!KiFastSystemCallRet
01 0192fbbc 77e6202c ntdll!NtWaitForMultipleObjects+0xc
02 0192fc64 7739bbd1 kernel32!WaitForMultipleObjectsEx+0x11a
03 0192fcc0 7739ce36 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0192fcdc 6c7d5ff9 USER32!MsgWaitForMultipleObjects+0x1f
05 0192fd28 6930e613 INFOCOMM!IIS_SERVICE::StartServiceOperation+0x231
06 0192fd68 010024b3 ftpsvc2!ServiceEntry+0xae
07 0192ffa4 77f65e91 inetinfo!InetinfoStartService+0x2cc
08 0192ffb8 77e64829 ADVAPI32!ScSvcctrlThreadW+0x21
09 0192ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 6
System Thread ID: 1f4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 01c1ff4c 7c8277db ntdll!KiFastSystemCallRet
01 01c1ff50 77e5bea2 ntdll!ZwRemoveIoCompletion+0xc
02 01c1ff7c 63ec7736 kernel32!GetQueuedCompletionStatus+0x29
03 01c1ffb8 77e64829 ISATQ!AtqPoolThread+0x40
04 01c1ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 7
System Thread ID: 258
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 01c5ff4c 7c8277db ntdll!KiFastSystemCallRet
01 01c5ff50 77e5bea2 ntdll!ZwRemoveIoCompletion+0xc
02 01c5ff7c 63ec7736 kernel32!GetQueuedCompletionStatus+0x29
03 01c5ffb8 77e64829 ISATQ!AtqPoolThread+0x40
04 01c5ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 8
System Thread ID: 8ec
Kernel Time: 0:0:0.46
User Time: 0:0:0.187
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.
No remote call being made
# ChildEBP RetAddr
00 01f5ff70 7c826f4b ntdll!KiFastSystemCallRet
01 01f5ff74 77c8884c ntdll!NtDelayExecution+0xc
02 01f5ff8c 77c88768 RPCRT4!TIMER::Wait+0x2b
03 01f5ffac 77c7b110 RPCRT4!BaseCachedThreadRoutine+0xe8
04 01f5ffb8 77e64829 RPCRT4!ThreadStartRoutine+0x1b
05 01f5ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 9
System Thread ID: c2c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 01f9fec4 7c827cfb ntdll!KiFastSystemCallRet
01 01f9fec8 77e6202c ntdll!NtWaitForMultipleObjects+0xc
02 01f9ff70 69308d78 kernel32!WaitForMultipleObjectsEx+0x11a
03 01f9ffb8 77e64829 ftpsvc2!PASV_ACCEPT_CONTEXT::AcceptThreadFunc+0x33
04 01f9ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 10
System Thread ID: 188
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0202fe0c 7c827d0b ntdll!KiFastSystemCallRet
01 0202fe10 71b21af5 ntdll!NtWaitForSingleObject+0xc
02 0202fe4c 71b21a03 mswsock!SockWaitForSingleObject+0x19d
03 0202ff3c 71c0283c mswsock!WSPSelect+0x380
04 0202ff8c 63ec4929 WS2_32!select+0xb9
05 0202ffb0 63ec499b ISATQ!ATQ_BMON_SET::BmonThreadFunc+0x23
06 0202ffb8 77e64829 ISATQ!BmonThreadFunc+0xd
07 0202ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 11
System Thread ID: aec
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.
No remote call being made
# ChildEBP RetAddr
00 0209fe18 7c82783b ntdll!KiFastSystemCallRet
01 0209fe1c 77c885ac ntdll!NtReplyWaitReceivePortEx+0xc
02 0209ff84 77c88792 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x198
03 0209ff8c 77c8872d RPCRT4!RecvLotsaCallsWrapper+0xd
04 0209ffac 77c7b110 RPCRT4!BaseCachedThreadRoutine+0x9d
05 0209ffb8 77e64829 RPCRT4!ThreadStartRoutine+0x1b
06 0209ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 12
System Thread ID: 620
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 020dfcec 7c827cfb ntdll!KiFastSystemCallRet
01 020dfcf0 7c83c78e ntdll!NtWaitForMultipleObjects+0xc
02 020dffb8 77e64829 ntdll!RtlpWaitThread+0x161
03 020dffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 13
System Thread ID: 6e8
Kernel Time: 0:0:0.46
User Time: 0:0:0.15
Thread Status: Thread is in a WAIT state.
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 0211fbb8 7c827cfb ntdll!KiFastSystemCallRet
01 0211fbbc 77e6202c ntdll!NtWaitForMultipleObjects+0xc
02 0211fc64 7739bbd1 kernel32!WaitForMultipleObjectsEx+0x11a
03 0211fcc0 7739ce36 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0211fcdc 6c7d5ff9 USER32!MsgWaitForMultipleObjects+0x1f
05 0211fd28 4f07540b INFOCOMM!IIS_SERVICE::StartServiceOperation+0x231
06 0211fd68 010024b3 SMTPSVC!ServiceEntry+0x12b
07 0211ffa4 77f65e91 inetinfo!InetinfoStartService+0x2cc
08 0211ffb8 77e64829 ADVAPI32!ScSvcctrlThreadW+0x21
09 0211ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 14
System Thread ID: 710
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0215fec4 7c827cfb ntdll!KiFastSystemCallRet
01 0215fec8 77e6202c ntdll!NtWaitForMultipleObjects+0xc
02 0215ff70 77e62fbe kernel32!WaitForMultipleObjectsEx+0x11a
03 0215ff8c 695324f7 kernel32!WaitForMultipleObjects+0x18
04 0215ffb8 77e64829 exstrace!RegNotifyThread+0x6a
05 0215ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 15
System Thread ID: 5c0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0219fec8 7c827cfb ntdll!KiFastSystemCallRet
01 0219fecc 77e6202c ntdll!NtWaitForMultipleObjects+0xc
02 0219ff74 77e62fbe kernel32!WaitForMultipleObjectsEx+0x11a
03 0219ff90 69531a1d kernel32!WaitForMultipleObjects+0x18
04 0219ffb8 77e64829 exstrace!WriteTraceThread+0x31
05 0219ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 16
System Thread ID: 9c8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0239ff18 7c827d0b ntdll!KiFastSystemCallRet
01 0239ff1c 77e61d1e ntdll!NtWaitForSingleObject+0xc
02 0239ff8c 77e61c8d kernel32!WaitForSingleObjectEx+0xac
03 0239ffa0 4ba58f80 kernel32!WaitForSingleObject+0x12
04 0239ffb8 77e64829 FCACHDLL!CScheduleThread::ScheduleThread+0x61
05 0239ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 17
System Thread ID: c4
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 024dfebc 7c827cfb ntdll!KiFastSystemCallRet
01 024dfec0 77e6202c ntdll!NtWaitForMultipleObjects+0xc
02 024dff68 77e62fbe kernel32!WaitForMultipleObjectsEx+0x11a
03 024dff84 4f08f1a5 kernel32!WaitForMultipleObjects+0x18
04 024dffb8 77e64829 SMTPSVC!TcpRegNotifyThread+0xde
05 024dffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 18
System Thread ID: fe0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 0251ff1c 7c827d0b ntdll!KiFastSystemCallRet
01 0251ff20 77e61d1e ntdll!NtWaitForSingleObject+0xc
02 0251ff90 77e61c8d kernel32!WaitForSingleObjectEx+0xac
03 0251ffa4 4f08f042 kernel32!WaitForSingleObject+0x12
04 0251ffb8 77e64829 SMTPSVC!FreeLibThread+0x2e
05 0251ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 19
System Thread ID: df8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.
No remote call being made
# ChildEBP RetAddr
00 02c3fe18 7c82783b ntdll!KiFastSystemCallRet
01 02c3fe1c 77c885ac ntdll!NtReplyWaitReceivePortEx+0xc
02 02c3ff84 77c88792 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x198
03 02c3ff8c 77c8872d RPCRT4!RecvLotsaCallsWrapper+0xd
04 02c3ffac 77c7b110 RPCRT4!BaseCachedThreadRoutine+0x9d
05 02c3ffb8 77e64829 RPCRT4!ThreadStartRoutine+0x1b
06 02c3ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 20
System Thread ID: 3bc
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.
No remote call being made
# ChildEBP RetAddr
00 013efeac 7c8277db ntdll!KiFastSystemCallRet
01 013efeb0 77e5bea2 ntdll!ZwRemoveIoCompletion+0xc
02 013efedc 77c7b900 kernel32!GetQueuedCompletionStatus+0x29
03 013eff18 77c7b703 RPCRT4!COMMON_ProcessCalls+0xa1
04 013eff84 77c7b9b5 RPCRT4!LOADABLE_TRANSPORT::ProcessIOEvents+0x117
05 013eff8c 77c8872d RPCRT4!ProcessIOEventsWrapper+0xd
06 013effac 77c7b110 RPCRT4!BaseCachedThreadRoutine+0x9d
07 013effb8 77e64829 RPCRT4!ThreadStartRoutine+0x1b
08 013effec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 21
System Thread ID: ec8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.
No remote call being made
# ChildEBP RetAddr
00 0132fe18 7c82783b ntdll!KiFastSystemCallRet
01 0132fe1c 77c885ac ntdll!NtReplyWaitReceivePortEx+0xc
02 0132ff84 77c88792 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x198
03 0132ff8c 77c8872d RPCRT4!RecvLotsaCallsWrapper+0xd
04 0132ffac 77c7b110 RPCRT4!BaseCachedThreadRoutine+0x9d
05 0132ffb8 77e64829 RPCRT4!ThreadStartRoutine+0x1b
06 0132ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 22
System Thread ID: 28c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 012eff70 7c8277db ntdll!KiFastSystemCallRet
01 012eff74 7c839f38 ntdll!ZwRemoveIoCompletion+0xc
02 012effb8 77e64829 ntdll!RtlpWorkerThread+0x3d
03 012effec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 23
System Thread ID: 25c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 00bfff70 7c8277db ntdll!KiFastSystemCallRet
01 00bfff74 7c839f38 ntdll!ZwRemoveIoCompletion+0xc
02 00bfffb8 77e64829 ntdll!RtlpWorkerThread+0x3d
03 00bfffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 24
System Thread ID: 6ac
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0063ff70 7c8277db ntdll!KiFastSystemCallRet
01 0063ff74 7c839f38 ntdll!ZwRemoveIoCompletion+0xc
02 0063ffb8 77e64829 ntdll!RtlpWorkerThread+0x3d
03 0063ffec 00000000 kernel32!BaseThreadStart+0x34
*****
Dump name is formatted as: PID-Timestamp.dmp
Creating C:\\output\3880-1186607979.dmp - mini user dump
*****
Closing open log file C:\\output\IISState-3880.log
----------------------------------------------------------
Thanks,
akghora