W3WP Consumes 100% CPU Time
am 05.07.2007 13:53:44 von Amal DevHi
We have hosted many sites in our server and w3wp process is using 100%
cpu times from time to time and it brings our server to its knees. we
have run iisstate during the 100% time and the log is given below
Please help us in finding out which one is creating this problem
Thanks in advance
Amal
Opened log file 'C:\iisstate\output\IISState-7468.log'
***********************
Starting new log output
IISState version 3.3.1
Mon Jul 02 05:14:01 2007
OS = Windows 2003 Server
Executable: w3wp.exe
PID = 7468
Note: Thread times are formatted as HH:MM:SS.ms
***********************
Thread ID: 0
System Thread ID: 1e44
Kernel Time: 0:0:0.0
User Time: 0:0:0.31
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 0006fc08 7c822124 ntdll!KiFastSystemCallRet
01 0006fc0c 77e6bad8 ntdll!NtWaitForSingleObject+0xc
02 0006fc7c 77e6ba42 kernel32!WaitForSingleObjectEx+0xac
03 0006fc90 5a36467a kernel32!WaitForSingleObject+0x12
04 0006fca0 5a366e63 w3dt!WP_CONTEXT::RunMainThreadLoop+0x10
05 0006fca8 5a3af41d w3dt!UlAtqStartListen+0x2d
06 0006fcb8 5a3bc259 w3core!W3_SERVER::StartListen+0xbd
07 0006ff0c 0100187c w3core!UlW3Start+0x26e
08 0006ff44 01001a23 w3wp!wmain+0x22a
09 0006ffc0 77e523e5 w3wp!wmainCRTStartup+0x12b
0a 0006fff0 00000000 kernel32!BaseProcessStart+0x23
Thread ID: 1
System Thread ID: 1ecc
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0096fea0 7c822114 ntdll!KiFastSystemCallRet
01 0096fea4 7c80e504 ntdll!NtWaitForMultipleObjects+0xc
02 0096ff48 7c80e933 ntdll!EtwpWaitForMultipleObjectsEx+0xf7
03 0096ffb8 77e6608b ntdll!EtwpEventPump+0x27f
04 0096ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 2
System Thread ID: 1258
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 009aff9c 7c821364 ntdll!KiFastSystemCallRet
01 009affa0 7c81fe26 ntdll!NtDelayExecution+0xc
02 009affb8 77e6608b ntdll!RtlpTimerThread+0x47
03 009affec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 3
System Thread ID: 304
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 009eff70 7c821bf4 ntdll!KiFastSystemCallRet
01 009eff74 7c83ad75 ntdll!NtRemoveIoCompletion+0xc
02 009effb8 77e6608b ntdll!RtlpWorkerThread+0x3d
03 009effec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 4
System Thread ID: 11f4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: Unable to locate ASP page
No remote call being made
# ChildEBP RetAddr
00 00a4fe18 7c821c54 ntdll!KiFastSystemCallRet
01 00a4fe1c 77c7538c ntdll!ZwReplyWaitReceivePortEx+0xc
02 00a4ff84 77c5778f RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x198
03 00a4ff8c 77c5f7dd RPCRT4!RecvLotsaCallsWrapper+0xd
04 00a4ffac 77c5de88 RPCRT4!BaseCachedThreadRoutine+0x9d
05 00a4ffb8 77e6608b RPCRT4!ThreadStartRoutine+0x1b
06 00a4ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 5
System Thread ID: f78
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: Unable to locate ASP page
No remote call being made
# ChildEBP RetAddr
00 00a8fa4c 7c821c94 ntdll!KiFastSystemCallRet
01 00a8fa50 77c72700 ntdll!NtRequestWaitReplyPort+0xc
02 00a8fa9c 77c713ba RPCRT4!LRPC_CCALL::SendReceive+0x230
03 00a8faa8 77c72c7f RPCRT4!I_RpcSendReceive+0x24
04 00a8fabc 77ce219b RPCRT4!NdrSendReceive+0x2b
05 00a8fea4 7769aa0a RPCRT4!NdrClientCall2+0x22e
06 00a8febc 7769a99c ole32!BulkUpdateOIDs+0x1c
07 00a8ff04 776adb72 ole32!CRpcResolver::BulkUpdateOIDs+0x92
08 00a8ff88 776b22e2
ole32!CROIDTable::ClientBulkUpdateOIDWithPingServer+0x2f0
09 00a8ff98 776b2307 ole32!CROIDTable::WorkerThreadLoop+0x56
0a 00a8ffa8 77670000 ole32!CRpcThread::WorkerLoop+0x1e
0b 00a8ffb8 77e6608b ole32!_imp__InstallApplication
0c 00a8ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 6
System Thread ID: 1c98
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 00c4ee08 7c821204 ntdll!KiFastSystemCallRet
01 00c4ee0c 77e6c401 ntdll!ZwCreateFile+0xc
02 00c4eea8 5a39cac5 kernel32!CreateFileW+0x377
03 00c4f158 5a39c26b w3core!W3_FILE_INFO::OpenFile+0x126
04 00c4fb44 5a39bfcf w3core!W3_FILE_INFO_CACHE::GetFileInfo+0x5db
05 00c4fb84 5a3997d5 w3core!W3_URL_INFO::GetFileInfo+0x125
06 00c4fbb8 5a3c5289 w3core!URL_CONTEXT::OpenFile+0x5d
07 00c4fe78 5a396764 w3core!W3_STATIC_FILE_HANDLER:oWork+0x1f9
08 00c4fe98 5a3966f4 w3core!W3_HANDLER::MainDoWork+0x16e
09 00c4fea8 5a3966ae w3core!W3_CONTEXT::ExecuteCurrentHandler+0x53
0a 00c4fec4 5a396648 w3core!W3_CONTEXT::ExecuteHandler+0x51
0b 00c4feec 5a392264 w3core!W3_STATE_HANDLE_REQUEST:oWork+0x9a
0c 00c4ff10 5a3965ea w3core!W3_MAIN_CONTEXT:oWork+0xa6
0d 00c4ff2c 5a36169f w3core!W3_MAIN_CONTEXT::OnNewRequest+0x55
0e 00c4ff38 5a361650 w3dt!UL_NATIVE_REQUEST:oStateProcess+0x48
0f 00c4ff48 5a3616ca w3dt!UL_NATIVE_REQUEST:oWork+0x7f
10 00c4ff5c 5a3024de w3dt!OverlappedCompletionRoutine+0x1a
11 00c4ff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x73
12 00c4ffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
13 00c4ffb8 77e6608b W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
14 00c4ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 7
System Thread ID: 13a0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00c8ff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00c8ff28 77e66142 ntdll!NtRemoveIoCompletion+0xc
02 00c8ff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00c8ff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00c8ffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00c8ffb8 77e6608b W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00c8ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 8
System Thread ID: 1298
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00ccff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00ccff28 77e66142 ntdll!NtRemoveIoCompletion+0xc
02 00ccff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00ccff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00ccffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00ccffb8 77e6608b W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00ccffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 9
System Thread ID: 1bec
Kernel Time: 0:0:0.0
User Time: 0:0:0.31
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00d0ff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00d0ff28 77e66142 ntdll!NtRemoveIoCompletion+0xc
02 00d0ff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00d0ff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00d0ffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00d0ffb8 77e6608b W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00d0ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 10
System Thread ID: 1568
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00dcfcec 7c822114 ntdll!KiFastSystemCallRet
01 00dcfcf0 7c83acfd ntdll!NtWaitForMultipleObjects+0xc
02 00dcffb8 77e6608b ntdll!RtlpWaitThread+0x161
03 00dcffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 11
System Thread ID: 1eb4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 017afa84 7c822124 ntdll!KiFastSystemCallRet
01 017afa88 77e6bad8 ntdll!NtWaitForSingleObject+0xc
02 017afaf8 77e6ba42 kernel32!WaitForSingleObjectEx+0xac
03 017afb0c 5a3b8147 kernel32!WaitForSingleObject+0x12
04 017affb8 77e6608b w3core!HTTP_COMPRESSION::CompressionThread+0x126
05 017affec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 12
System Thread ID: 1618
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: Unable to locate ASP page
No remote call being made
# ChildEBP RetAddr
00 017efe18 7c821c54 ntdll!KiFastSystemCallRet
01 017efe1c 77c7538c ntdll!ZwReplyWaitReceivePortEx+0xc
02 017eff84 77c5778f RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x198
03 017eff8c 77c5f7dd RPCRT4!RecvLotsaCallsWrapper+0xd
04 017effac 77c5de88 RPCRT4!BaseCachedThreadRoutine+0x9d
05 017effb8 77e6608b RPCRT4!ThreadStartRoutine+0x1b
06 017effec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 13
System Thread ID: 550
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0182ff8c 7c821364 ntdll!KiFastSystemCallRet
01 0182ff90 7c815267 ntdll!NtDelayExecution+0xc
02 0182ffb8 77e6608b ntdll!RtlpIOWorkerThread+0x3f
03 0182ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 14
System Thread ID: 18e0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: ASP
Executing Page: Unable to locate ASP page
# ChildEBP RetAddr
00 0250ff0c 7c822124 ntdll!KiFastSystemCallRet
01 0250ff10 77e6bad8 ntdll!NtWaitForSingleObject+0xc
02 0250ff80 77e6ba42 kernel32!WaitForSingleObjectEx+0xac
03 0250ff94 709fc91b kernel32!WaitForSingleObject+0x12
04 0250ffb4 709fc8f3 asp!CApplnCleanupMgr::ApplnCleanupDoWork+0x1e
05 0250ffb8 77e6608b asp!CApplnCleanupMgr::ApplnCleanupThread+0xa
06 0250ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 15
System Thread ID: 1208
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: ASP
Executing Page: Unable to locate ASP page
# ChildEBP RetAddr
00 025cfe1c 7c822114 ntdll!KiFastSystemCallRet
01 025cfe20 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 025cfec8 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 025cff24 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 025cff40 709fbcbe USER32!MsgWaitForMultipleObjects+0x1f
05 025cff84 77bcb530 asp!CMTACallbackThread::Thread+0x4f
06 025cffb8 77e6608b msvcrt!_endthreadex+0xa3
07 025cffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 16
System Thread ID: e8c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: ASP
Executing Page: Unable to locate ASP page
# ChildEBP RetAddr
00 0260fe1c 7c822114 ntdll!KiFastSystemCallRet
01 0260fe20 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0260fec8 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0260ff24 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0260ff40 70a018a9 USER32!MsgWaitForMultipleObjects+0x1f
05 0260ff84 77bcb3ca asp!Debugger+0x9e
06 0260ffb8 77e6608b msvcrt!_endthread+0xab
07 0260ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 17
System Thread ID: 8d0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: PDM (Debugger) Thread.
# ChildEBP RetAddr
00 0265fd80 7c822114 ntdll!KiFastSystemCallRet
01 0265fd84 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0265fe2c 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0265fe88 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0265fea4 54b21868 USER32!MsgWaitForMultipleObjects+0x1f
05 0265ff68 776ad682 pdm+0x1868
06 0265ff88 54b31012 ole32!CoInitializeEx+0x17f
07 0265ffb0 54b30fa7 pdm+0x11012
08 0265ffb8 77e6608b pdm+0x10fa7
09 0265ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 18
System Thread ID: 1c1c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: ASP
Executing Page: Unable to locate ASP page
# ChildEBP RetAddr
00 0277fef4 7c822124 ntdll!KiFastSystemCallRet
01 0277fef8 77e6bad8 ntdll!NtWaitForSingleObject+0xc
02 0277ff68 77e6ba42 kernel32!WaitForSingleObjectEx+0xac
03 0277ff7c 709fe9b7 kernel32!WaitForSingleObject+0x12
04 0277ffb8 77e6608b asp!CViperReqManager::WatchThread+0x68
05 0277ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 19
System Thread ID: 1180
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 027dfee8 7c822124 ntdll!KiFastSystemCallRet
01 027dfeec 77e6bad8 ntdll!NtWaitForSingleObject+0xc
02 027dff5c 77e6ba42 kernel32!WaitForSingleObjectEx+0xac
03 027dff70 75bd4bd0 kernel32!WaitForSingleObject+0x12
04 027dff84 77bcb530
comsvcs!CSTAThreadPool::LoadBalanceThreadControlLoop+0x29
05 027dffb8 77e6608b msvcrt!_endthreadex+0xa3
06 027dffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 20
System Thread ID: 11a4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0281fee0 7c822124 ntdll!KiFastSystemCallRet
01 0281fee4 77e6bad8 ntdll!NtWaitForSingleObject+0xc
02 0281ff54 77e6ba42 kernel32!WaitForSingleObjectEx+0xac
03 0281ff68 75bd464d kernel32!WaitForSingleObject+0x12
04 0281ff84 77bcb530 comsvcs!CSTAThreadPool::KillThreadControlLoop+0x25
05 0281ffb8 77e6608b msvcrt!_endthreadex+0xa3
06 0281ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 21
System Thread ID: 14ac
Kernel Time: 0:0:0.0
User Time: 0:0:0.93
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0285fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0285fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0285fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0285fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0285fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0285ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0285ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0285ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 22
System Thread ID: f3c
Kernel Time: 0:0:0.0
User Time: 0:0:0.31
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0273fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0273fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0273fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0273fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0273fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0273ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0273ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0273ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 23
System Thread ID: 1adc
Kernel Time: 0:0:6.578
User Time: 0:0:10.968
Thread Type: ASP
Executing Page: ??C:\INETPUB\WWWROOT\1STARMY\HTTP\PRODUCTS.ASP
# ChildEBP RetAddr
00 0289e2b8 7c8302e7 ntdll!ExpInterlockedPopEntrySListEnd+0x5
01 0289e2c4 7c82fadf ntdll!RtlpAllocateFromHeapLookaside+0x13
02 0289e4ec 77f67038 ntdll!RtlAllocateHeap+0x1dd
03 0289e6c8 77f66fa0 ADVAPI32!EnumTableAddKey+0xa4
04 0289e6ec 77f66b66 ADVAPI32!EnumTableGetKeyState+0x3b
05 0289e71c 77f66b0a ADVAPI32!EnumTableGetNextEnum+0x31
06 0289e888 77f67ae8 ADVAPI32!LocalBaseRegEnumKey+0x91
07 0289e8c4 4c85fcad ADVAPI32!RegEnumKeyExW+0xbc
08 0289ec8c 4c85fee2 oledb32!CError::CacheErrLookUpObject+0xfa
09 0289ed30 4bc4af2e oledb32!CImpIErrorRecords::AddErrorRecord+0xfa
0a 0289edb4 4bc1442e msado15!CContext::AddErrorRecord+0xd0
0b 0289ef24 4bbf4d7c msado15!CContext::PushError+0x26c
0c 0289ef38 4bbf4de6 msado15!CContext::FailedInvoke+0x43
0d 0289f388 73469f71 msado15!CRecordset::Invoke+0x830
0e 0289f3dc 73468f37 vbscript!CatchIDispatchInvoke+0x46
0f 0289f41c 73468ea6 vbscript!IDispatchInvoke2+0xaf
10 0289f458 73469000 vbscript!IDispatchInvoke+0x59
11 0289f56c 7346834d vbscript!InvokeDispatch+0x13a
12 0289f848 73464940 vbscript!CScriptRuntime::Run+0x1c27
13 0289f940 73464cd2 vbscript!CScriptEntryPoint::Call+0x5c
14 0289f998 73465522 vbscript!CSession::Execute+0xb4
15 0289f9e8 7346189b vbscript!COleScript::ExecutePendingScripts+0x13e
16 0289fa04 709e2f5a vbscript!COleScript::SetScriptState+0x150
17 0289fa30 709e2f1a asp!CActiveScriptEngine::TryCall+0x19
18 0289fa6c 709e2e50 asp!CActiveScriptEngine::Call+0x31
19 0289fa88 709e2d54 asp!CallScriptFunctionOfEngine+0x5b
1a 0289fadc 709e2c7f asp!ExecuteRequest+0x17e
1b 0289fb44 709e2a4d asp!Execute+0x249
1c 0289fb98 709e271a asp!CHitObj::ViperAsyncCallback+0x3e8
1d 0289fbb4 75bd72a5 asp!CViperAsyncRequest::OnCall+0x92
1e 0289fbd0 7770f0eb
comsvcs!CSTAActivityWork::STAActivityWorkHelper+0x32
1f 0289fc1c 7770fb38 ole32!EnterForCallback+0xc4
20 0289fd7c 77710042 ole32!SwitchForCallback+0x1a3
21 0289fda8 77694098 ole32!PerformCallback+0x54
22 0289fe40 777127fd ole32!CObjectContext::InternalContextCallback+0x159
23 0289fe60 75bd7649 ole32!CObjectContext:oCallback+0x1c
24 0289fecc 75bd79a5 comsvcs!CSTAActivityWork:oWork+0x12d
25 0289fee4 75bd833e comsvcs!CSTAThread:oWork+0x18
26 0289ff04 75bd878a comsvcs!CSTAThread::ProcessQueueWork+0x37
27 0289ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x17c
28 0289ffb8 77e6608b msvcrt!_endthreadex+0xa3
29 0289ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 24
System Thread ID: a9c
Kernel Time: 0:0:0.0
User Time: 0:0:0.31
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 028dfdcc 7c822114 ntdll!KiFastSystemCallRet
01 028dfdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 028dfe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 028dfed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 028dfef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 028dff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 028dffb8 77e6608b msvcrt!_endthreadex+0xa3
07 028dffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 25
System Thread ID: 1840
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 02e9ff88 7c822114 ntdll!KiFastSystemCallRet
01 02e9ff8c 71c6df19 ntdll!NtWaitForMultipleObjects+0xc
02 02e9ffb8 77e6608b NETAPI32!NetbiosWaiter+0x73
03 02e9ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 26
System Thread ID: 1460
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 02edfd00 7c822124 ntdll!KiFastSystemCallRet
01 02edfd04 77e6bad8 ntdll!NtWaitForSingleObject+0xc
02 02edfd74 77e6ba42 kernel32!WaitForSingleObjectEx+0xac
03 02edfd88 75bb22b9 kernel32!WaitForSingleObject+0x12
04 02edffb8 77e6608b comsvcs!PingThread+0xf6
05 02edffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 27
System Thread ID: ae4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 02f2ff40 7c821bf4 ntdll!KiFastSystemCallRet
01 02f2ff44 77e66142 ntdll!NtRemoveIoCompletion+0xc
02 02f2ff70 3381bdba kernel32!GetQueuedCompletionStatus+0x29
03 02f2ffb8 77e6608b sqlncli+0x7bdba
04 02f2ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 28
System Thread ID: 17a8
Kernel Time: 0:0:0.0
User Time: 0:0:0.78
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 03fcfdcc 7c822114 ntdll!KiFastSystemCallRet
01 03fcfdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 03fcfe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 03fcfed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 03fcfef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 03fcff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 03fcffb8 77e6608b msvcrt!_endthreadex+0xa3
07 03fcffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 29
System Thread ID: 1b10
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0400fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0400fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0400fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0400fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0400fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0400ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0400ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0400ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 30
System Thread ID: 17ec
Kernel Time: 0:0:0.0
User Time: 0:0:0.31
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0414fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0414fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0414fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0414fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0414fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0414ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0414ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0414ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 31
System Thread ID: 158
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 041cfdcc 7c822114 ntdll!KiFastSystemCallRet
01 041cfdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 041cfe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 041cfed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 041cfef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 041cff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 041cffb8 77e6608b msvcrt!_endthreadex+0xa3
07 041cffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 32
System Thread ID: 1c80
Kernel Time: 0:0:0.15
User Time: 0:0:0.15
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0420fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0420fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0420fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0420fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0420fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0420ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0420ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0420ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 33
System Thread ID: 1dbc
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0424fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0424fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0424fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0424fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0424fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0424ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0424ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0424ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 34
System Thread ID: 1760
Kernel Time: 0:0:0.15
User Time: 0:0:0.15
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0428fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0428fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0428fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0428fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0428fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0428ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0428ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0428ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 35
System Thread ID: e9c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 042cfdcc 7c822114 ntdll!KiFastSystemCallRet
01 042cfdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 042cfe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 042cfed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 042cfef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 042cff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 042cffb8 77e6608b msvcrt!_endthreadex+0xa3
07 042cffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 36
System Thread ID: 1920
Kernel Time: 0:0:0.15
User Time: 0:0:0.15
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0430fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0430fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0430fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0430fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0430fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0430ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0430ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0430ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 37
System Thread ID: 1c70
Kernel Time: 0:0:0.15
User Time: 0:0:0.31
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0434fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0434fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0434fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0434fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0434fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0434ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0434ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0434ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 38
System Thread ID: 9f4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0438fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0438fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0438fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0438fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0438fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0438ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0438ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0438ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 39
System Thread ID: ce0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 0440fdcc 7c822114 ntdll!KiFastSystemCallRet
01 0440fdd0 77e67143 ntdll!NtWaitForMultipleObjects+0xc
02 0440fe78 7739cd38 kernel32!WaitForMultipleObjectsEx+0x11a
03 0440fed4 7738e3b1 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0440fef0 75bd86c6 USER32!MsgWaitForMultipleObjects+0x1f
05 0440ff84 77bcb530 comsvcs!CSTAThread::WorkerLoop+0x1e5
06 0440ffb8 77e6608b msvcrt!_endthreadex+0xa3
07 0440ffec 00000000 kernel32!BaseThreadStart+0x34
*** Sent via Developersdex http://www.developersdex.com ***