IISSTATE log help to intrepret CPU spike

Hello, one of my IIS6 webserver's cpu is spiking very often to 100 and stays
for few seconds at 100 itself and it comes back to normal after few seconds..
is that normal behaviour ?

And the application performanceis poor if more than two or three users access
the app, so i am coying the iisstate log file here but no idea how to
interpret this dump log, i looking for some help identying the iisue on this..
thanks in advance

here is the copy of IIS state worker process log

Opened log file 'D:\ProcessMon\IISstate\output\IISState-3584.log'

***********************
Starting new log output
IISState version 3.3.1

Sun Oct 14 01:16:35 2007

OS = Windows 2003 Server
Executable: w3wp.exe
PID = 3584

Note: Thread times are formatted as HH:MM:SS.ms

***********************


IIS has crashed...
Beginning Analysis
DLL (!FunctionName) that failed:




Thread ID: 18
System Thread ID: 6b8
Kernel Time: 1:2:40.109
User Time: 3:15:40.515
Thread Type: Other
# ChildEBP RetAddr
WARNING: Frame IP not in any known module. Following frames may be wrong.
00 0219f774 0986a5e9 0x986beac
01 0219f7d4 08aaf1a4 0x986a5e9
02 0219f840 08aac0cd 0x8aaf1a4
03 0219f87c 08aab633 0x8aac0cd
04 0219f8cc 08aab55b 0x8aab633
05 0219f918 08695a24 0x8aab55b
06 0219f96c 08695243 0x8695a24
07 0219f9c4 04898c18 0x8695243
08 0219fa54 7923c206 0x4898c18
09 0219fa94 791cc3c8 mscorsvr+0x8c206
0a 0219fadc 7923c1c3 mscorsvr+0x1c3c8
0b 0219fb44 022ea0bd mscorsvr+0x8c1c3
0c 0219fc28 038c4cd8 0x22ea0bd
0d 038c4cd8 00000001 0x38c4cd8
Closing open log file D:\ProcessMon\IISstate\output\IISState-3584.log
Opened log file 'D:\ProcessMon\IISstate\output\IISState-3584.log'

***********************
Starting new log output
IISState version 3.3.1

Sun Oct 14 01:19:53 2007

OS = Windows 2003 Server
Executable: w3wp.exe
PID = 3584

Note: Thread times are formatted as HH:MM:SS.ms

***********************




Thread ID: 0
System Thread ID: 9cc
Kernel Time: 0:0:0.46
User Time: 0:0:0.78
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 0006fc08 7c822124 ntdll!KiFastSystemCallRet
01 0006fc0c 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0006fc7c 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0006fc90 5a36467a kernel32!WaitForSingleObject+0x12
04 0006fca0 5a366e63 w3dt!WP_CONTEXT::RunMainThreadLoop+0x10
05 0006fca8 5a3af41d w3dt!UlAtqStartListen+0x2d
06 0006fcb8 5a3bc259 w3core!W3_SERVER::StartListen+0xbd
07 0006ff0c 0100187c w3core!UlW3Start+0x26e
08 0006ff44 01001a23 w3wp!wmain+0x22a
09 0006ffc0 77e523cd w3wp!wmainCRTStartup+0x12b
0a 0006fff0 00000000 kernel32!BaseProcessStart+0x23




Thread ID: 1
System Thread ID: 970
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 009eff9c 7c821364 ntdll!KiFastSystemCallRet
01 009effa0 7c81fe26 ntdll!NtDelayExecution+0xc
02 009effb8 77e66063 ntdll!RtlpTimerThread+0x47
03 009effec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 2
System Thread ID: 3bc
Kernel Time: 0:0:0.343
User Time: 0:0:1.671
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00c8ff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00c8ff28 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 00c8ff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00c8ff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00c8ffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00c8ffb8 77e66063 W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00c8ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 3
System Thread ID: e40
Kernel Time: 0:0:0.343
User Time: 0:0:1.718
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00ccff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00ccff28 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 00ccff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00ccff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00ccffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00ccffb8 77e66063 W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00ccffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 4
System Thread ID: a88
Kernel Time: 0:0:0.218
User Time: 0:0:1.46
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00d0ff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00d0ff28 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 00d0ff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00d0ff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00d0ffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00d0ffb8 77e66063 W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00d0ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 5
System Thread ID: e98
Kernel Time: 0:0:0.484
User Time: 0:0:1.703
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00d4ff24 7c821bf4 ntdll!KiFastSystemCallRet
01 00d4ff28 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 00d4ff54 5a30249e kernel32!GetQueuedCompletionStatus+0x29
03 00d4ff8c 5a3026bc W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x33
04 00d4ffa0 5a301db9 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x24
05 00d4ffb8 77e66063 W3TP!THREAD_MANAGER::ThreadManagerThread+0x39
06 00d4ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 6
System Thread ID: 448
Kernel Time: 0:0:0.265
User Time: 0:0:0.78
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00e0fcec 7c822114 ntdll!KiFastSystemCallRet
01 00e0fcf0 7c83acfd ntdll!NtWaitForMultipleObjects+0xc
02 00e0ffb8 77e66063 ntdll!RtlpWaitThread+0x161
03 00e0ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 7
System Thread ID: ec4
Kernel Time: 0:0:27.375
User Time: 0:0:14.781
*** ERROR: Symbol file could not be found. Defaulted to export symbols for C:
\Program Files\Microsoft Application Center\ACSRTL.DLL -
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00f7fe08 7c822114 ntdll!KiFastSystemCallRet
01 00f7fe0c 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 00f7feb4 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 00f7ff10 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 00f7ff2c 602532ef USER32!MsgWaitForMultipleObjects+0x1f
WARNING: Stack unwind information not available. Following frames may be
wrong.
05 00007530 00000000 ACSRTL!RemoveWorkItem+0x27b




Thread ID: 8
System Thread ID: a50
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00fbfe08 7c822114 ntdll!KiFastSystemCallRet
01 00fbfe0c 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 00fbfeb4 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 00fbff10 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 00fbff2c 602532ef USER32!MsgWaitForMultipleObjects+0x1f
WARNING: Stack unwind information not available. Following frames may be
wrong.
05 00fbffb8 77e66063 ACSRTL!RemoveWorkItem+0x27b
06 00fbffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 9
System Thread ID: 160
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00fffe08 7c822114 ntdll!KiFastSystemCallRet
01 00fffe0c 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 00fffeb4 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 00ffff10 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 00ffff2c 602532ef USER32!MsgWaitForMultipleObjects+0x1f
WARNING: Stack unwind information not available. Following frames may be
wrong.
05 00ffffb8 77e66063 ACSRTL!RemoveWorkItem+0x27b
06 00ffffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 10
System Thread ID: f00
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0104fe08 7c822114 ntdll!KiFastSystemCallRet
01 0104fe0c 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 0104feb4 7739cd08 kernel32!WaitForMultipleObjectsEx+0x11a
03 0104ff10 7738e381 USER32!RealMsgWaitForMultipleObjectsEx+0x141
04 0104ff2c 602532ef USER32!MsgWaitForMultipleObjects+0x1f
WARNING: Stack unwind information not available. Following frames may be
wrong.
05 0104ffb8 77e66063 ACSRTL!RemoveWorkItem+0x27b
06 0104ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 11
System Thread ID: bb0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
*** ERROR: Symbol file could not be found. Defaulted to export symbols for C:
\Program Files\Microsoft Application Center\MSATQ.dll -
Thread Type: Other
# ChildEBP RetAddr
00 0114ff4c 7c821bf4 ntdll!KiFastSystemCallRet
01 0114ff50 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 0114ff7c 605a8db1 kernel32!GetQueuedCompletionStatus+0x29
WARNING: Stack unwind information not available. Following frames may be
wrong.
03 0114ffb8 77e66063 MSATQ!AtqInitialize+0x1392
04 0114ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 12
System Thread ID: cc4
Kernel Time: 0:0:0.15
User Time: 0:0:0.31
*** ERROR: Symbol file could not be found. Defaulted to export symbols for C:
\Program Files\Microsoft Application Center\WMISINK.dll -
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0118feb4 7c822114 ntdll!KiFastSystemCallRet
01 0118feb8 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 0118ff60 77e61075 kernel32!WaitForMultipleObjectsEx+0x11a
03 0118ff7c 60863999 kernel32!WaitForMultipleObjects+0x18
WARNING: Stack unwind information not available. Following frames may be
wrong.
04 00000000 00000000 WMISINK!CWMIEventSinkWrapper::SetupSubscription+0x48e




Thread ID: 13
System Thread ID: cc8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
*** ERROR: Symbol file could not be found. Defaulted to export symbols for C:
\Program Files\Microsoft Application Center\RfFilExt.dll -
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0120ff1c 7c822124 ntdll!KiFastSystemCallRet
01 0120ff20 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0120ff90 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0120ffa4 607cc9fb kernel32!WaitForSingleObject+0x12
WARNING: Stack unwind information not available. Following frames may be
wrong.
04 0120ffec 00000000 RfFilExt!CMBData::~CMBData+0xf6




Thread ID: 14
System Thread ID: a5c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 01ddfa84 7c822124 ntdll!KiFastSystemCallRet
01 01ddfa88 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 01ddfaf8 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 01ddfb0c 5a3b8147 kernel32!WaitForSingleObject+0x12
04 01ddffb8 77e66063 w3core!HTTP_COMPRESSION::CompressionThread+0x126
05 01ddffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 15
System Thread ID: c30
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 01e1ff8c 7c821364 ntdll!KiFastSystemCallRet
01 01e1ff90 7c815267 ntdll!NtDelayExecution+0xc
02 01e1ffb8 77e66063 ntdll!RtlpIOWorkerThread+0x3f
03 01e1ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 16
System Thread ID: 960
Kernel Time: 0:0:0.140
User Time: 0:0:0.593
Thread Type: Other
# ChildEBP RetAddr
00 020dfec0 7c821bf4 ntdll!KiFastSystemCallRet
01 020dfec4 77e6611a ntdll!NtRemoveIoCompletion+0xc
02 020dfef0 791fdb22 kernel32!GetQueuedCompletionStatus+0x29
03 020dff24 791fdacc mscorsvr+0x4db22
04 020dffb8 77e66063 mscorsvr+0x4dacc
05 020dffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 17
System Thread ID: db0
Kernel Time: 0:0:0.31
User Time: 0:0:0.31
Thread Type: Other
# ChildEBP RetAddr
00 0211fe50 7c821364 ntdll!KiFastSystemCallRet
01 0211fe54 77e42439 ntdll!NtDelayExecution+0xc
02 0211febc 77e424b7 kernel32!SleepEx+0x68
03 0211fecc 791bf4f9 kernel32!Sleep+0xf
04 0211ffb8 77e66063 mscorsvr+0xf4f9
05 0211ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 18
System Thread ID: 6b8
Kernel Time: 1:2:40.109
User Time: 3:15:40.515
Thread Type: Other
# ChildEBP RetAddr
WARNING: Frame IP not in any known module. Following frames may be wrong.
00 0219f774 0986a5e9 0x986beac
01 0219f7d4 08aaf1a4 0x986a5e9
02 0219f840 08aac0cd 0x8aaf1a4
03 0219f87c 08aab633 0x8aac0cd
04 0219f8cc 08aab55b 0x8aab633
05 0219f918 08695a24 0x8aab55b
06 0219f96c 08695243 0x8695a24
07 0219f9c4 04898c18 0x8695243
08 0219fa54 7923c206 0x4898c18
09 0219fa94 791cc3c8 mscorsvr+0x8c206
0a 0219fadc 7923c1c3 mscorsvr+0x1c3c8
0b 0219fb44 022ea0bd mscorsvr+0x8c1c3
0c 0219fc28 038c4cd8 0x22ea0bd
0d 038c4cd8 00000001 0x38c4cd8




Thread ID: 19
System Thread ID: c04
Kernel Time: 1:4:43.15
User Time: 3:21:12.140
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0223fc78 7c822124 ntdll!KiFastSystemCallRet
01 0223fc7c 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0223fcec 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0223fd00 791d401f kernel32!WaitForSingleObject+0x12
04 0223fd24 791fdacc mscorsvr+0x2401f
05 0223ffb8 77e66063 mscorsvr+0x4dacc
06 0223ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 20
System Thread ID: 8ac
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0235fe70 7c822114 ntdll!KiFastSystemCallRet
01 0235fe74 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 0235ff1c 77e61075 kernel32!WaitForMultipleObjectsEx+0x11a
03 0235ff38 79238fd6 kernel32!WaitForMultipleObjects+0x18
04 0235ffa0 79238f4d mscorsvr+0x88fd6
05 0235ffb0 7923a714 mscorsvr+0x88f4d
06 0235ffb8 77e66063 mscorsvr+0x8a714
07 0235ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 21
System Thread ID: ad4
Kernel Time: 0:0:0.15
User Time: 0:0:0.31
*** ERROR: Symbol file could not be found. Defaulted to export symbols for C:
\Program Files\Avicode\Intercept\Agent\v4.0.150\StubProfiler.dll -
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0241f938 7c822124 ntdll!KiFastSystemCallRet
01 0241f93c 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0241f9ac 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0241f9c0 0236b98d kernel32!WaitForSingleObject+0x12
WARNING: Stack unwind information not available. Following frames may be
wrong.
04 0241fde0 02449400 StubProfiler!DllRegisterServer+0x887d
05 0239c6d4 02376960 0x2449400
06 02375470 ffffff48 StubProfiler!DllRegisterServer+0x13850
07 e8f18b56 00000000 0xffffff48




Thread ID: 22
System Thread ID: c2c
Kernel Time: 0:0:0.734
User Time: 0:0:0.687
*** ERROR: Symbol file could not be found. Defaulted to export symbols for C:
\Program Files\Avicode\Intercept\Agent\v4.0.150\PerfMon.dll -
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 02fffb20 7c822114 ntdll!KiFastSystemCallRet
01 02fffb24 77e6711b ntdll!NtWaitForMultipleObjects+0xc
02 02fffbcc 77e61075 kernel32!WaitForMultipleObjectsEx+0x11a
03 02fffbe8 026c3992 kernel32!WaitForMultipleObjects+0x18
WARNING: Stack unwind information not available. Following frames may be
wrong.
04 02fffeb4 f772fa00 PerfMon+0x13992
05 80a56bcc 00000000 0xf772fa00




Thread ID: 23
System Thread ID: b88
Kernel Time: 0:0:1.375
User Time: 0:1:47.109
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0339fefc 7c822124 ntdll!KiFastSystemCallRet
01 0339ff00 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0339ff70 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0339ff84 791fe6b0 kernel32!WaitForSingleObject+0x12
04 0339ffac 792356bf mscorsvr+0x4e6b0
05 0339ffb8 77e66063 mscorsvr+0x856bf
06 0339ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 24
System Thread ID: 13c
Kernel Time: 0:0:0.640
User Time: 0:1:44.515
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 033dfdfc 7c822124 ntdll!KiFastSystemCallRet
01 033dfe00 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 033dfe70 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 033dfe84 791fe6b0 kernel32!WaitForSingleObject+0x12
04 033dfeac 792356bf mscorsvr+0x4e6b0
05 033dffb8 77e66063 mscorsvr+0x856bf
06 033dffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 25
System Thread ID: 9f0
Kernel Time: 0:0:0.593
User Time: 0:1:46.828
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0341fcfc 7c822124 ntdll!KiFastSystemCallRet
01 0341fd00 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0341fd70 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0341fd84 791fe6b0 kernel32!WaitForSingleObject+0x12
04 0341fdac 792356bf mscorsvr+0x4e6b0
05 0341ffb8 77e66063 mscorsvr+0x856bf
06 0341ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 26
System Thread ID: 420
Kernel Time: 0:0:0.671
User Time: 0:1:44.968
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0345fbfc 7c822124 ntdll!KiFastSystemCallRet
01 0345fc00 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0345fc70 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0345fc84 791fe6b0 kernel32!WaitForSingleObject+0x12
04 0345fcac 792356bf mscorsvr+0x4e6b0
05 0345ffb8 77e66063 mscorsvr+0x856bf
06 0345ffec 00000000 kernel32!BaseThreadStart+0x34




Thread ID: 27
System Thread ID: c8c
Kernel Time: 0:0:0.671
User Time: 0:0:8.562
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0349fe44 7c822124 ntdll!KiFastSystemCallRet
01 0349fe48 77e6baa8 ntdll!NtWaitForSingleObject+0xc
02 0349feb8 77e6ba12 kernel32!WaitForSingleObjectEx+0xac
03 0349fecc 7927823e kernel32!WaitForSingleObject+0x12

--
Message posted via WinServerKB.com
http://www.winserverkb.com/Uwe/Forums.aspx/iis-general/20071 0/1