w3wp.exe crashes running Crystal Report
am 25.08.2005 17:01:42 von Mark KauffmanThis issue is similar to a few other posts I've seen. It has to do with
Windows Server 2003 running an ASP.Net application and the w3wp.exe
process crashes.
In particular, we have a Crystal Report (Ver. 9) that can be run with
date ranges. We generate the crystal report fine and stream the output
to a pdf file and use Acrobat 7.0 to view the results. Once we exceed a
certain threshold, approximately 650+ records returned, about a 30-35
day date range, the crash occurs.
Error in Event Log:
The description for Event ID ( 0 ) in Source ( .NET Runtime ) cannot be
found. The local computer may not have the necessary registry
information or message DLL files to display messages from a remote
computer. You may be able to use the /AUXSOURCE= flag to retrieve this
description; see Help and Support for details. The following information
is part of the event: .NET Runtime version 1.1.4322.2032- Setup Error:
Failed to load resources from resource file. Please check your Setup.
I produced a log of the crash per another post on this site using
iisstate -p
log file of the crash that was created:
***********************
Starting new log output
IISState version 3.0
Wed Aug 24 17:14:22 2005
OS = Windows 2003 Server
Executable: w3wp.exe
PID = 916
Note: Thread times are formatted as HH:MM:SS.ms
***********************
Thread ID: 0
System Thread ID: 384
Kernel Time: 0:0:0.62
User Time: 0:0:0.31
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 0006fe58 77f43741 SharedUserData!SystemCallStub+0x4
01 0006fe5c 77e41817 ntdll!ZwWaitForSingleObject+0xc
02 0006fecc 77e4168f kernel32!WaitForSingleObjectEx+0xac
03 0006fedc 5a3635ae kernel32!WaitForSingleObject+0xf
04 0006feec 5a364d7d w3dt!WP_CONTEXT::RunMainThreadLoop+0xe
05 0006fef4 5a3a1d98 w3dt!UlAtqStartListen+0x2d
06 0006ff00 5a3a5d54 w3core!W3_SERVER::StartListen+0x8e
07 0006ff0c 010017af w3core!UlW3Start+0xea
08 0006ff44 0100195e w3wp!wmain+0x236
09 0006ffc0 77e4f38c w3wp!wmainCRTStartup+0x12f
0a 0006fff0 00000000 kernel32!BaseProcessStart+0x23
Thread ID: 1
System Thread ID: 414
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0097fea0 77f4372d SharedUserData!SystemCallStub+0x4
01 0097fea4 77f6c86c ntdll!NtWaitForMultipleObjects+0xc
02 0097ff48 77f6d7f5 ntdll!EtwpWaitForMultipleObjectsEx+0xf7
03 0097ffb8 77e4a990 ntdll!EtwpEventPump+0x27d
04 0097ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 2
System Thread ID: 41c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 009bff9c 77f4262b SharedUserData!SystemCallStub+0x4
01 009bffa0 77f6b5b2 ntdll!NtDelayExecution+0xc
02 009bffb8 77e4a990 ntdll!RtlpTimerThread+0x45
03 009bffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 3
System Thread ID: 3c4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 009fff70 77f430c7 SharedUserData!SystemCallStub+0x4
01 009fff74 77f7e6ae ntdll!ZwRemoveIoCompletion+0xc
02 009fffb8 77e4a990 ntdll!RtlpWorkerThread+0x3b
03 009fffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 4
System Thread ID: 1b8
Kernel Time: 0:0:0.0
User Time: 0:0:0.15
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.
No remote call being made
# ChildEBP RetAddr
00 00a6fe20 77f4313f SharedUserData!SystemCallStub+0x4
01 00a6fe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 00a6ff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 00a6ff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 00a6ffb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 00a6ffb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 00a6ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 5
System Thread ID: 5e4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 00aaff10 77f4262b SharedUserData!SystemCallStub+0x4
01 00aaff14 77e418ea ntdll!NtDelayExecution+0xc
02 00aaff7c 77e416ee kernel32!SleepEx+0x68
03 00aaff88 77162501 kernel32!Sleep+0xb
04 00aaff94 771625ea ole32!CROIDTable::WorkerThreadLoop+0x12
05 00aaffac 77162653 ole32!CRpcThread::WorkerLoop+0x1e
06 00aaffb8 77e4a990 ole32!CRpcThreadCache::RpcWorkerThreadEntry+0x1f
07 00aaffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 6
System Thread ID: 2bc
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00c6ff28 77f430c7 SharedUserData!SystemCallStub+0x4
01 00c6ff2c 77e430bc ntdll!ZwRemoveIoCompletion+0xc
02 00c6ff58 5a302360 kernel32!GetQueuedCompletionStatus+0x27
03 00c6ff90 5a302531 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x31
04 00c6ffa4 5a301d27 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x21
05 00c6ffb8 77e4a990 W3TP!THREAD_MANAGER::ThreadManagerThread+0x35
06 00c6ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 7
System Thread ID: 3f8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00caff28 77f430c7 SharedUserData!SystemCallStub+0x4
01 00caff2c 77e430bc ntdll!ZwRemoveIoCompletion+0xc
02 00caff58 5a302360 kernel32!GetQueuedCompletionStatus+0x27
03 00caff90 5a302531 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x31
04 00caffa4 5a301d27 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x21
05 00caffb8 77e4a990 W3TP!THREAD_MANAGER::ThreadManagerThread+0x35
06 00caffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 8
System Thread ID: 3f0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00ceff28 77f430c7 SharedUserData!SystemCallStub+0x4
01 00ceff2c 77e430bc ntdll!ZwRemoveIoCompletion+0xc
02 00ceff58 5a302360 kernel32!GetQueuedCompletionStatus+0x27
03 00ceff90 5a302531 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x31
04 00ceffa4 5a301d27 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x21
05 00ceffb8 77e4a990 W3TP!THREAD_MANAGER::ThreadManagerThread+0x35
06 00ceffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 9
System Thread ID: 3f4
Kernel Time: 0:0:0.46
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 00d2ff28 77f430c7 SharedUserData!SystemCallStub+0x4
01 00d2ff2c 77e430bc ntdll!ZwRemoveIoCompletion+0xc
02 00d2ff58 5a302360 kernel32!GetQueuedCompletionStatus+0x27
03 00d2ff90 5a302531 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x31
04 00d2ffa4 5a301d27 W3TP!THREAD_POOL_DATA::ThreadPoolThread+0x21
05 00d2ffb8 77e4a990 W3TP!THREAD_MANAGER::ThreadManagerThread+0x35
06 00d2ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 10
System Thread ID: 2a4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00defcec 77f4372d SharedUserData!SystemCallStub+0x4
01 00defcf0 77f75297 ntdll!NtWaitForMultipleObjects+0xc
02 00deffb8 77e4a990 ntdll!RtlpWaitThread+0x158
03 00deffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 11
System Thread ID: 484
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 016aff14 77f43741 SharedUserData!SystemCallStub+0x4
01 016aff18 77e41817 ntdll!ZwWaitForSingleObject+0xc
02 016aff88 77e4168f kernel32!WaitForSingleObjectEx+0xac
03 016aff98 5a3a51f7 kernel32!WaitForSingleObject+0xf
04 016affb8 77e4a990 w3core!HTTP_COMPRESSION::CompressionThread+0x85
05 016affec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 12
System Thread ID: 168
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.
No remote call being made
# ChildEBP RetAddr
00 016efe20 77f4313f SharedUserData!SystemCallStub+0x4
01 016efe24 77c57b85 ntdll!NtReplyWaitReceivePortEx+0xc
02 016eff8c 77c60829 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x193
03 016eff90 77c60771 RPCRT4!RecvLotsaCallsWrapper+0x9
04 016effb0 77c60857 RPCRT4!BaseCachedThreadRoutine+0x9c
05 016effb8 77e4a990 RPCRT4!ThreadStartRoutine+0x17
06 016effec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 13
System Thread ID: 474
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0189fec0 77f430c7 SharedUserData!SystemCallStub+0x4
01 0189fec4 77e430bc ntdll!ZwRemoveIoCompletion+0xc
02 0189fef0 792ed1b8 kernel32!GetQueuedCompletionStatus+0x27
03 0189ff24 792ec273
mscorwks!ThreadpoolMgr::CompletionPortThreadStart+0x49
04 0189ffb8 77e4a990 mscorwks!ThreadpoolMgr::intermediateThreadProc+0x44
05 0189ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 14
System Thread ID: 138
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 018dfee4 77f4262b SharedUserData!SystemCallStub+0x4
01 018dfee8 77e418ea ntdll!NtDelayExecution+0xc
02 018dff50 77e416ee kernel32!SleepEx+0x68
03 018dff5c 792ed50b kernel32!Sleep+0xb
04 018dffb8 77e4a990 mscorwks!ThreadpoolMgr::GateThreadStart+0x54
05 018dffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 15
System Thread ID: b4
Kernel Time: 0:0:1.703
User Time: 0:0:0.562
*** ERROR: Module load completed but symbols could not be loaded for
c:\windows\assembly\gac\crystaldecisions.crystalreports.engi ne\9.1.5000.
0__692fbea5521e1304\crystaldecisions.crystalreports.engine.d ll
*** WARNING: Unable to verify checksum for
c:\windows\assembly\nativeimages1_v1.1.4322\mscorlib\1.0.500 0.0__b77a5c5
61934e089_24e6e25e\mscorlib.dll
*** ERROR: Module load completed but symbols could not be loaded for
c:\windows\assembly\nativeimages1_v1.1.4322\mscorlib\1.0.500 0.0__b77a5c5
61934e089_24e6e25e\mscorlib.dll
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0191ec64 77f4372d SharedUserData!SystemCallStub+0x4
01 0191ec68 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 0191ed10 77d076f5 kernel32!WaitForMultipleObjectsEx+0x11a
03 0191ed6c 77d077f5 USER32!RealMsgWaitForMultipleObjectsEx+0x13f
04 0191ed88 3a824db2 USER32!MsgWaitForMultipleObjects+0x1d
WARNING: Stack unwind information not available. Following frames may be
wrong.
05 0191eda8 3a6faa01 CRPE32!EnableDialogsHelp+0x1d9fc
06 0191ee44 3a6feb88 CRPE32!CRPEConnectionInit+0xd0618
07 0191ee5c 3a5b2902 CRPE32!CRPEConnectionInit+0xd479f
08 0191ee9c 3a5b2db6 CRPE32!PEOutputToFaxW+0x113
09 0191ef4c 047d4b09 CRPE32!PEExportReportW+0xc1
0a 0191f6b0 042c5b83 crystaldecisions_crystalreports_engine+0x24b09
0b 0191f774 042c5444 0x42c5b83
0c 0191f7bc 042c10a3 0x42c5444
0d 0191f89c 0452e9dc 0x42c10a3
0e 0191f9cc 799ab472 0x452e9dc
0f 0191f9d8 799b3fd8 mscorlib_79990000+0x1b472
10 0191fa60 792227ad mscorlib_79990000+0x23fd8
11 01c76448 24548bca mscorwks!ComCallMLStubCache::CompileMLStub+0x429
12 01c76448 00000000 0x24548bca
Thread ID: 16
System Thread ID: 1bc
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 01a2fe74 77f4372d SharedUserData!SystemCallStub+0x4
01 01a2fe78 77e41bfa ntdll!NtWaitForMultipleObjects+0xc
02 01a2ff20 77e4b0e4 kernel32!WaitForMultipleObjectsEx+0x11a
03 01a2ff38 791d1707 kernel32!WaitForMultipleObjects+0x17
04 01a2ffa0 791d167e mscorwks!DebuggerRCThread::MainLoop+0x90
05 01a2ffb0 791d24ee mscorwks!DebuggerRCThread::ThreadProc+0x68
06 01a2ffb8 77e4a990 mscorwks!DebuggerRCThread::ThreadProcStatic+0xb
07 01a2ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 17
System Thread ID: 524
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 01b0fe48 77f43741 SharedUserData!SystemCallStub+0x4
01 01b0fe4c 77e41817 ntdll!ZwWaitForSingleObject+0xc
02 01b0febc 77e4168f kernel32!WaitForSingleObjectEx+0xac
03 01b0fecc 7926490a kernel32!WaitForSingleObject+0xf
04 01b0fee0 791bbcf3 mscorwks!WaitForFinalizerEvent+0x2d
05 01b0ff24 791cf03c mscorwks!GCHeap::FinalizerThreadStart+0x96
06 01b0ffb8 77e4a990 mscorwks!Thread::intermediateThreadProc+0x44
07 01b0ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 18
System Thread ID: 4f0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 01e4ff38 77f4262b SharedUserData!SystemCallStub+0x4
01 01e4ff3c 77e418ea ntdll!NtDelayExecution+0xc
02 01e4ffa4 792eda94 kernel32!SleepEx+0x68
03 01e4ffb8 77e4a990 mscorwks!ThreadpoolMgr::TimerThreadStart+0x30
04 01e4ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 19
System Thread ID: a34
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 01c2ff70 77f430c7 SharedUserData!SystemCallStub+0x4
01 01c2ff74 77f7e6ae ntdll!ZwRemoveIoCompletion+0xc
02 01c2ffb8 77e4a990 ntdll!RtlpWorkerThread+0x3b
03 01c2ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 20
System Thread ID: a48
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0494ff14 77d06718 SharedUserData!SystemCallStub+0x4
01 0494ff18 77d067e0 USER32!NtUserGetMessage+0xc
02 0494ff34 771bb5a9 USER32!GetMessageW+0x31
03 0494ff74 771bb527 ole32!CDllHost::STAWorkerLoop+0x70
04 0494ff90 771bb472 ole32!CDllHost::WorkerThread+0xc6
05 0494ff94 771625ea ole32!DLLHostThreadEntry+0x9
06 0494ffac 77162653 ole32!CRpcThread::WorkerLoop+0x1e
07 0494ffb8 77e4a990 ole32!CRpcThreadCache::RpcWorkerThreadEntry+0x1f
08 0494ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 21
System Thread ID: a4c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 04b8fcfc 77f43741 SharedUserData!SystemCallStub+0x4
01 04b8fd00 77e41817 ntdll!ZwWaitForSingleObject+0xc
02 04b8fd70 77e4168f kernel32!WaitForSingleObjectEx+0xac
03 04b8fd80 792eca59 kernel32!WaitForSingleObject+0xf
04 04b8fda4 792ec273 mscorwks!ThreadpoolMgr::WorkerThreadStart+0x3a
05 04b8ffb8 77e4a990 mscorwks!ThreadpoolMgr::intermediateThreadProc+0x44
06 04b8ffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 22
System Thread ID: a50
Kernel Time: 0:0:0.15
User Time: 0:0:0.31
Thread Type: Other
# ChildEBP RetAddr
00 04effec8 77d06718 SharedUserData!SystemCallStub+0x4
01 04effecc 77d067e0 USER32!NtUserGetMessage+0xc
02 04effee8 3a87af79 USER32!GetMessageW+0x31
WARNING: Stack unwind information not available. Following frames may be
wrong.
03 04efff04 3a87aac1 CRPE32!EnableDialogsHelp+0x73bc3
04 04efff1c 3a87a72c CRPE32!EnableDialogsHelp+0x7370b
05 04efff84 3a8319ae CRPE32!EnableDialogsHelp+0x73376
06 04efffb8 77e4a990 CRPE32!EnableDialogsHelp+0x2a5f8
07 04efffec 00000000 kernel32!BaseThreadStart+0x34
Thread ID: 23
System Thread ID: a54
Kernel Time: 0:0:0.343
User Time: 0:0:0.140
Thread Type: Other
# ChildEBP RetAddr
00 04f3ec38 7924d6d6 mscorwks!ComCallWrapper::GetOuter+0x3
01 04f3ec48 79225c3e mscorwks!GetCCWFromIUnknown+0x42
02 04f3f0f4 79225d6b mscorwks!GetObjectRefFromComIP+0x112
03 04f3f10c 01c56bda mscorwks!Interop::GetObjectForIUnknown+0x30
WARNING: Frame IP not in any known module. Following frames may be
wrong.
04 04f3f1a8 77f47c97 0x1c56bda
05 04f3f1b0 77f467e1 ntdll!RtlpFreeToHeapLookaside+0x1f
06 04f3f288 4ecd56b9 ntdll!RtlFreeHeap+0x1e9
07 04f3f2b8 77bbb9c3 crqe+0x56b9
08 04f3f370 3a5dcda5 msvcrt!free+0xc8
09 04f3f490 3a5dcc60 CRPE32!PEGetNthDestinationFormatInfo+0x8ab7
0a 04f3f4d4 3a5e717d CRPE32!PEGetNthDestinationFormatInfo+0x8972
0b 04f3f508 3a629086 CRPE32!PEGetNthDestinationFormatInfo+0x12e8f
0c 04f3f53c 3a5f1863 CRPE32!PEGetNthDestinationFormatInfo+0x54d98
0d 04f3f584 3a5f21e0 CRPE32!PEGetNthDestinationFormatInfo+0x1d575
0e 04f3f5a0 3a5efc97 CRPE32!PEGetNthDestinationFormatInfo+0x1def2
0f 04f3f5c4 3a5efad5 CRPE32!PEGetNthDestinationFormatInfo+0x1b9a9
10 04f3f5e8 3a73627e CRPE32!PEGetNthDestinationFormatInfo+0x1b7e7
11 04f3f61c 3a71c1e2 CRPE32!PESetBackgroundThreadProc+0x3651f
12 04f3fd20 3a6fd475 CRPE32!PESetBackgroundThreadProc+0x1c483
13 04f3fd94 3a700362 CRPE32!CRPEConnectionInit+0xd308c
14 04f3fde4 3a7002f5 CRPE32!PESetBackgroundThreadProc+0x603
15 04f3fef4 3a70006a CRPE32!PESetBackgroundThreadProc+0x596
16 04f3ff18 3a87a712 CRPE32!PESetBackgroundThreadProc+0x30b
17 04f3ff84 3a8319ae CRPE32!EnableDialogsHelp+0x7335c
18 04f3ffb8 77e4a990 CRPE32!EnableDialogsHelp+0x2a5f8
19 04f3ffec 00000000 kernel32!BaseThreadStart+0x34
*****
Dump name is formatted as: PID-Timestamp.dmp
Creating C:\Program Files\IIS
Resources\IISState\output\916-1124903665.dmp - user full dump
Dump successfully written
*****
Closing open log file C:\Program Files\IIS
Resources\IISState\output\IISState.log
Any help would be greatly appreciated.
Regards,
Mark
*** Sent via Developersdex http://www.developersdex.com ***