Help with Debug Diagnostic tool , Application pool hangs and recycles

Help with Debug Diagnostic tool , Application pool hangs and recycles

am 24.12.2007 17:32:22 von eran

Hi!

first time I am using this wonderful tool, but having difficulties
understanding the hang report.
I've installed a new (stronger) server, and running my benchmark on
it. It started handing and recycling, producing an event 1010 "A
process serving application pool 'DefaultAppPool' failed to respond to
a ping".

I've installed the Debug Diagnostic tool, and managed to capture such
event, but can't understand the reason all the threads are stuck. All
threads quoted here, are all on the same method: ntdll!
KiFastSystemCallRet [which I couldn't discover what it is].
What's even stranger, is that when I disabled pinging in the Health
Tab of the Application pool, the problem seems to disappear, as if
this is not a real handing problem.

Any ideas?

The report is attached bellow:

-----------------------------------------


Analysis Summary
Type Description Recommendation
Warning 11 client connection(s) in
w3wp.exe__DefaultAppPool__PID__3080__Date__12_24_2007__Time_ 03_22_54PM__825__IIS_COM
+ Hang Dump.dmp have been executing a request for more than 90
seconds. Please see the Client Connections section of this report for
more detailed information about the connection(s).





Analysis Details



Your browser settings are currently prohibiting this report's scripts
from running.

This is preventing some features of this analysis report from
displaying properly. To enable scripts to run, right-click the
security warning above and choose "Allow Blocked Content..." or enable
the "Allow active content to run in files on My Computer*" setting on
the Advanced tab of your "Internet Options" dialog to avoid being
prompted in the future





Table Of Contents
w3wp.exe__DefaultAppPool__PID__3080__Date__12_24_2007__Time_ 03_22_54PM__825__IIS_COM
+ Hang Dump.dmp

Top 5 threads by CPU time

Thread report

HTTP Report



Report for
w3wp.exe__DefaultAppPool__PID__3080__Date__12_24_2007__Time_ 03_22_54PM__825__IIS_COM
+ Hang Dump.dmp




Report for
w3wp.exe__DefaultAppPool__PID__3080__Date__12_24_2007__Time_ 03_22_54PM__825__IIS_COM
+ Hang Dump.dmp
Type of Analysis Performed Hang Analysis
Machine Name DPN-WEBE
Operating System Windows Server 2003 Service Pack 2
Number Of Processors 8
Process ID 3080
Process Image c:\WINDOWS\system32\inetsrv\w3wp.exe
System Up-Time 11 day(s) 17:22:22
Process Up-Time 01:20:48



Top 5 Threads by CPU time
Note - Times include both user mode and kernel mode for each thread
Thread ID: 3 Total CPU Time: 00:01:00.687 Entry Point for
Thread: w3tp!THREAD_MANAGER::ThreadManagerThread
Thread ID: 1 Total CPU Time: 00:00:55.827 Entry Point for
Thread: w3tp!THREAD_MANAGER::ThreadManagerThread
Thread ID: 0 Total CPU Time: 00:00:26.437 Entry Point for
Thread: 0x002683a0
Thread ID: 2 Total CPU Time: 00:00:01.186 Entry Point for
Thread: mscorwks!Thread::intermediateThreadProc





Thread report

Thread 0 - System ID 3404
Entry point 0x002683a0
Create time 24/12/2007 14:02:09
Time spent in user mode 0 Days 00:00:22.906
Time spent in kernel mode 0 Days 00:00:03.531




Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34




Back to Top


Thread 1 - System ID 3400
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 24/12/2007 14:02:09
Time spent in user mode 0 Days 00:00:48.640
Time spent in kernel mode 0 Days 00:00:07.187




Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34




Back to Top


Thread 2 - System ID 584
Entry point mscorwks!Thread::intermediateThreadProc
Create time 24/12/2007 14:02:09
Time spent in user mode 0 Days 00:00:01.140
Time spent in kernel mode 0 Days 00:00:00.046




Function Source
ntdll!KiFastSystemCallRet
ntdll!NtTerminateProcess+c
kernel32!_ExitProcess+63
kernel32!ExitProcess+14
mscorwks!SafeExitProcess+11a
mscorwks!DisableRuntime+d0
mscorwks!SystemNative::Exit+97
mscorlib_ni+3030a0
mscorwks!CallDescrWorker+33
mscorwks!CallDescrWorkerWithHandler+a3
mscorwks!MethodDesc::CallDescr+19c
mscorwks!MethodDesc::CallTargetWorker+20
mscorwks!MethodDescCallSite::Call+18
mscorwks!DllImportForDelegateGenericStubPostCall+2fc
mscorwks!COMDelegate::BindToMethodInfo+63a
mscorwks!DistributeEventReliably+c7
mscorwks!AppDomain::RaiseUnloadDomainEvent+c6
mscorwks!AppDomain::RaiseUnloadDomainEvent_Wrapper+9
mscorwks!Thread::DoADCallBack+cd
mscorwks!AppDomain::RaiseUnloadDomainEvent+ce
mscorwks!AppDomain::ProcessUnloadDomainEventOnFinalizeThread +70
mscorwks!Thread::DoExtraWorkForFinalizer+2e
mscorwks!SVR::GCHeap::FinalizerThreadWorker+c6
mscorwks!Thread::UserResumeThread+fb
mscorwks!Thread::DoADCallBack+355
mscorwks!Thread::DoADCallBack+541
mscorwks!ManagedThreadBase_NoADTransition+32
mscorwks!ManagedThreadBase::FinalizerBase+b
mscorwks!SVR::GCHeap::FinalizerThreadStart+bb
mscorwks!Thread::intermediateThreadProc+49
kernel32!BaseThreadStart+34




Back to Top


Thread 3 - System ID 3760
Entry point w3tp!THREAD_MANAGER::ThreadManagerThread
Create time 24/12/2007 14:04:55
Time spent in user mode 0 Days 00:00:52.875
Time spent in kernel mode 0 Days 00:00:07.812




Function Source
ntdll!KiFastSystemCallRet
ntdll!ZwRemoveIoCompletion+c
kernel32!GetQueuedCompletionStatus+29
w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
w3tp!THREAD_MANAGER::ThreadManagerThread+39
kernel32!BaseThreadStart+34




Back to Top

HTTP report
IIS ATQ worker thread count 9 Thread(s)
Available ATQ worker thread count 9 Thread(s)
Active client connections 64 client connection(s)



Client Connections
Client connection from 192.168.111.172:58825 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Shopping/Products.aspx?
Department=1&Compare=1&Shelf=3
Mapped To URL /Shopping/Products.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:07:35
QueryString Department=1&Compare=1&Shelf=3
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:58877 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Shopping/Products.aspx?Department=5
Mapped To URL /Shopping/Products.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:07:29
QueryString Department=5
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:59011 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Shopping/Products.aspx?
Department=10&Compare=2&Shelf=3187
Mapped To URL /Shopping/Products.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:05:16
QueryString Department=10&Compare=2&Shelf=3187
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:58855 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Shopping/Products.aspx?
Department=1&Shelf=1&GroupBy=1&CompareBy=1
Mapped To URL /Shopping/Products.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:04:35
QueryString Department=1&Shelf=1&GroupBy=1&CompareBy=1
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:59053 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Shopping/Products.aspx?
Department=12&Compare=2&Shelf=3222
Mapped To URL /Shopping/Products.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:02:15
QueryString Department=12&Compare=2&Shelf=3222
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:59077 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Shopping/Products.aspx?
Department=3&Shelf=3198&GroupBy=1688
Mapped To URL /Shopping/Products.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:38
QueryString Department=3&Shelf=3198&GroupBy=1688
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:58981 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Shopping/Products.aspx?Department=8
Mapped To URL /Shopping/Products.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:38
QueryString Department=8
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:58964 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Shopping/Products.aspx?Department=11
Mapped To URL /Shopping/Products.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:38
QueryString Department=11
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:59095 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Ajax/AddProduct.aspx?Product=2502
Mapped To URL /Ajax/AddProduct.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:38
QueryString Product=2502
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:58943 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Shopping/FindProducts.aspx?Query=Coffee
%20Beans&Compare=1
Mapped To URL /Shopping/FindProducts.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:37
QueryString Query=Coffee%20Beans&Compare=1
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




Client connection from 192.168.111.172:59090 to 192.168.111.141:80
Host Header dpn-webe:80
GET request for /Ajax/AddProduct.aspx?Product=9873
Mapped To URL /Ajax/AddProduct.aspx
HTTP Version HTTP/1.1
SSL Request False
Time alive 00:01:37
QueryString Product=9873
Request mapped to
HTTP Request State HTR_READING_CLIENT_REQUEST
Native Request State NREQ_STATE_PROCESS




53 connection(s) waiting for the next request.




Script Summary
Script Name Status Error Code Error Source Error Description Source
Line
CrashHangAnalysis.asp Completed

Re: Help with Debug Diagnostic tool , Application pool hangs and

am 25.12.2007 06:14:06 von David Wang

There's nothing strange here -- just misunderstood. Here's the
explanation.

If you disable pinging in Health Monitoring, then IIS stops monitoring
the worker process for issues. Obviously, if you stop IIS from
monitoring, you will stop getting the "failed to get a ping" event --
but it's up to you to decide whether ignoring warnings is a good thing
or not.

It looks like your ASP.Net application is not performant enough to
handle your benchmarking -- it has consumed "all" 11 of ASP.Net's
worker threads for over 90 seconds, which means your application did
not respond within 90 seconds -- maybe a software bottleneck, maybe
some database locking, maybe networking issue -- you figure it out.

Thus, you should really be looking at performance of your ASP.Net
application at handling the benchmarking load. If you improved
hardware to improve application performance, I am sorry to say that it
was not necessarily a worthwhile investment.

To improve performance, one MUST determine the actual bottleneck
slowing down performance and remove that bottleneck. The usual
bottlenecks are:
CPU
RAM utilization
Network Bandwidth
Hard Drive queuing
Software Limitations

Unless CPU, RAM, Network, or Hard Drive was the cause of the original
bottleneck, changing hardware will not solve the performance issue.
Right now, the bottleneck has to do with your application software --
hence stronger hardware does not help at all.


//David
http://w3-4u.blogspot.com
http://blogs.msdn.com/David.Wang
//






On Dec 24, 8:32=A0am, Eran wrote:
> Hi!
>
> first time I am using this wonderful tool, but having difficulties
> understanding the hang report.
> I've installed a new (stronger) server, and running my benchmark on
> it. It started handing and recycling, producing an event 1010 "A
> process serving application pool 'DefaultAppPool' failed to respond to
> a ping".
>
> I've installed the Debug Diagnostic tool, and managed to capture such
> event, but can't understand the reason all the threads are stuck. All
> threads quoted here, are all on the same method: ntdll!
> KiFastSystemCallRet =A0[which I couldn't discover what it is].
> What's even stranger, is that when I disabled pinging in the Health
> Tab of the Application pool, the problem seems to disappear, as if
> this is not a real handing problem.
>
> Any ideas?
>
> The report is attached bellow:
>
> -----------------------------------------
>
> =A0Analysis Summary
> =A0 Type Description Recommendation
> =A0 Warning 11 client connection(s) in
> w3wp.exe__DefaultAppPool__PID__3080__Date__12_24_2007__Time_ 03_22_54PM__82=
5=AD__IIS_COM
> + Hang Dump.dmp have been executing a request for more than 90
> seconds. Please see the Client Connections section of this report for
> more detailed information about the connection(s).
>
> =A0Analysis Details
>
> =A0Your browser settings are currently prohibiting this report's scripts
> from running.
>
> This is preventing some features of this analysis report from
> displaying properly. To enable scripts to run, right-click the
> security warning above and choose "Allow Blocked Content..." or enable
> the "Allow active content to run in files on My Computer*" setting on
> the Advanced tab of your "Internet Options" dialog to avoid being
> prompted in the future
>
> Table Of Contents
> w3wp.exe__DefaultAppPool__PID__3080__Date__12_24_2007__Time_ 03_22_54PM__82=
5=AD__IIS_COM
> + Hang Dump.dmp
>
> =A0 =A0Top 5 threads by CPU time
>
> =A0 =A0Thread report
>
> =A0 =A0HTTP Report
>
> =A0Report for
> w3wp.exe__DefaultAppPool__PID__3080__Date__12_24_2007__Time_ 03_22_54PM__82=
5=AD__IIS_COM
> + Hang Dump.dmp
>
> Report for
> w3wp.exe__DefaultAppPool__PID__3080__Date__12_24_2007__Time_ 03_22_54PM__82=
5=AD__IIS_COM
> + Hang Dump.dmp
> Type of Analysis Performed =A0 Hang Analysis
> Machine Name =A0 DPN-WEBE
> Operating System =A0 Windows Server 2003 Service Pack 2
> Number Of Processors =A0 8
> Process ID =A0 3080
> Process Image =A0 c:\WINDOWS\system32\inetsrv\w3wp.exe
> System Up-Time =A0 11 day(s) 17:22:22
> Process Up-Time =A0 01:20:48
>
> Top 5 Threads by CPU time
> Note - Times include both user mode and kernel mode for each thread
> Thread ID: 3 =A0 =A0 Total CPU Time: 00:01:00.687 =A0 =A0 Entry Point for
> Thread: w3tp!THREAD_MANAGER::ThreadManagerThread
> Thread ID: 1 =A0 =A0 Total CPU Time: 00:00:55.827 =A0 =A0 Entry Point for
> Thread: w3tp!THREAD_MANAGER::ThreadManagerThread
> Thread ID: 0 =A0 =A0 Total CPU Time: 00:00:26.437 =A0 =A0 Entry Point for
> Thread: 0x002683a0
> Thread ID: 2 =A0 =A0 Total CPU Time: 00:00:01.186 =A0 =A0 Entry Point for
> Thread: mscorwks!Thread::intermediateThreadProc
>
> Thread report
>
> Thread 0 - System ID 3404
> Entry point =A0 0x002683a0
> Create time =A0 24/12/2007 14:02:09
> Time spent in user mode =A0 0 Days 00:00:22.906
> Time spent in kernel mode =A0 0 Days 00:00:03.531
>
> Function =A0 Source
> ntdll!KiFastSystemCallRet
> ntdll!ZwRemoveIoCompletion+c
> kernel32!GetQueuedCompletionStatus+29
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
> w3tp!THREAD_MANAGER::ThreadManagerThread+39
> kernel32!BaseThreadStart+34
>
> Back to Top
>
> Thread 1 - System ID 3400
> Entry point =A0 w3tp!THREAD_MANAGER::ThreadManagerThread
> Create time =A0 24/12/2007 14:02:09
> Time spent in user mode =A0 0 Days 00:00:48.640
> Time spent in kernel mode =A0 0 Days 00:00:07.187
>
> Function =A0 Source
> ntdll!KiFastSystemCallRet
> ntdll!ZwRemoveIoCompletion+c
> kernel32!GetQueuedCompletionStatus+29
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
> w3tp!THREAD_MANAGER::ThreadManagerThread+39
> kernel32!BaseThreadStart+34
>
> Back to Top
>
> Thread 2 - System ID 584
> Entry point =A0 mscorwks!Thread::intermediateThreadProc
> Create time =A0 24/12/2007 14:02:09
> Time spent in user mode =A0 0 Days 00:00:01.140
> Time spent in kernel mode =A0 0 Days 00:00:00.046
>
> Function =A0 Source
> ntdll!KiFastSystemCallRet
> ntdll!NtTerminateProcess+c
> kernel32!_ExitProcess+63
> kernel32!ExitProcess+14
> mscorwks!SafeExitProcess+11a
> mscorwks!DisableRuntime+d0
> mscorwks!SystemNative::Exit+97
> mscorlib_ni+3030a0
> mscorwks!CallDescrWorker+33
> mscorwks!CallDescrWorkerWithHandler+a3
> mscorwks!MethodDesc::CallDescr+19c
> mscorwks!MethodDesc::CallTargetWorker+20
> mscorwks!MethodDescCallSite::Call+18
> mscorwks!DllImportForDelegateGenericStubPostCall+2fc
> mscorwks!COMDelegate::BindToMethodInfo+63a
> mscorwks!DistributeEventReliably+c7
> mscorwks!AppDomain::RaiseUnloadDomainEvent+c6
> mscorwks!AppDomain::RaiseUnloadDomainEvent_Wrapper+9
> mscorwks!Thread::DoADCallBack+cd
> mscorwks!AppDomain::RaiseUnloadDomainEvent+ce
> mscorwks!AppDomain::ProcessUnloadDomainEventOnFinalizeThread +70
> mscorwks!Thread::DoExtraWorkForFinalizer+2e
> mscorwks!SVR::GCHeap::FinalizerThreadWorker+c6
> mscorwks!Thread::UserResumeThread+fb
> mscorwks!Thread::DoADCallBack+355
> mscorwks!Thread::DoADCallBack+541
> mscorwks!ManagedThreadBase_NoADTransition+32
> mscorwks!ManagedThreadBase::FinalizerBase+b
> mscorwks!SVR::GCHeap::FinalizerThreadStart+bb
> mscorwks!Thread::intermediateThreadProc+49
> kernel32!BaseThreadStart+34
>
> Back to Top
>
> Thread 3 - System ID 3760
> Entry point =A0 w3tp!THREAD_MANAGER::ThreadManagerThread
> Create time =A0 24/12/2007 14:04:55
> Time spent in user mode =A0 0 Days 00:00:52.875
> Time spent in kernel mode =A0 0 Days 00:00:07.812
>
> Function =A0 Source
> ntdll!KiFastSystemCallRet
> ntdll!ZwRemoveIoCompletion+c
> kernel32!GetQueuedCompletionStatus+29
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+33
> w3tp!THREAD_POOL_DATA::ThreadPoolThread+24
> w3tp!THREAD_MANAGER::ThreadManagerThread+39
> kernel32!BaseThreadStart+34
>
> Back to Top
>
> HTTP report
> IIS ATQ worker thread count =A0 9 Thread(s)
> Available ATQ worker thread count =A0 9 Thread(s)
> Active client connections =A0 64 client connection(s)
>
> Client Connections
> Client connection from 192.168.111.172:58825 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Shopping/Products.aspx?
> Department=3D1&Compare=3D1&Shelf=3D3
> Mapped To URL =A0 /Shopping/Products.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:07:35
> QueryString =A0 Department=3D1&Compare=3D1&Shelf=3D3
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:58877 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Shopping/Products.aspx?Department=3D5
> Mapped To URL =A0 /Shopping/Products.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:07:29
> QueryString =A0 Department=3D5
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:59011 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Shopping/Products.aspx?
> Department=3D10&Compare=3D2&Shelf=3D3187
> Mapped To URL =A0 /Shopping/Products.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:05:16
> QueryString =A0 Department=3D10&Compare=3D2&Shelf=3D3187
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:58855 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Shopping/Products.aspx?
> Department=3D1&Shelf=3D1&GroupBy=3D1&CompareBy=3D1
> Mapped To URL =A0 /Shopping/Products.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:04:35
> QueryString =A0 Department=3D1&Shelf=3D1&GroupBy=3D1&CompareBy=3D1
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:59053 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Shopping/Products.aspx?
> Department=3D12&Compare=3D2&Shelf=3D3222
> Mapped To URL =A0 /Shopping/Products.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:02:15
> QueryString =A0 Department=3D12&Compare=3D2&Shelf=3D3222
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:59077 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Shopping/Products.aspx?
> Department=3D3&Shelf=3D3198&GroupBy=3D1688
> Mapped To URL =A0 /Shopping/Products.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:01:38
> QueryString =A0 Department=3D3&Shelf=3D3198&GroupBy=3D1688
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:58981 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Shopping/Products.aspx?Department=3D8
> Mapped To URL =A0 /Shopping/Products.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:01:38
> QueryString =A0 Department=3D8
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:58964 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Shopping/Products.aspx?Department=3D11
> Mapped To URL =A0 /Shopping/Products.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:01:38
> QueryString =A0 Department=3D11
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:59095 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Ajax/AddProduct.aspx?Product=3D2502
> Mapped To URL =A0 /Ajax/AddProduct.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:01:38
> QueryString =A0 Product=3D2502
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:58943 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Shopping/FindProducts.aspx?Query=3DCoffee
> %20Beans&Compare=3D1
> Mapped To URL =A0 /Shopping/FindProducts.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:01:37
> QueryString =A0 Query=3DCoffee%20Beans&Compare=3D1
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> Client connection from 192.168.111.172:59090 to 192.168.111.141:80
> Host Header =A0 dpn-webe:80
> GET request for =A0 /Ajax/AddProduct.aspx?Product=3D9873
> Mapped To URL =A0 /Ajax/AddProduct.aspx
> HTTP Version =A0 HTTP/1.1
> SSL Request =A0 False
> Time alive =A0 00:01:37
> QueryString =A0 Product=3D9873
> Request mapped to
> HTTP Request State =A0 HTR_READING_CLIENT_REQUEST
> Native Request State =A0 NREQ_STATE_PROCESS
>
> 53 connection(s) waiting for the next request.
>
> =A0Script Summary
> =A0 Script Name Status Error Code Error Source Error Description Source
> Line
> CrashHangAnalysis.asp Completed

Re: Help with Debug Diagnostic tool , Application pool hangs and

am 07.01.2008 16:14:53 von eran

Thanks David,

Your answer put me on track. Sorry for this late thank's post...

It turned out that the machine was installed with .net framework 2.0
first release build (45), and not the current build we are using. This
old version has some bugs that caused these problems. Scott Gu's post:
http://weblogs.asp.net/scottgu/archive/2005/12/14/433194.asp x was
also very helpful solving this issue, by getting more accurate events
into our event log.

In this process we also learned that for our benchmark the .net
framework SP1 increases the requests/sec arround 25%, so we are
starting to QA our product with these fixes as well.

The new machine with 2 Quad core CPUs turned out to be fantastic,
stronger than our 4 old machines altogether. Pretty amazing.