DebugDiag dump analysis help

External Since: Jan 22, 2008 Posts: 4

Hi there, I am analyzing a periodic IIS crash I receive on one of my servers.
This server hosts a document management product, and has an Oracle client
installation, among other things. During the last downage, I was able to
take a hang dump from the Windows Debug Diagnostic tool, and have pasted a
summary below. All I can tell is that it appears to be caused by a database
call, as the hanging process looks to be the Oracle client.

Is it possible to glean any additional info from this dump? Let me know if
you need the full log (it exceeded the posting limit).

Are there any additional tools I can use to get more precise info, such as
what sql code is hanging?

Thanks in advance...

Analysis Summary
Type Description Recommendation
Warning The following threads in
IIS_COM+__Date__01_04_2008__Time_08_39_09AM__w3wp.exe__DefaultAppPool__PID__5848__637__Manual
Dump.dmp are making a COM call to multi-threaded apartment (MTA) in another
COM server process via the local RpcSs service

( 16 17 18 19 20 21 22 24 25 26 27 28 29 30 )

42.42% of threads blocked

The thread(s) in question is/are waiting on a CoCreateInstance call to
return. Further analysis of the process hosting the particular component (not
the RpcSs service) should be performed to determine why these calls have not
completed. More information for the particular component(s) that the
thread(s) in question is/are attempting to instantiate can be found in the
thread detail for each thread listed in the Description pane to the left.
Warning Detected possible blocking or leaked critical section at
0x023f4c58 owned by thread 19 in
IIS_COM+__Date__01_04_2008__Time_08_39_06AM__dllhost.exe__RDCMS_XMLServer__PID__5192__121__Manual Dump.dmp

Impact of this lock

1 critical sections indirectly blocked

(Critical Sections ntdll!LdrpLoaderLock)

19.05% of threads blocked

(Threads 1 6 10 20)

The following functions are trying to enter this critical section

oracore10!sltsmna+f

The following module(s) are involved with this critical section

d:\oracle\product\10.2.0\client_1\BIN\oracore10.dll from Oracle Corporation
The following vendors were identified for follow up based on root cause
analysis

Oracle Corporation

Please follow up with the vendors identified above Consider the following
approach to determine root cause for this critical section problem:
Enable 'lock checks' in Application Verifier
Download Application Verifier from the following URL:

Microsoft Application Verifier
Enable 'lock checks' for this process by running the following command:

Appverif.exe -enable locks -for dllhost.exe
See the following document for more information on Application Verifier:

Testing Applications with AppVerifier
Use a DebugDiag crash rule to monitor the application for exceptions

Information
DebugDiag did not detect any known problems in the following dump files:

IIS_COM+__Date__01_04_2008__Time_08_39_03AM__inetinfo.exe__PID__1360__902__Manual Dump.dmp

IIS_COM+__Date__01_04_2008__Time_08_39_00AM__dllhost.exe__System
Application__PID__280__934__Manual Dump.dmp

Warning 14 client connection(s) in
IIS_COM+__Date__01_04_2008__Time_08_39_09AM__w3wp.exe__DefaultAppPool__PID__5848__637__Manual
Dump.dmp have been executing a request for more than 90 seconds. Please see
the Client Connections section of this report for more detailed information
about the connection(s).

External Since: Aug 23, 2003 Posts: 3041

Is the worker process actually crashing (terminating) or just appears to be
in a hung state (not responding to requests)?

From what you have posted below, it would appear that the process is hung,
and that the problem appears to be either in the Oracle client
components -or- some issue with the backend Oracle server.

Cheers
Ken

"Strago" <Strago.TakeThisOut@discussions.microsoft.com> wrote in message
news:6D744529-E303-4399-9BC6-46D20A3265FB@microsoft.com...
> Hi there, I am analyzing a periodic IIS crash I receive on one of my
> servers.
> This server hosts a document management product, and has an Oracle client
> installation, among other things. During the last downage, I was able to
> take a hang dump from the Windows Debug Diagnostic tool, and have pasted a
> summary below. All I can tell is that it appears to be caused by a
> database
> call, as the hanging process looks to be the Oracle client.
>
> Is it possible to glean any additional info from this dump? Let me know
> if
> you need the full log (it exceeded the posting limit).
>
> Are there any additional tools I can use to get more precise info, such as
> what sql code is hanging?
>
> Thanks in advance...
>
>
>
> Analysis Summary
> Type Description Recommendation
> Warning The following threads in
> IIS_COM+__Date__01_04_2008__Time_08_39_09AM__w3wp.exe__DefaultAppPool__PID__5848__637__Manual
> Dump.dmp are making a COM call to multi-threaded apartment (MTA) in
> another
> COM server process via the local RpcSs service
>
>
>
> ( 16 17 18 19 20 21 22 24 25 26 27 28 29 30 )
>
>
>
> 42.42% of threads blocked
>
>
> The thread(s) in question is/are waiting on a CoCreateInstance call to
> return. Further analysis of the process hosting the particular component
> (not
> the RpcSs service) should be performed to determine why these calls have
> not
> completed. More information for the particular component(s) that the
> thread(s) in question is/are attempting to instantiate can be found in the
> thread detail for each thread listed in the Description pane to the left.
> Warning Detected possible blocking or leaked critical section at
> 0x023f4c58 owned by thread 19 in
> IIS_COM+__Date__01_04_2008__Time_08_39_06AM__dllhost.exe__RDCMS_XMLServer__PID__5192__121__Manual
> Dump.dmp
>
>
>
> Impact of this lock
>
>
>
> 1 critical sections indirectly blocked
>
>
>
> (Critical Sections ntdll!LdrpLoaderLock)
>
>
>
> 19.05% of threads blocked
>
>
>
> (Threads 1 6 10 20)
>
>
>
> The following functions are trying to enter this critical section
>
> oracore10!sltsmna+f
>
>
>
> The following module(s) are involved with this critical section
>
> d:\oracle\product\10.2.0\client_1\BIN\oracore10.dll from Oracle
> Corporation
> The following vendors were identified for follow up based on root cause
> analysis
>
>
>
> Oracle Corporation
>
> Please follow up with the vendors identified above Consider the following
> approach to determine root cause for this critical section problem:
> Enable 'lock checks' in Application Verifier
> Download Application Verifier from the following URL:
>
> Microsoft Application Verifier
> Enable 'lock checks' for this process by running the following command:
>
> Appverif.exe -enable locks -for dllhost.exe
> See the following document for more information on Application Verifier:
>
> Testing Applications with AppVerifier
> Use a DebugDiag crash rule to monitor the application for exceptions
>
> Information
> DebugDiag did not detect any known problems in the following dump files:
>
>
> IIS_COM+__Date__01_04_2008__Time_08_39_03AM__inetinfo.exe__PID__1360__902__Manual
> Dump.dmp
>
> IIS_COM+__Date__01_04_2008__Time_08_39_00AM__dllhost.exe__System
> Application__PID__280__934__Manual Dump.dmp
>
>
>
> Warning 14 client connection(s) in
> IIS_COM+__Date__01_04_2008__Time_08_39_09AM__w3wp.exe__DefaultAppPool__PID__5848__637__Manual
> Dump.dmp have been executing a request for more than 90 seconds. Please
> see
> the Client Connections section of this report for more detailed
> information
> about the connection(s).
>