High CPU % - looking for direction

I've started testing a Asp.Net 1.1 app created in C#, that is (already)
having performance problems.
I have not used the iistate tool before, and I'm very interested to see what
information it may be
able to provide. The readme files said to post log files to this group for
analysis help...so here goes.

For a little background, some of the performance counters show
average cpu in the high 90's, GC time < 10%, Context switches/sec avg around
4k, and the aspnet_wp is not
restarting in the middle of my test runs (pid stays the same until I reset
iis)

I wasn't able to resolve the missing symbols for the asp.dll however.
iisstate has built the /symbols directory with debug symbols,
and the xxx.dbg files for my compiled code do exists in my execution
directory. I also downloaded the symbols from the ms website,
and place the asp.dbg in the iisstate/symbols dir without much luck in
correcting for threads 9,10,13 & 14.

Thread 1 seems to be where the place where any (significant) time was spent
within the test run - but I'm not sure what it is telling me?
What significant indicators should I be looking for?

Thanks,
Tim

Opened log file 'C:\iisstate\output\IISState-2376.log'

***********************
Starting new log output
IISState version 3.3.1

Wed Mar 17 23:52:27 2004

OS = Windows XP
Executable: aspnet_wp.exe
PID = 2376

Note: Thread times are formatted as HH:MM:SS.ms

***********************

Thread ID: 0
System Thread ID: a0c
Kernel Time: 0:0:0.40
User Time: 0:0:0.90
Thread Type: Other
# ChildEBP RetAddr
00 0012f69c 77f5b7f4 SharedUserData!SystemCallStub+0x4
01 0012f6a0 77e7a37a ntdll!ZwDelayExecution+0xc
02 0012f6f8 77e61bf5 KERNEL32!SleepEx+0x61
03 0012f704 00442df0 KERNEL32!Sleep+0xb
04 0012ff60 0044408d aspnet_wp!wmain+0x3a1
05 0012ffc0 77e814c7 aspnet_wp!wmainCRTStartup+0x143
06 0012fff0 00000000 KERNEL32!BaseProcessStart+0x23




Thread ID: 1
System Thread ID: f1c
Kernel Time: 0:0:4.406
User Time: 0:2:43.324
Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
succeeded
Loaded Son of Strike data table version 5 from
"C:\WINDOWS\Microsoft.NET\Framework\v1.1.4322\mscorwks.dll"
Thread 1
ESP EIP


Begin System Thread Information

# ChildEBP RetAddr
00 0088ff50 77f5c024 SharedUserData!SystemCallStub+0x4
01 0088ff54 77e7594a ntdll!NtRemoveIoCompletion+0xc
02 0088ff80 792e9b2f KERNEL32!GetQueuedCompletionStatus+0x27
03 0088ffb4 77e7d33b mscorwks!ThreadpoolMgr::CompletionPortThreadStart+0x49
04 0088ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 2
System Thread ID: b1c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
Thread 2
Not a managed thread.


Begin System Thread Information

# ChildEBP RetAddr
00 0098fef0 77f5b7f4 SharedUserData!SystemCallStub+0x4
01 0098fef4 77e7a37a ntdll!ZwDelayExecution+0xc
02 0098ff4c 77e61bf5 KERNEL32!SleepEx+0x61
03 0098ff58 792e9ebe KERNEL32!Sleep+0xb
04 0098ffb4 77e7d33b mscorwks!ThreadpoolMgr::GateThreadStart+0x54
05 0098ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 3
System Thread ID: e1c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 00a8fefc 77f5c534 SharedUserData!SystemCallStub+0x4
01 00a8ff00 77e7a62d ntdll!NtWaitForSingleObject+0xc
02 00a8ff64 77e7ac21 KERNEL32!WaitForSingleObjectEx+0xa8
03 00a8ff74 00443020 KERNEL32!WaitForSingleObject+0xf
04 00a8ff80 7c34940f aspnet_wp!DoPingThread+0x10
05 00a8ffb4 77e7d33b MSVCR71!_endthread+0xaa
06 00a8ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 4
System Thread ID: aa4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
Thread 4
Not a managed thread.


Begin System Thread Information

# ChildEBP RetAddr
00 00c2fe7c 77f5c524 SharedUserData!SystemCallStub+0x4
01 00c2fe80 77e75ee0 ntdll!NtWaitForMultipleObjects+0xc
02 00c2ff1c 77e75faa KERNEL32!WaitForMultipleObjectsEx+0x12c
03 00c2ff34 791d25d5 KERNEL32!WaitForMultipleObjects+0x17
04 00c2ff9c 791d254c mscorwks!DebuggerRCThread::MainLoop+0x90
05 00c2ffac 791d4d50 mscorwks!DebuggerRCThread::ThreadProc+0x68
06 00c2ffb4 77e7d33b mscorwks!DebuggerRCThread::ThreadProcStatic+0xb
07 00c2ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 5
System Thread ID: 848
Kernel Time: 0:0:0.30
User Time: 0:0:1.241
Thread Status: Thread is in a WAIT state.
Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
Thread 5
ESP EIP


Begin System Thread Information

# ChildEBP RetAddr
00 00dcfe98 77f5c524 SharedUserData!SystemCallStub+0x4
01 00dcfe9c 77e75ee0 ntdll!NtWaitForMultipleObjects+0xc
02 00dcff38 77e75faa KERNEL32!WaitForMultipleObjectsEx+0x12c
03 00dcff50 79262a5f KERNEL32!WaitForMultipleObjects+0x17
04 00dcff70 791bbea4 mscorwks!WaitForFinalizerEvent+0x5a
05 00dcffb4 77e7d33b mscorwks!GCHeap::FinalizerThreadStart+0x96
06 00dcffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 6
System Thread ID: eec
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
Thread 6
Not a managed thread.


Begin System Thread Information

# ChildEBP RetAddr
00 0714ff44 77f5b7f4 SharedUserData!SystemCallStub+0x4
01 0714ff48 77e7a37a ntdll!ZwDelayExecution+0xc
02 0714ffa0 792ea483 KERNEL32!SleepEx+0x61
03 0714ffb4 77e7d33b mscorwks!ThreadpoolMgr::TimerThreadStart+0x30
04 0714ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 7
System Thread ID: ad0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
Thread 7
Not a managed thread.


Begin System Thread Information

# ChildEBP RetAddr
00 077dff50 77f5c024 SharedUserData!SystemCallStub+0x4
01 077dff54 77e7594a ntdll!NtRemoveIoCompletion+0xc
02 077dff80 792e9b2f KERNEL32!GetQueuedCompletionStatus+0x27
03 077dffb4 77e7d33b mscorwks!ThreadpoolMgr::CompletionPortThreadStart+0x49
04 077dffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 8
System Thread ID: fe8
Kernel Time: 0:0:0.20
User Time: 0:0:0.140
Thread Status: Thread is in a WAIT state.
Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
Thread 8
ESP EIP


Begin System Thread Information

# ChildEBP RetAddr
00 079aff18 77f5c534 SharedUserData!SystemCallStub+0x4
01 079aff1c 77e7a62d ntdll!NtWaitForSingleObject+0xc
02 079aff80 77e7ac21 KERNEL32!WaitForSingleObjectEx+0xa8
03 079aff90 792e91e0 KERNEL32!WaitForSingleObject+0xf
04 079affb4 77e7d33b mscorwks!ThreadpoolMgr::WorkerThreadStart+0x3a
05 079affec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 9
System Thread ID: c10
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 07bdfe24 77f5c084 SharedUserData!SystemCallStub+0x4
01 07bdfe28 780016a4 ntdll!NtReplyWaitReceivePortEx+0xc
02 07bdff90 78001601 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0xf6
03 07bdff94 780019d6 RPCRT4!RecvLotsaCallsWrapper+0x9
04 07bdffac 780015f3 RPCRT4!BaseCachedThreadRoutine+0x64
05 07bdffb4 77e7d33b RPCRT4!ThreadStartRoutine+0x16
06 07bdffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 10
System Thread ID: d74
Kernel Time: 0:0:0.0
User Time: 0:0:0.10
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

No remote call being made

# ChildEBP RetAddr
00 09abfe24 77f5c084 SharedUserData!SystemCallStub+0x4
01 09abfe28 780016a4 ntdll!NtReplyWaitReceivePortEx+0xc
02 09abff90 78001601 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0xf6
03 09abff94 780019d6 RPCRT4!RecvLotsaCallsWrapper+0x9
04 09abffac 780015f3 RPCRT4!BaseCachedThreadRoutine+0x64
05 09abffb4 77e7d33b RPCRT4!ThreadStartRoutine+0x16
06 09abffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 11
System Thread ID: d14
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
Thread 11
ESP EIP
098bfc78 7ffe0304 [FRAME: ECallMethodFrame] [DEFAULT] Void
System.Threading.Thread.Sleep(I4)
098bfc88 080dba43 [DEFAULT] Void
System.EnterpriseServices.ServicedComponentProxy.QueueCleaner()
098bfe84 791da717 [FRAME: GCFrame]
098bfecc 791da717 [FRAME: ContextTransitionFrame]


Begin System Thread Information

# ChildEBP RetAddr
00 098bfbc4 77f5b7f4 SharedUserData!SystemCallStub+0x4
01 098bfbc8 77e7a37a ntdll!ZwDelayExecution+0xc
02 098bfc20 7929703b KERNEL32!SleepEx+0x61
03 098bfc40 792e42d5 mscorwks!Thread::UserSleep+0x93
04 098bfc50 070478c2 mscorwks!ThreadNative::Sleep+0x30
WARNING: Frame IP not in any known module. Following frames may be wrong.
05 098bfc8c 791da434 0x70478c2
06 098bfd9c 791da58a mscorwks!MethodDesc::CallDescr+0x1b6
07 098bfe4c 791da5f6 mscorwks!MethodDesc::CallDescr+0x43
08 098bfe74 792e518c mscorwks!MethodDesc::Call+0x97
09 098bfec0 792999a8 mscorwks!ThreadNative::KickOffThread_Worker+0x9d
0a 098bff08 792e5254 mscorwks!Thread::DoADCallBack+0x5c
0b 098bffb4 77e7d33b mscorwks!ThreadNative::KickOffThread+0xbb
0c 098bffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 12
System Thread ID: a7c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 09fffebc 77f5c534 SharedUserData!SystemCallStub+0x4
01 09fffec0 77e7a62d ntdll!NtWaitForSingleObject+0xc
02 09ffff24 77e7ac21 KERNEL32!WaitForSingleObjectEx+0xa8
03 09ffff34 757a618a KERNEL32!WaitForSingleObject+0xf
04 09ffffb4 77e7d33b comsvcs!CEventRegistrar::InitThread+0x101
05 09ffffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 13
System Thread ID: 88
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Distributed Transaction. Checking for running ASP page
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

# ChildEBP RetAddr
00 0a10ff10 77f5b7f4 SharedUserData!SystemCallStub+0x4
01 0a10ff14 77e7a37a ntdll!ZwDelayExecution+0xc
02 0a10ff6c 77e61bf5 KERNEL32!SleepEx+0x61
03 0a10ff78 60dce433 KERNEL32!Sleep+0xb
04 0a10ffb0 60dceeea
MSDTCPRX!CConnectionManager::TimerProcForNonGuardedUser+0x76
05 0a10ffb4 77e7d33b MSDTCPRX!CConnectionManager::TimerProc+0x1a
06 0a10ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 14
System Thread ID: b08
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Distributed Transaction. Checking for running ASP page
Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
Continuing with other analysis.

# ChildEBP RetAddr
00 0a2dfcf4 77f5c534 SharedUserData!SystemCallStub+0x4
01 0a2dfcf8 77e7a62d ntdll!NtWaitForSingleObject+0xc
02 0a2dfd5c 77e7ac21 KERNEL32!WaitForSingleObjectEx+0xa8
03 0a2dfd6c 60dd286a KERNEL32!WaitForSingleObject+0xf
04 0a2dff90 60dd2ba0 MSDTCPRX!CSessionObject::MaintainItInUpState+0x1b7
05 0a2dffb0 60dd2c30 MSDTCPRX!CSessionObject::MaintainIt+0x1bb
06 0a2dffb4 77e7d33b MSDTCPRX!CSessionObject::MaintainSession+0xd
07 0a2dffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 15
System Thread ID: 954
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0a49fdb0 77f5c524 SharedUserData!SystemCallStub+0x4
01 0a49fdb4 77e75ee0 ntdll!NtWaitForMultipleObjects+0xc
02 0a49fe50 77e75faa KERNEL32!WaitForMultipleObjectsEx+0x12c
03 0a49fe68 0a36716e KERNEL32!WaitForMultipleObjects+0x17
04 0a49ffb4 77e7d33b oramts!kpnttraceinit2+0x108
05 0a49ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 16
System Thread ID: d30
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 0a59ff34 77f5c534 SharedUserData!SystemCallStub+0x4
01 0a59ff38 77e7a62d ntdll!NtWaitForSingleObject+0xc
02 0a59ff9c 0a359dde KERNEL32!WaitForSingleObjectEx+0xa8
03 0a59ffb4 77e7d33b oramts!kpntdbid::expireTimeoutThread+0x41
04 0a59ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 17
System Thread ID: a70
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0a69ff04 77f5c024 SharedUserData!SystemCallStub+0x4
01 0a69ff08 77e7594a ntdll!NtRemoveIoCompletion+0xc
02 0a69ff34 0a35ddbf KERNEL32!GetQueuedCompletionStatus+0x27
03 0a69ff80 77c37fb8 oramts!workerThread+0x92
04 0a69ffb4 77e7d33b msvcrt!_endthreadex+0xa0
05 0a69ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 18
System Thread ID: b5c
Kernel Time: 0:0:0.10
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0a79ff04 77f5c024 SharedUserData!SystemCallStub+0x4
01 0a79ff08 77e7594a ntdll!NtRemoveIoCompletion+0xc
02 0a79ff34 0a35ddbf KERNEL32!GetQueuedCompletionStatus+0x27
03 0a79ff80 77c37fb8 oramts!workerThread+0x92
04 0a79ffb4 77e7d33b msvcrt!_endthreadex+0xa0
05 0a79ffec 00000000 KERNEL32!BaseThreadStart+0x37




Thread ID: 19
System Thread ID: de4
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0a9aff04 77f5c024 SharedUserData!SystemCallStub+0x4
01 0a9aff08 77e7594a ntdll!NtRemoveIoCompletion+0xc
02 0a9aff34 0a35ddbf KERNEL32!GetQueuedCompletionStatus+0x27
03 0a9aff80 77c37fb8 oramts!workerThread+0x92
04 0a9affb4 77e7d33b msvcrt!_endthreadex+0xa0
05 0a9affec 00000000 KERNEL32!BaseThreadStart+0x37

Closing open log file D:\iisstate\output\IISState-2376.log

Thread 9 (and others like it) are idle and not running ASP. IISState looks
for 'hints' that a thread may have an ASP page running, and reports that
there is a 'possible' asp page. The 'symbols' reference occurs when
IISState doesn't see ASP.dll on the stack. In the next version of IISState
this is a bit clearer.

Pat

"Tim Datters" <datazilla.RemoveThis@hotmail.com> wrote in message
news:eNUhhgKDEHA.2908@TK2MSFTNGP09.phx.gbl...
 > I've started testing a Asp.Net 1.1 app created in C#, that is (already)
 > having performance problems.
 > I have not used the iistate tool before, and I'm very interested to see
what
 > information it may be
 > able to provide. The readme files said to post log files to this group
for
 > analysis help...so here goes.
 >
 > For a little background, some of the performance counters show
 > average cpu in the high 90's, GC time < 10%, Context switches/sec avg
around
 > 4k, and the aspnet_wp is not
 > restarting in the middle of my test runs (pid stays the same until I reset
 > iis)
 >
 > I wasn't able to resolve the missing symbols for the asp.dll however.
 > iisstate has built the /symbols directory with debug symbols,
 > and the xxx.dbg files for my compiled code do exists in my execution
 > directory. I also downloaded the symbols from the ms website,
 > and place the asp.dbg in the iisstate/symbols dir without much luck in
 > correcting for threads 9,10,13 & 14.
 >
 > Thread 1 seems to be where the place where any (significant) time was
spent
 > within the test run - but I'm not sure what it is telling me?
 > What significant indicators should I be looking for?
 >
 > Thanks,
 > Tim
 >
 > Opened log file 'C:\iisstate\output\IISState-2376.log'
 >
 > ***********************
 > Starting new log output
 > IISState version 3.3.1
 >
 > Wed Mar 17 23:52:27 2004
 >
 > OS = Windows XP
 > Executable: aspnet_wp.exe
 > PID = 2376
 >
 > Note: Thread times are formatted as HH:MM:SS.ms
 >
 > ***********************
 >
 > Thread ID: 0
 > System Thread ID: a0c
 > Kernel Time: 0:0:0.40
 > User Time: 0:0:0.90
 > Thread Type: Other
 > # ChildEBP RetAddr
 > 00 0012f69c 77f5b7f4 SharedUserData!SystemCallStub+0x4
 > 01 0012f6a0 77e7a37a ntdll!ZwDelayExecution+0xc
 > 02 0012f6f8 77e61bf5 KERNEL32!SleepEx+0x61
 > 03 0012f704 00442df0 KERNEL32!Sleep+0xb
 > 04 0012ff60 0044408d aspnet_wp!wmain+0x3a1
 > 05 0012ffc0 77e814c7 aspnet_wp!wmainCRTStartup+0x143
 > 06 0012fff0 00000000 KERNEL32!BaseProcessStart+0x23
 >
 >
 >
 >
 > Thread ID: 1
 > System Thread ID: f1c
 > Kernel Time: 0:0:4.406
 > User Time: 0:2:43.324
 > Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
 > succeeded
 > Loaded Son of Strike data table version 5 from
 > "C:\WINDOWS\Microsoft.NET\Framework\v1.1.4322\mscorwks.dll"
 > Thread 1
 > ESP EIP
 >
 >
 > Begin System Thread Information
 >
 > # ChildEBP RetAddr
 > 00 0088ff50 77f5c024 SharedUserData!SystemCallStub+0x4
 > 01 0088ff54 77e7594a ntdll!NtRemoveIoCompletion+0xc
 > 02 0088ff80 792e9b2f KERNEL32!GetQueuedCompletionStatus+0x27
 > 03 0088ffb4 77e7d33b
mscorwks!ThreadpoolMgr::CompletionPortThreadStart+0x49
 > 04 0088ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 2
 > System Thread ID: b1c
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
 > Thread 2
 > Not a managed thread.
 >
 >
 > Begin System Thread Information
 >
 > # ChildEBP RetAddr
 > 00 0098fef0 77f5b7f4 SharedUserData!SystemCallStub+0x4
 > 01 0098fef4 77e7a37a ntdll!ZwDelayExecution+0xc
 > 02 0098ff4c 77e61bf5 KERNEL32!SleepEx+0x61
 > 03 0098ff58 792e9ebe KERNEL32!Sleep+0xb
 > 04 0098ffb4 77e7d33b mscorwks!ThreadpoolMgr::GateThreadStart+0x54
 > 05 0098ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 3
 > System Thread ID: e1c
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Status: Thread is in a WAIT state.
 > Thread Type: Other
 > # ChildEBP RetAddr
 > 00 00a8fefc 77f5c534 SharedUserData!SystemCallStub+0x4
 > 01 00a8ff00 77e7a62d ntdll!NtWaitForSingleObject+0xc
 > 02 00a8ff64 77e7ac21 KERNEL32!WaitForSingleObjectEx+0xa8
 > 03 00a8ff74 00443020 KERNEL32!WaitForSingleObject+0xf
 > 04 00a8ff80 7c34940f aspnet_wp!DoPingThread+0x10
 > 05 00a8ffb4 77e7d33b MSVCR71!_endthread+0xaa
 > 06 00a8ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 4
 > System Thread ID: aa4
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Status: Thread is in a WAIT state.
 > Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
 > Thread 4
 > Not a managed thread.
 >
 >
 > Begin System Thread Information
 >
 > # ChildEBP RetAddr
 > 00 00c2fe7c 77f5c524 SharedUserData!SystemCallStub+0x4
 > 01 00c2fe80 77e75ee0 ntdll!NtWaitForMultipleObjects+0xc
 > 02 00c2ff1c 77e75faa KERNEL32!WaitForMultipleObjectsEx+0x12c
 > 03 00c2ff34 791d25d5 KERNEL32!WaitForMultipleObjects+0x17
 > 04 00c2ff9c 791d254c mscorwks!DebuggerRCThread::MainLoop+0x90
 > 05 00c2ffac 791d4d50 mscorwks!DebuggerRCThread::ThreadProc+0x68
 > 06 00c2ffb4 77e7d33b mscorwks!DebuggerRCThread::ThreadProcStatic+0xb
 > 07 00c2ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 5
 > System Thread ID: 848
 > Kernel Time: 0:0:0.30
 > User Time: 0:0:1.241
 > Thread Status: Thread is in a WAIT state.
 > Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
 > Thread 5
 > ESP EIP
 >
 >
 > Begin System Thread Information
 >
 > # ChildEBP RetAddr
 > 00 00dcfe98 77f5c524 SharedUserData!SystemCallStub+0x4
 > 01 00dcfe9c 77e75ee0 ntdll!NtWaitForMultipleObjects+0xc
 > 02 00dcff38 77e75faa KERNEL32!WaitForMultipleObjectsEx+0x12c
 > 03 00dcff50 79262a5f KERNEL32!WaitForMultipleObjects+0x17
 > 04 00dcff70 791bbea4 mscorwks!WaitForFinalizerEvent+0x5a
 > 05 00dcffb4 77e7d33b mscorwks!GCHeap::FinalizerThreadStart+0x96
 > 06 00dcffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 6
 > System Thread ID: eec
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
 > Thread 6
 > Not a managed thread.
 >
 >
 > Begin System Thread Information
 >
 > # ChildEBP RetAddr
 > 00 0714ff44 77f5b7f4 SharedUserData!SystemCallStub+0x4
 > 01 0714ff48 77e7a37a ntdll!ZwDelayExecution+0xc
 > 02 0714ffa0 792ea483 KERNEL32!SleepEx+0x61
 > 03 0714ffb4 77e7d33b mscorwks!ThreadpoolMgr::TimerThreadStart+0x30
 > 04 0714ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 7
 > System Thread ID: ad0
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
 > Thread 7
 > Not a managed thread.
 >
 >
 > Begin System Thread Information
 >
 > # ChildEBP RetAddr
 > 00 077dff50 77f5c024 SharedUserData!SystemCallStub+0x4
 > 01 077dff54 77e7594a ntdll!NtRemoveIoCompletion+0xc
 > 02 077dff80 792e9b2f KERNEL32!GetQueuedCompletionStatus+0x27
 > 03 077dffb4 77e7d33b
mscorwks!ThreadpoolMgr::CompletionPortThreadStart+0x49
 > 04 077dffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 8
 > System Thread ID: fe8
 > Kernel Time: 0:0:0.20
 > User Time: 0:0:0.140
 > Thread Status: Thread is in a WAIT state.
 > Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
 > Thread 8
 > ESP EIP
 >
 >
 > Begin System Thread Information
 >
 > # ChildEBP RetAddr
 > 00 079aff18 77f5c534 SharedUserData!SystemCallStub+0x4
 > 01 079aff1c 77e7a62d ntdll!NtWaitForSingleObject+0xc
 > 02 079aff80 77e7ac21 KERNEL32!WaitForSingleObjectEx+0xa8
 > 03 079aff90 792e91e0 KERNEL32!WaitForSingleObject+0xf
 > 04 079affb4 77e7d33b mscorwks!ThreadpoolMgr::WorkerThreadStart+0x3a
 > 05 079affec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 9
 > System Thread ID: c10
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Type: Possible ASP page. Possible DCOM activity
 > Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
 > Continuing with other analysis.
 >
 > No remote call being made
 >
 > # ChildEBP RetAddr
 > 00 07bdfe24 77f5c084 SharedUserData!SystemCallStub+0x4
 > 01 07bdfe28 780016a4 ntdll!NtReplyWaitReceivePortEx+0xc
 > 02 07bdff90 78001601 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0xf6
 > 03 07bdff94 780019d6 RPCRT4!RecvLotsaCallsWrapper+0x9
 > 04 07bdffac 780015f3 RPCRT4!BaseCachedThreadRoutine+0x64
 > 05 07bdffb4 77e7d33b RPCRT4!ThreadStartRoutine+0x16
 > 06 07bdffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 10
 > System Thread ID: d74
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.10
 > Thread Type: Possible ASP page. Possible DCOM activity
 > Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
 > Continuing with other analysis.
 >
 > No remote call being made
 >
 > # ChildEBP RetAddr
 > 00 09abfe24 77f5c084 SharedUserData!SystemCallStub+0x4
 > 01 09abfe28 780016a4 ntdll!NtReplyWaitReceivePortEx+0xc
 > 02 09abff90 78001601 RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0xf6
 > 03 09abff94 780019d6 RPCRT4!RecvLotsaCallsWrapper+0x9
 > 04 09abffac 780015f3 RPCRT4!BaseCachedThreadRoutine+0x64
 > 05 09abffb4 77e7d33b RPCRT4!ThreadStartRoutine+0x16
 > 06 09abffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 11
 > System Thread ID: d14
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Type: Managed Thread. Possible ASP.Net page or other .Net worker
 > Thread 11
 > ESP EIP
 > 098bfc78 7ffe0304 [FRAME: ECallMethodFrame] [DEFAULT] Void
 > System.Threading.Thread.Sleep(I4)
 > 098bfc88 080dba43 [DEFAULT] Void
 > System.EnterpriseServices.ServicedComponentProxy.QueueCleaner()
 > 098bfe84 791da717 [FRAME: GCFrame]
 > 098bfecc 791da717 [FRAME: ContextTransitionFrame]
 >
 >
 > Begin System Thread Information
 >
 > # ChildEBP RetAddr
 > 00 098bfbc4 77f5b7f4 SharedUserData!SystemCallStub+0x4
 > 01 098bfbc8 77e7a37a ntdll!ZwDelayExecution+0xc
 > 02 098bfc20 7929703b KERNEL32!SleepEx+0x61
 > 03 098bfc40 792e42d5 mscorwks!Thread::UserSleep+0x93
 > 04 098bfc50 070478c2 mscorwks!ThreadNative::Sleep+0x30
 > WARNING: Frame IP not in any known module. Following frames may be wrong.
 > 05 098bfc8c 791da434 0x70478c2
 > 06 098bfd9c 791da58a mscorwks!MethodDesc::CallDescr+0x1b6
 > 07 098bfe4c 791da5f6 mscorwks!MethodDesc::CallDescr+0x43
 > 08 098bfe74 792e518c mscorwks!MethodDesc::Call+0x97
 > 09 098bfec0 792999a8 mscorwks!ThreadNative::KickOffThread_Worker+0x9d
 > 0a 098bff08 792e5254 mscorwks!Thread::DoADCallBack+0x5c
 > 0b 098bffb4 77e7d33b mscorwks!ThreadNative::KickOffThread+0xbb
 > 0c 098bffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 12
 > System Thread ID: a7c
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Status: Thread is in a WAIT state.
 > Thread Type: Idle ASP thread
 > # ChildEBP RetAddr
 > 00 09fffebc 77f5c534 SharedUserData!SystemCallStub+0x4
 > 01 09fffec0 77e7a62d ntdll!NtWaitForSingleObject+0xc
 > 02 09ffff24 77e7ac21 KERNEL32!WaitForSingleObjectEx+0xa8
 > 03 09ffff34 757a618a KERNEL32!WaitForSingleObject+0xf
 > 04 09ffffb4 77e7d33b comsvcs!CEventRegistrar::InitThread+0x101
 > 05 09ffffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 13
 > System Thread ID: 88
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Type: Distributed Transaction. Checking for running ASP page
 > Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
 > Continuing with other analysis.
 >
 > # ChildEBP RetAddr
 > 00 0a10ff10 77f5b7f4 SharedUserData!SystemCallStub+0x4
 > 01 0a10ff14 77e7a37a ntdll!ZwDelayExecution+0xc
 > 02 0a10ff6c 77e61bf5 KERNEL32!SleepEx+0x61
 > 03 0a10ff78 60dce433 KERNEL32!Sleep+0xb
 > 04 0a10ffb0 60dceeea
 > MSDTCPRX!CConnectionManager::TimerProcForNonGuardedUser+0x76
 > 05 0a10ffb4 77e7d33b MSDTCPRX!CConnectionManager::TimerProc+0x1a
 > 06 0a10ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 14
 > System Thread ID: b08
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Status: Thread is in a WAIT state.
 > Thread Type: Distributed Transaction. Checking for running ASP page
 > Executing Page: ASP.dll symbols not found. Unable to locate ASP page.
 > Continuing with other analysis.
 >
 > # ChildEBP RetAddr
 > 00 0a2dfcf4 77f5c534 SharedUserData!SystemCallStub+0x4
 > 01 0a2dfcf8 77e7a62d ntdll!NtWaitForSingleObject+0xc
 > 02 0a2dfd5c 77e7ac21 KERNEL32!WaitForSingleObjectEx+0xa8
 > 03 0a2dfd6c 60dd286a KERNEL32!WaitForSingleObject+0xf
 > 04 0a2dff90 60dd2ba0 MSDTCPRX!CSessionObject::MaintainItInUpState+0x1b7
 > 05 0a2dffb0 60dd2c30 MSDTCPRX!CSessionObject::MaintainIt+0x1bb
 > 06 0a2dffb4 77e7d33b MSDTCPRX!CSessionObject::MaintainSession+0xd
 > 07 0a2dffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 15
 > System Thread ID: 954
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Status: Thread is in a WAIT state.
 > Thread Type: Other
 > # ChildEBP RetAddr
 > 00 0a49fdb0 77f5c524 SharedUserData!SystemCallStub+0x4
 > 01 0a49fdb4 77e75ee0 ntdll!NtWaitForMultipleObjects+0xc
 > 02 0a49fe50 77e75faa KERNEL32!WaitForMultipleObjectsEx+0x12c
 > 03 0a49fe68 0a36716e KERNEL32!WaitForMultipleObjects+0x17
 > 04 0a49ffb4 77e7d33b oramts!kpnttraceinit2+0x108
 > 05 0a49ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 16
 > System Thread ID: d30
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Status: Thread is in a WAIT state.
 > Thread Type: Other
 > # ChildEBP RetAddr
 > 00 0a59ff34 77f5c534 SharedUserData!SystemCallStub+0x4
 > 01 0a59ff38 77e7a62d ntdll!NtWaitForSingleObject+0xc
 > 02 0a59ff9c 0a359dde KERNEL32!WaitForSingleObjectEx+0xa8
 > 03 0a59ffb4 77e7d33b oramts!kpntdbid::expireTimeoutThread+0x41
 > 04 0a59ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 17
 > System Thread ID: a70
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Type: Other
 > # ChildEBP RetAddr
 > 00 0a69ff04 77f5c024 SharedUserData!SystemCallStub+0x4
 > 01 0a69ff08 77e7594a ntdll!NtRemoveIoCompletion+0xc
 > 02 0a69ff34 0a35ddbf KERNEL32!GetQueuedCompletionStatus+0x27
 > 03 0a69ff80 77c37fb8 oramts!workerThread+0x92
 > 04 0a69ffb4 77e7d33b msvcrt!_endthreadex+0xa0
 > 05 0a69ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 18
 > System Thread ID: b5c
 > Kernel Time: 0:0:0.10
 > User Time: 0:0:0.0
 > Thread Type: Other
 > # ChildEBP RetAddr
 > 00 0a79ff04 77f5c024 SharedUserData!SystemCallStub+0x4
 > 01 0a79ff08 77e7594a ntdll!NtRemoveIoCompletion+0xc
 > 02 0a79ff34 0a35ddbf KERNEL32!GetQueuedCompletionStatus+0x27
 > 03 0a79ff80 77c37fb8 oramts!workerThread+0x92
 > 04 0a79ffb4 77e7d33b msvcrt!_endthreadex+0xa0
 > 05 0a79ffec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 >
 >
 >
 > Thread ID: 19
 > System Thread ID: de4
 > Kernel Time: 0:0:0.0
 > User Time: 0:0:0.0
 > Thread Type: Other
 > # ChildEBP RetAddr
 > 00 0a9aff04 77f5c024 SharedUserData!SystemCallStub+0x4
 > 01 0a9aff08 77e7594a ntdll!NtRemoveIoCompletion+0xc
 > 02 0a9aff34 0a35ddbf KERNEL32!GetQueuedCompletionStatus+0x27
 > 03 0a9aff80 77c37fb8 oramts!workerThread+0x92
 > 04 0a9affb4 77e7d33b msvcrt!_endthreadex+0xa0
 > 05 0a9affec 00000000 KERNEL32!BaseThreadStart+0x37
 >
 > Closing open log file D:\iisstate\output\IISState-2376.log
 >
 ><!-- ~MESSAGE_AFTER~ -->