Welcome to HostingForumz.com!
FAQFAQ      ProfileProfile    Private MessagesPrivate Messages   Log inLog in

High cpu Utilization - IISState Log

 
   Web Hosting Problem Solving Community! (Home) -> IIS RSS
Next:  Setup 2nd IIS server though other server with ISA  
Author Message
dstine

External


Since: Mar 17, 2004
Posts: 1



(Msg. 1) Posted: Wed Mar 17, 2004 7:59 pm
Post subject: High cpu Utilization - IISState Log
Archived from groups: microsoft>public>inetserver>iis (more info?)

Sorry for the repost. Having problems with the web interface for the group.

I have been testing a new application and have been hitting some performance
problems. The server seems to be going along fine as users are being added
to the load test. The cpu utilization is averaging in the high 30s, ASP
requests executing is around 7 or 8, context switching is in the 5000 range
and there is no queuing of ASP requests. Then, all of a sudden, in the 720
user range the wheels just fly off the cart.

It is like someone suddenly turned on a switch. CPU utilization shoots to
the high 90's. The ASP requests executing instantly goes to the maximum
level allowed by the ASPProcessorThreadMax value set on the system, the ASP
request queue begins building rapidly. Obviously, response time of the
applicatin increases dramatically at this point.

Checking the running processes, it is the InetInfo.exe process that is
hogging all the cpu. It seems to be something that triggers all of a sudden
and I am not sure what it is. Reviewing the IISStae dump log I found 10
threads that had an unusual message on them. They stated that "Thread
Status: Thread is in a WAIT state.
Other information: Thread is waiting for a lock to be released. Looking for
lock owner.
The owning thread is 0. This usually indicates that the lock has either
been leaked or is in a 'convoy' state
Thread Type: ASP"

By the huge jump in the cpu and the context switching I am guessing the
system is just constantly trying to execute these threads and is switch ing
back and forth waiting for one to unlock.

If someone could maybe take a look at the dump log I have attached below and
see if anythig rings a bell with them. Maybe give me some idea of what is
going on. I am a hardware/server guy and need to explain to th programmers
that there is a problem and where they need to look for it. Any help would
be greatly appreciated.

Thanks, (Log begins below)
Dave

Opened log file 'C:\iisstate\output\IISState-2612.log'

***********************
Starting new log output
IISState version 3.3.1

Tue Mar 16 15:37:19 2004

OS = Windows 2000
Executable: inetinfo.exe
PID = 2612

Note: Thread times are formatted as HH:MM:SS.ms

***********************




Thread ID: 0
System Thread ID: 974
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0006f89c 77e96156 ntdll!ZwReadFile+0xb
01 0006f910 77dd8752 KERNEL32!ReadFile+0x181
02 0006f93c 77dd7fdc ADVAPI32!ScGetPipeInput+0x28
03 0006f9b8 77dd7e0c ADVAPI32!ScDispatcherLoop+0x4a
04 0006fbf4 01002884 ADVAPI32!StartServiceCtrlDispatcherA+0x7d
05 0006fd30 01001e94 inetinfo!StartDispatchTable+0x2f1
06 0006ff70 01002fbf inetinfo!main+0x654
07 0006ffc0 77ea847c inetinfo!mainCRTStartup+0xff
08 0006fff0 00000000 KERNEL32!BaseProcessStart+0x3d




Thread ID: 1
System Thread ID: b28
Kernel Time: 0:0:0.62
User Time: 0:0:0.62
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 005dfd1c 77ea9b35 ntdll!NtWaitForSingleObject+0xb
01 005dfd44 77e8b32b KERNEL32!WaitForSingleObjectEx+0x71
02 005dfd54 6e6f1fe8 KERNEL32!WaitForSingleObject+0xf
03 005dfd70 01002440 iisadmin!ServiceEntry+0x156
04 005dffa4 77dd8943 inetinfo!InetinfoStartService+0x2bd
05 005dffb4 77e8b2d8 ADVAPI32!ScSvcctrlThreadW+0xe
06 005dffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 2
System Thread ID: 948
Kernel Time: 0:0:3.625
User Time: 0:0:0.687
Thread Type: Other
# ChildEBP RetAddr
00 0071fe60 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0071feb0 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 0071ff0c 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0071ff28 6e5abc1d USER32!MsgWaitForMultipleObjects+0x1d
04 0071ff80 780060ce IisRTL!SchedulerWorkerThread+0xa7
05 0071ffb4 77e8b2d8 MSVCRT!_beginthreadex+0xca
06 0071ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 3
System Thread ID: b50
Kernel Time: 0:0:4.62
User Time: 0:0:0.578
Thread Type: Other
# ChildEBP RetAddr
00 0075fe60 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0075feb0 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 0075ff0c 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0075ff28 6e5abc1d USER32!MsgWaitForMultipleObjects+0x1d
04 0075ff80 780060ce IisRTL!SchedulerWorkerThread+0xa7
05 0075ffb4 77e8b2d8 MSVCRT!_beginthreadex+0xca
06 0075ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 4
System Thread ID: 97c
Kernel Time: 0:0:3.765
User Time: 0:0:0.796
Thread Type: Other
# ChildEBP RetAddr
00 0079fe60 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0079feb0 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 0079ff0c 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0079ff28 6e5abc1d USER32!MsgWaitForMultipleObjects+0x1d
04 0079ff80 780060ce IisRTL!SchedulerWorkerThread+0xa7
05 0079ffb4 77e8b2d8 MSVCRT!_beginthreadex+0xca
06 0079ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 5
System Thread ID: 8c0
Kernel Time: 0:0:3.750
User Time: 0:0:0.515
Thread Type: Other
# ChildEBP RetAddr
00 007dfe60 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 007dfeb0 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 007dff0c 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 007dff28 6e5abc1d USER32!MsgWaitForMultipleObjects+0x1d
04 007dff80 780060ce IisRTL!SchedulerWorkerThread+0xa7
05 007dffb4 77e8b2d8 MSVCRT!_beginthreadex+0xca
06 007dffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 6
System Thread ID: 764
Kernel Time: 0:0:3.968
User Time: 0:0:0.468
Thread Type: Other
# ChildEBP RetAddr
00 0081fe60 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0081feb0 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 0081ff0c 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0081ff28 6e5abc1d USER32!MsgWaitForMultipleObjects+0x1d
04 0081ff80 780060ce IisRTL!SchedulerWorkerThread+0xa7
05 0081ffb4 77e8b2d8 MSVCRT!_beginthreadex+0xca
06 0081ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 7
System Thread ID: 6cc
Kernel Time: 0:0:3.640
User Time: 0:0:0.390
Thread Type: Other
# ChildEBP RetAddr
00 0085fe60 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0085feb0 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 0085ff0c 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0085ff28 6e5abc1d USER32!MsgWaitForMultipleObjects+0x1d
04 0085ff80 780060ce IisRTL!SchedulerWorkerThread+0xa7
05 0085ffb4 77e8b2d8 MSVCRT!_beginthreadex+0xca
06 0085ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 8
System Thread ID: 6c4
Kernel Time: 0:0:3.984
User Time: 0:0:0.562
Thread Type: Other
# ChildEBP RetAddr
00 0089fe60 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0089feb0 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 0089ff0c 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0089ff28 6e5abc1d USER32!MsgWaitForMultipleObjects+0x1d
04 0089ff80 780060ce IisRTL!SchedulerWorkerThread+0xa7
05 0089ffb4 77e8b2d8 MSVCRT!_beginthreadex+0xca
06 0089ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 9
System Thread ID: 7ec
Kernel Time: 0:0:3.453
User Time: 0:0:0.656
Thread Type: Other
# ChildEBP RetAddr
00 008dfe60 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 008dfeb0 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 008dff0c 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 008dff28 6e5abc1d USER32!MsgWaitForMultipleObjects+0x1d
04 008dff80 780060ce IisRTL!SchedulerWorkerThread+0xa7
05 008dffb4 77e8b2d8 MSVCRT!_beginthreadex+0xca
06 008dffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 10
System Thread ID: bbc
Kernel Time: 0:0:0.78
User Time: 0:0:0.78
Thread Type: Other
# ChildEBP RetAddr
00 00fffc1c 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 00fffc6c 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 00fffcc8 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 00fffce4 769c4f9f USER32!MsgWaitForMultipleObjects+0x1d
04 00fffd30 65f2d8b6 INFOCOMM!IIS_SERVICE::StartServiceOperation+0x209
05 00fffd70 01002440 w3svc!ServiceEntry+0x1b5
06 00ffffa4 77dd8943 inetinfo!InetinfoStartService+0x2bd
07 00ffffb4 77e8b2d8 ADVAPI32!ScSvcctrlThreadW+0xe
08 00ffffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 11
System Thread ID: b3c
Kernel Time: 0:0:0.78
User Time: 0:0:0.46
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 0104fc1c 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0104fc6c 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 0104fcc8 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0104fce4 769c4f9f USER32!MsgWaitForMultipleObjects+0x1d
04 0104fd30 6b561462 INFOCOMM!IIS_SERVICE::StartServiceOperation+0x209
05 0104fd70 01002440 SMTPSVC!ServiceEntry+0x136
06 0104ffa4 77dd8943 inetinfo!InetinfoStartService+0x2bd
07 0104ffb4 77e8b2d8 ADVAPI32!ScSvcctrlThreadW+0xe
08 0104ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 12
System Thread ID: 8e0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 011cff5c 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 011cff88 6d70b2fa KERNEL32!GetQueuedCompletionStatus+0x27
02 011cffb4 77e8b2d8 ISATQ!I_AtqOplockThreadFunc+0x32
03 011cffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 13
System Thread ID: 910
Kernel Time: 0:0:2.296
User Time: 0:0:3.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0120ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0120ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0120ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0120ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 14
System Thread ID: 9d0
Kernel Time: 0:0:3.265
User Time: 0:0:3.687
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0124ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0124ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0124ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0124ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 15
System Thread ID: a50
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: Unable to locate ASP page

No remote call being made

# ChildEBP RetAddr
00 013cfeb8 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 013cfee4 77d809da KERNEL32!GetQueuedCompletionStatus+0x27
02 013cff20 77d50ede RPCRT4!COMMON_ProcessCalls+0x9e
03 013cff74 77d50d17 RPCRT4!LOADABLE_TRANSPORT::ProcessIOEvents+0x99
04 013cff78 77d39a00 RPCRT4!ProcessIOEventsWrapper+0x9
05 013cffa8 77d41c6c RPCRT4!BaseCachedThreadRoutine+0x4f
06 013cffb4 77e8b2d8 RPCRT4!ThreadStartRoutine+0x18
07 013cffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 16
System Thread ID: 8c8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0174fd20 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0174fd70 77ea9c13 KERNEL32!WaitForMultipleObjectsEx+0xea
02 0174fd88 778322b2 KERNEL32!WaitForMultipleObjects+0x17
03 0174ffb4 77e8b2d8 RTUTILS!TraceServerThread+0xde
04 0174ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 17
System Thread ID: b64
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 0179ff20 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0179ff70 77ea9c13 KERNEL32!WaitForMultipleObjectsEx+0xea
02 0179ff88 701224fa KERNEL32!WaitForMultipleObjects+0x17
03 0179ffb4 77e8b2d8 exstrace!RegNotifyThread+0x6f
04 0179ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 18
System Thread ID: 73c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 017dff24 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 017dff74 77ea9c13 KERNEL32!WaitForMultipleObjectsEx+0xea
02 017dff8c 70121e6a KERNEL32!WaitForMultipleObjects+0x17
03 017dffb4 77e8b2d8 exstrace!WriteTraceThread+0x2f
04 017dffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 19
System Thread ID: 96c
Kernel Time: 0:0:0.15
User Time: 0:0:0.46
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 01adff64 77ea9b35 ntdll!NtWaitForSingleObject+0xb
01 01adff8c 77e8b32b KERNEL32!WaitForSingleObjectEx+0x71
02 01adff9c 6ff283ee KERNEL32!WaitForSingleObject+0xf
03 01adffb4 77e8b2d8 FCACHDLL!CScheduleThread::ScheduleThread+0x22
04 01adffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 20
System Thread ID: b30
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 01c1ff18 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 01c1ff68 77ea9c13 KERNEL32!WaitForMultipleObjectsEx+0xea
02 01c1ff80 6b579fbd KERNEL32!WaitForMultipleObjects+0x17
03 01c1ffb4 77e8b2d8 SMTPSVC!TcpRegNotifyThread+0x136
04 01c1ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 21
System Thread ID: 8d4
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 01c5ff68 77ea9b35 ntdll!NtWaitForSingleObject+0xb
01 01c5ff90 77e8b32b KERNEL32!WaitForSingleObjectEx+0x71
02 01c5ffa0 6b579df1 KERNEL32!WaitForSingleObject+0xf
03 01c5ffb4 77e8b2d8 SMTPSVC!FreeLibThread+0x1d
04 01c5ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 22
System Thread ID: ae0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Compression Thread
# ChildEBP RetAddr
00 01c9ff5c 77ea9b35 ntdll!NtWaitForSingleObject+0xb
01 01c9ff84 77e8b32b KERNEL32!WaitForSingleObjectEx+0x71
02 01c9ff94 732c3366 KERNEL32!WaitForSingleObject+0xf
03 01c9ffb4 77e8b2d8 compfilt!CompressionThread+0x29
04 01c9ffc0 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 23
System Thread ID: 894
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: Unable to locate ASP page

No remote call being made

# ChildEBP RetAddr
00 01ddfe24 77d574d4 ntdll!NtReplyWaitReceivePortEx+0xb
01 01ddff74 77d56d9e RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x74
02 01ddff78 77d39ad0 RPCRT4!RecvLotsaCallsWrapper+0x9
03 01ddffa8 77d41c6c RPCRT4!BaseCachedThreadRoutine+0x11f
04 01ddffb4 77e8b2d8 RPCRT4!ThreadStartRoutine+0x18
05 01ddffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 24
System Thread ID: 83c
Kernel Time: 0:0:0.15
User Time: 0:0:0.15
Thread Type: Other
# ChildEBP RetAddr
00 01e1fe74 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 01e1fec4 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 01e1ff20 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 01e1ff3c 65f38a88 USER32!MsgWaitForMultipleObjects+0x1d
04 01e1ff80 7800c9eb w3svc!CMTACallbackThread::Thread+0x42
05 01e1ffb4 77e8b2d8 MSVCRT!_beginthread+0xce
06 01e1ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 25
System Thread ID: ab0
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 01e5fea8 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 01e5fef8 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 01e5ff54 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 01e5ff70 65f2e673 USER32!MsgWaitForMultipleObjects+0x1d
04 01e5ffb4 77e8b2d8 w3svc!OleHackThread+0x88
05 01e5ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 26
System Thread ID: 9d8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 01edfce0 74fdbcd2 ntdll!NtWaitForSingleObject+0xb
01 01edfd1c 74fd7ee6 msafd!SockWaitForSingleObject+0x1a8
02 01edfe08 75031da9 msafd!WSPSelect+0x24e
03 01edfe6c 6e2b3b6e WS2_32!select+0xe7
04 01edffb4 77e8b2d8 inetsloc!SocketListenThread+0x51
05 01edffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 27
System Thread ID: 47c
Kernel Time: 0:0:0.46
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 01f1fdfc 74fdbcd2 ntdll!NtWaitForSingleObject+0xb
01 01f1fe38 74fd7ee6 msafd!SockWaitForSingleObject+0x1a8
02 01f1ff24 75031da9 msafd!WSPSelect+0x24e
03 01f1ff88 6d7062b4 WS2_32!select+0xe7
04 01f1ffb0 6d706605 ISATQ!ATQ_BMON_SET::BmonThreadFunc+0x22
05 01f1ffb4 77e8b2d8 ISATQ!BmonThreadFunc+0x9
06 01f1ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 28
System Thread ID: 8f0
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 01f6ff54 77ea9b35 ntdll!NtWaitForSingleObject+0xb
01 01f6ff7c 77e8b32b KERNEL32!WaitForSingleObjectEx+0x71
02 01f6ff8c 741a962d KERNEL32!WaitForSingleObject+0xf
03 01f6ffb4 77e8b2d8 aqueue!CSMTP_RETRY_HANDLER::RetryThreadRoutine+0xce
04 01f6ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 29
System Thread ID: 824
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: SMTP Service Worker Thread
# ChildEBP RetAddr
00 01fefed0 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 01feff20 77ea9c13 KERNEL32!WaitForMultipleObjectsEx+0xea
02 01feff38 74190002 KERNEL32!WaitForMultipleObjects+0x17
03 01feff9c 6b56ce35 aqueue!CConnMgr::GetNextConnection+0x1da
04 01feffb4 77e8b2d8 SMTPSVC!PERSIST_QUEUE::QueueThreadRoutine+0x23
05 01feffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 30
System Thread ID: 8d0
Kernel Time: 0:0:0.0
User Time: 0:0:0.15
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 023eff08 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 023eff58 77ea9c13 KERNEL32!WaitForMultipleObjectsEx+0xea
02 023eff70 787f21d4 KERNEL32!WaitForMultipleObjects+0x17
03 023effb4 77e8b2d8 COMSVCS!CEventDispatcher::PushEvents+0x44
04 023effc0 00000008 KERNEL32!BaseThreadStart+0x52




Thread ID: 31
System Thread ID: a9c
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: Unable to locate ASP page

Remote call is either to a MTA object or object not initialized. Also,
possible utility thread.
DCOM call being made to Process ID: 1004
Waiting on thread id: ffffffff

# ChildEBP RetAddr
00 0242fb68 77d4ec77 ntdll!NtRequestWaitReplyPort+0xb
01 0242fb94 77d3a2c7 RPCRT4!LRPC_CCALL::SendReceive+0x11e
02 0242fba0 77b23b2c RPCRT4!I_RpcSendReceive+0x2c
03 0242fbc0 77b239f7 ole32!ThreadSendReceive+0xef
04 0242fbd8 77b20aa5 ole32!CRpcChannelBuffer::SwitchAptAndDispatchCall+0x14a
05 0242fc18 77b23870 ole32!CRpcChannelBuffer::SendReceive2+0x96
06 0242fc28 77a6c767 ole32!CRpcChannelBuffer::SendReceive+0x11
07 0242fc88 77ab6ac3 ole32!CAptRpcChnl::SendReceive+0xa9
08 0242fce0 77d90328 ole32!CCtxComChnl::SendReceive+0x124
09 0242fcfc 77d92b3f RPCRT4!NdrProxySendReceive+0x4c
0a 0242ff44 77d95f85 RPCRT4!NdrClientCall2+0x4f5
0b 0242ff60 77d77fcb RPCRT4!ObjectStublessClient+0x76
0c 0242ff70 787f212e RPCRT4!ObjectStubless+0xf
0d 0242ffb4 77e8b2d8
COMSVCS!CEventDispatcher::GetEventServerInfoThread+0x10e
0e 0242ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 32
System Thread ID: a24
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: ASP
Executing Page: Unable to locate ASP page

# ChildEBP RetAddr
00 0304fe74 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0304fec4 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 0304ff20 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0304ff3c 74a11086 USER32!MsgWaitForMultipleObjects+0x1d
04 0304ff80 7800c9eb asp!CMTACallbackThread::Thread+0x42
05 0304ffb4 77e8b2d8 MSVCRT!_beginthread+0xce
06 0304ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 33
System Thread ID: a38
Kernel Time: 0:0:0.15
User Time: 0:0:0.15
Thread Type: ASP
Executing Page: Unable to locate ASP page

# ChildEBP RetAddr
00 0308fe74 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 0308fec4 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 0308ff20 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 0308ff3c 74a03472 USER32!MsgWaitForMultipleObjects+0x1d
04 0308ff80 7800c9eb asp!Debugger+0x74
05 0308ffb4 77e8b2d8 MSVCRT!_beginthread+0xce
06 0308ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 34
System Thread ID: 8b8
Kernel Time: 0:0:0.46
User Time: 0:0:0.0
*** WARNING: Unable to verify checksum for
*** ERROR: Symbol file could not be found. Defaulted to export symbols for
-
Thread Type: PDM (Debugger) Thread.
# ChildEBP RetAddr
00 030cfddc 77ea9d00 ntdll!ZwWaitForMultipleObjects+0xb
01 030cfe2c 77e1e97b KERNEL32!WaitForMultipleObjectsEx+0xea
02 030cfe88 77e1e9c8 USER32!MsgWaitForMultipleObjectsEx+0x153
03 030cfea4 4a00886c USER32!MsgWaitForMultipleObjects+0x1d
04 030cff88 4a008a85 pdm+0x886c
05 030cffb0 4a008a09 pdm+0x8a85
06 030cffb4 77e8b2d8 pdm+0x8a09
07 030cffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 35
System Thread ID: a64
Kernel Time: 0:0:0.15
User Time: 0:0:0.15
Thread Type: Other
# ChildEBP RetAddr
00 0310ff9c 77fa21d2 ntdll!NtDelayExecution+0xb
01 0310ffb4 77e8b2d8 ntdll!RtlpTimerThread+0x42
02 0310ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 36
System Thread ID: c04
Kernel Time: 0:0:19.93
User Time: 0:3:6.421
*** ERROR: Symbol file could not be found. Defaulted to export symbols
or -
Thread Status: Thread is in a WAIT state.
Other information: Thread is waiting for a lock to be released. Looking for
lock owner.
The owning thread is 0. This usually indicates that the lock has either
been leaked or is in a 'convoy' state
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 0314d524 77f8f1e5 ntdll!NtWaitForSingleObject+0xb
01 0314d598 77f87e86 ntdll!RtlpWaitForCriticalSection+0x9e
02 0314d5a0 77fc8d7e ntdll!RtlEnterCriticalSection+0x46
03 0314d744 77a652d2 ntdll!RtlAllocateHeap+0xfe
04 0314d754 77a0f9cf ole32!CRetailMalloc_Alloc+0x12
05 0314d764 779d93eb OLEAUT32!APP_DATA::AllocCachedMem+0x42
06 0314d77c 77a3099b OLEAUT32!SysAllocStringByteLen+0x5b
07 0314d798 6a9f4d81 OLEAUT32!VarBstrCat+0x33
08 0314d7ac 063a5f52 MSVBVM60!__vbaStrCat+0x13
09 0314d844 063a650f MACCADDB!SOCClassificationDB::addClassNameTag+0x162
0a 0314dcac 05fe7cc1 MACCADDB!SOCClassificationDB::getMajorGroupList+0x4ff
0b 0314e11c 779d7b9d MACCADBU!SOCClassificationBU::getMajorGroupList+0x7b1
0c 0314e140 6a9f9bdf OLEAUT32!DispCallFunc+0x15d
0d 0314ea9c 6a9f99d8 MSVBVM60!EpiInvokeMethod+0x1e1
0e 0314eaf8 02f24279 MSVBVM60!BASIC_CLASS_Invoke+0x52
WARNING: Stack unwind information not available. Following frames may be
wrong.
0f 0314eb74 02f2866f vbscript!DllCanUnloadNow+0x8e24
10 0314f254 00000000 vbscript!DllCanUnloadNow+0xd21a




Thread ID: 37
System Thread ID: 8f8
Kernel Time: 0:0:29.187
User Time: 0:5:6.375
Thread Status: Thread is in a WAIT state.
Other information: Thread is waiting for a lock to be released. Looking for
lock owner.
The owning thread is 0. This usually indicates that the lock has either
been leaked or is in a 'convoy' state
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 0318eb4c 77f8f1e5 ntdll!NtWaitForSingleObject+0xb
01 0318ebc0 77f87e86 ntdll!RtlpWaitForCriticalSection+0x9e
02 0318ebc8 77fc96a4 ntdll!RtlEnterCriticalSection+0x46
03 0318ec64 77a652ee ntdll!RtlFreeHeap+0xda
04 0318ec74 77a0f97f ole32!CRetailMalloc_Free+0x19
05 0318ec94 779d9267 OLEAUT32!APP_DATA::FreeCachedMem+0x85
06 0318eca4 779db652 OLEAUT32!SysFreeString+0x57
07 0318ecb8 02f274b7 OLEAUT32!VariantClear+0x72
WARNING: Stack unwind information not available. Following frames may be
wrong.
08 0318eccc 02f3adf0 vbscript!DllCanUnloadNow+0xc062
09 07948c98 00000000 vbscript!DllCanUnloadNow+0x1f99b




Thread ID: 38
System Thread ID: 8fc
Kernel Time: 0:0:26.937
User Time: 0:4:49.500
Thread Status: Thread is in a WAIT state.
Other information: Thread is waiting for a lock to be released. Looking for
lock owner.
The owning thread is 0. This usually indicates that the lock has either
been leaked or is in a 'convoy' state
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 031cd2a0 77f8f1e5 ntdll!NtWaitForSingleObject+0xb
01 031cd314 77f87e86 ntdll!RtlpWaitForCriticalSection+0x9e
02 031cd31c 77fc96a4 ntdll!RtlEnterCriticalSection+0x46
03 031cd3b8 77a652ee ntdll!RtlFreeHeap+0xda
04 031cd3c8 77a66d8a ole32!CRetailMalloc_Free+0x19
05 031cd3d4 1f5d1bf9 ole32!CoTaskMemFree+0xf
06 031cd410 1f5e0126 msdaprst!CMetaData::~CMetaData+0x13
07 031cd418 1f5e32fe msdaprst!CRowInfo::`scalar deleting destructor'+0x8
08 031cd444 1f44688c msdaprst!CPersistStreamInit::Save+0x1cc
09 031cd4ac 1f45bb62 msado15!CRecordset::SaveToStream+0x221
0a 031cd5b8 047262ce msado15!CRecordset::Save+0x200
0b 031cd828 0c153d3c MACCDal!Dal::runSPReturnXML+0xe7e
0c 031cdca0 0be4f7b3 MACCJSDB!JobSeekerDB::getDetail+0x5ec
0d 031ce118 779d7b9d MACCJSBU!JobSeekerBU::getDetail+0x7c3
0e 031ce140 6a9f9bdf OLEAUT32!DispCallFunc+0x15d
0f 031cea9c 6a9f99d8 MSVBVM60!EpiInvokeMethod+0x1e1
10 031ceaf8 02f24279 MSVBVM60!BASIC_CLASS_Invoke+0x52
WARNING: Stack unwind information not available. Following frames may be
wrong.
11 031ceb74 02f2866f vbscript!DllCanUnloadNow+0x8e24
12 031cf254 004f0052 vbscript!DllCanUnloadNow+0xd21a
13 00500000 00000000 0x4f0052




Thread ID: 39
System Thread ID: 9ac
Kernel Time: 0:0:28.125
User Time: 0:4:58.515
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 0320ec70 74a18b98 asp!CResponseBuffer::Write+0x3c
01 0320ec84 74a18d15 asp!CResponse::WriteSz+0x46
02 0320eca8 74a18865 asp!CResponse::WriteBSTR+0x139
03 0320ecd0 02f3f3fe asp!CResponse::Write+0x47
WARNING: Stack unwind information not available. Following frames may be
wrong.
04 0320f2c8 02f3d316 vbscript!DllCanUnloadNow+0x23fa9
05 0320f9b8 02f3d316 vbscript!DllCanUnloadNow+0x21ec1
06 00000000 00000000 vbscript!DllCanUnloadNow+0x21ec1




Thread ID: 40
System Thread ID: 880
Kernel Time: 0:0:27.125
User Time: 0:4:46.921
Thread Status: Thread is in a WAIT state.
Other information: Thread is waiting for a lock to be released. Looking for
lock owner.
The owning thread is 0. This usually indicates that the lock has either
been leaked or is in a 'convoy' state
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 0324ddc8 77f8f1e5 ntdll!NtWaitForSingleObject+0xb
01 0324de3c 77f87e86 ntdll!RtlpWaitForCriticalSection+0x9e
02 0324de44 77fc96a4 ntdll!RtlEnterCriticalSection+0x46
03 0324dee0 77a652ee ntdll!RtlFreeHeap+0xda
04 0324def0 77a0f97f ole32!CRetailMalloc_Free+0x19
05 0324df10 779d9267 OLEAUT32!APP_DATA::FreeCachedMem+0x85
06 0324df20 6a9f4155 OLEAUT32!SysFreeString+0x57
07 0324df2c 0b51ee78 MSVBVM60!__vbaFreeStr+0x10
08 0324e0d8 779d7b9d MACCError!ErrorHandler::logASPError+0x32e8
09 0324e140 6a9f9bdf OLEAUT32!DispCallFunc+0x15d
0a 0324ea9c 6a9f99d8 MSVBVM60!EpiInvokeMethod+0x1e1
0b 0324eaf8 02f24279 MSVBVM60!BASIC_CLASS_Invoke+0x52
WARNING: Stack unwind information not available. Following frames may be
wrong.
0c 0324eb74 02f2866f vbscript!DllCanUnloadNow+0x8e24
0d 00000000 00000000 vbscript!DllCanUnloadNow+0xd21a




Thread ID: 41
System Thread ID: bcc
Kernel Time: 0:0:26.359
User Time: 0:4:51.921
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 032cddbc 6a9f9320 MSVBVM60!CClassModule::InternalQueryInterface+0x91
01 032cddc8 6a9ed340 MSVBVM60!CClassModule::CUnkPrivate::QueryInterface+0x14
02 032cddec 77ac0823
MSVBVM60!BASIC_CLASS::PRIVATE_UNKNOWN::QueryInterface+0x178
03 032cde0c 77ac0508 ole32!CreateInprocInstanceHelper+0x4a
04 032cdec8 77a6be58 ole32!ICoCreateInstanceEx+0x134
05 032cdef0 6aa169c8 ole32!CoCreateInstanceEx+0x2b
06 032cdf60 6a9f3f78 MSVBVM60!RcmConstructObjectInstance_54+0x112
07 032cdf98 1101186d MSVBVM60!__vbaNew+0x21
08 032ce120 779d7b9d MACCSession!Session::find+0xfd
09 032ce140 6a9f9bdf OLEAUT32!DispCallFunc+0x15d
0a 032cea9c 6a9f99d8 MSVBVM60!EpiInvokeMethod+0x1e1
0b 032ceaf8 02f24279 MSVBVM60!BASIC_CLASS_Invoke+0x52
WARNING: Stack unwind information not available. Following frames may be
wrong.
0c 032ceb74 02f2866f vbscript!DllCanUnloadNow+0x8e24
0d 032cf254 00000000 vbscript!DllCanUnloadNow+0xd21a




Thread ID: 42
System Thread ID: b24
Kernel Time: 0:0:28.968
User Time: 0:4:54.609
Thread Type: ASP
Executing Page: D:\WWWROOT\WIAWEB\MACC\WEB SITES\PUBLICSITE\DEFAULT.ASP

# ChildEBP RetAddr
00 0330d7c0 1f435e72 MSWSTR10!DBLCMapStringW+0x28
01 0330d7e0 1f435deb msado15!LCMapStringWin95NT+0x38
02 0330d80c 1f44473f msado15!CSortKey::Create+0x63
03 0330dc30 1f435fcd msado15!CCollectionMap::LookUp+0x2e
04 0330dc50 1f43c6d5 msado15!CStdCollection::LookupItem+0x87
05 0330dc90 11015683 msado15!CRsetFields::get_Item+0x21
06 0330de20 11014cd9 MACCSession!Session::getSecurityToken+0x2a3
07 0330dff0 11009d9c MACCSession!Session::getUserDetailByCredentials+0xeb9
08 0330e124 779d7b9d MACCSession!Session::create+0x2cc
09 0330e140 6a9f9bdf OLEAUT32!DispCallFunc+0x15d
0a 0330ea9c 6a9f99d8 MSVBVM60!EpiInvokeMethod+0x1e1
0b 0330eaf8 02f24279 MSVBVM60!BASIC_CLASS_Invoke+0x52
WARNING: Stack unwind information not available. Following frames may be
wrong.
0c 0330eb74 02f2866f vbscript!DllCanUnloadNow+0x8e24
0d 0330f254 00000000 vbscript!DllCanUnloadNow+0xd21a




Thread ID: 43
System Thread ID: 990
Kernel Time: 0:0:28.500
User Time: 0:4:53.500
Thread Status: Thread is in a WAIT state.
Other information: Thread is waiting for a lock to be released. Looking for
lock owner.
The owning thread is 0. This usually indicates that the lock has either
been leaked or is in a 'convoy' state
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 0334eb4c 77f8f1e5 ntdll!NtWaitForSingleObject+0xb
01 0334ebc0 77f87e86 ntdll!RtlpWaitForCriticalSection+0x9e
02 0334ebc8 77fc96a4 ntdll!RtlEnterCriticalSection+0x46
03 0334ec64 77a652ee ntdll!RtlFreeHeap+0xda
04 0334ec74 77a0f97f ole32!CRetailMalloc_Free+0x19
05 0334ec94 779d9267 OLEAUT32!APP_DATA::FreeCachedMem+0x85
06 0334eca4 779db652 OLEAUT32!SysFreeString+0x57
07 0334ecb8 02f274b7 OLEAUT32!VariantClear+0x72
WARNING: Stack unwind information not available. Following frames may be
wrong.
08 0334eccc 02f3adf0 vbscript!DllCanUnloadNow+0xc062
09 00e58fe0 00000000 vbscript!DllCanUnloadNow+0x1f99b




Thread ID: 44
System Thread ID: 8d8
Kernel Time: 0:0:28.171
User Time: 0:4:54.15
Thread Status: Thread is in a WAIT state.
Other information: Thread is waiting for a lock to be released. Looking for
lock owner.
The owning thread is 0. This usually indicates that the lock has either
been leaked or is in a 'convoy' state
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 033ce45c 77f8f1e5 ntdll!NtWaitForSingleObject+0xb
01 033ce4d0 77f87e86 ntdll!RtlpWaitForCriticalSection+0x9e
02 033ce4d8 77fc96a4 ntdll!RtlEnterCriticalSection+0x46
03 033ce574 77a652ee ntdll!RtlFreeHeap+0xda
04 033ce584 77a0f97f ole32!CRetailMalloc_Free+0x19
05 033ce5a4 779d9267 OLEAUT32!APP_DATA::FreeCachedMem+0x85
06 033ce5b4 779db652 OLEAUT32!SysFreeString+0x57
07 033ce5c8 02f274b7 OLEAUT32!VariantClear+0x72
WARNING: Stack unwind information not available. Following frames may be
wrong.
08 033ce5dc 02f3adf0 vbscript!DllCanUnloadNow+0xc062
09 00e84780 00000000 vbscript!DllCanUnloadNow+0x1f99b




Thread ID: 45
System Thread ID: a80
Kernel Time: 0:0:27.62
User Time: 0:4:46.625
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 00004264 00000000 vbscript!DllCanUnloadNow+0x21862




Thread ID: 46
System Thread ID: b0c
Kernel Time: 0:0:26.171
User Time: 0:4:42.984
Thread Status: Thread is in a WAIT state.
Other information: Thread is waiting for a lock to be released. Looking for
lock owner.
The owning thread is 0. This usually indicates that the lock has either
been leaked or is in a 'convoy' state
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 0344d8f8 77f8f1e5 ntdll!NtWaitForSingleObject+0xb
01 0344d96c 77f87e86 ntdll!RtlpWaitForCriticalSection+0x9e
02 0344d974 77fc96a4 ntdll!RtlEnterCriticalSection+0x46
03 0344da10 77a652ee ntdll!RtlFreeHeap+0xda
04 0344da20 77a66d8a ole32!CRetailMalloc_Free+0x19
05 0344da2c 1f5ddc54 ole32!CoTaskMemFree+0xf
06 0344da80 1f5de066 msdaprst!CMetaData::mdGetColumnsUpdateInfo+0x2a1
07 0344dac0 1f5e20fb msdaprst!CMetaData::mdGetAllMetaData+0x38
08 0344db00 1f5e31db msdaprst!CPersistStreamInit::GatherInfo+0x2b
09 0344db30 1f44688c msdaprst!CPersistStreamInit::Save+0x77
0a 0344db98 1f45bb62 msado15!CRecordset::SaveToStream+0x221
0b 0344dca4 047262ce msado15!CRecordset::Save+0x200
0c 0344df14 0e472102 MACCDal!Dal::runSPReturnXML+0xe7e
0d 0344e390 0e3162c3 MACCEMDB!JobOrderDB::getDetail+0x5f2
0e 0344e808 779d7b9d MACCEMBU!JobOrderBU::getDetail+0x7c3
0f 0344e830 6a9f9bdf OLEAUT32!DispCallFunc+0x15d
10 0344f18c 6a9f99d8 MSVBVM60!EpiInvokeMethod+0x1e1
11 0344f1e8 02f24279 MSVBVM60!BASIC_CLASS_Invoke+0x52
WARNING: Stack unwind information not available. Following frames may be
wrong.
12 0344f264 02f2866f vbscript!DllCanUnloadNow+0x8e24
13 0344f944 00000000 vbscript!DllCanUnloadNow+0xd21a




Thread ID: 47
System Thread ID: 6b8
Kernel Time: 0:0:27.609
User Time: 0:4:48.609
*** ERROR: Symbol file could not be found. Defaulted to export symbols for
C:\WINNT\System32\msxml4.dll -
Thread Type: ASP
Executing Page:

# ChildEBP RetAddr
00 0348e1e0 03cdef8d KERNEL32!InterlockedExchange+0xe
WARNING: Stack unwind information not available. Following frames may be
wrong.
01 0348e23c 03ce3849 msxml4+0xef8d
02 0348e268 03cfbc3c msxml4!DllGetClassObject+0x3b1
03 0348e2c4 03ce3730 msxml4!DllGetClassObject+0x187a4
04 0348e2e0 03ce4870 msxml4!DllGetClassObject+0x298
05 0348e320 03ce68c8 msxml4!DllGetClassObject+0x13d8
06 0348e340 03cda12b msxml4!DllGetClassObject+0x3430
07 0348e360 03cdb5d3 msxml4+0xa12b
08 0348e3e0 03cdc162 msxml4+0xb5d3
09 0348e448 03cdc202 msxml4+0xc162
0a 0348e490 03cdc202 msxml4+0xc202
0b 0348e4d8 03ce8541 msxml4+0xc202
0c 0348e518 03d6d048 msxml4!DllGetClassObject+0x50a9
0d 0348e56c 03d38738 msxml4!DllUnregisterServer+0x2ae58
0e 0348e5dc 03d4aee9 msxml4!DllCanUnloadNow+0x12059
0f 0348e63c 03d562c0 msxml4!DllUnregisterServer+0x8cf9
10 0348e684 0b318b64 msxml4!DllUnregisterServer+0x140d0
11 0348e810 779d7b9d MACCXML!XMLController::loadXML+0xf4
12 0348e830 6a9f9bdf OLEAUT32!DispCallFunc+0x15d
13 0348f18c 6a9f99d8 MSVBVM60!EpiInvokeMethod+0x1e1
14 0348f1e8 02f24279 MSVBVM60!BASIC_CLASS_Invoke+0x52
15 0348f264 02f2866f vbscript!DllCanUnloadNow+0x8e24
16 00000000 00000000 vbscript!DllCanUnloadNow+0xd21a




Thread ID: 48
System Thread ID: 4e8
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 04d9ff88 751a44ba ntdll!ZwWaitForMultipleObjects+0xb
01 04d9ffb4 77e8b2d8 NETAPI32!NetbiosWaiter+0x71
02 04d9ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 49
System Thread ID: 9d4
Kernel Time: 0:0:1.937
User Time: 0:0:4.578
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 04ddff58 77ea9b35 ntdll!NtWaitForSingleObject+0xb
01 04ddff80 77e8b32b KERNEL32!WaitForSingleObjectEx+0x71
02 04ddff90 1f8b12e2 KERNEL32!WaitForSingleObject+0xf
03 04ddffb4 77e8b2d8 oledb32!ReleaseResourceThread+0x54
04 04ddffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 50
System Thread ID: 33c
Kernel Time: 0:0:3.250
User Time: 0:0:2.781
Thread Status: Thread is in a WAIT state.
Thread Type: Other
# ChildEBP RetAddr
00 04e1ff50 77ea9b35 ntdll!NtWaitForSingleObject+0xb
01 04e1ff78 77e8b32b KERNEL32!WaitForSingleObjectEx+0x71
02 04e1ff88 1f8b1276 KERNEL32!WaitForSingleObject+0xf
03 04e1ffb4 77e8b2d8 oledb32!ResetResourceThread+0x84
04 04e1ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 51
System Thread ID: 9c4
Kernel Time: 0:0:0.15
User Time: 0:0:0.0
Thread Status: Thread is in a WAIT state.
Thread Type: Idle ASP thread
# ChildEBP RetAddr
00 04e5fd54 77ea9b35 ntdll!NtWaitForSingleObject+0xb
01 04e5fd7c 77e8b32b KERNEL32!WaitForSingleObjectEx+0x71
02 04e5fd8c 7878d255 KERNEL32!WaitForSingleObject+0xf
03 04e5ffb4 77e8b2d8 COMSVCS!PingThread+0xf5
04 04e5ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 52
System Thread ID: 900
Kernel Time: 0:0:0.0
User Time: 0:0:0.0
Thread Type: Other
# ChildEBP RetAddr
00 05a0ff20 77fa07b7 ntdll!NtRemoveIoCompletion+0xb
01 05a0ffb4 77e8b2d8 ntdll!RtlpWorkerThread+0x6b
02 05a0ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 53
System Thread ID: a74
Kernel Time: 0:0:2.265
User Time: 0:0:2.984
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 07bdff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 07bdff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 07bdffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 07bdffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 54
System Thread ID: ae4
Kernel Time: 0:0:2.453
User Time: 0:0:3.265
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0a10ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0a10ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0a10ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0a10ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 55
System Thread ID: 1c8
Kernel Time: 0:0:3.484
User Time: 0:0:3.500
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0a14ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0a14ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0a14ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0a14ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 56
System Thread ID: 644
Kernel Time: 0:0:2.875
User Time: 0:0:3.187
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0a18ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0a18ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0a18ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0a18ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 57
System Thread ID: 274
Kernel Time: 0:0:2.890
User Time: 0:0:3.218
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0a1cff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0a1cff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0a1cffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0a1cffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 58
System Thread ID: b80
Kernel Time: 0:0:3.15
User Time: 0:0:3.375
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0a20ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0a20ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0a20ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0a20ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 59
System Thread ID: 89c
Kernel Time: 0:0:2.609
User Time: 0:0:2.750
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0a24ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0a24ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0a24ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0a24ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 60
System Thread ID: 6f0
Kernel Time: 0:0:1.984
User Time: 0:0:2.250
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0b40ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0b40ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0b40ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0b40ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 61
System Thread ID: 6ac
Kernel Time: 0:0:1.906
User Time: 0:0:2.171
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0b44ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0b44ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0b44ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0b44ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 62
System Thread ID: be0
Kernel Time: 0:0:2.937
User Time: 0:0:3.265
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0b48ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0b48ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0b48ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0b48ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 63
System Thread ID: 71c
Kernel Time: 0:0:1.781
User Time: 0:0:2.31
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0b4cff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0b4cff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0b4cffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0b4cffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 64
System Thread ID: be8
Kernel Time: 0:0:2.703
User Time: 0:0:3.31
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 0b50ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 0b50ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 0b50ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 0b50ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 65
System Thread ID: 1a0
Kernel Time: 0:0:1.296
User Time: 0:0:1.593
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 1568ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 1568ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 1568ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 1568ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 66
System Thread ID: 59c
Kernel Time: 0:0:0.421
User Time: 0:0:0.281
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 156cff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 156cff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 156cffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 156cffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 67
System Thread ID: a54
Kernel Time: 0:0:1.750
User Time: 0:0:1.984
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 1570ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 1570ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 1570ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 1570ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 68
System Thread ID: 7fc
Kernel Time: 0:0:27.531
User Time: 0:4:50.625
Thread Type: Other
# ChildEBP RetAddr
00 13d607f4 00000101 msxml4+0xf5b6




Thread ID: 69
System Thread ID: acc
Kernel Time: 0:0:0.625
User Time: 0:0:1.0
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 2433ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 2433ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 2433ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 2433ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 70
System Thread ID: 828
Kernel Time: 0:0:0.265
User Time: 0:0:0.234
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 2438ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 2438ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 2438ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 2438ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 71
System Thread ID: bac
Kernel Time: 0:0:0.437
User Time: 0:0:0.312
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 243cff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 243cff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 243cffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 243cffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 72
System Thread ID: 9f4
Kernel Time: 0:0:0.390
User Time: 0:0:0.437
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 2440ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 2440ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 2440ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 2440ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 73
System Thread ID: b68
Kernel Time: 0:0:0.625
User Time: 0:0:0.578
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 2448ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 2448ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 2448ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 2448ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 74
System Thread ID: 138
Kernel Time: 0:0:0.265
User Time: 0:0:0.406
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 2444ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 2444ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 2444ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 2444ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 75
System Thread ID: 6c8
Kernel Time: 0:0:0.281
User Time: 0:0:0.328
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 244cff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 244cff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 244cffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 244cffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 76
System Thread ID: 84c
Kernel Time: 0:0:0.359
User Time: 0:0:0.515
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 2450ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 2450ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 2450ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 2450ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 77
System Thread ID: 9dc
Kernel Time: 0:0:0.343
User Time: 0:0:0.250
Thread Type: Possible ASP page. Possible DCOM activity
Executing Page: Unable to locate ASP page

No remote call being made
# ChildEBP RetAddr
00 2f3efe24 77d574d4 ntdll!NtReplyWaitReceivePortEx+0xb
01 2f3eff74 77d56d9e RPCRT4!LRPC_ADDRESS::ReceiveLotsaCalls+0x74
02 2f3eff78 77d39ad0 RPCRT4!RecvLotsaCallsWrapper+0x9
03 2f3effa8 77d41c6c RPCRT4!BaseCachedThreadRoutine+0x11f
04 2f3effb4 77e8b2d8 RPCRT4!ThreadStartRoutine+0x18
05 2f3effec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 78
System Thread ID: 694
Kernel Time: 0:0:0.250
User Time: 0:0:0.328
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32abff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32abff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32abffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32abffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 79
System Thread ID: a1c
Kernel Time: 0:0:0.265
User Time: 0:0:0.171
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32b3ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32b3ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32b3ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32b3ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 80
System Thread ID: 8e4
Kernel Time: 0:0:0.593
User Time: 0:0:0.609
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32b7ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32b7ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32b7ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32b7ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 81
System Thread ID: 5b0
Kernel Time: 0:0:0.546
User Time: 0:0:0.718
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32bbff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32bbff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32bbffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32bbffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 82
System Thread ID: 754
Kernel Time: 0:0:0.171
User Time: 0:0:0.250
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32afff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32afff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32afffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32afffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 83
System Thread ID: 63c
Kernel Time: 0:0:0.218
User Time: 0:0:0.171
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32bfff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32bfff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32bfffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32bfffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 84
System Thread ID: b6c
Kernel Time: 0:0:0.437
User Time: 0:0:0.562
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32c3ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32c3ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32c3ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32c3ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 85
System Thread ID: c24
Kernel Time: 0:0:0.609
User Time: 0:0:0.703
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32c7ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32c7ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32c7ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32c7ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 86
System Thread ID: 9bc
Kernel Time: 0:0:0.171
User Time: 0:0:0.343
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32cbff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32cbff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32cbffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32cbffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 87
System Thread ID: ba8
Kernel Time: 0:0:0.281
User Time: 0:0:0.328
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32cfff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32cfff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32cfffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32cfffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 88
System Thread ID: c20
Kernel Time: 0:0:0.250
User Time: 0:0:0.265
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32d3ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32d3ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32d3ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32d3ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 89
System Thread ID: aec
Kernel Time: 0:0:0.328
User Time: 0:0:0.328
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32d7ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32d7ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32d7ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32d7ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 90
System Thread ID: 6c0
Kernel Time: 0:0:0.265
User Time: 0:0:0.234
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32dbff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32dbff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32dbffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32dbffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 91
System Thread ID: 718
Kernel Time: 0:0:0.265
User Time: 0:0:0.203
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32e7ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32e7ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32e7ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32e7ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 92
System Thread ID: a40
Kernel Time: 0:0:0.562
User Time: 0:0:0.515
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32e3ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32e3ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32e3ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32e3ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 93
System Thread ID: 774
Kernel Time: 0:0:0.218
User Time: 0:0:0.203
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32ebff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32ebff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32ebffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32ebffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 94
System Thread ID: b2c
Kernel Time: 0:0:0.609
User Time: 0:0:0.406
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32efff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32efff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32efffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32efffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 95
System Thread ID: 838
Kernel Time: 0:0:0.468
User Time: 0:0:0.343
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32f3ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32f3ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32f3ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32f3ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 96
System Thread ID: b34
Kernel Time: 0:0:0.500
User Time: 0:0:0.578
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32f7ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32f7ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32f7ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32f7ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 97
System Thread ID: 758
Kernel Time: 0:0:0.281
User Time: 0:0:0.312
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32fbff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32fbff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32fbffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32fbffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 98
System Thread ID: 8cc
Kernel Time: 0:0:0.359
User Time: 0:0:0.296
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32ffff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32ffff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32ffffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32ffffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 99
System Thread ID: 98
Kernel Time: 0:0:0.343
User Time: 0:0:0.531
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3303ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3303ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3303ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3303ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 100
System Thread ID: 488
Kernel Time: 0:0:0.390
User Time: 0:0:0.468
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3307ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3307ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3307ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3307ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 101
System Thread ID: 920
Kernel Time: 0:0:0.281
User Time: 0:0:0.406
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 330bff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 330bff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 330bffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 330bffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 102
System Thread ID: 8bc
Kernel Time: 0:0:0.687
User Time: 0:0:0.625
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 330fff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 330fff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 330fffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 330fffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 103
System Thread ID: 9c0
Kernel Time: 0:0:0.156
User Time: 0:0:0.453
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 32dfff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 32dfff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 32dfffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 32dfffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 104
System Thread ID: b7c
Kernel Time: 0:0:0.250
User Time: 0:0:0.156
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3313ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3313ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3313ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3313ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 105
System Thread ID: 820
Kernel Time: 0:0:0.187
User Time: 0:0:0.234
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 331bff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 331bff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 331bffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 331bffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 106
System Thread ID: 740
Kernel Time: 0:0:0.203
User Time: 0:0:0.125
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 331fff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 331fff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 331fffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 331fffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 107
System Thread ID: c10
Kernel Time: 0:0:0.546
User Time: 0:0:0.437
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3323ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3323ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3323ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3323ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 108
System Thread ID: 954
Kernel Time: 0:0:0.468
User Time: 0:0:0.484
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3327ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3327ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3327ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3327ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 109
System Thread ID: 87c
Kernel Time: 0:0:0.234
User Time: 0:0:0.218
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 332bff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 332bff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 332bffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 332bffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 110
System Thread ID: 88c
Kernel Time: 0:0:0.328
User Time: 0:0:0.250
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 332fff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 332fff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 332fffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 332fffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 111
System Thread ID: bc0
Kernel Time: 0:0:0.359
User Time: 0:0:0.468
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3317ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3317ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3317ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3317ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 112
System Thread ID: ad4
Kernel Time: 0:0:0.156
User Time: 0:0:0.218
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3333ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3333ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3333ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3333ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 113
System Thread ID: 6ec
Kernel Time: 0:0:0.406
User Time: 0:0:0.375
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3337ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3337ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3337ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3337ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 114
System Thread ID: bec
Kernel Time: 0:0:0.453
User Time: 0:0:0.281
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 333fff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 333fff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 333fffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 333fffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 115
System Thread ID: bc8
Kernel Time: 0:0:0.203
User Time: 0:0:0.250
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3343ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3343ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3343ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3343ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 116
System Thread ID: 994
Kernel Time: 0:0:0.562
User Time: 0:0:0.671
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3347ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3347ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3347ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3347ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 117
System Thread ID: 8b0
Kernel Time: 0:0:0.281
User Time: 0:0:0.281
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 333bff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 333bff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 333bffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 333bffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 118
System Thread ID: 9fc
Kernel Time: 0:0:0.343
User Time: 0:0:0.234
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 334bff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 334bff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 334bffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 334bffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 119
System Thread ID: adc
Kernel Time: 0:0:0.421
User Time: 0:0:0.390
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 334fff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 334fff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 334fffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 334fffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 120
System Thread ID: b5c
Kernel Time: 0:0:0.125
User Time: 0:0:0.171
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3353ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3353ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3353ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3353ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 121
System Thread ID: 8b4
Kernel Time: 0:0:0.406
User Time: 0:0:0.218
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3357ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3357ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3357ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3357ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 122
System Thread ID: 58c
Kernel Time: 0:0:0.218
User Time: 0:0:0.218
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 335bff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 335bff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 335bffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 335bffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 123
System Thread ID: a78
Kernel Time: 0:0:0.250
User Time: 0:0:0.296
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 335fff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 335fff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 335fffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 335fffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 124
System Thread ID: b14
Kernel Time: 0:0:0.406
User Time: 0:0:0.515
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3363ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3363ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3363ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3363ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 125
System Thread ID: 878
Kernel Time: 0:0:0.203
User Time: 0:0:0.234
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3367ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3367ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3367ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3367ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 126
System Thread ID: 90c
Kernel Time: 0:0:0.234
User Time: 0:0:0.281
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 336fff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 336fff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 336fffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 336fffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 127
System Thread ID: 884
Kernel Time: 0:0:0.328
User Time: 0:0:0.500
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 336bff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 336bff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 336bffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 336bffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 128
System Thread ID: 750
Kernel Time: 0:0:0.125
User Time: 0:0:0.140
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3373ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3373ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3373ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3373ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 129
System Thread ID: 890
Kernel Time: 0:0:0.453
User Time: 0:0:0.421
Thread Type: HTTP Listener
# ChildEBP RetAddr
00 3377ff50 77e95244 ntdll!NtRemoveIoCompletion+0xb
01 3377ff7c 6d7088db KERNEL32!GetQueuedCompletionStatus+0x27
02 3377ffb4 77e8b2d8 ISATQ!AtqPoolThread+0x40
03 3377ffec 00000000 KERNEL32!BaseThreadStart+0x52




Thread ID: 130
System Thread ID: b4c
Kernel Time: 0:0:0.265
User T...(message truncated)

 >> Stay informed about: High cpu Utilization - IISState Log 
Back to top
Login to vote
patfilot

External


Since: Aug 24, 2003
Posts: 1478



(Msg. 2) Posted: Wed Mar 17, 2004 10:44 pm
Post subject: Re: High cpu Utilization - IISState Log [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

On the good news side, I don't see any evidence of a bug. What I do see is
a relatively busy server that appears to have some relatively expensive code
paths.

Quite a few threads were busy doing string concatenation. It is important
to note that in VB & VBScript every '&' and '+' requires the entry/exit of 6
locks. Not only that, but strings become exponentially more expensive as
they grow in size (after the size passes 100k or so). If a lot of threads
are doing string concatenations, then the locks start to experience a
'convoy' (kind of like floating the valves in an engine). This is
happening.

What can be done?

Start looking in the VB dll's and VBScript and identify extraneous '&' and
'+'. A lot of times, these are added at a programmer's convenience:

str = "My String"
str = str + " is short"

instead of having just one line. Also, you want to look for string
manipulation in a loop. It's OK to do it, but you need to understand the
expense and make sure that there are as few concats as possible.

Pat

 >> Stay informed about: High cpu Utilization - IISState Log 
Back to top
Login to vote
anonymous1454

External


Since: Mar 17, 2004
Posts: 9



(Msg. 3) Posted: Thu Mar 18, 2004 8:11 am
Post subject: Re: High cpu Utilization - IISState Log [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Pat,
I can't thank you enough for your expertise on this matter. You have literally saved me hours, if not days, of banging my head against the wall over this problem. I feel liek I shoud be sending you my first born child or something.Smile

Again, many thanks.

Dave
 >> Stay informed about: High cpu Utilization - IISState Log 
Back to top
Login to vote
kenremove

External


Since: Aug 23, 2003
Posts: 3041



(Msg. 4) Posted: Thu Mar 18, 2004 6:26 pm
Post subject: Re: High cpu Utilization - IISState Log [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

In addition to Pat's comments, check out:
http://support.microsoft.com/?id=170964

If you want a test comparing concatenation -vs- just doing Response.Write(),
check out:
http://www.adopenstatic.com/experiments/stringconcatenation.asp
(note: you need to have Response Buffering on, otherwise using
Response.Write() a lot will be slow as well)

Cheers
Ken

"Pat [MSFT]" <patfilot.TakeThisOut@online.microsoft.com> wrote in message
news:ejeMNtJDEHA.2768@tk2msftngp13.phx.gbl...
: On the good news side, I don't see any evidence of a bug. What I do see
is
: a relatively busy server that appears to have some relatively expensive
code
: paths.
:
: Quite a few threads were busy doing string concatenation. It is important
: to note that in VB & VBScript every '&' and '+' requires the entry/exit of
6
: locks. Not only that, but strings become exponentially more expensive as
: they grow in size (after the size passes 100k or so). If a lot of threads
: are doing string concatenations, then the locks start to experience a
: 'convoy' (kind of like floating the valves in an engine). This is
: happening.
:
: What can be done?
:
: Start looking in the VB dll's and VBScript and identify extraneous '&' and
: '+'. A lot of times, these are added at a programmer's convenience:
:
: str = "My String"
: str = str + " is short"
:
: instead of having just one line. Also, you want to look for string
: manipulation in a loop. It's OK to do it, but you need to understand the
: expense and make sure that there are as few concats as possible.
:
: Pat
:
:
 >> Stay informed about: High cpu Utilization - IISState Log 
Back to top
Login to vote
anonymous1454

External


Since: Mar 17, 2004
Posts: 9



(Msg. 5) Posted: Thu Mar 18, 2004 6:26 pm
Post subject: Re: High cpu Utilization - IISState Log [Login to view extended thread Info.]
Archived from groups: per prev. post (more info?)

Ken,
Thanks to you too for posting those resources. Will pas them on to the programmers for their review.

Dave
 >> Stay informed about: High cpu Utilization - IISState Log 
Back to top
Login to vote
Display posts from previous:   
   Web Hosting Problem Solving Community! (Home) -> IIS All times are: Pacific Time (US & Canada) (change)
Page 1 of 1

 
You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum



[ Contact us | Terms of Service/Privacy Policy ]