WLM Delay Monitoring for z/OS

WebSphere® Application Server for z/OS® uses Workload Manager (WLM) services to report transaction begin-to-end response times and execution delay times.

The WLM data collected by Resource Measurement Facility (RMF™) is captured in two phases of the RMF report:
  • BTE - the begin-to-end phase applies to requests handled by the controller
  • EXE - the execution phase applies to requests handled by the servant
You can use this status information to determine where possible performance bottlenecks are occurring. This feature is available on z/OS V1R2 and above with WLM APAR OW51848 and RMF APAR OW52227.

For details on workload management, see z/OS MVS™ Planning: Workload Management. For details on WLM delay monitoring, refer to z/OS MVS Programming: Workload Management Services. Both are available on the z/OS Internet Library Web site.

When a new transaction enters the system, the WebSphere Application Server for z/OS application control region (ACR) starts the classify service. Delays associated with the WebSphere Application Server for z/OS ACR service class are counted separately for the BTE phase and the EXE phase. This support allows WLM to associate a performance block (PB) with an enclave to record delays that occur in the flow of a transaction. The state samples are collected on an ongoing basis and reported as a percentage of average transaction response time. The following table shows the states, their codes, the section of the RMF report where each is reported, the meaning, and suggested response.

Table 1. WLM delay monitoring states. You can use this information in the RMF report to determine where some of your system's performance problems may be occurring.
State Code Report Meaning Response
ACTIVE ACTIVE SUB Both BTE and EXE WebSphere is actively processing request
ACTIVE_APPLIC ACTIVE APPL Both BTE and EXE Application is running Use application monitoring tool to determine the cause of the delay.
[may2010] WAITING TYPE1 [may2010]
may2010
[may2010] TYP1 [may2010]
may2010
  [may2010] Not used [may2010]
may2010
[may2010] [may2010]
may2010
[may2010] WAITING TYPE2 [may2010]
may2010
[may2010] TYP2 [may2010]
may2010
  [may2010] Not used [may2010]
may2010
 
[may2010] WAITING TYPE3 [may2010]
may2010
[may2010] TYP3 [may2010]
may2010
  [may2010] Not used [may2010]
may2010
[may2010] [may2010]
may2010
WAITING TYPE 4 TYP4 BTE OTS call to RRS. Occurs only in controller when controller is trying to commit a distributed transaction.
  1. Investigate the delay on the other server.
  2. Look for any network problems.
  3. Consider combining application into one server to avoid delay.
[may2010] WAITING REGIST TO WORKTABLE [may2010]
may2010
[may2010] WORK [may2010]
may2010
  [may2010] Not used [may2010]
may2010
 
[may2010] WAITING OTHER_PRODUCT [may2010]
may2010
[may2010] OTHER [may2010]
may2010
  [may2010] Not used [may2010]
may2010
 
WAITING DISTRIB DIST BTE Controller as a client went outbound waiting for a response.
  1. Investigate the delay on the other server.
  2. Look for network problems.
  3. Consider combining application into one server to avoid delay.
[may2010] WAITING SESS_NETWORK [may2010]
may2010
[may2010] REMT [may2010]
may2010
  [may2010] Not used [may2010]
may2010
 
[may2010] WAITING SESS_SYSPLEX [may2010]
may2010
[may2010] SYSP [may2010]
may2010
  [may2010] Not used [may2010]
may2010
 
WAITING REGULAR_THREAD REGT BTE Waiting for a thread in the controller. Work is bottle-necked in the controller because it is receiving more requests than it can process. Split the controller.
WAITING SSL_THREAD SSLT BTE Waiting for an SSL thread in the controller. Work is bottle-necked in the controller because it is receiving more requests for SSL handshakes than it can process. Split controller to increase SSL threads.
  1. Increase SSL threads.
  2. Look at SSL configuration.
  3. Split the controller to increase SSL threads.
[may2010] WAITING SESS_LOCALMVS [may2010]
may2010
[may2010] LOCL [may2010]
may2010
  [may2010] Not used [may2010]
may2010
[may2010] [may2010]
may2010
[may2010] WAITING TYPE6 [may2010]
may2010
[may2010] TYP6 [may2010]
may2010
[may2010] EXE [may2010]
may2010
[may2010] Indicates a delay in ZIOP processing. [may2010]
may2010
[may2010] Contact IBM Support for assistance. [may2010]
may2010
[may2010] WAITING TYPE7 [may2010]
may2010
[may2010] TYP7 [may2010]
may2010
[may2010] BTE [may2010]
may2010
[may2010] Indicates a configuration problem in DNS or TCP/IP [may2010]
may2010
[may2010]
  1. Make sure all of the DNS servers are running.
  2. Look at OPING or ONSLOOKUP.
[may2010]
may2010
[may2010] WAITING TYPE8 [may2010]
may2010
[may2010] TYP8 [may2010]
may2010
[may2010] EXE [may2010]
may2010
[may2010] J2C Resource manager delay [may2010]
may2010
[may2010]
  1. Call a J2C connector to resource managers such as DB2, IMS, and CICS.
  2. Check other resource managers using their monitoring tools.
[may2010]
may2010
[may2010] WAITING TYPE9 [may2010]
may2010
[may2010] TYP9 [may2010]
may2010
  [may2010] Not used [may2010]
may2010
[may2010] [may2010]
may2010
[may2010] WAITING TYPE10 [may2010]
may2010
[may2010] TY10 [may2010]
may2010
[may2010] EXE [may2010]
may2010
[may2010] Servant called to the CR to perform one of the following actions:
  1. LocateFunction
  2. ControlFunction
  3. FlushService
  4. FRCAService
  5. PushService
  6. GIOPOutboundResponseFragmentService
  7. GIOPOutboundRequestFragmentService
  8. SIBusMessageListenerDispatch
[may2010]
may2010
[may2010] Check for a delay in the controller. [may2010]
may2010
[may2010] WAITING TYPE11 [may2010]
may2010
[may2010] TY11 [may2010]
may2010
[may2010] EXE [may2010]
may2010
[may2010] Servant issued a call to the controller, and the controller then issued a call to a different distributed object server using RMI/IIOP. [may2010]
may2010
[may2010]
  1. Investigate the delay on the other server. The delay might point to session caches.
  2. Look for network problems.
  3. Avoid outbound calls.
[may2010]
may2010
[may2010] WAITING TYPE12 [may2010]
may2010
[may2010] TY12 [may2010]
may2010
  [may2010] Not used [may2010]
may2010
[may2010] [may2010]
may2010
[may2010] WAITING TYPE13 [may2010]
may2010
[may2010] TY13 [may2010]
may2010
  [may2010] Not used [may2010]
may2010
[may2010] [may2010]
may2010
[may2010] WAITING TYPE14 [may2010]
may2010
[may2010] TY14 [may2010]
may2010
  [may2010] Not used [may2010]
may2010
[may2010] [may2010]
may2010
[may2010] WAITING TYPE15 [may2010]
may2010
[may2010] TY15 [may2010]
may2010
  [may2010] Not used [may2010]
may2010
[may2010] [may2010]
may2010



Subtopics
RMF report examples
Related tasks
Monitoring overall system health
Reference topic    

Terms of Use | Feedback

Last updated: Oct 22, 2010 12:21:29 AM CDT
http://www14.software.ibm.com/webapp/wsbroker/redirect?version=compass&product=was-nd-zos&topic=rprf_wlmdm
File name: rprf_wlmdm.html