MustGather: No response (hang) or performance degradation on HP-UX
 Technote (troubleshooting)
 
Problem(Abstract)
Collecting data for problems when IBM® WebSphere® Application Server is not responding (hangs) on the HP-UX platform. Gathering this MustGather information before calling IBM support will help you understand the problem and save time analyzing the data.
 
Resolving the problem
This list documents is what is needed to troubleshoot a stalled Java™ virtual machine (JVM) on HP-UX platforms.

If you have already contacted support, continue on to the Hang/Performance degradation MustGather information. Otherwise, refer to MustGather: Read first for all WebSphere Application Server products.

Hangs/Performance Degradation specific MustGather information

  1. Follow these instructions for initial environment set up before you re-create the hang problem:
    1. If possible, follow instructions on How to enable verbosegc on WebSphere Application Server before recreating the problem.

    2. Synchronize clocks on all Web server and WebSphere Application Server systems. If clocks on the Web server and WebSphere Application Server systems were not synchronized for some reason, provide information about which clock was faster and what was the difference.

    3. If possible, clean all Web server, plug-in and WebSphere Application Server and FFDC logs.

  2. At the next occurrence of the hang, do the following on the Application Server system:
    1. netstat -an > netstat.out
      If the Web server is remote, gather netstat output on the Application Server system and the Web server systems.

    2. vmstat 5 12 >> vmstat.log

    3. ps -ef > ps_ef.txt

    4. Check to see if you can serve a static .html document from the Web server.

    5. Check to see if you can serve dynamic documents such as servlets or JSPs when bypassing the Web server and WebSphere Application Server plug-in.

    6. kill -3 [PID of hung JVM]

    7. Wait two minutes.

    8. kill -3 [PID of hungJVM ]

    9. Wait two minutes.

    10. kill -3 [PID of hungJVM]

    11. Wait two minutes.

    12. netstat -an > netstat2.out

  3. Gather the following files:
For WebSphere Application Server V6.0 release:
  • The server.xml file located in the install_root/profiles/profile_name/config/cells/cell_name
    /nodes/node_name/servers/server_name
  • plugin-cfg.xml and http_plugin.log
  • Everything in the install_root/profiles/profile_name/logs/server_name directory
  • Everything in the install_root/profiles/profile_name/logs/ffdc directory
  • All documents requested for all releases later in this document

For WebSphere Application Server V5.0 and V5.1 releases:
  • The server.xml file located in the install_root/config/cells/nodes/node_name/servers/server_name directory
  • plugin-cfg.xml and http_plugin.log
  • Everything in the install_root/logs/server_name directory
  • Everything in the install_root/logs/ffdc directory.
  • All documents requested for all releases later in this document

For all releases
  • ps_ef.txt
  • All netstat*.out files
  • All vmstat*.out files
  • Web server's access and error logs
  • If the Web server is remote, send the appropriate file from the Web server system including Web server configuration files and Web server logs. For example for IBM HTTP Server and Apache Web server, provide httpd.conf, access and error logs, for Sun ONE 6 webserver provide magnus.conf, obj.conf, access and error logs.

4. Follow the instructions in Exchanging information with IBM Technical Support.

If you want to analyze the Java thread dumps yourself, you can use ThreadAnalyzer tool that is shipped with IBM Support Assistant. ThreadAnalyzer is a technology preview that can analyze thread dumps from WebSphere Application Server. It is useful for identifying deadlocks, contention, and bottlenecks, as well as summarizing the state of threads within WebSphere Application Server.

For a listing of all technotes, downloads, and educational materials specific to the Hangs/Performance Degradation component, search the WebSphere Application Server support site.

 
Related information
ThreadAnalyzer Technology Preview
Exchanging information with IBM Technical Support
Steps to get support for WebSphere Application Server
MustGather: Read first for WebSphere Application Server
Troubleshooting Guide for WebSphere Application Server
 
 
Cross Reference information
Segment Product Component Platform Version Edition
Application Servers Runtimes for Java Technology Java SDK
 
 


Document Information


Product categories: Software > Application Servers > Distributed Application & Web Servers > WebSphere Application Server > Hangs/Performance Degradation
Operating system(s): HP-UX
Software version: 6.0
Software edition:
Reference #: 1127574
IBM Group: Software Group
Modified date: Feb 2, 2007