Fix (APAR):  PK45090

Status:  Fix

Release:  6.1.0.3

Operating System:  AIX,HP-UX,i5/OS,Linux,Linux pSeries,Linux Red Hat - pSeries,Linux zSeries,OS/390,OS/400,Solaris,Windows,z/OS

Supersedes Fixes:  

CMVC Defect:  PK45090

Byte size of APAR:  38639

Date: 2007-06-21

Abstract:  When searching for users in a large LDAP repository the system runs out of memory.

Description/symptom of problem:  
PK45090 resolves the following problem:

ERROR DESCRIPTION:                                              
When searching for users with the wildcard * against a large    
repository in the Administrative Console a                      
java.lang.OutOfMemoryError can occur.                           

LOCAL FIX:                                                      
None                                                            

PROBLEM SUMMARY

USERS AFFECTED:
This affects IBM Websphere Application
Server version 6.1 users who use federated
repositories (virtual member manager).

PROBLEM DESCRIPTION:
When searching for users in a large
LDAP repository the system runs
out of memory.

RECOMMENDATION:
None

When virtual member manager (VMM) searches an LDAP repository
that contains a large number of users, it does not honor
the 'Maximum results' setting, and may run out of memory.

For example, if one searches for users in the administrative
console using the wildcard '*' and sets the 'Maximim results'
to 100, the search results will not be limited to 100, and
the exception java.lang.OutOfMemory may be reported, if the
repository contains a large number of users.

This problem can occur by using the 'Manage Users' panel
in the Websphere Application Server adminisrtative console,
or by directly calling the VMM APIs.


PROBLEM CONCLUSION:                                             
The problem has been fixed.  VMM will now honor the maximum     
search results specified for the search request.  If the        
repository contains 10000 users, but the maximum search         
results is set to 100, then only 100 users will be returned.    
                                                                
This fix is targeted for fixpack 6.1.0.11.                      
Please refer to the recommended updates page for delivery       
information:                                                    
http://www-1.ibm.com/support/docview.wss?rs=180&uid=swg27004980 

Directions to apply fix:  Fix applies to Editions:
Release 6.1
x_ Application Server (Express or BASE)
x_ Network Deployment (ND)

Install Fix to:
Method:
__ Application Server Nodes
__ Deployment Manager Nodes
x_ Both

NOTE:
The user must:
* Have Administrative rights in Windows, or be the Actual Root User in a UNIX environments.
* Logged in with the same authority level when unpacking a fix, fix pack or refresh pack.
* Be at V6.1.0.1 or newer of the Update Installer. This can be checked by reviewing the level of the Update Installer in file <was_root>/updateinstaller/version.txt.

The Update Installer can be downloaded from the following link:
http://www.ibm.com/support/docview.wss?rs=180&uid=swg21205991

For detailed instructions to Extract the Update Installer see the following Technote:
http://www-1.ibm.com/support/docview.wss?rs=180&uid=swg21205400

1) Copy 6.1.0.0-WS-WAS-IFPK45090.pak file directly to the maintenance directory

2) Shutdown WebSphere
Manually execute setupCmdLine.bat in Windows or . ./setupCmdLine.sh in Unix from the WebSphere instance that maintenance is being applied to.

3) Launch Update Installer

4) Enter the installation location of the WebSphere product you want to update.

5) Select the "Install maintenance package" operation.

6) Enter the file name of the maintenance package to install (6.1.0.0-WS-WAS-IFPK45090.pak file which was copied in the maintenance directory).

7) Install the maintenance package.

8) Restart WebSphere

Directions to remove fix:  NOTE:
* The user must have Administrative rights in Windows, or be the Actual Root User in a UNIX environments.
* FIXES MUST BE REMOVED IN THE ORDER THEY WERE APPLIED
* DO NOT REMOVE A FIX UNLESS ALL FIXES APPLIED AFTER IT HAVE FIRST BEEN REMOVED
* YOU MAY REAPPLY ANY REMOVED FIX

Example: If your system has fix1, fix2, and fix3 applied in that order and fix2 is to be removed, fix3 must be removed first, fix2 removed, and fix3 re-applied.

1) Shutdown WebSphere
Manually execute setupCmdLine.bat in Windows or . ./setupCmdLine.sh in Unix from the WebSphere instance that uninstall is being run against.

2) Start Update Installer

3) Enter the installation location of the WebSphere product you want to remove the fix.

4) Select  "Uninstall maintenance package" operation.

5) Enter the file name of the maintenance package to uninstall (6.1.0.0-WS-WAS-IFPK45090.pak).

6) UnInstall maintenance package.

7) Restart WebSphere

Directions to re-apply fix:  1) Shutdown WebSphere.

2) Follow the Fix instructions to apply the fix.

3) Restart WebSphere.

Additional Information:  This fix prereqs PK38815.  Please apply it first.