eFix (APAR): PQ65264 Status: efix Release: WebSphere 4.0.2 Operating System: All Supersedes eFixes: None; But this efix has include efixes PQ54436, PQ52939, PQ61243, PQ63548, d138696, and d138170 CMVC defect: PQ65264 Byte size of APAR: 1,117,352 Date: 8/15/2002 Title: PQ63548 Abstract: WLM and Security enabled ORB client hangs on operation of read__com_ibm_ejs_sm_beans_SeriousEvent__com_ibm_ejs_sm_beans_SeriousEvent__long when adminServer was purposely brought down. Description/symptom of problem: Thread stack dump from the hung client process "Thread-4" (TID:0x901508, sys_thread_t:0x22D40F58, state:CW, native ID:0x92C) prio=5 at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java:429) at com.ibm.rmi.util.Condition.wait(Condition.java:32) at com.ibm.CORBA.iiop.IIOPConnection.writeLock(IIOPConnection.java:1306) at com.ibm.CORBA.iiop.IIOPConnection.writeLock(IIOPConnection.java:1283) at com.ibm.CORBA.iiop.IIOPConnection.send(IIOPConnection.java:1495) at com.ibm.CORBA.iiop.IIOPConnection.locate(IIOPConnection.java:2011) at com.ibm.CORBA.iiop.GIOPImpl.locate(GIOPImpl.java:189) at com.ibm.CORBA.iiop.ClientDelegate.createRequest(ClientDelegate.java:1155) at com.ibm.CORBA.iiop.ClientDelegate.non_existent(ClientDelegate.java:1687) at org.omg.CORBA.portable.ObjectImpl._non_existent(ObjectImpl.java:92) at com.ibm.ISecurityLocalObjectBaseL13Impl.VaultImpl.init_security_context(VaultImpl.java:2930) at com.ibm.ISecurityLocalObjectBaseL13Impl.SecurityConnectionInterceptor.establishSecurityContext(SecurityConnectionInterceptor.java:913) at com.ibm.ISecurityLocalObjectBaseL13Impl.SecurityConnectionInterceptor.getSecureAssociation(SecurityConnectionInterceptor.java:2309) at com.ibm.ISecurityLocalObjectBaseL13Impl.SecurityConnectionInterceptor.getConnectionKey(SecurityConnectionInterceptor.java:1579) at com.ibm.CORBA.iiop.ConnectionTable.get(ConnectionTable.java:334) at com.ibm.CORBA.iiop.GIOPImpl.createRequest(GIOPImpl.java:152) at com.ibm.CORBA.iiop.GIOPImpl.createRequest(GIOPImpl.java:133) at com.ibm.CORBA.iiop.ClientDelegate.createRequest(ClientDelegate.java:1080) at com.ibm.CORBA.iiop.ClientDelegate.request(ClientDelegate.java:1877) at org.omg.CORBA.portable.ObjectImpl._request(ObjectImpl.java:245) at com.ibm.ejs.sm.beans._SeriousEventReader_Stub.read(_SeriousEventReader_Stub.java:234) at com.ibm.websphere.advance.tivoli.SeriousEventEngine.run(SeriousEventEngine.java:596) at java.lang.Thread.run(Thread.java:512) ORB trace shows client ORB hangs on the following entry and it is being the last entry as well during operation of read__com_ibm_ejs_sm_beans_SeriousEvent__com_ibm_ejs_sm_beans_SeriousEvent__long or other similar System Managment operation(s). [8/5/02 15:34:54:316 EDT] 68d09ac8 ORBRas > com.ibm.CORBA.iiop.ClientRequestImpl ijavaorb P=88428:O=0:CT Entry invoke(isOneway=false) Directions to apply efix: 1) Create temporary "efix" directory to store the jar file: AIX: /tmp/WebSphere/efix Solaris/Linux: /tmp/WebSphere/efix Windows: c:\temp\WebSphere\efix 2) Copy jar file to the directory 3) Shutdown WebSphere 4) Run the jar file with the following command answering questions/prompts as they appear: java -jar 5) Restart WebSphere 6) The temp directory may be removed but the jar file should be saved. Do not remove any files created and stored in the /WebSphere/AppServer/efix/ directories. These files are required if an efix is to be removed. Directions to remove an efix: NOTE: EFIXES MUST BE REMOVED IN THE ORDER THEY WERE APPLIED. DO NOT REMOVE AN EFIX UNLESS ALL EFIXES APPLIED AFTER IT HAVE FIRST BEEN REMOVED. YOU MAY REAPPLY ANY REMOVED EFIX. Example: If your system has efix1, efix2, and efix3 applied in that order and efix2 is to be removed, efix3 must be removed first, efix2 removed, and efix3 re-applied. 1) Change directory to the efix location (/WebSphere/AppServer/efix/). 2) Shutdown WebSphere 3) Run the backup jar file with the following command: java -jar 4) Restart WebSphere Directions to re-apply an efix: Follow the instructions for applying an efix. If the backup files still exist (from the previous efix application), you will be prompted to overwrite. Answer "yes" at the overwrite prompts. Additional Information: ------------------------------------------------------------------ PQ63548 ======= Abstract: Inter-op problem found when passing embedded valueTypes between WAS releases Description/symptom of problem: User may experience org.omg.CORBA.MARSHAL exceptions. Note, that these exceptions are sometimes masked by other exceptions in WAS or user application code. And errors are sometimes hard to identify. This is why we strongly recommended thta e-fixes are applied as soon as possible to avoid future inter-op issues. Also, user may experience this problem even after efixes have been applied, if user has saved off his IORs. If this is the case, user needs to re-export those IORs for the efixes to take their full effect. Known affected combinations WAS35x ==> WAS356+ or WAS403+ or higher releases WAS40x ==> WAS356+ or WAS403+ or higher releases PQ52939: ======== Admin Server is getting "Unable to initialize security context" and subsequently admin console could not start. It may be caused by null connection data object being returned in a request. PQ54436 (This fix is built for all platforms) ======== Abstract: Two Solaris nodes in a multi-node domain with LTPA security enabled; disconnect one node, fire up an admin gui at the other node, and the app-server on that HEALTHY node crashes, and does not come back up correctly. Although this problem was reported by customer used Solaris, this efix can be used for all platforms. Description: The problems seen with the system management topology were caused by several timing issues. With the second admin node down, the Solaris hardware will wait for up to 4.5 minutes, depending on the configuration, before it returns from creating a socket. This time was multiplied by the fact that the ORB does retries to compensate for the file system handles not being available. The retries have been removed to lessen the amount of time that the wait on the socket creation. The extended wait caused the transaction that is used by the system management topology to fail. Without the retries the ORB returns the failure to connect before the transaction times out. A second problem occurred during this time out because of a synchronization block that was waiting on the socket creation. This sync block was reduced to include only the connection table update. This allows a second connection to be established during the wait period. This caused the topology to not show any other servers that were running with the admin node that was up. PQ61243 ======= Abstract: EJB client or any client, which uses RMI-IIOP for communication, hangs during operation. This client can be servlet/jsp, stand alone java client, adminclient, wscp, or etc. Description/symptom of problem: Actual Exception: ================= [1/15/02 13:29:34:329 CST] 21b220 ORBRas X com.ibm.CORBA.iiop.IIOPConnection send Thread-0 The following exception was logged java.io.InterruptedIOException: at java.net.SocketOutputStream.socketWrite(Native Method) at java.net.SocketOutputStream.write(Unknown Source) at com.ibm.CORBA.iiop.ClientRequestImpl.writeTo(ClientRequestImpl.java:336) at com.ibm.CORBA.iiop.IIOPConnection.send(IIOPConnection.java:1352) at com.ibm.CORBA.iiop.ClientRequestImpl.invoke(ClientRequestImpl.java:508) at com.ibm.CORBA.iiop.ClientRequestImpl.invoke(ClientRequestImpl.java:456) ... Sometimes, the above error stack can't been seen. If this is the case, do a Java core dump. Java Core Dump: =============== "Worker#498" (TID:0x81e2cf70, sys_thread_t:0x3a7e3988, state:CW, native ID:0x2080b) prio=5 at java.lang.Object.wait(Native Method) at java.lang.Object.wait(Object.java(Compiled Code)) at com.ibm.rmi.util.Lock.lock(Lock.java(Compiled Code)) at com.ibm.CORBA.iiop.IIOPConnection.writeLock(IIOPConnection.java(Compiled Code)) at com.ibm.CORBA.iiop.IIOPConnection.send(IIOPConnection.java(Compiled Code)) at com.ibm.CORBA.iiop.ClientRequestImpl.invoke(ClientRequestImpl.java(Compiled Code)) at com.ibm.CORBA.iiop.ClientRequestImpl.invoke(ClientRequestImpl.java(Compiled Code)) at com.ibm.CORBA.iiop.ClientDelegate.invoke(ClientDelegate.java(Compiled Code)) at com.ibm.CORBA.iiop.ClientDelegate.invoke(ClientDelegate.java(Compiled Code)) at org.omg.CORBA.portable.ObjectImpl._invoke(ObjectImpl.java(Compiled Code)) at com.prusec.services.mq.ejb._GenericMQServiceHome_BaseStub.create(_GenericMQServiceHome_BaseStub.java(Compiled Code)) at com.prusec.services.mq.ejb._GenericMQServiceHome_Stub.create(_GenericMQServiceHome_Stub.java(Compiled Code)) at com.prusec.services.mq.client.DRPBean.createGenericMQService(DRPBean.java(Compiled Code)) at com.prusec.services.mq.client.DRPBean.getGenericMQService(DRPBean.java(Compiled Code)) at com.prusec.services.mq.client.DRPBean.sendRequest(DRPBean.java(Compiled Code)) at psCompliance.server.framework.action.AbstractMQServiceActionAdapter.callCicsProgram(AbstractMQServiceActionAdapter.java(Compiled Code)) at psCompliance.server.framework.action.AuthenticationAction.authenticateUser(AuthenticationAction.java(Compiled Code)) at psCompliance.server.framework.action.AuthenticationAction.dispatch(AuthenticationAction.java(Compiled Code)) at psCompliance.server.framework.action.ActionDispatcher.dispatchAuthentication(ActionDispatcher.java(Compiled Code)) at psCompliance.server.framework.servlet.ComplianceApplicationFrameworkServlet.service(ComplianceApplicationFrameworkServlet.java(Compiled Code)) at psCompliance.server.servlets.TradeBlotterServlet.service(TradeBlotterServlet.java(Compiled Code)) at javax.servlet.http.HttpServlet.service(HttpServlet.java(Compiled Code)) at com.ibm.servlet.engine.webapp.StrictServletInstance.doService(ServletManager.java(Compiled Code)) at com.ibm.servlet.engine.webapp.StrictLifecycleServlet._service(StrictLifecycleServlet.java(Compiled Code)) at com.ibm.servlet.engine.webapp.ServicingServletState.service(StrictLifecycleServlet.java(Compiled Code)) at com.ibm.servlet.engine.webapp.StrictLifecycleServlet.service(StrictLifecycleServlet.java(Compiled Code)) at com.ibm.servlet.engine.webapp.ServletInstance.service(ServletManager.java(Compiled Code)) at com.ibm.servlet.engine.webapp.ValidServletReferenceState.dispatch(ServletManager.java(Compiled Code)) at com.ibm.servlet.engine.webapp.ServletInstanceReference.dispatch(ServletManager.java(Compiled Code)) at com.ibm.servlet.engine.webapp.WebAppRequestDispatcher.handleWebAppDispatch(WebAppRequestDispatcher.java(Compiled Code)) at com.ibm.servlet.engine.webapp.WebAppRequestDispatcher.dispatch(WebAppRequestDispatcher.java(Compiled Code)) at com.ibm.servlet.engine.webapp.WebAppRequestDispatcher.forward(WebAppRequestDispatcher.java(Compiled Code)) at com.ibm.servlet.engine.srt.WebAppInvoker.handleInvocationHook(WebAppInvoker.java(Compiled Code)) at com.ibm.servlet.engine.invocation.CachedInvocation.handleInvocation(CachedInvocation.java(Compiled Code)) at com.ibm.servlet.engine.invocation.CacheableInvocationContext.invoke(CacheableInvocationContext.java(Compiled Code)) at com.ibm.servlet.engine.srp.ServletRequestProcessor.dispatchByURI(ServletRequestProcessor.java(Compiled Code)) at com.ibm.servlet.engine.oselistener.OSEListenerDispatcher.service(OSEListener.java(Compiled Code)) at com.ibm.servlet.engine.oselistener.SQEventListenerImp$ServiceRunnable.run(SQEventListenerImp.java(Compiled Code)) at com.ibm.servlet.engine.oselistener.SQEventListenerImp.notifySQEvent(SQEventListenerImp.java(Compiled Code)) at com.ibm.servlet.engine.oselistener.serverqueue.SQEventSource.notifyEvent(SQEventSource.java(Compiled Code)) at com.ibm.servlet.engine.oselistener.serverqueue.SQWrapperEventSource$SelectRunnable.notifyService(SQWrapperEventSource.java(Compiled Code)) at com.ibm.servlet.engine.oselistener.serverqueue.SQWrapperEventSource$SelectRunnable.run(SQWrapperEventSource.java:221) at com.ibm.servlet.engine.oselistener.outofproc.OutOfProcThread$CtlRunnable.run(OutOfProcThread.java(Compiled Code)) at java.lang.Thread.run(Thread.java(Compiled Code)) ----- Native Stack ----- unable to backtrace through native code - iar 0x301c4b28 not in text area (sp is 0x3aa07fec) ----- Monitors Held ----- (flat) com.ibm.servlet.engine.webapp.WebAppRequestDispatcher@86DF9F20/86DF9F28