IBM Tivoli Directory Server 6.0 - ReplicationApril 24, 2007Troubleshooting replica failures IBM Tivoli Directory Server 6.0 - Replication April 24, 2007 Troubleshooting replica failures Resuming replication using the webadmin Resuming replication using the webadmin Replication Management – Manage queues – select subtree – click on suspend/resume button To: There is a change in the queue… do I panic? Basic Debugging - I cannot stress firmly enough the first rule of replication! Basic Debugging - I cannot stress firmly enough the first rule of replication! Errors in replication are easy to solve Errors in replication are easy to solve In this case, what we see is not actually an error. Let’s look again at our queue: Because the last result is OK and not Failed we actually do not have an error, and should we make any change to the o=ibm,c=us tree this will clear itself. However, since we see something in Queue we might want to figure out what it is… select the subtree and click on the Queue Details button Queue Details Queue Details A little log analysis shows the root cause. A little log analysis shows the root cause. The FIRST place to start on any replication problem is the ibmslapd.log Default location: /home/inst_name/idsslapd-instname/logs File Name: ibmslapd.log A little research shows the change we have stored in queue: 04/26/07 19:55:08 GLPRPL043W Replication continuing for replica 'CN=PEER2:389,CN=PEER1:389,IBM-REPLICAGROUP=DEFAULT,O=IBM,C=US' after skipping add for entry 'cn=replica1:389,cn=peer1:389,ibm-replicaGroup=default,O=IBM,C=US' because of error: 68 Already exists . Our options to resolve? Our options to resolve? We can deal with this one of two ways: Do Nothing! On the next real add/modify/delete will skip over this change as it is not a blocking entry Use the “Skip Blocking Entry” button in the Queue Details section of the WebAdmin Use an extended op to skip the blocking entry Skipping a blocking entry Skipping a blocking entry What your queues will look like when everything is perfect What your queues will look like when everything is perfect All subtrees should show: - Last result: OK - State: Ready - Queue size: 0 A quick test – adding a new user to Peer1 A quick test – adding a new user to Peer1 I want to test my replication to make sure its working as I expect. Add and entry to Peer1: ldapadd –h Peer1 –D cn=root –w secret –f /tmp/add.ldif Where /tmp/add.ldif reads: dn: CN=TESTUSER,o=ibm,c=us objectclass: inetOrgPerson objectclass: organizationalPerson objectclass: person objectclass: top sn: TEST cn: TEST cn: TESTUSER description: user added to Peer1 Will return: Adding new entry CN=TESTUSER,o=ibm,c=us A quick test – Checking for that user on Peer2/Replica1 A quick test – Checking for that user on Peer2/Replica1 I would run a simple search to each of the hosts to see if that user exsists: ldapsearch -h peer2 -D cn=root -w secret -b CN=TESTUSER,o=ibm,c=us objectclass=* And: ldapsearch -h replica1 -D cn=root -w secret -b CN=TESTUSER,o=ibm,c=us objectclass=* Both should return: CN=TESTUSER,o=ibm,c=us objectclass=inetOrgPerson objectclass=organizationalPerson objectclass=person objectclass=top sn=TEST cn=TEST cn=TESTUSER description=user added to Peer1 I could further test this by adding another user to Peer2 and checking for the user on Peer1 and so on. The basics for troubleshooting. The basics for troubleshooting. Any time I hit an error the first place I check is the ibmslapd.log on BOTH servers involved. There may not be useful information as to why the error is occurring on the supplier, but the consumer may clearly point out root cause. It is a good idea to copy off the ibmslapd.log so you are only dealing with the errors effecting us at this time Copyright and trademark information Copyright and trademark information © Copyright IBM Corporation 2000 - 2007. All rights reserved. U.S. Government Users Restricted Rights - Use, duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp. IBM web site pages may contain other proprietary notices and copyright information which should be observed. IBM trademarks http://www.ibm.com/legal/copytrade.shtml#ibm Fair use guidelines for use and reference of IBM trademarks http://www.ibm.com/legal/copytrade.shtml#fairuse General rules for proper reference to IBM product names http://www.ibm.com/legal/copytrade.shtml#general Special attributions IBM, the IBM logo and DB2 are trademarks of International Business Machines Corporation in the United States, other countries, or both. MMX, Pentium, and ProShare are trademarks of Intel Corporation in the United States, other countries, or both. Microsoft and Windows NT are trademarks of Microsoft Corporation in the United States, other countries, or both. Java and all Java-based trademarks are trademarks of Sun Microsystems, Inc. in the United States, other countries, or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Linux is a registered trademark of Linus Torvalds in the United States, other countries, or both. Other company, product or service names may be trademarks or service marks of others.