Record the troubleshooting process of a System Cluster Manager caused by a password change of the active domain administrator.
Environment Description a company has a set of systems and two Windows2003 systems. It uses the built-in Cluster Manager function to implement dual-host hot backup. Normally, server 10.1.1.1 carries the middleware application service, the server 10.1.1.2 carries the Database Service and switches the resource to the other server only when one server fails.
| System name |
System Version |
IP address |
Remarks |
| S-EIP-APP |
Windows2003ENTSP2 |
10.1.1.1 |
Use the built-in Cluster Manager of Windows2003 to implement hot standby |
| S-EIP-DATA |
Windows2003ENTSP2 |
10.1.1.2 |
Fault performance: an SMS is reported one night. The system is abnormal and cannot be accessed. Log on to the system 10.1.1.1 and check the Cluster Manager status. The server 10.1.1.2 is out of the Cluster status. Process and Analysis 1) remotely log on to the system 10.1.1.1, open the Cluster Manager, and find "S-EIP-DATA" database server node failure, display "Red Cross ", the EAIEIP, Oracle Services for MSC, and OracleOraDb10g_home1TNSListenerFsloracle-vip statuses in active resources are in failure, and Cluster Manager attempts to automatically move the fault to the S-EIP-APP node, however, the fault persists. 2) restart the 10.1.1.2 server and try to solve the problem. 3) log on to the 10.1.1.2 server, view the event log, found alarm information and error information: "Security system detected an authentication error for the server DNS/s-xx1.hq.cxxp.xxx, the failure code from the authentication protocol ipvs is invalid logon because the user name or authentication message is invalid ",
4) The log shows that the error similar to "unknown user name and password error" occurs. Since the Windows Cluster Manager uses the AD domain for centralized management, the AD domain administrator was consulted to learn that the administrator password of the AD domain has been changed before. 5) how to modify the latest password for the AD domain in the Cluster Manager of the portal. After checking the official KB and online materials, try to modify the Active Domain password in the cluster Manager: log on to 10.1.1.1 and 10.1.1.2 respectively, modify "cluster service" in "service" -- log on -- change the password, 6) After modifying the password in the cluster service, the problem persists, view the Oracle Services for MSc in the S-EIP-DATA in the cluster Manager is still in failure status, view the log that, (7) solution: Modify the logon password of "oracleMSCSServices" in "service" in 10.1.1.1 and 10.1.1.2 respectively. (8) after the modification, the EAIEIP resource in the Cluster Manager S-EIP-DATA active resource is still in the failed State,
9) from the error message, we can see that the user password in the oracle fail safe failover cluster is incorrect. According to the above experience, the administrator password in the AD domain should also be used for oracle fail safe, try to change the password: log on to 10.1.1.2 -- start -- program -- oracle-ofs34_home1 -- "oracle services for MSC Security Setup" to change the new AD domain administrator password. 10) after all the passwords related to the Active Directory Administrator Account are changed to be consistent with the Active Directory Administrator Account, the problem is solved, the Cluster Manager function is normal, and the business is restored to normal. The cause of the fault is that the system uses the user password of the active domain administrator for management during the preliminary planning, however, no corresponding changes were made to the system, resulting in the occurrence of this fault.
