oracle 11.2.0.3.6升级故障---instance无法启动

最新推荐文章于 2026-06-21 10:24:54 发布
转载 最新推荐文章于 2026-06-21 10:24:54 发布 · 591 阅读 · 0
标签
#数据库
本文记录了Oracle 11.2.0.3.0升级过程中遇到的问题及解决步骤。主要介绍了节点1实例无法正常启动的情况，通过分析日志发现oraagent进程问题并修复，最终使实例成功启动。
 

1.1 实例无法cleaning

1.1.1 故障现象

ORACLE 11.2.0.3.0升级到oracle 11.2.0.3.6，节点1上打psu过程完全正常，没有任何报错。但是，最后一步启动CRS的时候，发现节点1上实例无法正常启动。

1.1.2 集群状态

    发现节点1上，实例状态为unknown，并且srvctl无法启动和关闭节点1上的实例。

RAC02:/home/grid> crsctl stat res -t                            

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASM_ARCH.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_CRS.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA01.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA02.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA03.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                               

ora.LISTENER.lsnr

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.asm

               ONLINE  ONLINE       rac01           Started            

               ONLINE  ONLINE       rac02           Started            

ora.gsd

               OFFLINE OFFLINE      rac01                              

               OFFLINE OFFLINE      rac02                               

ora.net1.network

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ons

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       rac01                              

ora.cvu

      1        ONLINE  ONLINE       rac01                              

ora.racdb.db

      1        ONLINE  UNKNOWN      rac01                              

      2        ONLINE  ONLINE       rac02           Open               

ora.rac01.vip

      1        ONLINE  ONLINE       rac01                               

ora.rac02.vip

      1        ONLINE  ONLINE       rac02                              

ora.oc4j

      1        ONLINE  ONLINE       rac01                              

ora.scan1.vip

      1        ONLINE  ONLINE       rac01 

1.1.3 手工停止实例

试着手工停掉节点1实例，发现节点1实例一直是CLEANING状态，不能正常停止：

RAC01:/home/grid> crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASM_ARCH.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_CRS.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA01.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA02.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA03.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.LISTENER.lsnr

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                               

ora.asm

               ONLINE  ONLINE       rac01           Started            

               ONLINE  ONLINE       rac02           Started            

ora.gsd

               OFFLINE OFFLINE      rac01                               

               OFFLINE OFFLINE      rac02                              

ora.net1.network

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                               

ora.ons

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       rac02                              

ora.cvu

      1        ONLINE  ONLINE       rac02                              

ora.racdb.db

      1        ONLINE  OFFLINE                               CLEANING           

      2        ONLINE  ONLINE       rac02           Open               

ora.rac01.vip

      1        ONLINE  ONLINE       rac01                              

ora.rac02.vip

      1        ONLINE  ONLINE       rac02                              

ora.oc4j

      1        ONLINE  ONLINE       rac01                               

ora.scan1.vip

      1        ONLINE  ONLINE       rac02

1.1.4 查看日志     

查看日志crsd.log：

2013-11-27 13:22:43.287: [    A**][41] {1:37211:819} Starting the agent: /oracle/grid/11.2.0/grid_1/bin/oraagent with user id: oracle and incarnation:15

2013-11-27 13:22:43.287: [UiServer][47] {1:37211:819} Container [ Name: ORDER

        MESSAGE:

        TextMessage[CRS-2790: Starting shutdown of Cluster Ready Services-managed resources on 'rac01']

        MSGTYPE:

        TextMessage[3]

        OBJID:

        TextMessage[rac01]

        WAIT:

        TextMessage[0]

]

2013-11-27 13:22:43.288: [UiServer][47] {1:37211:819} Container [ Name: ORDER

        MESSAGE:

        TextMessage[CRS-2679: Attempting to clean 'ora.racdb.db' on 'rac01']

        MSGTYPE:

        TextMessage[3]

        OBJID:

        TextMessage[ora.racdb.db 1 1]

        WAIT:

        TextMessage[0]

]

2013-11-27 13:22:43.345: [    A**][41] {1:37211:819} Starting the HB [Interval =  30000, misscount = 6kill allowed=1] for agent: /oracle/grid/11.2.0/grid_1/bin/oraagent_oracle

2013-11-27 13:22:43.347: [    A**][41] {1:37211:819} Could not forward message [RESOURCE_CLEAN[ora.racdb.db 1 1] ID 4100:3131] to agent. /oracle/grid/11.2.0/grid_1/bin/oraagent_oracle is not running

2013-11-27 13:22:43.348: [    A**][41] {1:37211:819} Starting of the agent: /oracle/grid/11.2.0/grid_1/bin/oraagent with user id oracle is already in progress.

2013-11-27 13:22:57.461: [    A**][44] {2:6722:146} Created alert : (:CRSAGF00130:) :  Failed to start the agent /oracle/grid/11.2.0/grid_1/bin/oraagent_oracle

2013-11-27 13:22:57.462: [    A**][44] {2:6722:146} A** Proxy Server sending the last reply to PE for message:RESOURCE_CLEAN[ora.racdb.db 1 1] ID 4100:2464

2013-11-27 13:22:57.462: [    A**][44] {2:6722:146} Can not stop the agent: /oracle/grid/11.2.0/grid_1/bin/oraagent_oracle because pid is not initialized

2013-11-27 13:22:57.462: [   CRSPE][49] {2:6722:146} Received reply to action [Clean] message ID: 2464

2013-11-27 13:22:57.462: [   CRSPE][49] {2:6722:146} RI [ora.racdb.db 1 1] new internal state: [STABLE] old value: [CLEANING]

2013-11-27 13:22:57.462: [   CRSPE][49] {2:6722:146} Fatal Error from A** Proxy: Unable to start the agent process

2013-11-27 13:22:57.463: [   CRSPE][49] {2:6722:146} CRS-2680: Clean of 'ora.racdb.db' on 'rac01' failed

2013-11-27 13:22:57.465: [   CRSPE][49] {2:6722:146} Sequencer for [ora.racdb.db 1 1] has completed with error: CRS-5802: Unable to s

tart the agent process     

     

1.1.5 查看oraagent进程

因为日志里有提到oraagent_oracle无法启动，所以在两个节点上对比oraagent进程状态：

节点2：

RAC02:/home/grid> ps -ef | grep oraagent

    grid  3211     1  0 12:04:45 ?         0:50 /oracle/grid/11.2.0/grid_1/bin/oraagent.bin

    grid  3830     1  0 12:05:50 ?         0:24 /oracle/grid/11.2.0/grid_1/bin/oraagent.bin

  oracle  6046     1  0 12:12:42 ?         0:57 /oracle/grid/11.2.0/grid_1/bin/oraagent.bin

    grid  3204 26634  1 13:39:21 pts/4     0:00 grep oraagent      

节点1：   

RAC01:/home/grid> ps -ef | grep oraagent

    grid  5077     1  0 11:46:17 ?         1:05 /oracle/grid/11.2.0/grid_1/bin/oraagent.bin

    grid  5938     1  0 11:47:41 ?         0:35 /oracle/grid/11.2.0/grid_1/bin/oraagent.bin

    grid 29140 19598  0 13:39:15 pts/2     0:00 grep oraagent   

1.1.6 手工启动oraagent进程

从上面的信息看，节点1比节点2少启动一个oraagent.bin进程。于是在节点1上尝试进入oracle用户启动该进程：

RAC01:/home/oracle> /oracle/grid/11.2.0/grid_1/bin/oraagent.bin

sh: /oracle/grid/11.2.0/grid_1/bin/oraagent.bin: Execute permission denied.

RAC01:/home/oracle> ll /oracle/grid/11.2.0/grid_1/bin/oraagent.bin

-rwx------   1 grid       oinstall   40262952 Nov 26 19:46 /oracle/grid/11.2.0/grid_1/bin/oraagent.bin

RAC01:/home/oracle> id

uid=1101(oracle) gid=1000(oinstall) groups=1031(dba)

RAC01:/home/oracle> exit

logout

RAC01:/> id

uid=0(root) gid=3(sys) groups=0(root),1(other),2(bin),4(adm),5(daemon),6(mail),7(lp),20(users)

RAC01:/> chmod 777 /oracle/grid/11.2.0/grid_1/bin/oraagent.bin   

1.1.7 再次停止instance

在节点1上用srvctl停掉instance，然后启动：

RAC01:/oracle/grid> srvctl stop instance -d racdb -n rac01 -f

发现这次stop可以顺利完成，查看状态，发现节点1的顺利状态也是正常的shutdwon状态：

RAC01:/oracle/grid> crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASM_ARCH.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_CRS.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA01.dg

               ONLINE  ONLINE       rac01                               

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA02.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                               

ora.ASM_DATA03.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.LISTENER.lsnr

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.asm

               ONLINE  ONLINE       rac01           Started            

               ONLINE  ONLINE       rac02           Started            

ora.gsd

               OFFLINE OFFLINE      rac01                              

               OFFLINE OFFLINE      rac02                              

ora.net1.network

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ons

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       rac01                              

ora.cvu

      1        ONLINE  ONLINE       rac01                              

ora.racdb.db

      1        OFFLINE OFFLINE                               Instance Shutdown  

      2        ONLINE  ONLINE       rac02           Open               

ora.rac01.vip

      1        ONLINE  ONLINE       rac01                              

ora.rac02.vip

      1        ONLINE  ONLINE       rac02                              

ora.oc4j

      1        ONLINE  ONLINE       rac01                              

ora.scan1.vip

      1        ONLINE  ONLINE       rac01                     

1.1.8 再使用srvctl启动instance

RAC01:/oracle/grid> srvctl start instance -d racdb -n rac01

启动命令成功完成！！！！

查看状态，节点1上的实例已经顺利启动：

RAC01:/oracle/grid> crsctl stat res -t

--------------------------------------------------------------------------------

NAME           TARGET  STATE        SERVER                   STATE_DETAILS      

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASM_ARCH.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_CRS.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA01.dg

               ONLINE  ONLINE       rac01                               

               ONLINE  ONLINE       rac02                              

ora.ASM_DATA02.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                               

ora.ASM_DATA03.dg

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.LISTENER.lsnr

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.asm

               ONLINE  ONLINE       rac01           Started            

               ONLINE  ONLINE       rac02           Started            

ora.gsd

               OFFLINE OFFLINE      rac01                              

               OFFLINE OFFLINE      rac02                              

ora.net1.network

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

ora.ons

               ONLINE  ONLINE       rac01                              

               ONLINE  ONLINE       rac02                              

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       rac01                              

ora.cvu

      1        ONLINE  ONLINE       rac01                              

ora.racdb.db

      1        ONLINE  ONLINE       rac01           Open               

      2        ONLINE  ONLINE       rac02           Open               

ora.rac01.vip

      1        ONLINE  ONLINE       rac01                              

ora.rac02.vip

      1        ONLINE  ONLINE       rac02                              

ora.oc4j

      1        ONLINE  ONLINE       rac01                              

ora.scan1.vip

      1        ONLINE  ONLINE       rac01       

至此，节点1的oracle实例已经顺利启动，节点1升级完成，开始进行节点2升级。

来自 “ ITPUB博客 ” ，链接：http://blog.itpub.net/751371/viewspace-1061243/，如需转载，请注明出处，否则将追究法律责任。

转载于:http://blog.itpub.net/751371/viewspace-1061243/

cnqt2015
关注
oracle集群管理状态unknown问题
10-07
oracle集群管理状态unknown问题
Starting Instance Fails with ORA-29702
你好我是李白
11-30 229
Starting Instance Fails with ORA-29702 [ID 216030.1] 修改时间 16-SEP-2010类型 PROBLEM状态 PUBLISHED fact: Oracle Server Enterprise Edition 8 fact: Oracle Parallel Server (OPS) fact: AIX-Based Systems symptom: Starting database fails symptom: ORA-29702: err..
Oracle监听数据库实例状态显示status UNKNOWN
sunny05296的博客
08-22 1万+
Oracle监听数据库实例状态显示status UNKNOWN [oracle@localhost admin]$ lsnrctl status LSNRCTL for Linux: Version 11.2.0.1.0 - Production on 22-AUG-2020 19:38:58 Copyright (c) 1991, 2009, Oracle. All rights reserved. Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=IP.
Oracle监听出现的问题总结，以及解决办法
forever_rivers
02-18 3万+
ORA-12541: TNS: 无监听程序 C:\Users\Administrator>sqlplus sys/cape@orcl as sysdba SQL*Plus: Release 11.2.0.1.0 Production on 星期六 2月 18 12:55:46 2017 Copyright (c) 1982, 2010, Oracle. All rights reserved. E
12.2RAC 实例State 为 UNKNOWN
kevinyu998的博客
05-17 1022
去年10月份接手一个12.2 RAC环境，使用crsctl status res -t查看，发现有个实例状态是UNKNOWN。今天客户要求在该环境上新加一个实例，应付一些应用急需使用。就dbca创建hyoa实例，到最后报错了，截图如下，节点一看样子还是有问题的。可以手动启动实例，无法使用srvctl，但是监听中没有，以为是listener的问题，一查看节点一确实不正常，赶紧修改，但修改监听可以看到的，但还是无法srvctl启动。继续排查，想到删除实例并添加实例，操作后还是无法使用srvctl启动。
告别安全警告：手把手为Oracle 11.2.0.4数据库打上最后的PSU和OJVM补丁
weixin_30500105的博客
03-30 378
本文详细指导如何为Oracle 11.2.0.4数据库安装最终的PSU和OJVM补丁，解决常见安全警告问题。通过分步教程，包括补丁获取、环境预检、备份策略和补丁应用，确保数据库安全稳定运行。特别强调OJVM补丁的重要性，避免Java组件漏洞带来的风险。
故障分析：ORA-00001: unique constraint violated异常处理
Enmotech的博客
03-03 2万+
墨墨导读：本文记录SYS.SCHEDULER$_INSTANCE_PK冲突异常分析及处理过程，希望对大家有帮助。一、前言最近，客户经常收到告警信息，一台数据库的安装目录/u01经常使用率经...
Accumulo 1.6.6 在 Ubuntu 14.04 上的高安全分布式部署实践
最新发布
weixin_30664051的博客
06-21 333
分布式键值存储是支撑海量数据实时访问与细粒度权限控制的核心基础设施。其底层依赖于稳定的Hadoop生态、强一致的协调服务（如ZooKeeper）以及可插拔的安全模型。Apache Accumulo 作为典型代表，以单元级ACL、多级排序索引和Thrift接口著称，特别适用于金融风控、政务数据中台、IoT元数据管理等对审计合规与多租户隔离要求严苛的场景。本文聚焦 Accumulo 1.6.6 版本在 Ubuntu 14.04 环境下的真实生产级部署，深入解析 Hadoop 2.2.x 兼容性约束、ZooKee
oracle10g企业管理器打不开,2014年05月13日  Oracle 10g的企业管理器（Enterprise Manager）的常见问题...
weixin_33256071的博客
04-04 509
问题：如何打开Oracle10g的企业管理器(Enterprise Manager)？装了个Oracle10g，却发现找不到企业管理器了。原来10g又升级了管理工具，不再采用8i,9i的那些Java工具了，而是与时俱进地改用了Web方式。按照网上的方法：http://机器的IP地址:5500/em，还是没有连上。难道端口号不对吗？解决方法 1：查看Oracle10g安装目录install下的rea...
oracle监听器启动lsnrctl status例程的状态为unknown
热门推荐
河南骏的博客
11-11 3万+
以前同事问及为何数据库例程在监听器中状态为unnkown，这是何意．有何影响．查阅了资料，解决如下： # listener.ora Network Configuration File: E:\oracle\product\10.2.0\db_1\network\admin\listener.ora # Generated by Oracle configuration tools.
oracle监听unknow,Oracle10g 监听注册问题 - Ready及Unknown状态
weixin_28903391的博客
04-03 1171
Oracle 9i 数据库软件安装的时候最后自动会跳出配置监听器的画面， 我们可以配置监听，然后会生成listener.ora 及tnsnames.ora 文件， DBCA建库的时候会将相应的数据库名称写入listener.ora及tnsnames.ora中 。那么开启一般监听是是静态注册，监听Listener.ora 一般格式是：LISTENER =(DESCRIPTION_LIST =(DES...
oracle实例状态为unknown,处理listener和ASM状态为UNKNOWN，并且无法使用srvctl start 启动的问题...
weixin_34809240的博客
04-12 2364
========phanx.com========Author: phanxUpdated: 2013-7-7转载请保留作者信息=========================使用srvctl start启动listener和asm均报错# srvctl start listener -n coredb1CRS-1028: Dependency analysis failed because...
oracle 状态unknown,Oracle RAC 一个节点的instance资源状态为unknown
weixin_36249942的博客
04-05 1053
一个朋友新装的一套oracle 11.2.0.4版本的RAC发现节点一的实例状态为unknown，在启动集群资源的时候发现instance没有被集群带起来。crsd.log中报错信息如下：Could not forward message [RESOURCE_CLEAN[ora.testdb.db 1 1] ID 4100:6053] to agent. /opt/app/11.2.0/grid/...
oracle11g实例监听unknown,oracle监听器启动lsnrctl status例程的状态为unknown
weixin_35895485的博客
04-09 2582
以前同事问及为何数据库例程在监听器中状态为unnkown，这是何意．有何影响．查阅了资料，解决如下：# listener.ora Network Configuration File: E:\oracle\product\10.2.0\db_1\network\admin\listener.ora# Generated by Oracle configuration tools.SID_LIST_...
oracle实例unknow,请问监听启动后 Instance "XE", status UNKNOWN 是什么情况？
weixin_39757743的博客
04-14 487
该楼层疑似违规已被系统折叠隐藏此楼查看此楼[root@HY alert]# lsnrctl statusLSNRCTL for Linux: Version 11.2.0.2.0 - Production on 10-JAN-2018 12:54:27Copyright (c) 1991, 2011, Oracle. All rights reserved.Connecting to (DE...
oracle报status UNKNOWN
u014104653的博客
09-30 4362
oracle 监听 unknown status
Linux ora-12514多实例,Oracle错误 ORA-12514 解决方法
weixin_39818662的博客
05-14 468
6.连到实例，关闭数据库，启动数据库到mount状态，均正常！查看某服务是动态注册或是静态注册。可以使用命令lsnrctl status 来查看数据库是动态注册还是静态注册。实例状态为UNKNOWN时，表示此服务是静态注册的设置，监听器表明他不知道关于该实例的任何信息，只有当用户发出连接请求时，他才检查该实例是否存在。而动态注册的数据库通过状态信息中的状态为READY或BLOCKED来指明。不管何...
oracle crs中监听资源状态异常(ora.LISTENER.lsnr)
渔夫数据库笔记
11-11 8812
oracle crs中监听资源状态异常(ora.LISTENER.lsnr)
Oracle 配置transparent gateway（透明网关）连接sqlserver数据库（gateway安装在sqlserver服务器）
lk的窝
04-28 3742
sqlserver服务器：192.168.6.16  测试数据库：orcl  测试表：shenfen  测试视图：id   端口：1433 oracle服务器：192.168.6.10   gateway安装在192.168.6.16 一、sqlserver 服务器 gateway安装目录：D:\product\11.2.0\tg_1 C:\Users\Admin
评论
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值