Fatal ni connect error 12528, connecting to

fatal ni connect error 12528, connecting to

Connected as SYSDBA. DGMGRL> add database 'SITEB' as connect identifier is 'SITEB'; Fatal NI connect error 12528, connecting to. 之前排查发现是tnsname.ora中有主机名设置错误并进行修改。 今天在看还是存在Fatal NI connect error 12537错误提示. 数据库版本是11。2.0.4,Centos linux 6.10,单机详细. DG搭建过程中主库报错如下: Fatal NI connect error 12528, connecting to.

Fatal ni connect error 12528, connecting to - something is

Read these next...

blarman
following detail describe lsnrctl status and listener file content:

LSNRCTL> status LISTENER9
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=server)(PORT=1521)))
STATUS of the LISTENER
---
Alias LISTENER9
Version TNSLSNR for 64-bit Windows: Version 11.2.0.1.0 - Produ
ction
Start Date 20-DEC-2012 15:40:27
Uptime 4 days 21 hr. 29 min. 52 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File D:oracleproduct11.2.0dbhome_1NETWORKADMINlisten
er.ora
Listener Log File d:oraclediagtnslsnrSERVERlistener9alertlog.x
ml
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=server)(PORT=1521)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=::1)(PORT=1521))(CONNECT_DATA=(SERVE
R=DEDICATED)(SERVICE_NAME=ORACLE)))
Services Summary...
Service "ORACLE" has 2 instance(s).
Instance "ORACLE", status UNKNOWN, has 1 handler(s) for this service...
Instance "oracle", status READY, has 1 handler(s) for this service...
Service "oracleXDB" has 1 instance(s).
Instance "oracle", status READY, has 1 handler(s) for this service...
The command completed successfully
LSNRCTL> status LISTENER2
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=server)(PORT=1522)))
STATUS of the LISTENER
---
Alias LISTENER2
Version TNSLSNR for 64-bit Windows: Version 11.2.0.1.0 - Produ
ction
Start Date 20-DEC-2012 15:38:04
Uptime 4 days 21 hr. 32 min. 19 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File D:oracleproduct11.2.0dbhome_1NETWORKADMINlisten
er.ora
Listener Log File d:oraclediagtnslsnrSERVERlistener2alertlog.x
ml
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=server)(PORT=1522)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=::1)(PORT=1522))(CONNECT_DATA=(SERVE
R=DEDICATED)(SERVICE_NAME=ORACLE)))
Services Summary...
Service "ORACLE" has 2 instance(s).
Instance "ORACLE", status UNKNOWN, has 1 handler(s) for this service...
Instance "oracle", status READY, has 1 handler(s) for this service...
Service "oracleXDB" has 1 instance(s).
Instance "oracle", status READY, has 1 handler(s) for this service...
The command completed successfully


LSNRCTL> SERVICES
Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
Services Summary...
Service "ORACLE" has 2 instance(s).
Instance "ORACLE", status UNKNOWN, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:704197 refused:0
LOCAL SERVER
Instance "oracle", status READY, has 1 handler(s) for this service...
Handler(s):
"DEDICATED" established:3746093 refused:0 state:ready
LOCAL SERVER
Service "oracleXDB" has 1 instance(s).
Instance "oracle", status READY, has 1 handler(s) for this service...
Handler(s):
"D000" established:0 refused:0 current:0 max:1022 state:ready
DISPATCHER
(ADDRESS=(PROTOCOL=tcp)(HOST=server)(PORT=49182))
The command completed successfully


************************************************************

LISTENER CONTENT :

LISTENER2 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = server)(PORT = 1522))
)

SID_LIST_LISTENER9 =
(SID_LIST =
(SID_DESC =
(GLOBAL_DBNAME = ORACLE)
(ORACLE_HOME = D:oracleproduct11.2.0dbhome_1)
(SID_NAME = ORACLE)
)
)

SID_LIST_LISTENER2 =
(SID_LIST =
(SID_DESC =
(GLOBAL_DBNAME = ORACLE)
(ORACLE_HOME = D:oracleproduct11.2.0dbhome_1)
(SID_NAME = ORACLE)
)
)

ADR_BASE_LISTENER9 = D:oracle

ADR_BASE_LISTENER2 = D:oracle

LISTENER9 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = server)(PORT = 1521))
)

Twitter Communities

Fatal NI connect error 12518 in ORACLE 11g Data Guard

Hi all,

We are getting "Fatal NI connect error 12518" while performing switch over. In alert log shows below error message,

**************************************************************************************************************

***********************************************************************

Fatal NI connect error 12518, connecting to:

(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(COMMUNITY=SAP.WORLD)(PROTOCOL=TCP)(HOST=mmsr18)(PORT=1521)))(CONNECT_DATA=(SID=DEV)(SERVICE_NAME=DEV_mmsr18)(CID=(PROGRAM=d:\oracle\dev\11203\bin\ORACLE.EXE)(HOST=MMDT0172)(USER=SYSTEM))))

VERSION INFORMATION:

TNS for 64-bit Windows: Version 11.2.0.3.0 - Production

Windows NT TCP/IP NT Protocol Adapter for 64-bit Windows: Version 11.2.0.3.0 - Production

Time: 17-AUG-2015 18:08:59

Tracing not turned on.

Tns error struct:

ns main err code: 12564

TNS-12564: TNS:connection refused

ns secondary err code: 0

nt main err code: 0

nt secondary err code: 0

nt OS err code: 0

***********************************************************************

Fatal NI connect error 12518, connecting to:

(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(COMMUNITY=SAP.WORLD)(PROTOCOL=TCP)(HOST=mmsr18)(PORT=1521)))(CONNECT_DATA=(SID=DEV)(SERVICE_NAME=DEV_mmsr18)(CID=(PROGRAM=d:\oracle\dev\11203\bin\ORACLE.EXE)(HOST=MMDT0172)(USER=SYSTEM))))

VERSION INFORMATION:

TNS for 64-bit Windows: Version 11.2.0.3.0 - Production

Windows NT TCP/IP NT Protocol Adapter for 64-bit Windows: Version 11.2.0.3.0 - Production

Time: 17-AUG-2015 18:08:59

Tracing not turned on.

Tns error struct:

ns main err code: 12564

TNS-12564: TNS:connection refused

ns secondary err code: 0

nt main err code: 0

nt secondary err code: 0

nt OS err code: 0

***********************************************************************

Fatal NI connect error 12518, connecting to:

(DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(COMMUNITY=SAP.WORLD)(PROTOCOL=TCP)(HOST=mmsr18)(PORT=1521)))(CONNECT_DATA=(SID=DEV)(SERVICE_NAME=DEV_mmsr18)(CID=(PROGRAM=d:\oracle\dev\11203\bin\ORACLE.EXE)(HOST=MMDT0172)(USER=SYSTEM))))

VERSION INFORMATION:

TNS for 64-bit Windows: Version 11.2.0.3.0 - Production

Windows NT TCP/IP NT Protocol Adapter for 64-bit Windows: Version 11.2.0.3.0 - Production

Time: 17-AUG-2015 18:08:59

Tracing not turned on.

Tns error struct:

ns main err code: 12564

TNS-12564: TNS:connection refused

ns secondary err code: 0

nt main err code: 0

nt secondary err code: 0

nt OS err code: 0

Error 12518 received logging on to the standby

FAL[server, ARC0]: Error 12518 creating remote archivelog file 'dev_mmsr18'

FAL[server, ARC0]: FAL archive failed, see trace file.

ARCH: FAL archive failed. Archiver continuing

Please suggest if anyone face such problem

Regards,

Jithin

Yesterday, I demonstrated a DataGuard Switchoverfrom a 2node RAC(ASM) database to a SingleInstance(FileSystem) Database.

These are the messages in the alert log and drc log files during the Switchover (Messages from the start of the Switchover to the subsequent restart and shutdown of all three instances.

First on node 1 which is running database instance RAC1. The drcRAC1.log and alert_RAC1.log :

04/10/2017 23:30:58 SWITCHOVER TO stby Switchover to physical standby cannot be initiated from primary database; redirecting to the switchover target stby using connect identifier: stby 04/10/2017 23:31:00 SWITCHOVER TO stby 04/10/2017 23:31:02 Notifying Oracle Clusterware to prepare primary database for switchover 04/10/2017 23:31:19 Target standby stby did not have Active Data Guard enabled at the time of switchover. To maintain Active Data Guard license compliance Block Change Tracking will be disabled. 04/10/2017 23:31:20 Notifying Clusterware to restart this instance for Switchover 04/10/2017 23:31:23 Shutting down instance after CTL_SWITCH 04/10/2017 23:33:20 >> Starting Data Guard Broker bootstrap << Broker Configuration File Locations: dg_broker_config_file1 = "+DATA/RAC/dgbroker1.dat" dg_broker_config_file2 = "+FRA/RAC/dgbroker2.dat" 2017-04-10 23:33:20.858 DMON: Attach state object 2017-04-10 23:33:21.407 DMON: rfafoGetLocks reinitializing dubious PMYSHUT lock value block contents: sts=0, flags=0x0, spare1=0x0, spare2=0x0, cksm=0x0, rndm=0x0 2017-04-10 23:33:21.407 DMON: Broker state reconciled, version = 0, state = 00000000 2017-04-10 23:33:21.407 DMON: Broker State Initialized 2017-04-10 23:33:21.407 Version = 1 2017-04-10 23:33:21.407 State = 00000000 2017-04-10 23:33:21.407 DMON: Entered rfm_get_chief_lock() for CTL_BOOTSTRAP, reason 2 2017-04-10 23:33:21.422 7fffffff 0 DMON: Entered rfm_get_chief_lock() for CTL_BOOTSTRAP, reason 0 2017-04-10 23:33:24.580 7fffffff 0 DMON: start task execution: broker initialization 2017-04-10 23:33:24.580 DMON: Boot configuration (0.0.0), loading from "+DATA/RAC/dgbroker1.dat" 2017-04-10 23:33:24.856 DMON Registering service RAC_DGB with listener(s) 2017-04-10 23:33:24.857 DMON: Executing SQL [ALTER SYSTEM REGISTER] 2017-04-10 23:33:24.902 SQL [ALTER SYSTEM REGISTER] Executed successfully 04/10/2017 23:33:25 Broker Configuration: "rac" Protection Mode: Maximum Performance Fast-Start Failover (FSFO): Disabled, flags=0x0, version=0 Primary Database: stby (0x02010000) Physical standby bootstrap requires Oracle Clusterware buildup 04/10/2017 23:33:39 Notifying Oracle Clusterware to buildup 04/10/2017 23:33:41 rac version check successfully completed Broker configuration file is current on rac, completing initialization Creating process RSM0 04/10/2017 23:42:33 Data Guard Broker shutting down Data Guard Broker - notifying primary of shutdown posting shutdown message to primary database 0x02001000 RSM0 successfully terminated 2017-04-10 23:42:36.437 >> DMON Process Shutdown << ============================================================================================= Mon Apr 10 23:30:59 2017 SWITCHOVER VERIFY: Send VERIFY request to switchover target stby SWITCHOVER VERIFY COMPLETE SWITCHOVER VERIFY: Send VERIFY request to switchover target stby SWITCHOVER VERIFY COMPLETE ALTER DATABASE SWITCHOVER TO 'stby' Mon Apr 10 23:31:04 2017 Starting switchover [Process ID: 17791] Mon Apr 10 23:31:04 2017 ALTER DATABASE COMMIT TO SWITCHOVER TO PHYSICAL STANDBY [Process Id: 17791] (RAC1) Waiting for target standby to receive all redo Mon Apr 10 23:31:04 2017 Waiting for all non-current ORLs to be archived... Mon Apr 10 23:31:04 2017 All non-current ORLs have been archived. Mon Apr 10 23:31:04 2017 Waiting for all FAL entries to be archived... Mon Apr 10 23:31:04 2017 All FAL entries have been archived. Mon Apr 10 23:31:04 2017 Waiting for dest_id 2 to become synchronized... Mon Apr 10 23:31:05 2017 Active, synchronized Physical Standby switchover target has been identified Preventing updates and queries at the Primary Generating and shipping final logs to target standby Switchover End-Of-Redo Log thread 1 sequence 70 has been fixed Switchover End-Of-Redo Log thread 2 sequence 39 has been fixed Switchover: Primary highest seen SCN set to 0x0.0x3553b3 ARCH: Noswitch archival of thread 2, sequence 39 ARCH: End-Of-Redo Branch archival of thread 2 sequence 39 ARCH: LGWR is actively archiving destination LOG_ARCHIVE_DEST_2 ARCH: Standby redo logfile selected for thread 2 sequence 39 for destination LOG_ARCHIVE_DEST_2 ARCH: Noswitch archival of thread 1, sequence 70 ARCH: End-Of-Redo Branch archival of thread 1 sequence 70 ARCH: LGWR is actively archiving destination LOG_ARCHIVE_DEST_2 ARCH: Standby redo logfile selected for thread 1 sequence 70 for destination LOG_ARCHIVE_DEST_2 ARCH: Archiving is disabled due to current logfile archival Primary will check for some target standby to have received all redo Waiting for target standby to apply all redo Backup controlfile written to trace file /u01/app/oracle/diag/rdbms/rac/RAC1/trace/RAC1_rsm0_17791.trc Converting the primary database to a new standby database Clearing standby activation ID 2519803190 (0x96312536) The primary database controlfile was created using the 'MAXLOGFILES 192' clause. There is space for up to 188 standby redo logfiles Use the following SQL commands on the standby database to create standby redo logfiles that match the primary database: ALTER DATABASE ADD STANDBY LOGFILE 'srl1.f' SIZE 52428800; ALTER DATABASE ADD STANDBY LOGFILE 'srl2.f' SIZE 52428800; ALTER DATABASE ADD STANDBY LOGFILE 'srl3.f' SIZE 52428800; ALTER DATABASE ADD STANDBY LOGFILE 'srl4.f' SIZE 52428800; ALTER DATABASE ADD STANDBY LOGFILE 'srl5.f' SIZE 52428800; Archivelog for thread 1 sequence 70 required for standby recovery Archivelog for thread 2 sequence 39 required for standby recovery Offline data file 5 marked as online during convert to standby or switchover to standby. Restore of backup may be required if the file is not physically accessible. Offline data file 7 marked as online during convert to standby or switchover to standby. Restore of backup may be required if the file is not physically accessible. Switchover: Primary controlfile converted to standby controlfile succesfully. Mon Apr 10 23:31:14 2017 minact-scn status: grec-scn:0x0000.00000000 gmin-scn:0x0000.0033ccde gcalc-scn:0x0000.0033ccee minact-scn: master found reconf/inst-rec before recscn scan old-inc#:4 new-inc#:4 Mon Apr 10 23:31:14 2017 Submitted all GCS remote-cache requests Fix write in gcs resources Mon Apr 10 23:31:14 2017 Reconfiguration complete (total time 0.6 secs) Mon Apr 10 23:31:19 2017 Switchover complete. Database shutdown required Completed: ALTER DATABASE SWITCHOVER TO 'stby' Target standby stby did not have Active Data Guard enabled at the time of switchover. To maintain Active Data Guard license compliance Block Change Tracking will be disabled. Mon Apr 10 23:31:21 2017 Errors in file /u01/app/oracle/diag/rdbms/rac/RAC1/trace/RAC1_rfs_6513.trc: ORA-16456: switchover to standby in progress or completed Mon Apr 10 23:31:22 2017 Errors in file /u01/app/oracle/diag/rdbms/rac/RAC1/trace/RAC1_rfs_6518.For optimal performance, configure system with expected number of pages for every supported system pagesize prior to the next instance restart operation. Mon Apr 10 23:31:42 2017 ********************************************************************** LICENSE_MAX_SESSION = 0 LICENSE_SESSIONS_WARNING = 0 Initial number of CPU is 2 Number of processor cores in the system is 2 Number of processor sockets in the system is 1 Private Interface 'eth1:1' configured from GPnP for use as a private interconnect. [name='eth1:1', type=1, ip=169.254.3.70, mac=08-00-27-6f-ef-ba, net=169.254.0.0/16, mask=255.255.0.0, use=haip:cluster_interconnect/62] Public Interface 'eth0' configured from GPnP for use as a public interface. [name='eth0', type=1, ip=192.168.78.51, mac=08-00-27-44-0e-4c, net=192.168.78.0/24, mask=255.255.255.0, use=public/1] Public Interface 'eth0:1' configured from GPnP for use as a public interface. [name='eth0:1', type=1, ip=192.168.78.61, mac=08-00-27-44-0e-4c, net=192.168.78.0/24, mask=255.255.255.0, use=public/1] Public Interface 'eth0:4' configured from GPnP for use as a public interface. [name='eth0:4', type=1, ip=192.168.78.251, mac=08-00-27-44-0e-4c, net=192.168.78.0/24, mask=255.255.255.0, use=public/1] Public Interface 'eth0:5' configured from GPnP for use as a public interface. [name='eth0:5', type=1, ip=192.168.78.252, mac=08-00-27-44-0e-4c, net=192.168.78.0/24, mask=255.255.255.0, use=public/1] Picked latch-free SCN scheme 3 Autotune of undo retention is turned on. LICENSE_MAX_USERS = 0 SYS auditing is enabled NOTE: remote asm mode is local (mode 0x1; from cluster type) Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production With the Partitioning, Real Application Clusters, OLAP, Advanced Analytics and Real Application Testing options. ORACLE_HOME = /u01/app/oracle/product/12.1.0/dbhome_1 System name: Linux Node name: collabn1.racattack Release: 2.6.39-400.17.1.el6uek.x86_64 Version: #1 SMP Fri Feb 22 18:16:18 PST 2013 Machine: x86_64 Using parameter settings in server-side pfile /u01/app/oracle/product/12.1.0/dbhome_1/dbs/initRAC1.ora System parameters with non-default values: processes = 300 sga_max_size = 800M spfile = "+DATA/RAC/spfilerac.ora" control_files = "+DATA/RAC/CONTROLFILE/current.282.931825275" control_files = "+FRA/RAC/CONTROLFILE/current.256.931825275" db_block_size = 8192 db_cache_size = 100M compatible = "12.1.0.2.0" log_archive_dest_1 = "location=USE_DB_RECOVERY_FILE_DEST" log_archive_dest_1 = "valid_for=(ALL_LOGFILES, ALL_ROLES)" log_archive_dest_2 = "service="stby"" log_archive_dest_2 = "ASYNC NOAFFIRM delay=0 optional compression=disable max_failure=0 max_connections=1 reopen=300 db_unique_name="stby" net_timeout=30" log_archive_dest_2 = "valid_for=(online_logfile,all_roles)" log_archive_dest_state_2 = "ENABLE" log_archive_min_succeed_dest= 1 log_archive_trace = 0 log_archive_config = "dg_config=(RAC,stby)" log_archive_format = "%t_%s_%r.dbf" log_archive_max_processes= 4 archive_lag_target = 0 cluster_database = TRUE db_create_file_dest = "+DATA" db_recovery_file_dest = "+FRA" db_recovery_file_dest_size= 4785M standby_file_management = "MANUAL" thread = 1 undo_tablespace = "UNDOTBS1" instance_number = 1 remote_login_passwordfile= "EXCLUSIVE" db_domain = "racattack" dispatchers = "(PROTOCOL=TCP) (SERVICE=RACXDB)" audit_file_dest = "/u01/app/oracle/admin/RAC/adump" audit_trail = "DB" db_name = "RAC" open_cursors = 300 dg_broker_start = TRUE dg_broker_config_file1 = "+DATA/RAC/dgbroker1.dat" dg_broker_config_file2 = "+FRA/RAC/dgbroker2.dat" diagnostic_dest = "/u01/app/oracle" enable_pluggable_database= TRUE Mon Apr 10 23:31:52 2017 NOTE: remote asm mode is local (mode 0x1; from cluster type) Mon Apr 10 23:31:52 2017 Cluster communication is configured to use the following interface(s) for this instance 169.254.3.70 cluster interconnect IPC version: Oracle UDP/IP (generic) IPC Vendor 1 proto 2 Oracle instance running with ODM: Oracle Direct NFS ODM Library Version 3.Mon Apr 10 23:31:56 2017 MMNL started with pid=31, OS id=6965 starting up 1 shared server(s) ... 7 secs) Starting background process LCK0 Mon Apr 10 23:32:29 2017 LCK0 started with pid=39, OS id=7084 Starting background process RSMN Mon Apr 10 23:32:30 2017 RSMN started with pid=40, OS id=7094 Mon Apr 10 23:32:32 2017 Instance started by oraagent Starting background process DMON ORACLE_BASE from environment = /u01/app/oracle Mon Apr 10 23:32:32 2017 DMON started with pid=41, OS id=7100 Mon Apr 10 23:32:34 2017 ALTER SYSTEM SET local_listener=' (ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))' SCOPE=MEMORY SID='RAC1'; Mon Apr 10 23:32:35 2017 ALTER SYSTEM SET remote_listener=' collabn-cluster-scan.racattack:1521' SCOPE=MEMORY SID='RAC1'; ALTER DATABASE MOUNT /* db agent *//* {1:46642:1193} */ Mon Apr 10 23:32:36 2017 This instance was first to mount Mon Apr 10 23:32:38 2017 NOTE: ASMB mounting group 1 (DATA) NOTE: Assigning number (1,0) to disk (/dev/asm-disk1) NOTE: Assigning number (1,1) to disk (/dev/asm-disk2) NOTE: Assigning number (1,2) to disk (/dev/asm-disk5) SUCCESS: mounted group 1 (DATA) NOTE: grp 1 disk 0: DATA_0000 path:/dev/asm-disk1 NOTE: grp 1 disk 1: DATA_0001 path:/dev/asm-disk2 NOTE: grp 1 disk 2: DATA_0002 path:/dev/asm-disk5 NOTE: ASMB mounting group 2 (FRA) Mon Apr 10 23:32:39 2017 NOTE: dependency between database RAC and diskgroup resource ora.DATA.dg is established Mon Apr 10 23:32:39 2017 NOTE: Assigning number (2,0) to disk (/dev/asm-disk3) SUCCESS: mounted group 2 (FRA) NOTE: grp 2 disk 0: FRA_0000 path:/dev/asm-disk3 Mon Apr 10 23:32:40 2017 NOTE: dependency between database RAC and diskgroup resource ora.FRA.dg is established Mon Apr 10 23:32:46 2017 WARNING: STANDBY_FILE_MANAGEMENT initialization parameter is not set to the value "AUTO". This may cause recovery of the standby database to terminate prior to applying all available redo data. It may be necessary to use the ALTER DATABASE CREATE DATAFILE command to add datafiles created on the primary database. 5 secs) Mon Apr 10 23:34:15 2017 Archived Log entry 138 added for thread 1 sequence 72 ID 0x96bd0722 dest 1: Mon Apr 10 23:34:16 2017 Archived Log entry 139 added for thread 1 sequence 71 rlc 931825279 ID 0x96bd0722 dest 2: RFS[2]: Opened log for thread 2 sequence 40 dbid 2519807290 branch 931825279 Mon Apr 10 23:34:23 2017 Archived Log entry 140 added for thread 2 sequence 40 rlc 931825279 ID 0x0 dest 2: Mon Apr 10 23:34:28 2017 Parallel Media Recovery started with 2 slaves Completed: ALTER DATABASE RECOVER MANAGED STANDBY DATABASE DISCONNECT NODELAY Mon Apr 10 23:34:33 2017 Waiting for all non-current ORLs to be archived... Mon Apr 10 23:34:33 2017 All non-current ORLs have been archived. Clearing online redo logfile 1 +DATA/RAC/ONLINELOG/group_1.283.931825279 Clearing online log 1 of thread 1 sequence number 69 Mon Apr 10 23:34:50 2017 Clearing online redo logfile 1 complete Clearing online redo logfile 2 +DATA/RAC/ONLINELOG/group_2.284.931825283 Clearing online log 2 of thread 1 sequence number 70 Mon Apr 10 23:34:51 2017 Using STANDBY_ARCHIVE_DEST parameter default value as USE_DB_RECOVERY_FILE_DEST Mon Apr 10 23:35:00 2017 Increasing number of real time LMS from 0 to 1 Mon Apr 10 23:35:09 2017 Clearing online redo logfile 2 complete Clearing online redo logfile 3 +DATA/RAC/ONLINELOG/group_3.290.931826413 Clearing online log 3 of thread 2 sequence number 39 Mon Apr 10 23:35:22 2017 Clearing online redo logfile 3 complete Clearing online redo logfile 4 +DATA/RAC/ONLINELOG/group_4.291.931826417 Clearing online log 4 of thread 2 sequence number 38 Clearing online redo logfile 4 complete Mon Apr 10 23:35:28 2017 Media Recovery Log +FRA/RAC/ARCHIVELOG/2017_04_10/thread_2_seq_38.357.940980599 Mon Apr 10 23:35:28 2017 Media Recovery Log +FRA/RAC/ARCHIVELOG/2017_04_10/thread_1_seq_67.355.940978999 Mon Apr 10 23:35:29 2017 Media Recovery Log +FRA/RAC/ARCHIVELOG/2017_04_10/thread_1_seq_68.356.940980597 Mon Apr 10 23:35:31 2017 Media Recovery Log +FRA/RAC/ARCHIVELOG/2017_04_10/thread_1_seq_69.358.940980603 Mon Apr 10 23:35:32 2017 Media Recovery Log +FRA/RAC/ARCHIVELOG/2017_04_10/thread_2_seq_39.360.940980795 Mon Apr 10 23:35:35 2017 Media Recovery Log +FRA/RAC/ARCHIVELOG/2017_04_10/thread_1_seq_70.359.940980783 Mon Apr 10 23:35:38 2017 Resetting standby activation ID 0 (0x0) Mon Apr 10 23:35:39 2017 Media Recovery End-Of-Redo indicator encountered Mon Apr 10 23:35:39 2017 Media Recovery Continuing Mon Apr 10 23:35:39 2017 Media Recovery Log +FRA/RAC/ARCHIVELOG/2017_04_10/thread_1_seq_71.361.940980839 Mon Apr 10 23:35:39 2017 Media Recovery Log +FRA/RAC/ARCHIVELOG/2017_04_10/thread_2_seq_40.363.940980861 Mon Apr 10 23:35:39 2017 Media Recovery Log +FRA/RAC/ARCHIVELOG/2017_04_10/thread_1_seq_72.362.940980841 Mon Apr 10 23:35:51 2017 Media Recovery Waiting for thread 1 sequence 73 (in transit) Mon Apr 10 23:35:51 2017 Recovery of Online Redo Log: Thread 1 Group 6 Seq 73 Reading mem 0 Mem# 0: +DATA/RAC/ONLINELOG/group_6.298.937936361 Mem# 1: +FRA/RAC/ONLINELOG/group_6.304.937936363 Mon Apr 10 23:41:26 2017 Shutting down instance (immediate) Shutting down instance: further logons disabled Stopping background process MMNL Stopping background process MMON Mon Apr 10 23:41:28 2017 MRP0: Background Media Recovery cancelled with status 16037 Mon Apr 10 23:41:28 2017 Errors in file /u01/app/oracle/diag/rdbms/rac/RAC1/trace/RAC1_pr00_8020.trc: ORA-16037: user requested cancel of managed recovery operation Mon Apr 10 23:41:28 2017 Managed Standby Recovery not using Real Time Apply Mon Apr 10 23:41:29 2017 Recovery interrupted! Recovered data files to a consistent state at change 3497232 Mon Apr 10 23:41:29 2017 NOTE: Deferred communication with ASM instance NOTE: deferred map free for map id 99 Mon Apr 10 23:41:29 2017 Errors in file /u01/app/oracle/diag/rdbms/rac/RAC1/trace/RAC1_pr00_8020.trc: ORA-16037: user requested cancel of managed recovery operation Mon Apr 10 23:41:29 2017 MRP0: Background Media Recovery process shutdown (RAC1) Mon Apr 10 23:41:29 2017 NOTE: Deferred communication with ASM instance License high water mark = 10 Mon Apr 10 23:41:29 2017 All dispatchers and shared servers shutdown ALTER DATABASE CLOSE NORMAL Stopping Emon pool ORA-1109 signalled during: ALTER DATABASE CLOSE NORMAL... 2 secs) Mon Apr 10 23:42:31 2017 ARCH: Archival disabled due to shutdown: 1089 Shutting down archive processes Archiving is disabled Shutting down Data Guard Broker processes Mon Apr 10 23:42:36 2017 Completed: Data Guard Broker shutdown Mon Apr 10 23:42:37 2017 ARCH: Archival disabled due to shutdown: 1089 Shutting down archive processes Archiving is disabled Mon Apr 10 23:42:37 2017 Stopping background process VKTM Mon Apr 10 23:42:42 2017 freeing rdom 0 Mon Apr 10 23:42:44 2017 Instance shutdown complete





Next on node2 running instance RAC2 :

04/10/2017 23:34:35 >> Starting Data Guard Broker bootstrap << Broker Configuration File Locations: dg_broker_config_file1 = "+DATA/RAC/dgbroker1.dat" dg_broker_config_file2 = "+FRA/RAC/dgbroker2.dat" 2017-04-10 23:34:35.584 DMON: Attach state object 2017-04-10 23:34:35.991 DMON: Broker State Initialized 2017-04-10 23:34:35.991 Version = 3 2017-04-10 23:34:35.991 State = 00000000 2017-04-10 23:34:35.992 DMON: Entered rfm_get_chief_lock() for CTL_BOOTSTRAP, reason 2 2017-04-10 23:34:35.993 7fffffff 0 DMON: Entered rfm_get_chief_lock() for CTL_BOOTSTRAP, reason 0 2017-04-10 23:34:39.031 7fffffff 0 DMON: start task execution: broker initialization 2017-04-10 23:34:39.130 DMON: Boot configuration (0.0.0), loading from "+DATA/RAC/dgbroker1.dat" 2017-04-10 23:34:39.192 DMON Registering service RAC_DGB with listener(s) 2017-04-10 23:34:39.192 DMON: Executing SQL [ALTER SYSTEM REGISTER] 2017-04-10 23:34:39.193 SQL [ALTER SYSTEM REGISTER] Executed successfully 04/10/2017 23:34:39 Broker Configuration: "rac" Protection Mode: Maximum Performance Fast-Start Failover (FSFO): Disabled, flags=0x0, version=0 Primary Database: stby (0x02010000) 04/10/2017 23:34:47 rac version check successfully completed Broker configuration file is current on rac, completing initialization Creating process RSM0 04/10/2017 23:41:41 Data Guard Broker shutting down RSM0 successfully terminated 2017-04-10 23:41:44.For optimal performance, configure system with expected number of pages for every supported system pagesize prior to the next instance restart operation. Mon Apr 10 23:33:51 2017 ********************************************************************** LICENSE_MAX_SESSION = 0 LICENSE_SESSIONS_WARNING = 0 Initial number of CPU is 2 Number of processor cores in the system is 2 Number of processor sockets in the system is 1 Private Interface 'eth1:1' configured from GPnP for use as a private interconnect. [name='eth1:1', type=1, ip=169.254.178.54, mac=08-00-27-c5-68-87, net=169.254.0.0/16, mask=255.255.0.0, use=haip:cluster_interconnect/62] Public Interface 'eth0' configured from GPnP for use as a public interface. [name='eth0', type=1, ip=192.168.78.52, mac=08-00-27-1e-02-8d, net=192.168.78.0/24, mask=255.255.255.0, use=public/1] Public Interface 'eth0:1' configured from GPnP for use as a public interface. [name='eth0:1', type=1, ip=192.168.78.62, mac=08-00-27-1e-02-8d, net=192.168.78.0/24, mask=255.255.255.0, use=public/1] Public Interface 'eth0:2' configured from GPnP for use as a public interface. [name='eth0:2', type=1, ip=192.168.78.253, mac=08-00-27-1e-02-8d, net=192.168.78.0/24, mask=255.255.255.0, use=public/1] Picked latch-free SCN scheme 3 Autotune of undo retention is turned on. LICENSE_MAX_USERS = 0 SYS auditing is enabled NOTE: remote asm mode is local (mode 0x1; from cluster type) Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production With the Partitioning, Real Application Clusters, OLAP, Advanced Analytics and Real Application Testing options. ORACLE_HOME = /u01/app/oracle/product/12.1.0/dbhome_1 System name: Linux Node name: collabn2.racattack Release: 2.6.39-400.17.1.el6uek.x86_64 Version: #1 SMP Fri Feb 22 18:16:18 PST 2013 Machine: x86_64 Using parameter settings in server-side pfile /u01/app/oracle/product/12.1.0/dbhome_1/dbs/initRAC2.ora System parameters with non-default values: processes = 300 sga_max_size = 800M spfile = "+DATA/RAC/spfilerac.ora" control_files = "+DATA/RAC/CONTROLFILE/current.282.931825275" control_files = "+FRA/RAC/CONTROLFILE/current.256.931825275" db_block_size = 8192 db_cache_size = 100M compatible = "12.1.0.2.0" log_archive_dest_1 = "location=USE_DB_RECOVERY_FILE_DEST" log_archive_dest_1 = "valid_for=(ALL_LOGFILES, ALL_ROLES)" log_archive_dest_2 = "service="stby"" log_archive_dest_2 = "ASYNC NOAFFIRM delay=0 optional compression=disable max_failure=0 max_connections=1 reopen=300 db_unique_name="stby" net_timeout=30" log_archive_dest_2 = "valid_for=(online_logfile,all_roles)" log_archive_dest_state_2 = "ENABLE" log_archive_min_succeed_dest= 1 log_archive_trace = 0 log_archive_config = "dg_config=(RAC,stby)" log_archive_format = "%t_%s_%r.dbf" log_archive_max_processes= 4 archive_lag_target = 0 cluster_database = TRUE db_create_file_dest = "+DATA" db_recovery_file_dest = "+FRA" db_recovery_file_dest_size= 4785M standby_file_management = "MANUAL" thread = 2 undo_tablespace = "UNDOTBS2" instance_number = 2 remote_login_passwordfile= "EXCLUSIVE" db_domain = "racattack" dispatchers = "(PROTOCOL=TCP) (SERVICE=RACXDB)" audit_file_dest = "/u01/app/oracle/admin/RAC/adump" audit_trail = "DB" db_name = "RAC" open_cursors = 300 dg_broker_start = TRUE dg_broker_config_file1 = "+DATA/RAC/dgbroker1.dat" dg_broker_config_file2 = "+FRA/RAC/dgbroker2.dat" diagnostic_dest = "/u01/app/oracle" enable_pluggable_database= TRUE NOTE: remote asm mode is local (mode 0x1; from cluster type) Mon Apr 10 23:33:55 2017 Cluster communication is configured to use the following interface(s) for this instance 169.254.178.54 cluster interconnect IPC version: Oracle UDP/IP (generic) IPC Vendor 1 proto 2 Oracle instance running with ODM: Oracle Direct NFS ODM Library Version 3.Mon Apr 10 23:33:57 2017 MMNL started with pid=31, OS id=8323 Mon Apr 10 23:33:57 2017 NOTE: ASMB registering with ASM instance as Standard client 0xffffffffffffffff (reg:593534517) (new connection) Mon Apr 10 23:33:57 2017 starting up 1 shared server(s) ... 8 secs) Starting background process LCK0 Mon Apr 10 23:34:00 2017 LCK0 started with pid=38, OS id=8337 Mon Apr 10 23:34:00 2017 Using default pga_aggregate_limit of 2048 MB Starting background process RSMN Mon Apr 10 23:34:01 2017 RSMN started with pid=40, OS id=8351 Mon Apr 10 23:34:02 2017 Instance started by oraagent Starting background process DMON ORACLE_BASE from environment = /u01/app/oracle Mon Apr 10 23:34:02 2017 DMON started with pid=41, OS id=8353 Mon Apr 10 23:34:03 2017 ALTER SYSTEM SET local_listener=' (ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.62)(PORT=1521))' SCOPE=MEMORY SID='RAC2'; Mon Apr 10 23:34:03 2017 ALTER SYSTEM SET remote_listener=' collabn-cluster-scan.racattack:1521' SCOPE=MEMORY SID='RAC2'; ALTER DATABASE MOUNT /* db agent *//* {1:46642:1276} */ Mon Apr 10 23:34:04 2017 NOTE: ASMB mounting group 1 (DATA) NOTE: Assigning number (1,0) to disk (/dev/asm-disk1) NOTE: Assigning number (1,1) to disk (/dev/asm-disk2) NOTE: Assigning number (1,2) to disk (/dev/asm-disk5) SUCCESS: mounted group 1 (DATA) NOTE: grp 1 disk 0: DATA_0000 path:/dev/asm-disk1 NOTE: grp 1 disk 1: DATA_0001 path:/dev/asm-disk2 NOTE: grp 1 disk 2: DATA_0002 path:/dev/asm-disk5 Mon Apr 10 23:34:04 2017 NOTE: dependency between database RAC and diskgroup resource ora.DATA.dg is established Mon Apr 10 23:34:04 2017 NOTE: ASMB mounting group 2 (FRA) NOTE: Assigning number (2,0) to disk (/dev/asm-disk3) SUCCESS: mounted group 2 (FRA) NOTE: grp 2 disk 0: FRA_0000 path:/dev/asm-disk3 Mon Apr 10 23:34:04 2017 NOTE: dependency between database RAC and diskgroup resource ora.FRA.dg is established Mon Apr 10 23:34:14 2017 WARNING: STANDBY_FILE_MANAGEMENT initialization parameter is not set to the value "AUTO". This may cause recovery of the standby database to terminate prior to applying all available redo data. It may be necessary to use the ALTER DATABASE CREATE DATAFILE command to add datafiles created on the primary database. Lost write protection disabled Completed: ALTER DATABASE MOUNT /* db agent *//* {1:46642:1276} */ Mon Apr 10 23:34:35 2017 Starting Data Guard Broker (DMON) Starting background process INSV Mon Apr 10 23:34:36 2017 INSV started with pid=42, OS id=8424 Starting background process NSV1 Mon Apr 10 23:34:39 2017 NSV1 started with pid=51, OS id=8432 Starting background process RSM0 Mon Apr 10 23:34:47 2017 RSM0 started with pid=52, OS id=8439 Mon Apr 10 23:34:51 2017 Using STANDBY_ARCHIVE_DEST parameter default value as USE_DB_RECOVERY_FILE_DEST Using STANDBY_ARCHIVE_DEST parameter default value as USE_DB_RECOVERY_FILE_DEST Mon Apr 10 23:34:51 2017 ALTER SYSTEM SET log_archive_dest_2='' SCOPE=BOTH; Mon Apr 10 23:34:51 2017 ALTER SYSTEM SET log_archive_dest_state_2='ENABLE' SCOPE=BOTH; Mon Apr 10 23:34:52 2017 ALTER SYSTEM SET log_archive_trace=0 SCOPE=BOTH SID='RAC2'; Mon Apr 10 23:34:52 2017 ALTER SYSTEM SET log_archive_format='%t_%s_%r.dbf' SCOPE=SPFILE SID='RAC2'; Mon Apr 10 23:41:28 2017 Managed Standby Recovery not using Real Time Apply Mon Apr 10 23:41:30 2017 ARC2: Becoming the active heartbeat ARCH ARC2: Becoming the active heartbeat ARCH Mon Apr 10 23:41:37 2017 Shutting down instance (immediate) Shutting down instance: further logons disabled Stopping background process MMNL Stopping background process MMON License high water mark = 2 Mon Apr 10 23:41:40 2017 All dispatchers and shared servers shutdown ALTER DATABASE CLOSE NORMAL Stopping Emon pool ORA-1109 signalled during: ALTER DATABASE CLOSE NORMAL...




Next, the original Standby (SingleInstance) node: the drcSTBY.log and alert_STBY.log

04/10/2017 23:31:03 Notifying Oracle Clusterware to prepare target standby database for switchover 04/10/2017 23:33:49 Deferring associated archivelog destinations of sites permanently disabled due to Switchover Notifying Oracle Clusterware to buildup primary database after switchover Switchover Complete New Primary Site is named: stby 04/10/2017 23:41:22 Notifying DMON of db close Notifying RSM0 of db close 04/10/2017 23:41:27 Data Guard Broker shutting down RSM0 successfully terminated 2017-04-10 23:41:30.761 >> DMON Process Shutdown << 04/10/2017 23:41:55 >> Starting Data Guard Broker bootstrap << Broker Configuration File Locations: dg_broker_config_file1 = "/u01/app/oracle/product/12.1.0/dbhome_1/dbs/dr1STBY.dat" dg_broker_config_file2 = "/u01/app/oracle/product/12.1.0/dbhome_1/dbs/dr2STBY.dat" 2017-04-10 23:41:55.856 DMON: Attach state object 2017-04-10 23:41:55.856 DMON: rfafoGetLocks reinitializing dubious PMYSHUT lock value block contents: sts=0, flags=0x0, spare1=0x0, spare2=0x0, cksm=0x0, rndm=0x0 2017-04-10 23:41:55.857 DMON: Broker state reconciled, version = 0, state = 00000000 2017-04-10 23:41:55.857 DMON: Broker State Initialized 2017-04-10 23:41:55.857 Version = 1 2017-04-10 23:41:55.857 State = 00000000 2017-04-10 23:41:55.857 DMON: Entered rfm_get_chief_lock() for CTL_BOOTSTRAP, reason 2 2017-04-10 23:41:55.857 7fffffff 0 DMON: Entered rfm_get_chief_lock() for CTL_BOOTSTRAP, reason 0 2017-04-10 23:41:58.902 7fffffff 0 DMON: start task execution: broker initialization 2017-04-10 23:41:58.902 DMON: Boot configuration (0.0.0), loading from "/u01/app/oracle/product/12.1.0/dbhome_1/dbs/dr1STBY.dat" 2017-04-10 23:41:58.903 DMON Registering service STBY_DGB with listener(s) 2017-04-10 23:41:58.903 DMON: Executing SQL [ALTER SYSTEM REGISTER] 2017-04-10 23:41:58.904 SQL [ALTER SYSTEM REGISTER] Executed successfully 04/10/2017 23:41:58 Broker Configuration: "rac" Protection Mode: Maximum Performance Fast-Start Failover (FSFO): Disabled, flags=0x0, version=0 Primary Database: stby (0x02010000) 04/10/2017 23:42:11 Failed to connect to remote database rac. Error is ORA-12528 Failed to send message to site rac. Error code is ORA-12528. Version Check Results: Database rac returned ORA-12528 Creating process RSM0 04/10/2017 23:42:35 Processing shutdown notification from database rac, instance 1 Broker operation Setting SHUTDOWN status for database rac 04/10/2017 23:45:20 Notifying DMON of db close Notifying RSM0 of db close 04/10/2017 23:45:28 Data Guard Broker shutting down RSM0 successfully terminated 2017-04-10 23:45:31.Mon Apr 10 23:31:15 2017 ALTER DATABASE SWITCHOVER TO PRIMARY (STBY) Maximum wait for role transition is 15 minutes. Switchover: Media recovery is still active Role Change: Canceling MRP - no more redo to apply Mon Apr 10 23:31:15 2017 MRP0: Background Media Recovery cancelled with status 16037 Mon Apr 10 23:31:15 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_pr00_29969.trc: ORA-16037: user requested cancel of managed recovery operation Managed Standby Recovery not using Real Time Apply Recovery interrupted! Mon Apr 10 23:31:16 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_pr00_29969.trc: ORA-16037: user requested cancel of managed recovery operation Mon Apr 10 23:31:16 2017 MRP0: Background Media Recovery process shutdown (STBY) Mon Apr 10 23:31:17 2017 Role Change: Canceled MRP Killing 1 processes (PIDS:30372) (all RFS) in order to disallow current and future RFS connections. Requested by OS process 30402 Backup controlfile written to trace file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_rmi_30402.trc SwitchOver after complete recovery through change 3494835 Online logfile pre-clearing operation disabled by switchover Online log /u01/app/oracle/oradata/STBY/onlinelog/group_1.283.931825279: Thread 1 Group 1 was previously cleared Online log /u01/app/oracle/fast_recovery_area/STBY/onlinelog/group_1.257.931825281: Thread 1 Group 1 was previously cleared Online log /u01/app/oracle/oradata/STBY/onlinelog/group_2.284.931825283: Thread 1 Group 2 was previously cleared Online log /u01/app/oracle/fast_recovery_area/STBY/onlinelog/group_2.258.931825287: Thread 1 Group 2 was previously cleared Online log /u01/app/oracle/oradata/STBY/onlinelog/group_3.290.931826413: Thread 2 Group 3 was previously cleared Online log /u01/app/oracle/fast_recovery_area/STBY/onlinelog/group_3.259.931826417: Thread 2 Group 3 was previously cleared Online log /u01/app/oracle/oradata/STBY/onlinelog/group_4.291.931826417: Thread 2 Group 4 was previously cleared Online log /u01/app/oracle/fast_recovery_area/STBY/onlinelog/group_4.260.931826421: Thread 2 Group 4 was previously cleared Standby became primary SCN: 3494833 Switchover: Complete - Database mounted as primary SWITCHOVER: completed request from primary database. Mon Apr 10 23:31:21 2017 Using STANDBY_ARCHIVE_DEST parameter default value as USE_DB_RECOVERY_FILE_DEST Mon Apr 10 23:31:21 2017 ALTER SYSTEM SET log_archive_dest_2='service="rac1"','ASYNC NOAFFIRM delay=0 optional compression=disable max_failure=0 max_connections=1 reopen=300 db_unique_name="rac" net_timeout=30','valid_for=(online_logfile,all_roles)' SCOPE=BOTH; Mon Apr 10 23:31:21 2017 ARC0: Becoming the 'no SRL' ARCH Mon Apr 10 23:31:21 2017 ALTER SYSTEM SET log_archive_dest_state_2='ENABLE' SCOPE=BOTH; ALTER DATABASE OPEN Mon Apr 10 23:31:21 2017 Data Guard Broker initializing... Ping without log force is disabled . Mon Apr 10 23:31:21 2017 Assigning activation ID 2528970530 (0x96bd0722) Mon Apr 10 23:31:21 2017 Thread 1 advanced to log sequence 72 (thread open) Thread 1 opened at log sequence 72 Current log# 2 seq# 72 mem# 0: /u01/app/oracle/oradata/STBY/onlinelog/group_2.284.931825283 Current log# 2 seq# 72 mem# 1: /u01/app/oracle/fast_recovery_area/STBY/onlinelog/group_2.258.931825287 Successful open of redo thread 1 Mon Apr 10 23:31:21 2017 MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set Mon Apr 10 23:31:21 2017 SMON: enabling cache recovery Mon Apr 10 23:31:21 2017 ****************************************************************** TT00: Setting 'active' archival for destination LOG_ARCHIVE_DEST_2 ****************************************************************** Mon Apr 10 23:31:21 2017 Archived Log entry 46 added for thread 1 sequence 71 ID 0x96bd0722 dest 1: Mon Apr 10 23:31:21 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_tt00_30433.trc: ORA-16456: switchover to standby in progress or completed Mon Apr 10 23:31:21 2017 Error 16456 for archive log file 2 to 'rac1' Mon Apr 10 23:31:22 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_arc3_29915.trc: ORA-16456: switchover to standby in progress or completed Mon Apr 10 23:31:22 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_tt00_30433.trc: ORA-16456: switchover to standby in progress or completed Mon Apr 10 23:31:22 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_tt00_30433.trc: ORA-16456: switchover to standby in progress or completed Mon Apr 10 23:31:22 2017 FAL[server, ARC3]: Error 16456 creating remote archivelog file 'rac1' ARC3: FAL archive failed with error 16456. See trace for details Mon Apr 10 23:31:22 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_arc3_29915.trc: ORA-16055: FAL request rejected ARCH: FAL archive failed. Archiver continuing Mon Apr 10 23:31:22 2017 ORACLE Instance STBY - Archival Error. Archiver continuing. Mon Apr 10 23:31:24 2017 [29938] Successfully onlined Undo Tablespace 2. Undo initialization finished serial:0 start:4159104 end:4161254 diff:2150 ms (2.2 seconds) Dictionary check beginning Dictionary check complete Verifying minimum file header compatibility (11g) for tablespace encryption.. Trying to get it from Buffer Cache for process 29792. Mon Apr 10 23:33:37 2017 Opening pdb PDB (3) with no Resource Manager plan active Mon Apr 10 23:33:38 2017 =========================================================== Dumping current patch information =========================================================== No patches have been applied =========================================================== Mon Apr 10 23:33:38 2017 Pluggable database PDB opened read write Completed: ALTER PLUGGABLE DATABASE ALL OPEN Mon Apr 10 23:33:38 2017 ALTER SYSTEM SET log_archive_trace=0 SCOPE=BOTH SID='STBY'; Mon Apr 10 23:33:39 2017 ALTER SYSTEM SET log_archive_format='%t_%s_%r.283.931825279 Current log# 1 seq# 73 mem# 1: /u01/app/oracle/fast_recovery_area/STBY/onlinelog/group_1.257.931825281 Mon Apr 10 23:33:46 2017 db_recovery_file_dest_size of 16384 MB is 0.73% used. This is a user-specified limit on the amount of space that will be used by this database for recovery-related files, and does not reflect the amount of space available in the underlying filesystem or ASM diskgroup. For optimal performance, configure system with expected number of pages for every supported system pagesize prior to the next instance restart operation. Mon Apr 10 23:41:44 2017 ********************************************************************** LICENSE_MAX_SESSION = 0 LICENSE_SESSIONS_WARNING = 0 Initial number of CPU is 2 Number of processor cores in the system is 2 Number of processor sockets in the system is 1 _ksb_restart_policy_times={0,60,120,240} Picked latch-free SCN scheme 3 Autotune of undo retention is turned on. IMODE=BR ILAT =35 LICENSE_MAX_USERS = 0 SYS auditing is enabled NOTE: remote asm mode is local (mode 0x1; from cluster type) NOTE: Using default ASM root directory ASM Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production With the Partitioning, OLAP, Advanced Analytics and Real Application Testing options. ORACLE_HOME = /u01/app/oracle/product/12.1.0/dbhome_1 System name: Linux Node name: oem132.racattack Release: 2.6.39-400.17.1.el6uek.x86_64 Version: #1 SMP Fri Feb 22 18:16:18 PST 2013 Machine: x86_64 Using parameter settings in server-side spfile /u01/app/oracle/product/12.1.0/dbhome_1/dbs/spfileSTBY.ora System parameters with non-default values: _ksb_restart_policy_times= "0" _ksb_restart_policy_times= "60" _ksb_restart_policy_times= "120" _ksb_restart_policy_times= "240" sga_target = 800M control_files = "/u01/app/oracle/oradata/STBY/controlfile/o1_mf_ddbs0p3w_.ctl" control_files = "/u01/app/oracle/fast_recovery_area/STBY/controlfile/o1_mf_ddbs0p40_.ctl" db_file_name_convert = "+DATA/RAC" db_file_name_convert = "/u01/app/oracle/oradata/STBY" db_file_name_convert = "+FRA/RAC" db_file_name_convert = "/u01/app/oracle/fast_recovery_area/STBY" log_file_name_convert = "+DATA/RAC" log_file_name_convert = "/u01/app/oracle/oradata/STBY" log_file_name_convert = "+FRA/RAC" log_file_name_convert = "/u01/app/oracle/fast_recovery_area/STBY" compatible = "12.1.0.2.0" log_archive_dest_1 = "location=USE_DB_RECOVERY_FILE_DEST" log_archive_dest_1 = "valid_for=(ALL_LOGFILES, ALL_ROLES)" log_archive_dest_2 = "service="rac1"" log_archive_dest_2 = "ASYNC NOAFFIRM delay=0 optional compression=disable max_failure=0 max_connections=1 reopen=300 db_unique_name="rac" net_timeout=30" log_archive_dest_2 = "valid_for=(online_logfile,all_roles)" log_archive_dest_state_2 = "ENABLE" log_archive_min_succeed_dest= 1 fal_server = "rac1" log_archive_trace = 0 log_archive_config = "dg_config=(rac)" log_archive_format = "%t_%s_%r.dbf" log_archive_max_processes= 4 log_buffer = 5064K archive_lag_target = 0 db_create_file_dest = "/u01/app/oracle/oradata" db_recovery_file_dest = "/u01/app/oracle/fast_recovery_area" db_recovery_file_dest_size= 16G standby_file_management = "MANUAL" _compression_compatibility= "12.1.0.2.0" remote_login_passwordfile= "EXCLUSIVE" connection_brokers = "((TYPE=DEDICATED)(BROKERS=1))" connection_brokers = "((TYPE=EMON)(BROKERS=1))" plsql_warnings = "DISABLE:ALL" result_cache_max_size = 4M _gby_vector_aggregation_enabled= TRUE _optimizer_vector_transformation= TRUE core_dump_dest = "/u01/app/oracle/diag/rdbms/stby/STBY/cdump" db_name = "RAC" db_unique_name = "STBY" optimizer_mode = "ALL_ROWS" _optimizer_mode_force = TRUE _always_anti_join = "CHOOSE" _optimizer_null_aware_antijoin= TRUE _optimizer_partial_join_eval= TRUE _partition_view_enabled = TRUE _b_tree_bitmap_plans = TRUE _cpu_to_io = 0 _optimizer_extended_cursor_sharing= "UDO" _optimizer_extended_cursor_sharing_rel= "SIMPLE" _optimizer_adaptive_cursor_sharing= TRUE _optimizer_cost_model = "CHOOSE" _optimizer_undo_cost_change= "12.1.0.Mon Apr 10 23:41:55 2017 Starting Data Guard Broker (DMON) Starting background process INSV Mon Apr 10 23:41:55 2017 INSV started with pid=24, OS id=1402 Mon Apr 10 23:41:56 2017 Data Guard Broker initialization complete Data Guard: verifying database primary role... Starting background process NSV0 Mon Apr 10 23:41:58 2017 NSV0 started with pid=25, OS id=1410 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=rac_DGB.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:01 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=rac_DGB.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:01 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=rac_DGB.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:01 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=rac_DGB.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:01 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:01 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:01 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:01 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:01 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=rac_DGB.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:11 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=rac_DGB.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:11 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=rac_DGB.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:11 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=rac_DGB.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:11 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:11 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:11 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:11 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:11 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 Starting background process RSM0 Mon Apr 10 23:42:11 2017 RSM0 started with pid=26, OS id=1452 Mon Apr 10 23:42:12 2017 Data Guard: version check completed Data Guard: primary role verified Ping without log force is disabled . 284.931825283 Current log# 2 seq# 74 mem# 1: /u01/app/oracle/fast_recovery_area/STBY/onlinelog/group_2.258.931825287 Successful open of redo thread 1 Mon Apr 10 23:42:13 2017 MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set Mon Apr 10 23:42:13 2017 SMON: enabling cache recovery Mon Apr 10 23:42:13 2017 ****************************************************************** TT00: Setting 'active' archival for destination LOG_ARCHIVE_DEST_2 ****************************************************************** *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:13 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:13 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:13 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:13 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 Error 12528 received logging on to the standby Mon Apr 10 23:42:13 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_tt00_1468.trc: ORA-12528: TNS:listener: all appropriate instances are blocking new connections Error 12528 for archive log file 2 to 'rac1' Mon Apr 10 23:42:13 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_tt00_1468.trc: ORA-12528: TNS:listener: all appropriate instances are blocking new connections Mon Apr 10 23:42:13 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_tt00_1468.trc: ORA-12528: TNS:listener: all appropriate instances are blocking new connections Mon Apr 10 23:42:13 2017 Archived Log entry 52 added for thread 1 sequence 73 ID 0x96bd0722 dest 1: *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:13 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:13 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:13 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:13 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 Error 12528 received logging on to the standby Mon Apr 10 23:42:13 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_arc0_1460.trc: ORA-12528: TNS:listener: all appropriate instances are blocking new connections FAL[server, ARC0]: Error 12528 creating remote archivelog file 'rac1' ARC0: FAL archive failed with error 12528. See trace for details Mon Apr 10 23:42:13 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_arc0_1460.trc: ORA-16055: FAL request rejected ARCH: FAL archive failed. Archiver continuing Mon Apr 10 23:42:13 2017 ORACLE Instance STBY - Archival Error. Archiver continuing. Mon Apr 10 23:42:14 2017 [1400] Successfully onlined Undo Tablespace 2. Undo initialization finished serial:0 start:4809484 end:4810074 diff:590 ms (0.6 seconds) Verifying minimum file header compatibility (11g) for tablespace encryption.. Verifying 11g file header compatibility for tablespace encryption completed Mon Apr 10 23:42:14 2017 SMON: enabling tx recovery Starting background process SMCO Mon Apr 10 23:42:14 2017 SMCO started with pid=34, OS id=1474 Mon Apr 10 23:42:14 2017 Database Characterset is AL32UTF8 No Resource Manager plan active Mon Apr 10 23:42:16 2017 Using STANDBY_ARCHIVE_DEST parameter default value as USE_DB_RECOVERY_FILE_DEST Mon Apr 10 23:42:16 2017 ****************************************************************** TT00: Setting 'active' archival for destination LOG_ARCHIVE_DEST_2 ****************************************************************** *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 Error 12528 received logging on to the standby *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 Mon Apr 10 23:42:16 2017 Error 12528 received logging on to the standby Mon Apr 10 23:42:16 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_arc2_1464.trc: ORA-12528: TNS:listener: all appropriate instances are blocking new connections PING[ARC2]: Heartbeat failed to connect to standby 'rac1'. Error is 12528. Mon Apr 10 23:42:16 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_tt00_1468.trc: ORA-12528: TNS:listener: all appropriate instances are blocking new connections Mon Apr 10 23:42:16 2017 Error 12528 for archive log file 2 to 'rac1' Mon Apr 10 23:42:16 2017 ALTER SYSTEM SET log_archive_dest_state_2='ENABLE' SCOPE=BOTH; *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 *********************************************************************** Fatal NI connect error 12528, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=192.168.78.61)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SERVICE_NAME=RAC.racattack)(CID=(PROGRAM=oracle)(HOST=oem132.racattack)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 12.1.0.2.0 - Production TCP/IP NT Protocol Adapter for Linux: Version 12.1.0.2.0 - Production Time: 10-APR-2017 23:42:16 Tracing not turned on. Tns error struct: ns main err code: 12564 TNS-12564: TNS:connection refused ns secondary err code: 0 nt main err code: 0 nt secondary err code: 0 nt OS err code: 0 Mon Apr 10 23:42:16 2017 Error 12528 received logging on to the standby Mon Apr 10 23:42:16 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_arc2_1464.trc: ORA-12528: TNS:listener: all appropriate instances are blocking new connections PING[ARC2]: Heartbeat failed to connect to standby 'rac1'. Error is 12528. Mon Apr 10 23:42:17 2017 ALTER SYSTEM SET log_archive_trace=0 SCOPE=BOTH SID='STBY'; Mon Apr 10 23:42:17 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_tt00_1468.trc: ORA-12528: TNS:listener: all appropriate instances are blocking new connections Mon Apr 10 23:42:17 2017 Errors in file /u01/app/oracle/diag/rdbms/stby/STBY/trace/STBY_tt00_1468.trc: ORA-12528: TNS:listener: all appropriate instances are blocking new connections Mon Apr 10 23:42:17 2017 ALTER SYSTEM SET log_archive_format='%t_%s_%r.dbf' SCOPE=SPFILE SID='STBY'; Mon Apr 10 23:42:17 2017 replication_dependency_tracking turned off (no async multimaster replication found) Mon Apr 10 23:42:18 2017 Thread 1 advanced to log sequence 75 (LGWR switch) Current log# 1 seq# 75 mem# 0: /u01/app/oracle/oradata/STBY/onlinelog/group_1.283.931825279 Current log# 1 seq# 75 mem# 1: /u01/app/oracle/fast_recovery_area/STBY/onlinelog/group_1.257.931825281 Mon Apr 10 23:42:18 2017 Archived Log entry 53 added for thread 1 sequence 74 ID 0x96bd0722 dest 1: Starting background process AQPC Mon Apr 10 23:42:18 2017 AQPC started with pid=37, OS id=1489 Mon Apr 10 23:42:21 2017 Database Characterset for PDB$SEED is AL32UTF8 Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Opening pdb PDB$SEED (2) with no Resource Manager plan active Mon Apr 10 23:42:35 2017 ALTER SYSTEM SET log_archive_dest_state_2='RESET' SCOPE=BOTH; Starting background process CJQ0 Completed: ALTER DATABASE OPEN Mon Apr 10 23:42:39 2017 CJQ0 started with pid=50, OS id=1904 Mon Apr 10 23:42:58 2017 Shared IO Pool defaulting to 36MB. Trying to get it from Buffer Cache for process 1365. =========================================================== Dumping current patch information =========================================================== No patches have been applied =========================================================== Mon Apr 10 23:42:59 2017 db_recovery_file_dest_size of 16384 MB is 0.84% used. This is a user-specified limit on the amount of space that will be used by this database for recovery-related files, and does not reflect the amount of space available in the underlying filesystem or ASM diskgroup. alter pluggable database pdb open Mon Apr 10 23:43:00 2017 Database Characterset for PDB is AL32UTF8 Due to limited space in shared pool (need 6094848 bytes, have 3981120 bytes), limiting Resource Manager entities from 2048 to 32 Mon Apr 10 23:43:15 2017 Opening pdb PDB (3) with no Resource Manager plan active Pluggable database PDB opened read write Completed: alter pluggable database pdb open Mon Apr 10 23:45:07 2017 alter pluggable database pdb close ALTER SYSTEM: Flushing buffer cache inst=0 container=3 local Mon Apr 10 23:45:12 2017 Pluggable database PDB closed Completed: alter pluggable database pdb close Shutting down instance (immediate) Stopping background process SMCO Shutting down instance: further logons disabled Stopping background process CJQ0 Killed process [email protected]

Ignore the Fatal NI and TNS errrors.  I plan to address them later.

.
.
.

Recent Posts

DG搭建过程中主库报错如下:
Fatal NI connect error 12528, connecting to:
(DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=172.20.0.134)(PORT=1521))(CONNECT_DATA=(SERVER=DEDICATED)(SID=orcl)(CID=(PROGRAM=oracle)(HOST=gdcdb)(USER=oracle))))

VERSION INFORMATION:
TNS for Linux: Version 11.2.0.4.0 – Production
TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.4.0 – Production
Time: 09-AUG-2016 16:39:36
Tracing not turned on.
Tns error struct:
ns main err code: 12564

TNS-12564: TNS:connection refused
ns secondary err code: 0
nt main err code: 0
nt secondary err code: 0
nt OS err code: 0
Error 12528 received logging on to the standby
Tue Aug 09 16:39:38 2016
Thread 1 advanced to log sequence 39105 (LGWR switch)
Current log# 3 seq# 39105 mem# 0: /u01/app/oracle/oradata/orcl/redo03.log
Tue Aug 09 16:39:39 2016
Archived Log entry 72876 added for thread 1 sequence 39104 ID 0x5424c602 dest 1:

查看从库侦听状态为BLOCKED状态.
11gR2下,umount从库的动态监听不可用.如果想先传归档,然后restore,必须得mount才行.
当然静态监听肯定是OK的.

Like this:

LikeLoading...

Related

This entry was posted in Oracle, 故障处理. Bookmark the permalink.
fatal ni connect error 12528, connecting to

Similar video

ORA 12528 - TNS:listener: all appropriate instances are blocking new connections

1 Comments

  1. Has casually found today this forum and it was registered to participate in discussion of this question.

Leave a Comment