OID Fails To Start with OIDCTL.log Error “Database insert error”

After a failed backup attempt on our infrastructure database ( offline ) . We found ourself ( as it seemed ) in a world of trouble when trying to startup the OPMN processes.
The metadata repostory database was up and still the OPMN processes would not start correctly ( init states and Stopped states where reported )
In the $ORACLE_HOME/opmn/logs/OIDCTL.log we found registration like:


10/04/12 10:28:23 Start process
Database insert error.


First we checked the database and found datafiles which needed recovery.


SQL> select FILE#, status from v$datafile;
    
FILE# STATUS

---------- -------
       
24 ONLINE
       
25 ONLINE
       
26 ONLINE
       
27 RECOVER
       
28 RECOVER



27 rows selected.
SQL>


After this still the environment was not starting properly.

The solution to it all was to stop all processes and clean up the ODS.ODS_PROCESS table by truncating it.

SQL> truncate table ods.ods_process;

After this , the environment was reborn and back in business !