How to upgrade Oracle EBS R12.0.6 to 12.1.1

How to upgrade Oracle R12.0.6 to 12.1.1

We have followed the instruction provided in doc ID 752619.1. 

DB upgrade

we upgraded the Database to Oracle Database 11g Release 1 by following the doc Note 735276.1. No particular issue has been faced during the upgrade.

IAS upgrade
Follow the note Note 454811.1 . Different types of issue has been during this time. A list of issues and solutions are as follows ->

________________________IAS Issue faced ________________________________________
ISSUE ->
OPMN is failing to start. OPMN must be started in order to correctly install and configure the patchset. Please start OPMN manually in order
 to continue with the patchset installation.
OPMN is failing to start. OPMN must be started in order to correctly install and configure the patchset. Please exit the patchset, start OPM
N manually, and then continue with the patchset installation.
Error finding file NonExistentFile
this silent installation was unsuccessful.
We are upgrading OracleAS 10g Release 3 (10.1.3) to OracleAS 10g Release 3 (10.1.3.5) as a prerequistes for R12.1.1 update[ID 752619.1].
We are following document [ID 454811.1] and readme notes supplied by patchset Oracle® Application Server Patch Set Notes
10g Release 3 (10.1.3) Patch Set 5 (10.1.3.5.0).

While applying the patch we tried to run this command ->

$./runInstaller -invPtrLoc $ORACLE_HOME/oraInst.loc  -silent -responseFile <path>/applicationServer102350patch/Disk1/stage/Response/oracle.as.j2ee.patchset.Custom.rsp 

We get the following output ->

===================output start=====================
Starting Oracle Universal Installer...
Checking installer requirements...
Checking operating system version: must be 5.8, 5.9 or 5.10.    Actual 5.10
                                      Passed
Checking Temp space: must be greater than 250 MB.   Actual 10148 MB    Passed
Checking swap space: must be greater than 1535 MB.   Actual 28444MB    Passed
Checking operating system packages: SUNWarc,SUNWbtool,SUNWhea,SUNWlibm,SUNWlibms,SUNWsprot,SUNWtoo,SUNWi1of,SUNWxwfnt    Passed
Checking if CPU speed is above 450 MHz.    Actual 1800 MHz    Passed
All installer requirements met.
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2011-01-07_07-10-52PM. Please wait ...bash-3.00$ Oracle Universal Installer, Version 10.1.0.6.0 Production
Copyright (C) 1999, 2009, Oracle. All rights reserved.


Loading Product Information
...............................................................100% Done.
Analyzing dependencies
..................................Val: 0
Val: 0
Val: 0
Val: 0
Val: 0
Val: 0
Val: 0
Val: 0
Val: 0
Val: 0
Please check /other/testclone/oraInventory/logs/silentInstall2011-01-07_07-10-52PM.log for more details.

===================output end=======================
The log file contains the following info ->
==============================
silentInstall2011-01-07_07-10-52PM.log
OPMN is failing to start. OPMN must be started in order to correctly install and configure the patchset. Please start OPMN manually in order to continue with
the patchset installation.
OPMN is failing to start. OPMN must be started in order to correctly install and configure the patchset. Please exit the patchset, start OPMN manually, and th
en continue with the patchset installation.
Error finding file NonExistentFile
This silent installation was unsuccessful.
==============================

We have checked that opmn is running by follwing command ->
===================
bash-3.00$ opmnctl status

Processes in Instance: DEMOXXX_yyyyyy.iiiii.xxxx.co.in
-------------------+--------------------+---------+---------
ias-component      | process-type       |     pid | status
-------------------+--------------------+---------+---------
default_group      | oafm               |   26106 | Alive
default_group      | forms              |   26049 | Alive
default_group      | oacore             |   25974 | Alive
HTTP_Server        | HTTP_Server        |   25921 | Alive
==================

Solution ->
Upgrade the jdk version to latest by following Note 437878.1 
check whether soft and hard links are correct in IAS_HOME
Create the oracle inventory by following this ((link))
Check whether the proper home name is configured in response file as you have configured in the oracle inventory.
Run the upgrade by running this kind of command ->
./runInstaller -invPtrLoc $ORACLE_HOME/oraInst.loc  -silent -responseFile
<path>/frm_upgrade/5983622/Disk1/stage/Response/oracle.iappserver.patchset.rsp -force
Form Upgrade
to upgrade to Patchset 3 (10.1.2.3). You must upgrade to this version before applying the Release 12.1.1 Maintenance Pack. The following is being faced during form upgrade ->
______________________Form upgrade isuue_________________________________________
The login page is not coming and giving the following error ->
Not Found
The requested URL /OA_HTML/AppsLogin was not found on this server.
So, I have restarted the whole apps and database server. While executing ./adstrtal.sh I encountered following error ->
You are running adformsctl.sh version 120.12.12000000.6
Starting OPMN managed FORMS OC4J instance ...
Calling txkChkFormsDeployment.pl to check whether latest FORMSAPP.EAR is deployed...
Program :
<path>/TESTXXX_CLONE/apps/apps_st/appl/fnd/12.0.0/patch/115/bin/txkChkFormsDeployment.pl started @ Fri Jan 21 18:07:00 2011
*** Log File =
<path>/TESTXXX_CLONE/inst/apps/XXXX_xxxx/logs/appl/rgf/TXK/txkChkFormsDeployment_Fri_Jan_21_18_06_59_2011/txkChkFormsDeployment_Fri_Jan_21_18_06_59_2011.log
Program :
<path>/TESTXXX_CLONE/apps/apps_st/appl/fnd/12.0.0/patch/115/bin/txkChkFormsDeployment.pl completed @ Fri Jan 21 18:07:00 2011
Error while executing the perl script txkChkFormsDeployment.pl
<path>/TESTXXX_CLONE/inst/apps/XXXX_xxxx/logs/appl/admin/log/adformsctl.txt
adformsctl.sh: exiting with status 1
.end std out.
*** ALL THE FOLLOWING FILES ARE REQUIRED FOR RESOLVING RUNTIME ERRORS
*** Log File =
<path>/TESTXXX_CLONE/inst/apps/XXXX_yyyy/logs/appl/rgf/TXK/txkChkFormsDeployment_Fri_Jan_21_18_06_59_2011/txkChkFormsDeployment_Fri_Jan_21_18_06_59_2011.log
.end err out.
The txkChkFormsDeployment_Fri_Jan_21_18_06_59_2011.log file contains following information ->
Script Name : txkChkFormsDeployment.pl
Script Version : 120.0.12000000.1
Started : Fri Jan 21 18:07:00 IST 2011
==============================================
*** Forms is configured in servlet mode ***
==============================================
ERROR DESCRIPTION:
(Can't locate object method "txkFormsDeploymentStatus" via package "TXK::Techstack" at 
<path>/TESTXXX_CLONE/apps/apps_st/appl/fnd/12.0.0/pa
tch/115/bin/txkChkFormsDeployment.pl line 225.)
Program :
<path>/TESTXXX_CLONE/apps/apps_st/appl/fnd/12.0.0/patch/115/bin/txkChkFormsDeployment.pl completed @ Fri Jan 21 18:07:00 2011

Solution Approach ->
Just skip this issue. Go ahead with upgrade and applying patch 7303030 and post upgrade task. This issue I have fixed at last.

______________________Form upgrade issue end______________________________________










Apply Patch 8886260:R12.FND.A (Conditionally Required)
If you have installed and licensed the product Oracle Lease and Finance Management (OKL) in your instance and you are planning to upgrade from any Release 12.0.x version to Release 12.1.1, then you must apply Patch 8886260 (8886260:R12.FND.A) before you apply the AD Minipack R12.AD.B.1 Patch 7461070 and the Release 12.1.1 maintenance pack Patch 7303030. 
Apply the AD Minipack (Required)
Use AutoPatch to apply R12.AD.B.1 Patch 7461070. Do not merge this patch with any other patch. R12.AD.B.1 must be applied separately. Refer to Oracle Applications DBA Update Pack for Release 12.1.1 Readme Note 760167.1 for more information about R12.AD.B.1
Apply Patch 8764069:R12.FND.B (Required)
Apply Patch 8764069:R12.FND.B (Patch 8764069) in pre-install mode, following the instructions in the readme of that patch. Alternatively, if you are merging patches prior to upgrading, you can merge Patch 8764069:R12.FND.B as well.








Apply the main maintanence pack patch 7303030

Lots of issues have been fixed during applying this patch. A brief description of those issues and solution approaches are as follows ->

First time the patch failed when 19000 jobs still remaining. I exactly did not noted the error. But, this error has been fixed after reducing the worker and restarting the whole patch application.
------------------------------------------------
  ** Backing up $JAVA_TOP/META-INF/JRIMETA.DAT...

  Copying JRIMETA.DAT to JRIMETA.DAT.BackedupByAdpatch ...
  Copied JRIMETA.DAT to JRIMETA.DAT.BackedupByAdpatch.

  ** Successfully backed up JRIMETA.DAT.


  Running adjcopy.class:

adjava -mx512m -nojit oracle.apps.ad.jri.adjcopy @
<path>/TESTXXXF_CLONE/apps/apps_st/appl/admin/DEMONA/out/apps.cmd


AutoPatch error:
ERROR [code=1] Running adjcopy.class


AutoPatch error:
Error updating master archive


An error occurred while Updating Oracle Applications Java files if necessary.
Continue as if it were successful [No] :

You should check the file
<path>/TESTXXX_CLONE/apps/apps_st/appl/admin/DEMOXXX/log/adpatch_7303030.log

for errors.
-------------------------------------------------


 FAILED: file ARXINTEGB.pls on worker  1 for product ar  username AR.
 Deferred: file ARXINTEGB.pls on worker  1 for product ar  username AR.               (Deferment number 1 for this job)
 Assigned: file ARXINTEGB.pls on worker  2 for product ar  username AR.
   FAILED: file RLMDPBOB.pls on worker 11 for product rlm username RLM.
 Deferred: file RLMDPBOB.pls on worker 11 for product rlm username RLM.               (Deferment number 1 for this job)
 Assigned: file RLMDPBOB.pls on worker  3 for product rlm username RLM.
Completed: file ARXINTEGB.pls on worker  2 for product ar  username AR.


------------------------------------------------

 FAILED: file adobjcmp.sql on worker  2 for product ad  username APPLSYS.
 Deferred: file adobjcmp.sql on worker  2 for product ad  username APPLSYS.               (Deferment number 1 for this job)
 Assigned: file adobjcmp.sql on worker  1 for product ad  username APPLSYS.Segmentation Fault - core dumped


------------------------------------------------

ORA-04031: unable to allocate 32 bytes of shared memory ("shared pool","DATABASESYS","trigger inform","kglhin: temp")
ORA-04031: unable to allocate 32 bytes of shared memory ("shared pool","update fnd_install_processes...","sql area","tmp")
<path>/TESTXXX_CLONE/db


==============================================================================

There are now 7764 jobs remaining (current phase=A96):
    0 running, 1 ready to run and 7763 waiting.

 Deferred: file egogdsnag.ldt on worker  1 for product ego username APPS.               (Deferment number 1 for this job)
 Assigned: file egogdsnag.ldt on worker  1 for product ego username APPS.
Program completed successfully

   FAILED: file egogdsnag.ldt on worker  1 for product ego username APPS.
 Deferred: file egogdsnag.ldt on worker  1 for product ego username APPS.               (Deferment number 2 for this job)
 Assigned: file egogdsnag.ldt on worker  1 for product ego username APPS.
Program completed successfully

   FAILED: file egogdsnag.ldt on worker  1 for product ego username APPS.

ATTENTION: All workers either have failed or are waiting:

           FAILED: file egogdsnag.ldt on worker  1.

ATTENTION: Please fix the above failed worker(s) so the manager can continue.

***************************
Solution ->
I believe you can ignore this error, and skip the failed worker.
Product Data File Error Applying Patch 4440000 [ID 421136.1]
Oracle Applications DBA Minipack R12.AD.A [ID 401424.1] 
***************************


-----------------------------------------------------

Completed: file zpbsv_composit.sql on worker  1 for product zpb username ZPB.
   FAILED: file MSDXWDEVKIT.sql on worker  4 for product msd username MSD.
 Deferred: file MSDXWDEVKIT.sql on worker  4 for product msd username MSD.               (Deferment number 1 for this job)
 Assigned: file MSDXWDEVKIT.sql on worker  1 for product msd username MSD.
   FAILED: file MSDXWDEVKIT.sql on worker  1 for product msd username MSD.
 Deferred: file MSDXWDEVKIT.sql on worker  1 for product msd username MSD.               (Deferment number 2 for this job)
 Assigned: file MSDXWDEVKIT.sql on worker  1 for product msd username MSD.
   FAILED: file MSDXWDEVKIT.sql on worker  1 for product msd username MSD.

ATTENTION: All workers either have failed or are waiting:

           FAILED: file MSDXWDEVKIT.sql on worker  1.

ATTENTION: Please fix the above failed worker(s) so the manager can continue.

**************

BEGIN dbms_aw.execute('upd'); END;

*
ERROR at line 1:
ORA-37604: Parallel updating analytic workspace APPS.XWDEVKIT failed
ORA-12801: error signaled in parallel query server P000
ORA-03238: unable to extend LOB segment APPS.SYS_LOB0000476346C00004$$
subpartition SYS_LOB_SUBP479 by 16 in tablespace APPS_TS_TX_DATA
ORA-06512: at "SYS.DBMS_AW", line 93
ORA-06512: at "SYS.DBMS_AW", line 122
ORA-06512: at line 1

---------------------------------------------------

 Deferred: file EGOSILDU.sql on worker  1 for product ego username EGO.               (Deferment number 2 for this job)
 Assigned: file EGOSILDU.sql on worker  1 for product ego username EGO.
   FAILED: file EGOSILDU.sql on worker  1 for product ego username EGO.
Completed: file EGOEXTCONC.sql on worker  3 for product ego username EGO.

ATTENTION: All workers either have failed or are waiting:

           FAILED: file EGOSILDU.sql on worker  1.

ATTENTION: Please fix the above failed worker(s) so the manager can continue.


********************************
Solution -> Patch 7303030 Fails on Egosildu.sql : ORA-02149 Specified Partition Does Not Exist [ID 847687.1].
added new datafile using following command and restared the process ->
alter tablespace APPS_TS_TX_DATA add datafile '
<path>/TESTXXX_CLONE/db/apps_st/data/a_txn_data05_x.dbf' size 2048m;
You need to add more space (extend the tablespace or add new one).

Unable To Extend Table Zpb.Zpb_solve_member_defs By 16 In Tablespace [ID 418107.1]
TROUBLESHOOTING GUIDE (TSG) : UNABLE TO EXTEND Errors [ID 1025288.6]
OERR: ORA-3238 unable to extend LOB segment %s.%s subpartition %s by %s in tab [ID 75188.1] 
********************************

----------------------------------------------------
I got error again while only 215 jobs remaining. The error is as follows ->

There are now 215 jobs remaining (current phase=A178):
1 running, 0 ready to run and 214 waiting.

Assigned: file DDR_BS_CLS_DAY_MV.xdf on worker 1 for product ddr username APPS.
FAILED: file DDR_BS_FRCST_LST_SLS_MV.xdf on worker 2 for product ddr username APPS.
FAILED: file DDR_BS_CLS_DAY_MV.xdf on worker 1 for product ddr username APPS.

ATTENTION: All workers either have failed or are waiting:

FAILED: file DDR_BS_CLS_DAY_MV.xdf on worker 1.
FAILED: file DDR_BS_FRCST_LST_SLS_MV.xdf on worker 2.

ATTENTION: Please fix the above failed worker(s) so the manager can continue.

**************************************************
Worker 1 log file ->
Materialized View does not exist in the target database

Executing create Statement
Create Statement is

CREATE MATERIALIZED VIEW "APPS"."DDR_BS_CLS_DAY_MV"
ORGANIZATION HEAP PCTFREE 10 PCTUSED 40 INITRANS 10 MAXTRANS 255 LOGGING
STORAGE(INITIAL 4096 NEXT 65536 MINEXTENTS 1 MAXEXTENTS 2147483645
PCTINCREASE 0 FREELISTS 4 FREELIST GROUPS 4 BUFFER_POOL DEFAULT)
TABLESPACE "APPS_TS_SUMMARY"
BUILD DEFERRED
USING INDEX PCTFREE 10 INITRANS 11 MAXTRANS 255
STORAGE(INITIAL 4096 NEXT 65536 MINEXTENTS 1 MAXEXTENTS 2147483645
PCTINCREASE 0 FREELISTS 4 FREELIST GROUPS 4 BUFFER_POOL DEFAULT)
TABLESPACE "APPS_TS_SUMMARY"
REFRESH FAST ON DEMAND
WITH ROWID USING DEFAULT LOCAL ROLLBACK SEGMENT
DISABLE QUERY REWRITE
AS select mfghier.MFG_ORG_CD
, timehier.CLNDR_CD
, mfghier.MFG_ITEM_CLASS_ID
, timehier.DAY_CD
, count(*) as NUM_MFG_SKU_ITEMS
from ddr_r_mfg_item_sku_dn_mv mfghier
, ddr_r_base_day_dn_mv timehier
where timehier.mfg_org_cd = mfghier.mfg_org_cd
and timehier.clndr_cd = CONCAT(mfghier.mfg_org_cd, '-BSNS')
and timehier.clndr_dt between mfghier.eff_from_dt and mfghier.eff_to_dt
group by mfghier.MFG_ORG_CD
, timehier.CLNDR_CD
, mfghier.MFG_ITEM_CLASS_ID
, timehier.DAY_CD

Start time for statement above is Thu Jan 20 21:46:42 IST 2011
Exception occured No more data to read from socket
java.sql.SQLException: No more data to read from socket
Exception while setting task done in the database. The exception message is OALL8 is in an inconsistent state
There is some other exception while setting the task done. The exception message is OALL8 is in an inconsistent state
Updating task with status 1

AD Worker error:
The utility FndXdfCmp returned error for the above task.

AD Worker error:
The above program failed. See the error messages listed
above, if any, or see the log and output files for the program.

Time when worker failed: Thu Jan 20 2011 21:46:42
_____________________________________
*Worker 2 log file ->*-------------------------------------
Start time for statement above is Thu Jan 20 21:41:40 IST 2011
Exception occured No more data to read from socket
java.sql.SQLException: No more data to read from socket
Exception while setting task done in the database. The exception message is OALL8 is in an inconsistent state
There is some other exception while setting the task done. The exception message is OALL8 is in an inconsistent state
Updating task with status 1

AD Worker error:
The utility FndXdfCmp returned error for the above task.

AD Worker error:
The above program failed. See the error messages listed
above, if any, or see the log and output files for the program.

Time when worker failed: Thu Jan 20 2011 21:43:38

Restarting job that failed and was fixed.

Time when worker restarted job: Thu Jan 20 2011 21:49:41

Start time for file is: Thu Jan 20 2011 21:49:41

Invoking Utility FndXdfCmp ...
Class: oracle.apps.fnd.odf2.FndXdfCmp
Method: applyXDF
Arguments: &un_apps &pw_apps &un_apps &pw_apps &jdbc_protocol &jdbc_db_addr mview &fullpath_ddr_patch/115/xdf_DDR_BS_FRCST_LST_SLS_MV.xdf &fullpath_fnd_patch/115/xdf_xsl

XDF file application started. Current time is: Thu Jan 20 21:49:41 IST 2011

================================================================================
Applying XDF file :
<path>/TESTXXX_CLONE/apps/apps_st/appl/ddr/12.0.0/patch/115/xdf/DDR_BS_FRCST_LST_Sbash-

Solution ->
Understanding the "OALL8 is in an inconsistent state" Exception (Doc ID 944692.1)
After Database Upgrade From 9.2.0.7 To 10.2.0.4, 'OALL8 Is In An Inconsistent State' And 'No more data to read from socket" Errors Occur When Running JDBC Application (Doc ID 879589.1)
OALL8 is in an inconsistent state" With JDBC Thin Driver and selecting non-ascii Characters (Doc ID 549409.1)


---------------------------------------------------------


After upgrading your EBS to 12.1.1, if you want to upgrade EBS to 12.1.3, follow the following article.
how-to-upgrade-oracle-ebs-r1211-to-1213

4 comments: