ISSUE:
Apache Web Server Listener is not running.
Starting Apache Web Server Listener (dedicated HTTP in SSL mode) ...
Syntax error on line 1231 of /pageni/product/iAS/Apache/Apache/conf/httpd.conf:
SSLCertificateChainFile: file '/pageni/product/iAS/Apache/Apache/conf/ssl.crt/ca.crt' not exists
or empty
/pageni/product/iAS/Apache/Apache/bin/apachectl startssl: httpd could not be started
Apache Web Server Listener (PLSQL) :httpd ( pid 2694 ) is running.
Can not start Apache Web Server now
Solution 3:
============
commented out SSLCertificateChainFile in $APACHE_TOP/Apache/conf/httpd.conf and apache was
started.
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISssue : forms not launching
error FRM-40833 : Could not completely load the dynamic user exit libraries. User exit FND did not execute
Solution Note :754347.1
To resolve the issue
1. Copy fndfmxit.so from a backup
2. Place it in $FND_TOP/bin
3. Do NOT relink fnddmxit.so, instead bounce services and you should be able to launch forms now
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue :forms not coming SR .1788103321
Approach
---------
+ there seems to some kind of problem linked with binary frmweb
Will strive to take strace from this binary
+ the error message in trace fiele is
open("/sid/product/1012/lib/libXm.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/sid/product/1012/jdk/jre/lib/i386/libXm.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
+ file /sid/product/1012/lib/libXm.so.2 seems to be missing on OS level.
will create collaboration request to System admin team to fix the issue on OS level.
+ libraries are missing in /usr/X11R6/lib/ on host aohssbic02, which is reason why dsbici and tsbici froms sever can't start.
Forms issues is resolved after installing the rpm openmotif21
Reference note id:880088.1
ISSUE:
Got the below error while accessing the forms
FRM-40010: Cannot read form
/SID/applmgr/1211/fnd/12.0.0/forms/US/FNDSCSGN
===> The above error is happening while accessing the forms in first time.
If you open this is second time it's working fine.
Solution
---------
bash-3.00$ pwd
/SID/inst/apps/SID_aohsrigs03/ora/10.1.2/forms/server
bash-3.00$ ls
appsweb.cfg appsweb.cfg_org default.env ftrace.cfg socket.env txkcsa.cfg txkLoadXMLInDB.sh
+ compare default.env and socket.env with files in snapshot, if difference found restore
Note: 1200 is replaced with 1211
ex:bash-3.00$ diff socket.env ../../socket.env
32,36c32,36
< APPL_TOP=/SID/applmgr/1200
< APPL_TOP2=/SID/applmgr/1200
< APPL_TOP3=/SID/applmgr/1200
< APPL_TOP4=/SID/applmgr/1200
< ADMIN_SID=/SID/applmgr/1200/admin/SID
---
> APPL_TOP=/SID/applmgr/1211
> APPL_TOP2=/SID/applmgr/1211
> APPL_TOP3=/SID/applmgr/1211
> APPL_TOP4=/SID/applmgr/1211
> ADMIN_SID=/SID/applmgr/1211/admin/SID
44c44
< REPORTS_PATH=/SID/applmgr/1200/au/12.0.0/plsql:/SID/applmgr/1200/fnd/12.0.0/reports:/SID/applmgr/1200/au/12.0.0/reports:/SID/applmgr/1200/au/12.0.0/graphs
---
> REPORTS_PATH=/SID/applmgr/1211/au/12.0.0/plsql:/SID/applmgr/1211/fnd/12.0.0/reports:/SID/applmgr/1211/au/12.0.0/reports:/SID/applmgr/1211/au/12.0.0/graphs
< XNP_TOP=/SID/applmgr/1200/xnp/12.0.0
< XTR_TOP=/SID/applmgr/1200/xtr/12.0.0
< ZPB_TOP=/SID/applmgr/1200/zpb/12.0.0
< ZX_TOP=/SID/applmgr/1200/zx/12.0.0
---
> XNP_TOP=/SID/applmgr/1211/xnp/12.0.0
> XTR_TOP=/SID/applmgr/1211/xtr/12.0.0
> ZPB_TOP=/SID/applmgr/1211/zpb/12.0.0
> ZX_TOP=/SID/applmgr/1211/zx/12.0.0
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Please do the following changes and try to relink again 1273390.1
1. Open $AD_TOP/bin/adrelinknew.sh 2. find the string below in the LINUX section
CPP_LDFLAGS=' -L$(ORACLE_HOME)/lib -L$(ORACLE_HOME)/lib/stubs -lclntsh'
3. change this to the string below
CPP_LDFLAGS=' -L$(ORACLE_HOME)/lib -L$(ORACLE_HOME)/lib/stubs -lclntsh -Wl,--noinhibit-exec'
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue :
Jserv and tcfsocket is not working on DMZ node
Solution
=========
commented below line in httpd.conf
#Configuration file containing Aceess Restrictions in a DMZ configuration.
#include "/thorui/product/iAS/Apache/Apache/conf/url_fw.conf"
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE : unable to view MHP Purchasing Super User Responsibility
Observation:
MHP Purchasing Super User Responsibility was end dated for SYSADMIN user
Solution:
--------
Removed end-date from 'MHP Purchasing Super User Responsibility' for SYSADMIN user
+ Ran conc requests "Workflow Directory Services User/Role Validation" ( with parameters YES,NO,YES and YES,YES,no) and "Synchronize WF LOCAL tables"
+ Able to view the responsibility 'MHP Purchasing Super User' now.
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Doc ID 390425.1
Thu Feb 24 18:02:19 2011] [warn] pid file /var/opt/TBAXTC_aohsbaxt03/Apache/logs/httpd.pid
overwritten -- Unclean shutdown of previous Apache run?[Thu Feb 24 18:02:19 2011] [error] OPM:Fail
to allocate memory for mutex in shmpool[Thu Feb 24 18:02:19 2011] [error] OPM:Fail to call
opm_sys_init[Thu Feb 24 18:02:19 2011] [error] OPM: process manager could not create internal
tables[Thu Feb 24 18:02:19 2011] [crit] (37)No locks available: Apache JServ encountered a fatal
error; check your ApJServLogFile for details if none are present in this file. Exiting.
Httpd processes are getting defunct while starting up .
cat /etc/fstab
Recomended action plan
---------------------------------
Request SA's to to mount the NFS disks using the nolock option
Issue fixed
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue
======
OC4JGroup:default_group | OC4J:oacore | N/A | Down
$ adopmnctl.sh startall
You are running adopmnctl.sh version 120.4.12000000.3
opmnctl: starting opmn and all managed processes...
================================================================================
opmn id=aohsioil23:11025
5 of 6 processes started.
ias-instance id=PIOI1I_aohsioil23.aohsioil23.orclsourcing.com
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
ias-component/process-type/process-set:
default_group/oacore/default_group/
Error
--> Process (index=4,uid=863643606,pid=0)
no port available from the port range
failed to start a managed process after the maximum retry limit
no port available from the port range
no port available from the port range
Log:
none
cause disco services was running on this node some port was occupying:
Solution
======
Brought down all the services on 23 including disco services
Started MT services. started successfully.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE: FORMS COMING WITH BLANK PAGE
RFC .1F6J1FJ
Applied Note ID 1221913.1 to apply interoperability dev6i Patch 9935935
Issue fixed, able to launch forms now
submitted active users req id 63145888
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE
======
+ tried to generate using adadmin , failed
Generating any out of date or missing jar files.
adearea();
Warning=> unable to locate /dmoi/applmgr/common/java/owa.zip file.
Signing product JAR files in JAVA_TOP -
/dmoi/applmgr/common/java
using entity Customer and certificate 1.
Successfully created javaVersionFile.
Generating product JAR files in JAVA_TOP -
/dmoi/applmgr/common/java with command:
adjava -mx512m -nojit oracle.apps.ad.jri.adjmx
@/dmoi/applmgr/1159/admin/dmoi_BALANCE/out/genjars.cmd
Failed to generate product JAR files in JAVA_TOP -
/dmoi/applmgr/common/java.
adogjf() Unable to generate jar files under JAVA_TOP
Observation
------------
bash-2.05$ pwd
/dmoi/product
bash-2.05$ ls -l identitydb.obj
lrwxrwxrwx 1 apdmoi aadmoi 25 May 13 2005 identitydb.obj -> ../applmgr/identitydb.obj
bash-2.05$
bash-2.05$ ls -ltr ../applmgr/identitydb.obj
-rwxrwxrwx 1 apdmoi aadmoi 0 Mar 21 08:45 ../applmgr/identitydb.obj
bash-2.05$
+ identitydb.obj file shows 0 byte.
Solution
--------
+Copied the $HOME/identitydb.obj from production to devlopment inatance dmoi
+ Ran adadmin to regenerate jarfiles, Running fine..
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE :Apache not starting
Error log
==========
[Tue Mar 29 16:06:55 2011] [notice] Oracle HTTP Server Powered by Apache/1.3.19 configured -- resuming normal operations
[Tue Mar 29 16:10:16 2011] [warn] pid file /var/opt/SID_aohsapig04/Apache/logs/httpd_pls.pid overwritten -- Unclean shutdown of previous Apache run?
[Tue Mar 29 16:10:16 2011] [notice] FastCGI: process manager initialized (pid 16075)
[Tue Mar 29 16:10:17 2011] [notice] Oracle HTTP Server Powered by Apache/1.3.19 configured -- resuming normal operations
[Tue Mar 29 16:10:14 2011] [warn] pid file /var/opt/SID_aohsapig04/Apache/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Tue Mar 29 16:10:14 2011] [error] OPM:Fail to open file /var/opt/SID_aohsapig04/Apache/logs/SID_opm_sys_mtx.pid.15981
[Tue Mar 29 16:10:14 2011] [error] OPM:Fail to create mutex
[Tue Mar 29 16:10:14 2011] [error] OPM: process manager could not create internal tables
[Tue Mar 29 16:10:14 2011] [crit] (13)Permission denied: Apache JServ encountered a fatal error; check your ApJServLogFile for details if none are present in this file. Exiting.
bash-3.00$ grep -i s_lock_pid_dir $CONTEXT_FILE
<lock_pid_dir oa_var="s_lock_pid_dir">/var/opt/SID_aohsapig04/Apache/logs</lock_pid_dir>
bash-3.00$
bash-3.00$ ls -lrt /var/opt/SID_aohsapig04/Apache/logs/httpd.pid
-rwxrwxrwx 1 root root 6 Mar 29 16:10 /var/opt/SID_aohsapig04/Apache/logs/httpd.pid
bash-3.00$
bash-3.00$ touch test.txt
touch: cannot touch `test.txt': Read-only file system
bash-3.00$
+ Unable to create/overwrite pid file
+ Request SA's to give 777 permissions to '/var/opt/SID_aohsapig04/Apache/logs/'
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue:
Test Verify TCF Socket Server servlet : FAILED
Test Verify JServ : FAILED
Solution
---------
bash-3.00$ diff httpd.conf httpd.conf_bkp8apr11
1414c1414
< #include "/SID/product/SID_aohssfir09/iAS/Apache/Apache/conf/url_fw.conf"
---
> include "/SID/product/SID_aohssfir09/iAS/Apache/Apache/conf/url_fw.conf"
bash-3.00$
bash-3.00$ diff httpd.conf httpd.conf_bkpapr811
1414c1414
< #include "/SID/product/SID_aohssfir05/iAS/Apache/Apache/conf/url_fw.conf"
---
> include "/SID/product/SID_aohssfir05/iAS/Apache/Apache/conf/url_fw.conf"
bash-3.00$
Issue resolved
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Forms issue:
error:
failed to connect to server:tst.bardahl.com.mx:10513
java.net.socketException:Connection reset
Solution:
bash-3.00$ diff adformsrvctl.sh_s adformsrvctl.sh
237,248c237,248
< printf "Calling txkChkFormsDeployment.pl to check whether latest FORMSAPP.EAR is deployed...\n";
< /SID/applmgr/1213/fnd/12.0.0/bin/txkrun.pl -script=ChkFormsDeployment
< exit_code=$?
< if [ $exit_code -ne 0 ]; then
< printf "Error while executing the perl script txkChkFormsDeployment.pl\n";
< printf "$LOGAP\n\n";
< printf "\n$program: exiting with status 1\n\n"
< exit 1;
< else
< printf "Perl script txkChkFormsDeployment.pl got executed successfully\n";
< printf "\n\n";
< fi
---
> #printf "Calling txkChkFormsDeployment.pl to check whether latest FORMSAPP.EAR is deployed...\n";
> #/SID/applmgr/1213/fnd/12.0.0/bin/txkrun.pl -script=ChkFormsDeployment
> #exit_code=$?
> #if [ $exit_code -ne 0 ]; then
> # printf "Error while executing the perl script txkChkFormsDeployment.pl\n";
> # printf "$LOGAP\n\n";
> # printf "\n$program: exiting with status 1\n\n"
> # exit 1;
> # else
> # printf "Perl script txkChkFormsDeployment.pl got executed successfully\n";
> # printf "\n\n";
> #fi
bash-3.00$
+ Forms issue Resolved.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : Apache PLSQL component not starting
error log
----------
[Sat Dec 10 01:21:26 2011] [notice] Oracle HTTP Server Powered by Apache/1.3.19 configured -- resuming normal operations
/bin/sh: 6829 Killed
[Sat Dec 10 01:52:53 2011] [warn] pid file /SID/product/iAS/Apache/Apache/logs/httpd_pls.pid overwritten -- Unclean shutdown of previous Apache run?
[Sat Dec 10 01:52:54 2011] [notice] Oracle HTTP Server Powered by Apache/1.3.19 configured -- resuming normal operations
~
Solution
woeaap03:apSID>diff httpd_pls.conf httpd_pls.conf_bkp10dec11
107c107
< PidFile /var/opt/SID_woeaap03/Apache/logs/httpd_pls.pid
---
> PidFile /SID/product/iAS/Apache/Apache/logs/httpd_pls.pid
woeaap03:apSID>
woeaap03:apSID>adapcctl.sh status
adapcctl.sh version 115.55
Apache Web Server Listener :httpd ( pid 10801 ) is running.
Apache Web Server Listener (PLSQL) :httpd ( pid 11036 ) is running.
adapcctl.sh: exiting with status 0
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
issue : No responsibility for sysadmin user
SQL> select count(*) from fnd_user_resp_groups where USER_ID=0;
COUNT(*)
----------
0
Downloaded the sysadmin user responsibilities from test instance and uploaded to DPSNLI
FNDLOAD apps/Y7wOF6kd 0 Y DOWNLOAD $FND_TOP/patch/115/import/afscursp.lct sysadminresp.ldt FND_USER USER_NAME='SYSADMIN'
FNDLOAD apps/C5uLB2sj 0 Y UPLOAD $FND_TOP/patch/115/import/afscursp.lct sysadminresp.ldt FND_USER USER_NAME='SYSADMIN'
select count(*) from fnd_user_resp_groups where USER_ID=0;
COUNT(*)
----------
14
+ ran below concurrent programs from backend
Sync responsibility role data into the WF table.
Workflow Directory Services User/Role Validation
CONCSUB APPS/*** SYSADMIN 'System Administrator' SYSADMIN WAIT=Y CONCURRENT FND AFFURGO2 START='"24-FEB-2012 01:00:00"' REPEAT_DAYS=1 REPEAT_END='"24-FEB-2012 23:59:00"' Y 0 0
CONCSUB APPS/*** SYSADMIN 'System Administrator' SYSADMIN WAIT=Y CONCURRENT FND FNDWFDSURV START='"24-FEB-2012 01:00:00"' REPEAT_DAYS=1 REPEAT_END='"24-FEB-2012 23:59:00"' Y 0 0
+ Now able to view the responsibilities for sysadmin user
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
"system Administrator" responsibility not showing(listing) for sysadmin user
COL USER_NAME FOR A17
COL RESPONSIBILITY_NAME FOR A30
COL END_DATE FOR A20
select a.USER_NAME, b.RESPONSIBILITY_ID, c.RESPONSIBILITY_NAME, b.END_DATE
from apps.FND_USER a, apps.FND_USER_RESP_GROUPS b, apps.FND_RESPONSIBILITY_VL c
where a.USER_ID=b.USER_ID and b.RESPONSIBILITY_ID=c.RESPONSIBILITY_ID
and user_name = UPPER('&user_name');
OBSERVATION:
+ Compared with non-pord and found that "System Administrator" role is inactive (navig User Management ->Users-> query for sysadmin user.. and in roles search for "System Administrator"
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Apache server not starting
adapccl.sh start
--> Process (index=1,uid=555560055,pid=26257)
failed to start a managed process after the maximum retry limit
Log:
/SID/mtlog/SID_aohsapas33/logs/ora/10.1.3/opmn/HTTP_Server~1.log
adapcctl.sh: exiting with status 0
adapcctl.sh: check the logfile /SID/mtlog/SID_aohsapas33/logs/appl/admin/log/adapcctl.txt
for more information ...
Apache Error log
===========
[Sun Apr 1 01:57:41 2012] [warn] pid file /var/opt/SID_aohsapas33/Apache/logs/httpd.pid
overwritten -- Unclean shutdown of previous Apache run?
[Sun Apr 1 01:57:41 2012] [error] mod_ossl: Cannot allocate shared memory: mm:core: failed to
open memory file (No such file or directory)
[Sun Apr 1 01:57:43 2012] [warn] pid file /var/opt/SID_aohsapas33/Apache/logs/httpd.pid
overwritten -- Unclean shutdown of previous Apache run?
[Sun Apr 1 01:57:43 2012] [error] mod_ossl: Cannot allocate shared memory: mm:core: failed to
open memory file (No such file or directory)
Cause:
SSLSessionCache location in ssl.conf has invalid location
[AMD64] apSID@aohsapas35 > diff ssl.conf
/SID/inst/apps/SID_aohsapas35/ora/10.1.3/Apache/Apache/conf/ssl.conf
42c42
< SSLSessionCache
shmcb:/SID/mtlog/SID_aohsapas35/logs/ora/10.1.3/Apache/ssl_scache(512000)
---
> SSLSessionCache
shmcb:/var/opt/SID_aohsapas35/Apache/logs/ora/10.1.3/Apache/ssl_scache(512000)
Solution
=========
Made below changes
==================
[AMD64] apSID@aohsapas35 > diff ssl.conf ssl.conf_bkp1mar12
42,43c42
< #SSLSessionCache
shmcb:/var/opt/SID_aohsapas35/Apache/logs/ora/10.1.3/Apache/ssl_scache(512000)
< SSLSessionCache
shmcb:/SID/mtlog/SID_aohsapas35/logs/ora/10.1.3/Apache/ssl_scache(512000)
---
> SSLSessionCache
shmcb:/var/opt/SID_aohsapas35/Apache/logs/ora/10.1.3/Apache/ssl_scache(512000)
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
oafm not starting
=================
bash-3.2$ adoafmctl.sh start
You are running adoafmctl.sh version 120.8
Starting OPMN managed OAFM OC4J instance ...
adoafmctl.sh: exiting with status 150
adoafmctl.sh: check the logfile /SID/mtlog/SID_aohsmich38/logs/appl/admin/log/adoafmctl.txt
for more information ...
solution
========
found the oafm process was failing to start due to timeout.
Tried setting the timeout value to 600 to 1200 in opmn.xml and finally, the process started.
ref Doc ID 564536.1 (have updated the custom template opmn_xml_1013.tmp with same value.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Forms failed to launch
FRM-40010:cannot read form
/SID/applmgr/1213/fnd/12.0.0/forms/US/FNDSCSGN
+ Corrected below files on nodes rmohsclop95 and rmohsclop95
socket.env , default.env and appsweb.cfg
+1206 entries are there in socket.env , default.env --> corrected
bash-3.00$ pwd
/SID/inst/apps/SID_rmohsclop95/ora/10.1.2/forms/server
bash-3.00$
bash-3.00$ diff appsweb.cfg appsweb.cfg_4sep12
108c108
< EndUserMonitoringURL=
---
> EndUserMonitoringURL=https://r12test.clopay.com:443/oracle_smp_chronos/oracle_smp_chronos_sdk.gif
112c112
< serverName=r12test
---
> serverName=rmohsclop95
bash-3.00$
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Forms are not working with any user other than sysadmin
SOlution
ICX_FORMS_LAUNCHER (ICX: Forms Launcher)
is set to http://r12test.clay.com:443/OA_HTML/frmservlet on Site level - this is not valid URL.
It's set correctly on SYSADMIN level to: https://r12test.clay.com:443/OA_HTML/frmservlet
Please set the profile option properly to
https://r12test.clay.com:443/OA_HTML/frmservlet
on site level and let the customer re-test.
Regards,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue: TCF Socket Server servlet and
Verify JServ failed on DMZ node
below urls does not work
http://aohspsnl17.orclsourcing.com:12515/oa_servlets/oracle.apps.fnd.tcf.SocketServer
http://aohspsnl17.orclsourcing.com:12515/servlets/Hello
error
Access to the requested URI has been blocked by the URL Firewall
Fix:
Made below changes in httpd.conf
bash-3.2$ diff httpd.conf httpd.conf_bkpold
1412c1412
< #include "/tpsn2i/product/TPSN2I_aohspsnl17/iAS/Apache/Apache/conf/url_fw.conf"
---
> include "/tpsn2i/product/TPSN2I_aohspsnl17/iAS/Apache/Apache/conf/url_fw.conf"
bash-3.2$
below urls working
http://aohspsnl17.orclsourcing.com:12515/oa_servlets/oracle.apps.fnd.tcf.SocketServer
http://aohspsnl17.orclsourcing.com:12515/servlets/Hello
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue: OTA is not running
SQL> SELECT count(*)
from gv$session vs
where vs.inst_id = userenv('INSTANCE')
and action like '%OXTA%'; 2 3 4
COUNT(*)
----------
0
SQL> select decode(count(*),0,'Error: OTA is Not Running','OTA is Running') from gv$session
where action like '%OXTA%';
DECODE(COUNT(*),0,'ERROR:
-------------------------
Error: OTA is Not Running
Solution:
========
+ Unable to ping OTA Fom url https://ebsotest.ntenergy.com/OA_HTML/US/ECXOTAPing.htm
+ user name and password not defined correctly in data-sources.xml
$INST_TOP/ora/10.1.3/j2ee/oafm/application-deployments/oafm/data-sources.xml
+ Made below changes.
bash-3.2$ diff data-sources.xml data-sources.xml_abkp26jun14
29c29
< password="->ASADMIN"
---
> password="->W52C0m5a23"
bash-3.2$
+ Bounced the OAFM container .
+ able to ping OTA Fom url https://ebsotest.ntenergy.com/OA_HTML/US/ECXOTAPing.htm
SQL> select name from v$database;
NAME
---------
TTEI
SQL> select decode(count(*),0,'Error: OTA is Not Running','OTA is Running') from gv$session
where action like '%OXTA%'; 2
DECODE(COUNT(*),0,'ERROR:
-------------------------
OTA is Running
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE: Node manager WLS_DISCO is not starting
OBSERVATION/FINDINGS
====================
the Node Manager associated with machine mohcord002.orclsourcing.com is not reachable
<Jul 11, 2014 9:44:39 PM EDT> <Info> <Security> <BEA-090908> <Using default WebLogic SSL Hostname Verifier implementation.>
<Jul 11, 2014 9:44:39 PM> <SEVERE> <Fatal error in node manager server>
java.net.BindException: Address already in use
at java.net.PlainSocketImpl.socketBind(Native Method)
at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:383)
at java.net.ServerSocket.bind(ServerSocket.java:328)
at javax.net.ssl.impl.SSLServerSocketImpl.bind(Unknown Source)
SEVERE: Fatal error in node manager server
java.net.BindException: Address already in use
+ port 5556 is occupied by dev instance DCORDI
+ changed to available port 5557 in nodemanager.properties and config.xml
Changed StartScriptName to below value
+ bash-3.2$ diff nodemanager.properties nodemanager.properties_abkp
12c12
< StartScriptName=startWebLogic.sh
---
> StartScriptName=startNodeManager.sh
bash-3.2$
bash-3.2$ pwd
/tcordi/disco11g/.zfs/snapshot/.498ZPJD-exp18Jul14_mohcord001_TCORDI_PROJ_20140711_0207/product/user_projects/domains/TCORDI/config
bash-3.2$ grep -i 555 config.xml
<listen-port>5556</listen-port>
changed listen-port to 5557
bash-3.2$ grep -i 555 /tcordi/disco11g/product/user_projects/domains/TCORDI/config/config.xml
<listen-port>5557</listen-port>
bash-3.2$
+ Reatarted services
Able to start Node manager WLS_DISCO
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue: Apache not starting
+ mount point /var/opt/SID_host/Apache/logs 100% filled
Removed few files from /var/opt/SID_host/Apache/logs
bash-3.2$ adopmnctl.sh startall
You are running adopmnctl.sh version 120.6.12010000.5
Starting Apache...
Apache started successfully.
Starting OACORE oc4j...
OACORE oc4j started successfully.
Starting OAFM oc4j...
OAFM oc4j started successfully.
adopmnctl.sh: exiting with status 0
adopmnctl.sh: check the logfile /tgac3i/inst/apps/SID_host/logs/appl/admin/log/adopmnctl.txt for more information ...
bash-3.2$ adopmnctl.sh status
You are running adopmnctl.sh version 120.6.12010000.5
Checking status of OPMN managed processes...
Processes in Instance: SID_host.mohgaco014.orclsourcing.com
---------------------------------+--------------------+---------+---------
ias-component | process-type | pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:default_group | OC4J:oafm | 16863 | Alive
OC4JGroup:default_group | OC4J:oacore | 16756 | Alive
OC4JGroup:default_group | OC4J:oacore | 16757 | Alive
HTTP_Server | HTTP_Server | 16705 | Alive
adopmnctl.sh: exiting with status 0
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE : responsibilities missing to sysadmin user
SQL> select count(*) from fnd_user_resp_groups where USER_ID=0;
COUNT(*)
----------
11
+ Ran below concurrent prog from backend
Run the concurrent request Workflow Directory Services User/Role Validation as follows:
a. "Workflow Directory Services User/Role Validation" Parameters : 100000, Yes, No, No"
b. "Workflow Directory Services User/Role Validation" Parameters : 100000, No, Yes, No"
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE: logo not displaying on DMZ login page after compiling jsps
Observation/findings:
https://appnttest.orclsourcing.com/OA_MEDIA/Masternautnew_180913.png --works
But
https://appsmsntmfstest.orclsourcing.com/OA_MEDIA/Masternautnew_180913.png -errors
Access to the requested URI has been blocked by the URL Firewall.
If you believe that you have reached this page while performing valid operations within the
application, please send mail to aptmsnti@orclsourcing.com explaining what you were doing
when you got this error
+ Observed that url_fw.conf not excluded form httpd.conf.
Solution:
=========
+ Made below changes
bash-3.2$ diff httpd.conf httpd.conf_bkp2514
1127c1127
< #include
"/tmsnti/inst/apps/TMSNTI_mohmsnt014/ora/10.1.3/Apache/Apache/conf/url_fw.conf"
---
> include
"/tmsnti/inst/apps/TMSNTI_mohmsnt014/ora/10.1.3/Apache/Apache/conf/url_fw.conf"
bash-3.2$
+ bounced services
+ Now able to see logo on URL https://appsmsntmfstest.orclsourcing.com
+ Request customer to retest the issue.
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : unable to start apache
$ adapcctl.sh start
adapcctl.sh version 115.55
Apache Web Server Listener is not running.
Starting Apache Web Server Listener (dedicated HTTP)
...
08/24/12-02:18:58 :: Removing gantt cache directory
+ solution
============
Moved gantt directory ( get gantt cache directory from adapcctl.sh )
+ And started apache on all Mts
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Concurrent manager
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : CM not coming up only one FNDLIBR process is running
Solution:
Brought down MT services
Ran cmclean.sql
To implement the solution, please execute the following steps:
1. Log in as applmgr
2. Cd to $FND_TOP/patch/115/sql
3. Run the script: afdcm037.sql
Broughtup services
Cm up and running now.
bash-3.00$ ps -ef | grep FNDLIBR | wc -l
174
bash-3.00$
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : CM not coming up only one FNDLIBR process is running
started relink on /sid/product/1012/bin but didn't helped
==> Restored the 1012 bin directory from a backup
bash-3.2$ pwd
/sid/product/1012/bin
bash-3.2$ cd ..
bash-3.2$ mv bin bin_Bkp
bash-3.2$ cd
/sid/product/.zfs/snapshot/.4MFTMKY-exp20Jan15_mohe10o002_sid_PROJ_20150113_1939/1012
bash-3.2$ cp -R bin /sid/product/1012/
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : FNDLIBR defunct
After Full Instance Bounce.
All services UP and Running. Except on PCP2 node - aohsgeor32
Showing :
24676 ? Z 0:00 \_ [FNDLIBR] <defunct>
24677 ? Z 0:00 \_ [FNDLIBR] <defunct>
24684 ? Z 0:00 \_ [FNDLIBR] <defunct>
Action
======
1 - Stop MT services on all MT nodes and make sure no stray processes
2 - Bounce DB instance
3 - Launch adadmin and choose the task to relink all product executables.
4 - Run cmclean.sql
5 - Start MT services on MT nodes one by one
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue :
aptwhiri 15816 0.2 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15817 0.4 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15818 0.4 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15819 0.5 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15821 0.5 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15822 0.2 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15823 0.5 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15824 0.5 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
<Action Plan>
ran cmclean and relinked the following
adrelink.sh force=y link_debug=y "fnd FNDLIBR"
adrelink.sh force=y link_debug=y "fnd FNDSM"
$AD_TOP/bin/adrelink.sh force=y ranlib=y "inv INVLIBR"
$AD_TOP/bin/adrelink.sh force=y ranlib=y "inv INCTM"
$AD_TOP/bin/adrelink.sh force=y ranlib=y "fnd FNDCRM"
Now CM is up and running.
48627651 -AU
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE FNDLIBR defunct
Solution
********
Ref Doc ID 392246.1
Faced the issue as XBOL_TOP is not set correctly.
sqlnet.expire_time is set to 10 and set FDCPTRW to 11 in the customsid_mohpucl006.env file
in MT.
bash-3.2$ grep -i FDCPTRW customsid_mohpucl006.env
FDCPTRW=11
export FDCPTRW
bash-3.2$
and added the missing env file in APPSsid_mohpucl006.env
bash-3.2$ cd /sid/applmgr/1200/admin/
bash-3.2$ cd ..
bash-3.2$ diff APPSsid_mohpucl006.env APPSsid_mohpucl006.env_bkp
33c33
< . /sid/applmgr/1200/customsid_mohpucl006.env
---
>
bash-3.2$
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
(Doc ID 1413393.1)
apdfrdei 29573 0.0 0.0 0 0 ? Z 13:54 0:00 POXCON <defunct>
apdfrdei 29574 0.0 0.0 0 0 ? Z 13:54 0:00 POXCON <defunct>
apdfrdei 29575 0.0 0.0 0 0 ? Z 13:54 0:00 POXCON <defunct>
apdfrdei 29576 0.0 0.0 0 0 ? Z 13:54 0:00 POXCON <defunct>
apdfrdei 29577 0.0 0.0 0 0 ? Z 13:54 0:00 INCTM <defunct>
apdfrdei 29578 0.0 0.0 0 0 ? Z 13:54 0:00 RCVOLTM <defunct>
Below managers do not start, Die after restart ( processes going to defunct)
USER_CONCURRENT_QUEUE_NAME DESCRIPTION CONCURRENT_QUEUE_NAME RUNNING_PROCESSES TARGET_PROCESSES
--------------------------------------------------------------------------------------------------- ------------------------------ ----------------- ----------------
PO Document Approval Manager PO Document Approval Manager Queue PODAMGR 0 4
Receiving Transaction Manager Receiving Transaction Manager program RCVOLTM 0 1
Inventory Manager Manager to run Immediate Concurrent Programs defined in INVLIBR INVMGR 1 1
SQL> select * from ad_bugs where bug_number='12923944';
no rows selected
cd $FND_TOP/bin/
$ strings FNDTMTST | grep afptm.lc
$Header: afptm.lc 120.6.12010000.2 2009/08/05 18:35:08 jtoruno ship $
Action Plan
===========
1. Download and review the readme and pre-requisites for Patch: 12923944:R12.FND.B
2. Ensure that you have taken a backup of your system before applying the recommended patch.
3. Apply the patch in a test environment.
4. Confirm the following file versions:
afptm.lc 120.6.12010000.3
The following command can be used to confirm the file version: strings $FND_TOP/bin/FNDTMTST | grep afptm.lc
5. Bounce the concurrent managers.
6. Retest the issue
Issue fixed after patch
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue:- Active users failed with error
Symptoms:-
REP-0059: Unable to locate resources for subcomponent 'VGS'.
Check the location of resource file.
Cause:- corrupted files under location /sid/product/1012/guicommon/vgs/admin/resource/US
Resolution/Fix:- Copied files from other instance
Reference Note/RFC:- NA
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue Active users failing
Enter Password:
REP-0004: Warning: Unable to open user preference file.
ORA-01410: invalid ROWID
==> select user_name, application_name, responsibility_name,
REP-0069: Internal error
REP-57054: In-process job terminated:Terminated with error:
REP-300: invalid ROWID
==> select user_name, application_name, responsibility_name,
+ Bounced CM , ran utlrp
copied prefs.ora to $HOME from /tsukai/product/1012/tools/admin
+ Now Active user completed Normal req id 1262941
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
How to Cancel Cost Manager (CMCTCM ) And Relaunch It (Doc ID 373207.1)
Solution
1 - To cancel the Cost Manager : use one of the following method :
a) use Sysadmin responsability
Navigate to /Request/view
Set : specific Request=on
Name=Cost Manager.
In the lower part of the Find requests window
you have a field "Select the Number of Days to view" set by default to 7 days
-> Set "Select the Number of Days to view"=9999
In fact this field is a filter which limits how far back it will query requests.
From here Cancel the Cost Manager which is Pending Scheduled.
or
b) run
SELECT request_id RequestId,
request_date RequestDt, concurrent_program_name,
phase_code Phase,
status_code Status FROM
fnd_concurrent_requests fcr,
fnd_concurrent_programs fcp
WHERE fcp.application_id = 702 AND
fcp.concurrent_program_name in ('CMCTCM', 'CMCMCW', 'CMCACW') AND
fcr.concurrent_program_id = fcp.concurrent_program_id AND
fcr.program_application_id = 702 AND fcr.phase_code <> 'C'
Cancel all the requests from the above output.
by going /Sysadmin / Concurrent / Request
query for the RequestId returned from the select above
In the lower part of the Find requests window
you have a field "Select the Number of Days to view" set by default to 7 days
-> Set "Select the Number of Days to view"=9999
In fact this field is a filter which limits how far back it will query requests.
Cancel the request id other than running. Let the running request get over.
2 - Run the cmclean.sql script available from Metalink (cf Note 134007.1)
3 - Restart the cost manager via
Inventory / Setup / Transactions / Interface Managers
on line 'cost manager' - do Tools > Launch
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
*********************************
Issue : With out put post processiong (OPP)
*********************************
The concurrent manager has timed out waiting for the Output Post-processor to finish this request
Action Plan
==========
1> Increase number of workers for OPP to 2 (currently 1)
2> Increase value for profile, Concurrent:OPP Process Timeout, to 600 (currently 300)
3> Restart OPP Concurrent Manager
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue:-Active users going in pending state
Cause:- This requests were waiting in CM queue "TAM : High Workload" and "TAM :
Fast Running Jobs" which were in deactivated state
Resolution/Fix:- Reactivated the manages "TAM : High Workload" and "TAM : Fast
Running Jobs" all the pending ones got completed.
The "Active user" report has a request type defined as "XTAM_FAST" which is
specialized for the queue TAM : Fast Running Jobs
hence on starting the "TAM : Fast Running Jobs" they got completed.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Request viewlog and view output not working
Actions Done :
------------
Changed Profile "RRA: Service Prefix" from TSIB1I_ to Blank at Site Level and the issue
is fixed.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue: concurrent requests running with " inactive nomanager "
We don't include any program for specialization rules for Stadnard Mangaer. "Active User and Prints environment variable values " concurrent programs were included for the Standard Mangaer. Excluded the Print Variable concurrent Program and Active Responsibility concurrent program from the Standard Manager. Now all the requests are being processed.
We can not delete any line from the Specialization rules from the any Manager.
So I changed the include to exclude the "Prints environment variable values" concurrent requests.
And renamed the Active user to "Active Responsibilities and Users" and excluded from the standard Manger.
Now all the concurrent requests will be processed except these two requests "Active Responsibilities and Users" and "Prints environment variable values"
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Unable to start CM( fndlibr) processes on secondary pcp node
SOlution:
=========
$ diff sqlnet.ora sqlnet.ora.bak
13c13
< tcp.invited_nodes = (RMOHSAVCR99.orclsourcing.com, mohAVCR598.orclsourcing.com,
mohAVCR596, mohAVCR599.orclsourcing.com)
---
> tcp.invited_nodes = (RMOHSAVCR99.orclsourcing.com, mohAVCR598.orclsourcing.com,
mohAVCR596)
16c16
-> node 599 was not allowed to Net8 connect to node 598
=> adding it to tcp.invited_nodes fixed the issue
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Apache Web Server Listener is not running.
Starting Apache Web Server Listener (dedicated HTTP in SSL mode) ...
Syntax error on line 1231 of /pageni/product/iAS/Apache/Apache/conf/httpd.conf:
SSLCertificateChainFile: file '/pageni/product/iAS/Apache/Apache/conf/ssl.crt/ca.crt' not exists
or empty
/pageni/product/iAS/Apache/Apache/bin/apachectl startssl: httpd could not be started
Apache Web Server Listener (PLSQL) :httpd ( pid 2694 ) is running.
Can not start Apache Web Server now
Solution 3:
============
commented out SSLCertificateChainFile in $APACHE_TOP/Apache/conf/httpd.conf and apache was
started.
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISssue : forms not launching
error FRM-40833 : Could not completely load the dynamic user exit libraries. User exit FND did not execute
Solution Note :754347.1
To resolve the issue
1. Copy fndfmxit.so from a backup
2. Place it in $FND_TOP/bin
3. Do NOT relink fnddmxit.so, instead bounce services and you should be able to launch forms now
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue :forms not coming SR .1788103321
Approach
---------
+ there seems to some kind of problem linked with binary frmweb
Will strive to take strace from this binary
+ the error message in trace fiele is
open("/sid/product/1012/lib/libXm.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/sid/product/1012/jdk/jre/lib/i386/libXm.so.2", O_RDONLY) = -1 ENOENT (No such file or directory)
+ file /sid/product/1012/lib/libXm.so.2 seems to be missing on OS level.
will create collaboration request to System admin team to fix the issue on OS level.
+ libraries are missing in /usr/X11R6/lib/ on host aohssbic02, which is reason why dsbici and tsbici froms sever can't start.
Forms issues is resolved after installing the rpm openmotif21
Reference note id:880088.1
ISSUE:
Got the below error while accessing the forms
FRM-40010: Cannot read form
/SID/applmgr/1211/fnd/12.0.0/forms/US/FNDSCSGN
===> The above error is happening while accessing the forms in first time.
If you open this is second time it's working fine.
Solution
---------
bash-3.00$ pwd
/SID/inst/apps/SID_aohsrigs03/ora/10.1.2/forms/server
bash-3.00$ ls
appsweb.cfg appsweb.cfg_org default.env ftrace.cfg socket.env txkcsa.cfg txkLoadXMLInDB.sh
+ compare default.env and socket.env with files in snapshot, if difference found restore
Note: 1200 is replaced with 1211
ex:bash-3.00$ diff socket.env ../../socket.env
32,36c32,36
< APPL_TOP=/SID/applmgr/1200
< APPL_TOP2=/SID/applmgr/1200
< APPL_TOP3=/SID/applmgr/1200
< APPL_TOP4=/SID/applmgr/1200
< ADMIN_SID=/SID/applmgr/1200/admin/SID
---
> APPL_TOP=/SID/applmgr/1211
> APPL_TOP2=/SID/applmgr/1211
> APPL_TOP3=/SID/applmgr/1211
> APPL_TOP4=/SID/applmgr/1211
> ADMIN_SID=/SID/applmgr/1211/admin/SID
44c44
< REPORTS_PATH=/SID/applmgr/1200/au/12.0.0/plsql:/SID/applmgr/1200/fnd/12.0.0/reports:/SID/applmgr/1200/au/12.0.0/reports:/SID/applmgr/1200/au/12.0.0/graphs
---
> REPORTS_PATH=/SID/applmgr/1211/au/12.0.0/plsql:/SID/applmgr/1211/fnd/12.0.0/reports:/SID/applmgr/1211/au/12.0.0/reports:/SID/applmgr/1211/au/12.0.0/graphs
< XNP_TOP=/SID/applmgr/1200/xnp/12.0.0
< XTR_TOP=/SID/applmgr/1200/xtr/12.0.0
< ZPB_TOP=/SID/applmgr/1200/zpb/12.0.0
< ZX_TOP=/SID/applmgr/1200/zx/12.0.0
---
> XNP_TOP=/SID/applmgr/1211/xnp/12.0.0
> XTR_TOP=/SID/applmgr/1211/xtr/12.0.0
> ZPB_TOP=/SID/applmgr/1211/zpb/12.0.0
> ZX_TOP=/SID/applmgr/1211/zx/12.0.0
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Please do the following changes and try to relink again 1273390.1
1. Open $AD_TOP/bin/adrelinknew.sh 2. find the string below in the LINUX section
CPP_LDFLAGS=' -L$(ORACLE_HOME)/lib -L$(ORACLE_HOME)/lib/stubs -lclntsh'
3. change this to the string below
CPP_LDFLAGS=' -L$(ORACLE_HOME)/lib -L$(ORACLE_HOME)/lib/stubs -lclntsh -Wl,--noinhibit-exec'
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue :
Jserv and tcfsocket is not working on DMZ node
Solution
=========
commented below line in httpd.conf
#Configuration file containing Aceess Restrictions in a DMZ configuration.
#include "/thorui/product/iAS/Apache/Apache/conf/url_fw.conf"
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE : unable to view MHP Purchasing Super User Responsibility
Observation:
MHP Purchasing Super User Responsibility was end dated for SYSADMIN user
Solution:
--------
Removed end-date from 'MHP Purchasing Super User Responsibility' for SYSADMIN user
+ Ran conc requests "Workflow Directory Services User/Role Validation" ( with parameters YES,NO,YES and YES,YES,no) and "Synchronize WF LOCAL tables"
+ Able to view the responsibility 'MHP Purchasing Super User' now.
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Doc ID 390425.1
Thu Feb 24 18:02:19 2011] [warn] pid file /var/opt/TBAXTC_aohsbaxt03/Apache/logs/httpd.pid
overwritten -- Unclean shutdown of previous Apache run?[Thu Feb 24 18:02:19 2011] [error] OPM:Fail
to allocate memory for mutex in shmpool[Thu Feb 24 18:02:19 2011] [error] OPM:Fail to call
opm_sys_init[Thu Feb 24 18:02:19 2011] [error] OPM: process manager could not create internal
tables[Thu Feb 24 18:02:19 2011] [crit] (37)No locks available: Apache JServ encountered a fatal
error; check your ApJServLogFile for details if none are present in this file. Exiting.
Httpd processes are getting defunct while starting up .
cat /etc/fstab
Recomended action plan
---------------------------------
Request SA's to to mount the NFS disks using the nolock option
Issue fixed
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue
======
OC4JGroup:default_group | OC4J:oacore | N/A | Down
$ adopmnctl.sh startall
You are running adopmnctl.sh version 120.4.12000000.3
opmnctl: starting opmn and all managed processes...
================================================================================
opmn id=aohsioil23:11025
5 of 6 processes started.
ias-instance id=PIOI1I_aohsioil23.aohsioil23.orclsourcing.com
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
ias-component/process-type/process-set:
default_group/oacore/default_group/
Error
--> Process (index=4,uid=863643606,pid=0)
no port available from the port range
failed to start a managed process after the maximum retry limit
no port available from the port range
no port available from the port range
Log:
none
cause disco services was running on this node some port was occupying:
Solution
======
Brought down all the services on 23 including disco services
Started MT services. started successfully.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE: FORMS COMING WITH BLANK PAGE
RFC .1F6J1FJ
Applied Note ID 1221913.1 to apply interoperability dev6i Patch 9935935
Issue fixed, able to launch forms now
submitted active users req id 63145888
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE
======
+ tried to generate using adadmin , failed
Generating any out of date or missing jar files.
adearea();
Warning=> unable to locate /dmoi/applmgr/common/java/owa.zip file.
Signing product JAR files in JAVA_TOP -
/dmoi/applmgr/common/java
using entity Customer and certificate 1.
Successfully created javaVersionFile.
Generating product JAR files in JAVA_TOP -
/dmoi/applmgr/common/java with command:
adjava -mx512m -nojit oracle.apps.ad.jri.adjmx
@/dmoi/applmgr/1159/admin/dmoi_BALANCE/out/genjars.cmd
Failed to generate product JAR files in JAVA_TOP -
/dmoi/applmgr/common/java.
adogjf() Unable to generate jar files under JAVA_TOP
Observation
------------
bash-2.05$ pwd
/dmoi/product
bash-2.05$ ls -l identitydb.obj
lrwxrwxrwx 1 apdmoi aadmoi 25 May 13 2005 identitydb.obj -> ../applmgr/identitydb.obj
bash-2.05$
bash-2.05$ ls -ltr ../applmgr/identitydb.obj
-rwxrwxrwx 1 apdmoi aadmoi 0 Mar 21 08:45 ../applmgr/identitydb.obj
bash-2.05$
+ identitydb.obj file shows 0 byte.
Solution
--------
+Copied the $HOME/identitydb.obj from production to devlopment inatance dmoi
+ Ran adadmin to regenerate jarfiles, Running fine..
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE :Apache not starting
Error log
==========
[Tue Mar 29 16:06:55 2011] [notice] Oracle HTTP Server Powered by Apache/1.3.19 configured -- resuming normal operations
[Tue Mar 29 16:10:16 2011] [warn] pid file /var/opt/SID_aohsapig04/Apache/logs/httpd_pls.pid overwritten -- Unclean shutdown of previous Apache run?
[Tue Mar 29 16:10:16 2011] [notice] FastCGI: process manager initialized (pid 16075)
[Tue Mar 29 16:10:17 2011] [notice] Oracle HTTP Server Powered by Apache/1.3.19 configured -- resuming normal operations
[Tue Mar 29 16:10:14 2011] [warn] pid file /var/opt/SID_aohsapig04/Apache/logs/httpd.pid overwritten -- Unclean shutdown of previous Apache run?
[Tue Mar 29 16:10:14 2011] [error] OPM:Fail to open file /var/opt/SID_aohsapig04/Apache/logs/SID_opm_sys_mtx.pid.15981
[Tue Mar 29 16:10:14 2011] [error] OPM:Fail to create mutex
[Tue Mar 29 16:10:14 2011] [error] OPM: process manager could not create internal tables
[Tue Mar 29 16:10:14 2011] [crit] (13)Permission denied: Apache JServ encountered a fatal error; check your ApJServLogFile for details if none are present in this file. Exiting.
bash-3.00$ grep -i s_lock_pid_dir $CONTEXT_FILE
<lock_pid_dir oa_var="s_lock_pid_dir">/var/opt/SID_aohsapig04/Apache/logs</lock_pid_dir>
bash-3.00$
bash-3.00$ ls -lrt /var/opt/SID_aohsapig04/Apache/logs/httpd.pid
-rwxrwxrwx 1 root root 6 Mar 29 16:10 /var/opt/SID_aohsapig04/Apache/logs/httpd.pid
bash-3.00$
bash-3.00$ touch test.txt
touch: cannot touch `test.txt': Read-only file system
bash-3.00$
+ Unable to create/overwrite pid file
+ Request SA's to give 777 permissions to '/var/opt/SID_aohsapig04/Apache/logs/'
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue:
Test Verify TCF Socket Server servlet : FAILED
Test Verify JServ : FAILED
Solution
---------
bash-3.00$ diff httpd.conf httpd.conf_bkp8apr11
1414c1414
< #include "/SID/product/SID_aohssfir09/iAS/Apache/Apache/conf/url_fw.conf"
---
> include "/SID/product/SID_aohssfir09/iAS/Apache/Apache/conf/url_fw.conf"
bash-3.00$
bash-3.00$ diff httpd.conf httpd.conf_bkpapr811
1414c1414
< #include "/SID/product/SID_aohssfir05/iAS/Apache/Apache/conf/url_fw.conf"
---
> include "/SID/product/SID_aohssfir05/iAS/Apache/Apache/conf/url_fw.conf"
bash-3.00$
Issue resolved
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Forms issue:
error:
failed to connect to server:tst.bardahl.com.mx:10513
java.net.socketException:Connection reset
Solution:
bash-3.00$ diff adformsrvctl.sh_s adformsrvctl.sh
237,248c237,248
< printf "Calling txkChkFormsDeployment.pl to check whether latest FORMSAPP.EAR is deployed...\n";
< /SID/applmgr/1213/fnd/12.0.0/bin/txkrun.pl -script=ChkFormsDeployment
< exit_code=$?
< if [ $exit_code -ne 0 ]; then
< printf "Error while executing the perl script txkChkFormsDeployment.pl\n";
< printf "$LOGAP\n\n";
< printf "\n$program: exiting with status 1\n\n"
< exit 1;
< else
< printf "Perl script txkChkFormsDeployment.pl got executed successfully\n";
< printf "\n\n";
< fi
---
> #printf "Calling txkChkFormsDeployment.pl to check whether latest FORMSAPP.EAR is deployed...\n";
> #/SID/applmgr/1213/fnd/12.0.0/bin/txkrun.pl -script=ChkFormsDeployment
> #exit_code=$?
> #if [ $exit_code -ne 0 ]; then
> # printf "Error while executing the perl script txkChkFormsDeployment.pl\n";
> # printf "$LOGAP\n\n";
> # printf "\n$program: exiting with status 1\n\n"
> # exit 1;
> # else
> # printf "Perl script txkChkFormsDeployment.pl got executed successfully\n";
> # printf "\n\n";
> #fi
bash-3.00$
+ Forms issue Resolved.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : Apache PLSQL component not starting
error log
----------
[Sat Dec 10 01:21:26 2011] [notice] Oracle HTTP Server Powered by Apache/1.3.19 configured -- resuming normal operations
/bin/sh: 6829 Killed
[Sat Dec 10 01:52:53 2011] [warn] pid file /SID/product/iAS/Apache/Apache/logs/httpd_pls.pid overwritten -- Unclean shutdown of previous Apache run?
[Sat Dec 10 01:52:54 2011] [notice] Oracle HTTP Server Powered by Apache/1.3.19 configured -- resuming normal operations
~
Solution
woeaap03:apSID>diff httpd_pls.conf httpd_pls.conf_bkp10dec11
107c107
< PidFile /var/opt/SID_woeaap03/Apache/logs/httpd_pls.pid
---
> PidFile /SID/product/iAS/Apache/Apache/logs/httpd_pls.pid
woeaap03:apSID>
woeaap03:apSID>adapcctl.sh status
adapcctl.sh version 115.55
Apache Web Server Listener :httpd ( pid 10801 ) is running.
Apache Web Server Listener (PLSQL) :httpd ( pid 11036 ) is running.
adapcctl.sh: exiting with status 0
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
issue : No responsibility for sysadmin user
SQL> select count(*) from fnd_user_resp_groups where USER_ID=0;
COUNT(*)
----------
0
Downloaded the sysadmin user responsibilities from test instance and uploaded to DPSNLI
FNDLOAD apps/Y7wOF6kd 0 Y DOWNLOAD $FND_TOP/patch/115/import/afscursp.lct sysadminresp.ldt FND_USER USER_NAME='SYSADMIN'
FNDLOAD apps/C5uLB2sj 0 Y UPLOAD $FND_TOP/patch/115/import/afscursp.lct sysadminresp.ldt FND_USER USER_NAME='SYSADMIN'
select count(*) from fnd_user_resp_groups where USER_ID=0;
COUNT(*)
----------
14
+ ran below concurrent programs from backend
Sync responsibility role data into the WF table.
Workflow Directory Services User/Role Validation
CONCSUB APPS/*** SYSADMIN 'System Administrator' SYSADMIN WAIT=Y CONCURRENT FND AFFURGO2 START='"24-FEB-2012 01:00:00"' REPEAT_DAYS=1 REPEAT_END='"24-FEB-2012 23:59:00"' Y 0 0
CONCSUB APPS/*** SYSADMIN 'System Administrator' SYSADMIN WAIT=Y CONCURRENT FND FNDWFDSURV START='"24-FEB-2012 01:00:00"' REPEAT_DAYS=1 REPEAT_END='"24-FEB-2012 23:59:00"' Y 0 0
+ Now able to view the responsibilities for sysadmin user
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
"system Administrator" responsibility not showing(listing) for sysadmin user
COL USER_NAME FOR A17
COL RESPONSIBILITY_NAME FOR A30
COL END_DATE FOR A20
select a.USER_NAME, b.RESPONSIBILITY_ID, c.RESPONSIBILITY_NAME, b.END_DATE
from apps.FND_USER a, apps.FND_USER_RESP_GROUPS b, apps.FND_RESPONSIBILITY_VL c
where a.USER_ID=b.USER_ID and b.RESPONSIBILITY_ID=c.RESPONSIBILITY_ID
and user_name = UPPER('&user_name');
OBSERVATION:
+ Compared with non-pord and found that "System Administrator" role is inactive (navig User Management ->Users-> query for sysadmin user.. and in roles search for "System Administrator"
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Apache server not starting
adapccl.sh start
--> Process (index=1,uid=555560055,pid=26257)
failed to start a managed process after the maximum retry limit
Log:
/SID/mtlog/SID_aohsapas33/logs/ora/10.1.3/opmn/HTTP_Server~1.log
adapcctl.sh: exiting with status 0
adapcctl.sh: check the logfile /SID/mtlog/SID_aohsapas33/logs/appl/admin/log/adapcctl.txt
for more information ...
Apache Error log
===========
[Sun Apr 1 01:57:41 2012] [warn] pid file /var/opt/SID_aohsapas33/Apache/logs/httpd.pid
overwritten -- Unclean shutdown of previous Apache run?
[Sun Apr 1 01:57:41 2012] [error] mod_ossl: Cannot allocate shared memory: mm:core: failed to
open memory file (No such file or directory)
[Sun Apr 1 01:57:43 2012] [warn] pid file /var/opt/SID_aohsapas33/Apache/logs/httpd.pid
overwritten -- Unclean shutdown of previous Apache run?
[Sun Apr 1 01:57:43 2012] [error] mod_ossl: Cannot allocate shared memory: mm:core: failed to
open memory file (No such file or directory)
Cause:
SSLSessionCache location in ssl.conf has invalid location
[AMD64] apSID@aohsapas35 > diff ssl.conf
/SID/inst/apps/SID_aohsapas35/ora/10.1.3/Apache/Apache/conf/ssl.conf
42c42
< SSLSessionCache
shmcb:/SID/mtlog/SID_aohsapas35/logs/ora/10.1.3/Apache/ssl_scache(512000)
---
> SSLSessionCache
shmcb:/var/opt/SID_aohsapas35/Apache/logs/ora/10.1.3/Apache/ssl_scache(512000)
Solution
=========
Made below changes
==================
[AMD64] apSID@aohsapas35 > diff ssl.conf ssl.conf_bkp1mar12
42,43c42
< #SSLSessionCache
shmcb:/var/opt/SID_aohsapas35/Apache/logs/ora/10.1.3/Apache/ssl_scache(512000)
< SSLSessionCache
shmcb:/SID/mtlog/SID_aohsapas35/logs/ora/10.1.3/Apache/ssl_scache(512000)
---
> SSLSessionCache
shmcb:/var/opt/SID_aohsapas35/Apache/logs/ora/10.1.3/Apache/ssl_scache(512000)
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
oafm not starting
=================
bash-3.2$ adoafmctl.sh start
You are running adoafmctl.sh version 120.8
Starting OPMN managed OAFM OC4J instance ...
adoafmctl.sh: exiting with status 150
adoafmctl.sh: check the logfile /SID/mtlog/SID_aohsmich38/logs/appl/admin/log/adoafmctl.txt
for more information ...
solution
========
found the oafm process was failing to start due to timeout.
Tried setting the timeout value to 600 to 1200 in opmn.xml and finally, the process started.
ref Doc ID 564536.1 (have updated the custom template opmn_xml_1013.tmp with same value.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Forms failed to launch
FRM-40010:cannot read form
/SID/applmgr/1213/fnd/12.0.0/forms/US/FNDSCSGN
+ Corrected below files on nodes rmohsclop95 and rmohsclop95
socket.env , default.env and appsweb.cfg
+1206 entries are there in socket.env , default.env --> corrected
bash-3.00$ pwd
/SID/inst/apps/SID_rmohsclop95/ora/10.1.2/forms/server
bash-3.00$
bash-3.00$ diff appsweb.cfg appsweb.cfg_4sep12
108c108
< EndUserMonitoringURL=
---
> EndUserMonitoringURL=https://r12test.clopay.com:443/oracle_smp_chronos/oracle_smp_chronos_sdk.gif
112c112
< serverName=r12test
---
> serverName=rmohsclop95
bash-3.00$
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Forms are not working with any user other than sysadmin
SOlution
ICX_FORMS_LAUNCHER (ICX: Forms Launcher)
is set to http://r12test.clay.com:443/OA_HTML/frmservlet on Site level - this is not valid URL.
It's set correctly on SYSADMIN level to: https://r12test.clay.com:443/OA_HTML/frmservlet
Please set the profile option properly to
https://r12test.clay.com:443/OA_HTML/frmservlet
on site level and let the customer re-test.
Regards,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue: TCF Socket Server servlet and
Verify JServ failed on DMZ node
below urls does not work
http://aohspsnl17.orclsourcing.com:12515/oa_servlets/oracle.apps.fnd.tcf.SocketServer
http://aohspsnl17.orclsourcing.com:12515/servlets/Hello
error
Access to the requested URI has been blocked by the URL Firewall
Fix:
Made below changes in httpd.conf
bash-3.2$ diff httpd.conf httpd.conf_bkpold
1412c1412
< #include "/tpsn2i/product/TPSN2I_aohspsnl17/iAS/Apache/Apache/conf/url_fw.conf"
---
> include "/tpsn2i/product/TPSN2I_aohspsnl17/iAS/Apache/Apache/conf/url_fw.conf"
bash-3.2$
below urls working
http://aohspsnl17.orclsourcing.com:12515/oa_servlets/oracle.apps.fnd.tcf.SocketServer
http://aohspsnl17.orclsourcing.com:12515/servlets/Hello
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue: OTA is not running
SQL> SELECT count(*)
from gv$session vs
where vs.inst_id = userenv('INSTANCE')
and action like '%OXTA%'; 2 3 4
COUNT(*)
----------
0
SQL> select decode(count(*),0,'Error: OTA is Not Running','OTA is Running') from gv$session
where action like '%OXTA%';
DECODE(COUNT(*),0,'ERROR:
-------------------------
Error: OTA is Not Running
Solution:
========
+ Unable to ping OTA Fom url https://ebsotest.ntenergy.com/OA_HTML/US/ECXOTAPing.htm
+ user name and password not defined correctly in data-sources.xml
$INST_TOP/ora/10.1.3/j2ee/oafm/application-deployments/oafm/data-sources.xml
+ Made below changes.
bash-3.2$ diff data-sources.xml data-sources.xml_abkp26jun14
29c29
< password="->ASADMIN"
---
> password="->W52C0m5a23"
bash-3.2$
+ Bounced the OAFM container .
+ able to ping OTA Fom url https://ebsotest.ntenergy.com/OA_HTML/US/ECXOTAPing.htm
SQL> select name from v$database;
NAME
---------
TTEI
SQL> select decode(count(*),0,'Error: OTA is Not Running','OTA is Running') from gv$session
where action like '%OXTA%'; 2
DECODE(COUNT(*),0,'ERROR:
-------------------------
OTA is Running
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE: Node manager WLS_DISCO is not starting
OBSERVATION/FINDINGS
====================
the Node Manager associated with machine mohcord002.orclsourcing.com is not reachable
<Jul 11, 2014 9:44:39 PM EDT> <Info> <Security> <BEA-090908> <Using default WebLogic SSL Hostname Verifier implementation.>
<Jul 11, 2014 9:44:39 PM> <SEVERE> <Fatal error in node manager server>
java.net.BindException: Address already in use
at java.net.PlainSocketImpl.socketBind(Native Method)
at java.net.PlainSocketImpl.bind(PlainSocketImpl.java:383)
at java.net.ServerSocket.bind(ServerSocket.java:328)
at javax.net.ssl.impl.SSLServerSocketImpl.bind(Unknown Source)
SEVERE: Fatal error in node manager server
java.net.BindException: Address already in use
+ port 5556 is occupied by dev instance DCORDI
+ changed to available port 5557 in nodemanager.properties and config.xml
Changed StartScriptName to below value
+ bash-3.2$ diff nodemanager.properties nodemanager.properties_abkp
12c12
< StartScriptName=startWebLogic.sh
---
> StartScriptName=startNodeManager.sh
bash-3.2$
bash-3.2$ pwd
/tcordi/disco11g/.zfs/snapshot/.498ZPJD-exp18Jul14_mohcord001_TCORDI_PROJ_20140711_0207/product/user_projects/domains/TCORDI/config
bash-3.2$ grep -i 555 config.xml
<listen-port>5556</listen-port>
changed listen-port to 5557
bash-3.2$ grep -i 555 /tcordi/disco11g/product/user_projects/domains/TCORDI/config/config.xml
<listen-port>5557</listen-port>
bash-3.2$
+ Reatarted services
Able to start Node manager WLS_DISCO
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue: Apache not starting
+ mount point /var/opt/SID_host/Apache/logs 100% filled
Removed few files from /var/opt/SID_host/Apache/logs
bash-3.2$ adopmnctl.sh startall
You are running adopmnctl.sh version 120.6.12010000.5
Starting Apache...
Apache started successfully.
Starting OACORE oc4j...
OACORE oc4j started successfully.
Starting OAFM oc4j...
OAFM oc4j started successfully.
adopmnctl.sh: exiting with status 0
adopmnctl.sh: check the logfile /tgac3i/inst/apps/SID_host/logs/appl/admin/log/adopmnctl.txt for more information ...
bash-3.2$ adopmnctl.sh status
You are running adopmnctl.sh version 120.6.12010000.5
Checking status of OPMN managed processes...
Processes in Instance: SID_host.mohgaco014.orclsourcing.com
---------------------------------+--------------------+---------+---------
ias-component | process-type | pid | status
---------------------------------+--------------------+---------+---------
OC4JGroup:default_group | OC4J:oafm | 16863 | Alive
OC4JGroup:default_group | OC4J:oacore | 16756 | Alive
OC4JGroup:default_group | OC4J:oacore | 16757 | Alive
HTTP_Server | HTTP_Server | 16705 | Alive
adopmnctl.sh: exiting with status 0
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE : responsibilities missing to sysadmin user
SQL> select count(*) from fnd_user_resp_groups where USER_ID=0;
COUNT(*)
----------
11
+ Ran below concurrent prog from backend
Run the concurrent request Workflow Directory Services User/Role Validation as follows:
a. "Workflow Directory Services User/Role Validation" Parameters : 100000, Yes, No, No"
b. "Workflow Directory Services User/Role Validation" Parameters : 100000, No, Yes, No"
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE: logo not displaying on DMZ login page after compiling jsps
Observation/findings:
https://appnttest.orclsourcing.com/OA_MEDIA/Masternautnew_180913.png --works
But
https://appsmsntmfstest.orclsourcing.com/OA_MEDIA/Masternautnew_180913.png -errors
Access to the requested URI has been blocked by the URL Firewall.
If you believe that you have reached this page while performing valid operations within the
application, please send mail to aptmsnti@orclsourcing.com explaining what you were doing
when you got this error
+ Observed that url_fw.conf not excluded form httpd.conf.
Solution:
=========
+ Made below changes
bash-3.2$ diff httpd.conf httpd.conf_bkp2514
1127c1127
< #include
"/tmsnti/inst/apps/TMSNTI_mohmsnt014/ora/10.1.3/Apache/Apache/conf/url_fw.conf"
---
> include
"/tmsnti/inst/apps/TMSNTI_mohmsnt014/ora/10.1.3/Apache/Apache/conf/url_fw.conf"
bash-3.2$
+ bounced services
+ Now able to see logo on URL https://appsmsntmfstest.orclsourcing.com
+ Request customer to retest the issue.
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : unable to start apache
$ adapcctl.sh start
adapcctl.sh version 115.55
Apache Web Server Listener is not running.
Starting Apache Web Server Listener (dedicated HTTP)
...
08/24/12-02:18:58 :: Removing gantt cache directory
+ solution
============
Moved gantt directory ( get gantt cache directory from adapcctl.sh )
+ And started apache on all Mts
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Concurrent manager
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : CM not coming up only one FNDLIBR process is running
Solution:
Brought down MT services
Ran cmclean.sql
To implement the solution, please execute the following steps:
1. Log in as applmgr
2. Cd to $FND_TOP/patch/115/sql
3. Run the script: afdcm037.sql
Broughtup services
Cm up and running now.
bash-3.00$ ps -ef | grep FNDLIBR | wc -l
174
bash-3.00$
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : CM not coming up only one FNDLIBR process is running
started relink on /sid/product/1012/bin but didn't helped
==> Restored the 1012 bin directory from a backup
bash-3.2$ pwd
/sid/product/1012/bin
bash-3.2$ cd ..
bash-3.2$ mv bin bin_Bkp
bash-3.2$ cd
/sid/product/.zfs/snapshot/.4MFTMKY-exp20Jan15_mohe10o002_sid_PROJ_20150113_1939/1012
bash-3.2$ cp -R bin /sid/product/1012/
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue : FNDLIBR defunct
After Full Instance Bounce.
All services UP and Running. Except on PCP2 node - aohsgeor32
Showing :
24676 ? Z 0:00 \_ [FNDLIBR] <defunct>
24677 ? Z 0:00 \_ [FNDLIBR] <defunct>
24684 ? Z 0:00 \_ [FNDLIBR] <defunct>
Action
======
1 - Stop MT services on all MT nodes and make sure no stray processes
2 - Bounce DB instance
3 - Launch adadmin and choose the task to relink all product executables.
4 - Run cmclean.sql
5 - Start MT services on MT nodes one by one
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue :
aptwhiri 15816 0.2 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15817 0.4 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15818 0.4 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15819 0.5 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15821 0.5 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15822 0.2 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15823 0.5 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
aptwhiri 15824 0.5 0.0 0 0 ? Z 22:43 0:00 FNDLIBR <defunct>
<Action Plan>
ran cmclean and relinked the following
adrelink.sh force=y link_debug=y "fnd FNDLIBR"
adrelink.sh force=y link_debug=y "fnd FNDSM"
$AD_TOP/bin/adrelink.sh force=y ranlib=y "inv INVLIBR"
$AD_TOP/bin/adrelink.sh force=y ranlib=y "inv INCTM"
$AD_TOP/bin/adrelink.sh force=y ranlib=y "fnd FNDCRM"
Now CM is up and running.
48627651 -AU
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
ISSUE FNDLIBR defunct
Solution
********
Ref Doc ID 392246.1
Faced the issue as XBOL_TOP is not set correctly.
sqlnet.expire_time is set to 10 and set FDCPTRW to 11 in the customsid_mohpucl006.env file
in MT.
bash-3.2$ grep -i FDCPTRW customsid_mohpucl006.env
FDCPTRW=11
export FDCPTRW
bash-3.2$
and added the missing env file in APPSsid_mohpucl006.env
bash-3.2$ cd /sid/applmgr/1200/admin/
bash-3.2$ cd ..
bash-3.2$ diff APPSsid_mohpucl006.env APPSsid_mohpucl006.env_bkp
33c33
< . /sid/applmgr/1200/customsid_mohpucl006.env
---
>
bash-3.2$
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
(Doc ID 1413393.1)
apdfrdei 29573 0.0 0.0 0 0 ? Z 13:54 0:00 POXCON <defunct>
apdfrdei 29574 0.0 0.0 0 0 ? Z 13:54 0:00 POXCON <defunct>
apdfrdei 29575 0.0 0.0 0 0 ? Z 13:54 0:00 POXCON <defunct>
apdfrdei 29576 0.0 0.0 0 0 ? Z 13:54 0:00 POXCON <defunct>
apdfrdei 29577 0.0 0.0 0 0 ? Z 13:54 0:00 INCTM <defunct>
apdfrdei 29578 0.0 0.0 0 0 ? Z 13:54 0:00 RCVOLTM <defunct>
Below managers do not start, Die after restart ( processes going to defunct)
USER_CONCURRENT_QUEUE_NAME DESCRIPTION CONCURRENT_QUEUE_NAME RUNNING_PROCESSES TARGET_PROCESSES
--------------------------------------------------------------------------------------------------- ------------------------------ ----------------- ----------------
PO Document Approval Manager PO Document Approval Manager Queue PODAMGR 0 4
Receiving Transaction Manager Receiving Transaction Manager program RCVOLTM 0 1
Inventory Manager Manager to run Immediate Concurrent Programs defined in INVLIBR INVMGR 1 1
SQL> select * from ad_bugs where bug_number='12923944';
no rows selected
cd $FND_TOP/bin/
$ strings FNDTMTST | grep afptm.lc
$Header: afptm.lc 120.6.12010000.2 2009/08/05 18:35:08 jtoruno ship $
Action Plan
===========
1. Download and review the readme and pre-requisites for Patch: 12923944:R12.FND.B
2. Ensure that you have taken a backup of your system before applying the recommended patch.
3. Apply the patch in a test environment.
4. Confirm the following file versions:
afptm.lc 120.6.12010000.3
The following command can be used to confirm the file version: strings $FND_TOP/bin/FNDTMTST | grep afptm.lc
5. Bounce the concurrent managers.
6. Retest the issue
Issue fixed after patch
Thanks,
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue:- Active users failed with error
Symptoms:-
REP-0059: Unable to locate resources for subcomponent 'VGS'.
Check the location of resource file.
Cause:- corrupted files under location /sid/product/1012/guicommon/vgs/admin/resource/US
Resolution/Fix:- Copied files from other instance
Reference Note/RFC:- NA
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue Active users failing
Enter Password:
REP-0004: Warning: Unable to open user preference file.
ORA-01410: invalid ROWID
==> select user_name, application_name, responsibility_name,
REP-0069: Internal error
REP-57054: In-process job terminated:Terminated with error:
REP-300: invalid ROWID
==> select user_name, application_name, responsibility_name,
+ Bounced CM , ran utlrp
copied prefs.ora to $HOME from /tsukai/product/1012/tools/admin
+ Now Active user completed Normal req id 1262941
Thanks
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
How to Cancel Cost Manager (CMCTCM ) And Relaunch It (Doc ID 373207.1)
Solution
1 - To cancel the Cost Manager : use one of the following method :
a) use Sysadmin responsability
Navigate to /Request/view
Set : specific Request=on
Name=Cost Manager.
In the lower part of the Find requests window
you have a field "Select the Number of Days to view" set by default to 7 days
-> Set "Select the Number of Days to view"=9999
In fact this field is a filter which limits how far back it will query requests.
From here Cancel the Cost Manager which is Pending Scheduled.
or
b) run
SELECT request_id RequestId,
request_date RequestDt, concurrent_program_name,
phase_code Phase,
status_code Status FROM
fnd_concurrent_requests fcr,
fnd_concurrent_programs fcp
WHERE fcp.application_id = 702 AND
fcp.concurrent_program_name in ('CMCTCM', 'CMCMCW', 'CMCACW') AND
fcr.concurrent_program_id = fcp.concurrent_program_id AND
fcr.program_application_id = 702 AND fcr.phase_code <> 'C'
Cancel all the requests from the above output.
by going /Sysadmin / Concurrent / Request
query for the RequestId returned from the select above
In the lower part of the Find requests window
you have a field "Select the Number of Days to view" set by default to 7 days
-> Set "Select the Number of Days to view"=9999
In fact this field is a filter which limits how far back it will query requests.
Cancel the request id other than running. Let the running request get over.
2 - Run the cmclean.sql script available from Metalink (cf Note 134007.1)
3 - Restart the cost manager via
Inventory / Setup / Transactions / Interface Managers
on line 'cost manager' - do Tools > Launch
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
*********************************
Issue : With out put post processiong (OPP)
*********************************
The concurrent manager has timed out waiting for the Output Post-processor to finish this request
Action Plan
==========
1> Increase number of workers for OPP to 2 (currently 1)
2> Increase value for profile, Concurrent:OPP Process Timeout, to 600 (currently 300)
3> Restart OPP Concurrent Manager
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue:-Active users going in pending state
Cause:- This requests were waiting in CM queue "TAM : High Workload" and "TAM :
Fast Running Jobs" which were in deactivated state
Resolution/Fix:- Reactivated the manages "TAM : High Workload" and "TAM : Fast
Running Jobs" all the pending ones got completed.
The "Active user" report has a request type defined as "XTAM_FAST" which is
specialized for the queue TAM : Fast Running Jobs
hence on starting the "TAM : Fast Running Jobs" they got completed.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Request viewlog and view output not working
Actions Done :
------------
Changed Profile "RRA: Service Prefix" from TSIB1I_ to Blank at Site Level and the issue
is fixed.
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Issue: concurrent requests running with " inactive nomanager "
We don't include any program for specialization rules for Stadnard Mangaer. "Active User and Prints environment variable values " concurrent programs were included for the Standard Mangaer. Excluded the Print Variable concurrent Program and Active Responsibility concurrent program from the Standard Manager. Now all the requests are being processed.
We can not delete any line from the Specialization rules from the any Manager.
So I changed the include to exclude the "Prints environment variable values" concurrent requests.
And renamed the Active user to "Active Responsibilities and Users" and excluded from the standard Manger.
Now all the concurrent requests will be processed except these two requests "Active Responsibilities and Users" and "Prints environment variable values"
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Unable to start CM( fndlibr) processes on secondary pcp node
SOlution:
=========
$ diff sqlnet.ora sqlnet.ora.bak
13c13
< tcp.invited_nodes = (RMOHSAVCR99.orclsourcing.com, mohAVCR598.orclsourcing.com,
mohAVCR596, mohAVCR599.orclsourcing.com)
---
> tcp.invited_nodes = (RMOHSAVCR99.orclsourcing.com, mohAVCR598.orclsourcing.com,
mohAVCR596)
16c16
-> node 599 was not allowed to Net8 connect to node 598
=> adding it to tcp.invited_nodes fixed the issue
&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&&
Appreciate your contribution to the Oracle community
ReplyDelete