After installing new R12.1.3, concurrent manager was not starting and showing "Inactive nomanager" error

After installing new R12.1.3, concurrent manager was not starting and showing "Inactive nomanager" error.

We have done the following to try to solve the problem.


1. We followed Note 134007.1 : Concurrent Processing - CMCLEAN.SQL - Non Destructive Script to Clean Concurrent Manager Tables 
2. after this we run autoconfig on both DB and apps tier.
Then again.
1. Shutdown concurrent managers

2. Relink FNDSM and FNDLIBR executables as mentioned below:

$ adrelink.sh force=y link_debug=y "fnd FNDLIBR"
$ adrelink.sh force=y link_debug=y "fnd FNDSM"

3. Run cmclean.sql

4. Start up the managers/services and retest.
But, the issue was not resolved.

Next, we check the following as per a metalink doc.
Verify all the steps that are necessary to start a Service Manager successfully. 

1. There should be a Service Manager defined. 

Run the following statement as the APPS user: 

select CONCURRENT_QUEUE_NAME from FND_CONCURRENT_QUEUES where CONCURRENT_QUEUE_NAME like 'FNDSM%'; 

The above statement should return a value related to the CP node. 

If the above does not return any value then please do the following: 

1. Connect SQLPLUS as APPS user
2. cd to $FND_TOP/patch/115/sql
3. Run the script: afdcm037.sql

This script will create libraries for FNDSM and create Managers for Preexisting Nodes.

(Note : The same "afdcm037.sql" script is used for Release 12 also). 


2. Verify the entries in the FND_NODES as correct. 

Run the following statement as the APPS user: 

select node_name "Node Name", node_mode "Mode", support_cp "C", 
support_web "W", support_admin "A", support_forms "F" 
from FND_NODES; 

If the above statement returns any invalid node or IP address follow the steps provided in the following note to clean up and repopulate the table.

Note.260887.1 : Steps to Clean Nonexistent Nodes or IP Addresses from FND_NODES 

3. Verify entries in tnsnames.ora on CP node. 

The below entry should present in tnsnames.ora on CP node : 

FNDSM_ORACLETEST_VIS= 
(DESCRIPTION= 
(ADDRESS=(PROTOCOL=tcp)(HOST=oracletest.idc.oracle.com)(PORT=1626)) 
(CONNECT_DATA= 
(SID=FNDSM) 
) 
) 

FNDSM_ORACLETEST.oracle.com_VIS= 
(DESCRIPTION= 
(ADDRESS=(PROTOCOL=tcp)(HOST=oracletest.idc.oracle.com)(PORT=1626)) 
(CONNECT_DATA= 
(SID=FNDSM) 
) 
) 

Where ORACLETEST is the "hostname", VIS is the "SID" and ".oracle.com" is domain. 

4. Check that tnsping is successful for all entries related to FNDSM in tnsnames.ora on CP node. 

$ tnsping FNDSM_ORACLETEST_VIS 



5. Verify that no error exists in APPS Listener log file on CP node and it is running on correct port. 

APPS Listener should be up and running for Service Manager to be up and running as expected. There should not be any error in the APPS Listener log file. If there will be any error in APPS Listener log file then the Service Manager will not start properly. Check the APPS Listener log file. You can find this APPS Listener log file in one directory up of $TNS_ADMIN named as "apps_.log". Make sure that APPS listener is running on correct port. You can verify this from APPS listener logfile. If the APPS listener is started on wrong port or using local host then you need to kill that listener and start it correctly on correct port. 

6. Are you able to ping the host name/IP Address of the host. 

$ hostname 
ORACLETEST.oracle.com 
$ ping ORACLETEST.oracle.com 
PING ORACLETEST.oracle.com (10.100.100.10) 56(84) bytes of data. 
64 bytes from ORACLETEST.oracle.com (10.100.100.10): icmp_seq=0 ttl=64 time=0.029 ms 
64 bytes from ORACLETEST.oracle.com (10.100.100.10): icmp_seq=1 ttl=64 time=0.028 ms

Now, we get that abobe step 4 for tnsping is not working.
It is showing following error.
$ tnsping FNDSM_FFFLINUX_SASD

TNS Ping Utility for Linux: Version 10.1.0.5.0 - Production on 24-MAY-2012 12:40:18

Copyright (c) 1997, 2003, Oracle. All rights reserved.

Used parameter files:


Used TNSNAMES adapter to resolve the alias
Attempting to contact (DESCRIPTION= (ADDRESS=(PROTOCOL=tcp)(HOST=ffflinux.ttt.co.in)(PORT=1646)) (CONNECT_DATA= (SID=FNDSM)))
TNS-12541: TNS:no listener

Solution ->

I solved the above problem by solving incorrect /etc/hosts file entry.
Previous entry was ->
127.0.0.1               ffflinux localhost.localdomain localhost
::1             localhost6.localdomain6 localhost6
172.18.41.50    ffflinux.ttt.co.in       ffflinux


I have updated the entry as follows ->

127.0.0.1       localhost.localdomain localhost
::1             localhost6.localdomain6 localhost6
172.18.41.50    ffflinux.ttt.co.in       ffflinux
172.18.41.50    FFFLINUX.ttt.co.in    FFFLINUX

After this I have restarted the Oracle R12 instance and Linux server. And the problem was resolved.