Managing Hosts and Nodes in "Not Running" State

For ineligible Hosts, if you execute the internal HTTP Connector update with URL change using the "force" target, the ineligible Hosts appear in the "Out of Sync" state in the ActiveMatrix Administrator UI.

In the following example, RemoteHost and RemoteHost1 are in the "Not Running" state and the internal HTTP Connector port is being updated from 19767 to 19769.

The execution of the update.internal.http target fails and it indicates that RemoteHost and RemoteHost1 are in the "Not Running" state.

Command: 

ant -f internal_http_connector_build.xml force update.internal.http

Sample log: 

[AMXAdminTask] 16 Jun 2017 13:49:58 INFO - Initializing JSSE's crypto provider class com.sun.net.ssl.internal.ssl.Provider in default mode
[AMXAdminTask] 16 Jun 2017 13:49:59 INFO - Connecting to AMX Admin server at 'http://localhost:8120' as user 'root'.
[AMXAdminTask] 16 Jun 2017 13:49:59 INFO - Executing action 'updateInternalHttpConnector' for 1 objects from data file 'E:\tibco_data_Admin\admin\testamxadmin\samples\internal_http_connector_data.xml'
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO - Starting to update internal http connector...
(operationID:root_InternalHttpConnectorUpdate_20170616135000)
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO - Checking Hosts and Nodes for eligibility, it may a take few minutes in large setup.
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO - Notification Transport will NOT be updated on below hosts:
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO -
-------------------------------------------------------------------------------------------
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO - RemoteHost (NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO - RemoteHost1 (NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO -
-------------------------------------------------------------------------------------------
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO - Default Keystore will NOT be updated on below nodes:
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO -
-------------------------------------------------------------------------------------------
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO - DevEnvironment:RemoteNode1(Managed by RemoteHost) (HOST NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO - DevEnvironment:RemoteNode2(Managed by RemoteHost) (HOST NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO - DevEnvironment:RemoteNode3(Managed by RemoteHost1) (HOST NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 13:50:00 INFO -
-------------------------------------------------------------------------------------------
[AMXAdminTask] 16 Jun 2017 13:50:00 ERROR - Exiting Internal Http Connector Update as some host(s) or Node(s) are not running. To proceed with the update for host(s) that are eligible, please re-run the Ant script with the "force" option, for example: "ant -f internal_http_connector_build.xml force update.internal.http"
BUILD FAILED

The force target can be used to proceed with the internal HTTP Connector Configuration update in spite of having ineligible Hosts. However, this causes RemoteHost, RemoteHost1, and Keytore Resource Instances to appear in the "Out of Sync" state in the ActiveMatrix Administrator UI. As default Keystores are hidden, they are not shown in the ActiveMatrix Administrator UI, but they are marked as "Out of Sync" internally.

This is because the Notification Transport of the ineligible Hosts is not updated with the new URL of Internal HTTP Connector. The Keystores on the Nodes managed by these Hosts are not updated either.

Command: 

ant -f internal_http_connector_build.xml force update.internal.http

Sample log: 

[AMXAdminTask] 16 Jun 2017 14:02:08 INFO - Initializing JSSE's crypto provider class com.sun.net.ssl.internal.ssl.Provider in default mode
[AMXAdminTask] 16 Jun 2017 14:02:09 INFO - Connecting to AMX Admin server at 'http://localhost:8120' as user 'root'.
[AMXAdminTask] 16 Jun 2017 14:02:09 INFO - Executing action 'updateInternalHttpConnector' for 1 objects from data file 'E:\tibco_data_Admin\admin\testamxadmin\samples\internal_http_connector_data.xml'
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - Starting to update internal http connector...
(operationID:root_InternalHttpConnectorUpdate_20170616140210)
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - Checking Hosts and Nodes for eligibility, it may a take few minutes in large setup.
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - Notification Transport will NOT be updated on below hosts:
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO -
-------------------------------------------------------------------------------------------
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - RemoteHost (NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - RemoteHost1 (NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO -
-------------------------------------------------------------------------------------------
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - Default Keystore will NOT be updated on below nodes:
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO -
-------------------------------------------------------------------------------------------
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - DevEnvironment:RemoteNode1(Managed by RemoteHost) (HOST NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - DevEnvironment:RemoteNode2(Managed by RemoteHost) (HOST NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - DevEnvironment:RemoteNode3(Managed by RemoteHost1) (HOST NOT RUNNING)
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO -
-------------------------------------------------------------------------------------------
[AMXAdminTask] 16 Jun 2017 14:02:10 INFO - Starting to update Internal Http Connector Template.
...
...
...

To recover such Hosts and Nodes, you can start these Hosts and Nodes, and then run the command again. This time only Hosts 'RemoteHost' and 'RemoteHost1' and Nodes managed by them are updated.

Command: 

ant -f internal_http_connector_build.xml force update.internal.http

Sample log: 

[AMXAdminTask] 16 Jun 2017 14:06:22 INFO - Initializing JSSE's crypto provider class  com.sun.net.ssl.internal.ssl.Provider in default mode
[AMXAdminTask] 16 Jun 2017 14:06:22 INFO - Connecting to AMX Admin server at 'http://localhost:8120' as user 'root'.
[AMXAdminTask] 16 Jun 2017 14:06:22 INFO - Executing action 'updateInternalHttpConnector' for 1 objects from data file 'E:\tibco_data_Admin\admin\testamxadmin\samples\internal_http_connector_data.xml'
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - Starting to update internal http connector...
(operationID:root_InternalHttpConnectorUpdate_20170616140623)
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - Checking Hosts and Nodes for eligibility, it may a take few minutes in large setup.
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - Starting to update Internal Http Connector Template.
(operationID:root_InternalHttpConnectorUpdate_20170616140623)
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - Current Internal Http Connector:
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - SystemNode
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - host:0.0.0.0
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - port:19769
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - lowResourceMaxIdleTime:-1
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - requestHeaderSize:4096
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - responseHeaderSize:4096
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - outputBufferSize:24576
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - idleTimeout:200000
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - Internal Http Connector will be updated with below details:
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - host: 0.0.0.0
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - port: 19769
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - description: This is Internal HttpConnector RT
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - lowResourceMaxIdleTime: -1
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - acceptQueuSize: 7
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - lingerTime: -1
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - isSslEnabled: false
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - acceptors: 3
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - isSecuredWithTCS:false
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - requestHeaderSize:4096
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - responseHeaderSize:4096
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - outputBufferSize: 24576
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - idleTimeout: 200000
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - Internal Http Connector Resource Template is updated.
[AMXAdminTask] 16 Jun 2017 14:06:23 INFO - Internal Htpp Connector Resource Instance has not been changed.
[AMXAdminTask] 16 Jun 2017 14:06:24 INFO - Waiting for Internal Http Connector(s) to be running...
[AMXAdminTask] 16 Jun 2017 14:06:24 INFO - Internal Http Connector(s) are fully running.
[AMXAdminTask] 16 Jun 2017 14:06:24 INFO -
[AMXAdminTask] 16 Jun 2017 14:06:24 INFO - Starting to update keystore URL for hosts.
(operationID :root_InternalHttpConnectorUpdate_20170616140623)
[AMXAdminTask] 16 Jun 2017 14:06:24 INFO - Starting Notification Transport Configuration Update for Host: 'RemoteHost1'
[AMXAdminTask] 16 Jun 2017 14:06:24 INFO - Starting Notification Transport Configuration Update for Host: 'RemoteHost'
[AMXAdminTask] 16 Jun 2017 14:06:24 INFO - Waiting to complete Notification Transport Update on Host: RemoteHost,RemoteHost1
[AMXAdminTask] 16 Jun 2017 14:06:29 INFO - Notification Transport Configuration Update is completed for Host: 'RemoteHost1', '1' out of '2' hosts.
[AMXAdminTask] 16 Jun 2017 14:06:29 INFO - Notification Transport Configuration Update is completed for Host: 'RemoteHost', '2' out of '2' hosts.
[AMXAdminTask] 16 Jun 2017 14:06:34 INFO -
[AMXAdminTask] 16 Jun 2017 14:06:34 INFO - Starting to update Default Keystores.
(operationID :root_InternalHttpConnectorUpdate_20170616140623)
[AMXAdminTask] 16 Jun 2017 14:06:34 INFO - Starting Default Keystore Update for Node: 'DevEnvironment:RemoteNode2'
[AMXAdminTask] 16 Jun 2017 14:06:34 INFO - Starting Default Keystore Update for Node: 'DevEnvironment:RemoteNode3'
[AMXAdminTask] 16 Jun 2017 14:06:34 INFO - Starting Default Keystore Update for Node: 'DevEnvironment:RemoteNode1'
[AMXAdminTask] 16 Jun 2017 14:06:34 INFO - Waiting to complete Default Keystore Update on Node: DevEnvironment:RemoteNode2,DevEnvironment:RemoteNode3,DevEnvironment:RemoteNode1
[AMXAdminTask] 16 Jun 2017 14:06:39 INFO - Default Keystore Update is completed for Node: 'DevEnvironment:RemoteNode2', '1' out of '3' nodes.
[AMXAdminTask] 16 Jun 2017 14:06:39 INFO - Default Keystore Update is completed for Node: 'DevEnvironment:RemoteNode3', '2' out of '3' nodes.
[AMXAdminTask] 16 Jun 2017 14:06:39 INFO - Default Keystore Update is completed for Node: 'DevEnvironment:RemoteNode1', '3' out of '3' nodes.
[AMXAdminTask] 16 Jun 2017 14:06:44 INFO - Internal Http Connector Update operation is done.
[AMXAdminTask] 16 Jun 2017 14:06:44 INFO - Action finished at 6/16/17 2:06 PM in 20.897 seconds
BUILD SUCCESSFUL