Trigger from CLAMP (DH logs) 2019-05-09T18:43:13.370Z|2019-05-09T18:43:58.073Z|1e6cda1a-d379-4da3-93fa-36abbd8996c8|||deployment-handler.onap|PUT /dcae-deployments/CLAMP_1be7ff5e-367a-4ac0-abd1-8cf836bf8c4c||COMPLETE|202||1fbbed44-ea14-4a39-8065-794ece2d9fd9|INFO||10.42.5.6|44703|deployment-handler.onap|10.42.14.40||||||||Execution ID: 985c16d3-4c4c-4639-80b5-95f570d03b69 2019-05-09T18:44:27.043Z|2019-05-09T18:44:27.044Z|a54b0bdb-ef37-4bd5-b386-6183a9f253c2|||10.42.5.6|GET /||COMPLETE|200||1fbbed44-ea14-4a39-8065-794ece2d9fd9|INFO||10.42.5.6|1|10.42.5.6|10.0.0.12||||||||{"server":{"name":"onap-dcae-deployment-handler","description":"ONAP DCAE Deployment Handler","version":"6.0.1","branch":"","commit":"unspecified","commit_datetime":"","server_instance_uuid":"1fbbed44-ea14-4a39-8065-794ece2d9fd9"},"apiVersion":"5.1.0","links":{"info":"/","internal-health":"/healthcheck","service-health":"/servicehealth","deployments":"/dcae-deployments","policy":"/policy","swagger-ui":"/swagger-ui"}} 2019-05-09T18:44:45.310Z|2019-05-09T18:44:45.994Z|7fbe78bb-f0ba-48a7-9e3d-eaeb596ecbed|||deployment-handler.onap|GET /dcae-deployments/CLAMP_1be7ff5e-367a-4ac0-abd1-8cf836bf8c4c/operation/985c16d3-4c4c-4639-80b5-95f570d03b69||COMPLETE|200||1fbbed44-ea14-4a39-8065-794ece2d9fd9|INFO||10.42.5.6|684|deployment-handler.onap|10.42.14.40||||||||Workflow type: install -- execution status: processing [root@dev-dcaegen2-dcae-bootstrap-5fd5ccc585-hp2rw /]# cfy deployments list Listing all deployments... Deployments: +--------------------------------------------+--------------------------------------------+--------------------------+--------------------------+--------------+----------------+------------+ | id | blueprint_id | created_at | updated_at | availability | tenant_name | created_by | +--------------------------------------------+--------------------------------------------+--------------------------+--------------------------+--------------+----------------+------------+ | pgaas_initdb | pgaas_initdb | 2019-04-24 19:20:07.689 | 2019-04-24 19:20:07.689 | tenant | default_tenant | admin | | dashboard | dashboard | 2019-04-24 19:20:46.672 | 2019-04-24 19:20:46.672 | tenant | default_tenant | admin | | snmptrap | snmptrap | 2019-04-24 19:23:13.457 | 2019-04-24 19:23:13.457 | tenant | default_tenant | admin | | hv-ves | hv-ves | 2019-04-24 19:23:13.704 | 2019-04-24 19:23:13.704 | tenant | default_tenant | admin | | ves | ves | 2019-04-24 19:23:14.135 | 2019-04-24 19:23:14.135 | tenant | default_tenant | admin | | holmes_rules | holmes_rules | 2019-04-24 19:23:14.912 | 2019-04-24 19:23:14.912 | tenant | default_tenant | admin | | tca | tca | 2019-04-24 19:23:15.126 | 2019-04-24 19:23:15.126 | tenant | default_tenant | admin | | prh | prh | 2019-04-24 19:23:15.628 | 2019-04-24 19:23:15.628 | tenant | default_tenant | admin | | holmes_engine | holmes_engine | 2019-04-24 19:24:36.924 | 2019-04-24 19:24:36.924 | tenant | default_tenant | admin | | CLAMP_1be7ff5e-367a-4ac0-abd1-8cf836bf8c4c | CLAMP_1be7ff5e-367a-4ac0-abd1-8cf836bf8c4c | 2019-05-09 18:43:20.843 | 2019-05-09 18:43:20.843 | tenant | default_tenant | admin | +--------------------------------------------+--------------------------------------------+--------------------------+--------------------------+--------------+----------------+------------+ root@sb00-rancher:~# kubectl get pods -n onap |egrep "analytics" dep-dcae-tca-analytics-b8b6874df-ndvq2 2/2 Running 0 14d dep-sa2750ae3d77946e29b6461505604a999-dcaegen2-analytics-tktpxt 0/2 ContainerCreating 0 52s Events: Type Reason Age From Message ---- ------ ---- ---- ------- Normal Scheduled 74s default-scheduler Successfully assigned onap/dep-sa2750ae3d77946e29b6461505604a999-dcaegen2-analytics-tktpxt to sb00-k8s-02 Normal Pulling 73s kubelet, sb00-k8s-02 pulling image "nexus3.onap.org:10001/onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.1.1" root@sb00-rancher:~# kubectl get pods -n onap |egrep "analytics" dep-dcae-tca-analytics-b8b6874df-ndvq2 2/2 Running 0 14d dep-sa2750ae3d77946e29b6461505604a999-dcaegen2-analytics-tktpxt 2/2 Running 0 26m TCA COntainer logs root@sb00-rancher:~# kubectl logs -f -n onap dep-sa2750ae3d77946e29b6461505604a999-dcaegen2-analytics-tktpxt sa2750ae3d77946e29b6461505604a999-dcaegen2-analytics-tca Generting preference file Starting TCA-CDAP in standalone mode Thu May 9 19:00:26 UTC 2019 Starting CDAP Standalone (SDK) ................... Standalone CDAP started successfully. Connect to the CDAP UI at http://localhost:11011 CDAP Started, waiting CDAP ready on localhost:11015 ... Creating namespace cdap_tca_hi_lo ... Namespace 'cdap_tca_hi_lo' created successfully. Stopping TCADMaaPMRPublisherWorker, TCADMaaPMRSubscriberWorker, and TCAVESCollectorFlow ... 'application:cdap_tca_hi_lo.dcae-tca.-SNAPSHOT' was not found.'application:cdap_tca_hi_lo.dcae-tca.-SNAPSHOT' was not found.'application:cdap_tca_hi_lo.dcae-tca.-SNAPSHOT' was not found.done Deleting application dcae-tca http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca 'application:cdap_tca_hi_lo.dcae-tca.-SNAPSHOT' was not found. Deleting artifact http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/artifacts/dcae-analytics-cdap-tca/versions/2.2.1 ... 'artifact:cdap_tca_hi_lo.dcae-analytics-cdap-tca.2.2.1' was not found. Loading artifact /opt/tca/dcae-analytics-cdap-tca.2.2.1.jar to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/artifacts/dcae-analytics-cdap-tca... Artifact added successfully Loading configuration /opt/tca/tca_app_config.json to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca Deploy Complete Loading preferences /opt/tca/tca_app_preferences.json to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca/preferences Starting TCADMaaPMRPublisherWorker, TCADMaaPMRSubscriberWorker, and TCAVESCollectorFlow ... TCADMaaPMRPublisherWorker status: {"status":"RUNNING"} TCADMaaPMRSubscriberWorker status: {"status":"RUNNING"} TCAVESCollectorFlow status: {"status":"RUNNING"} TCA-CDAP standalone mode initialization completed, with 3 / 3 up TCA environment: I am sa2750ae3d77946e29b6461505604a999-dcaegen2-analytics-tca, consul at consul-server.onap:8500, CBS service name config_binding_service ======================================================> Thu May 9 19:00:54 UTC 2019 TCADMaaPMRPublisherWorker status: {"status":"RUNNING"} TCADMaaPMRSubscriberWorker status: {"status":"RUNNING"} TCAVESCollectorFlow status: {"status":"RUNNING"} Retrieving host and port for config_binding_service from consul-server.onap:8500 CBS discovered to be at config-binding-service:10000 tca_poll_policy: Retrieving all-in-one config at config-binding-service:10000/service_component_all/sa2750ae3d77946e29b6461505604a999-dcaegen2-analytics-tca tca_poll_policy: CONFIG is [{ "tcaVESAlertsTableTTLSeconds": "1728000", "thresholdCalculatorFlowletInstances": "2", "tcaAlertsAbatementTableTTLSeconds": "1728000", "tcaAlertsAbatementTableName": "TCAAlertsAbatementTable", "appName": "dcae-tca", "appDescription": "DCAE Analytics Threshold Crossing Alert Application", "tcaSubscriberOutputStreamName": "TCASubscriberOutputStream", "tcaVESMessageStatusTableTTLSeconds": "86400", "tcaVESAlertsTableName": "TCAVESAlertsTable", "tcaVESMessageStatusTableName": "TCAVESMessageStatusTable" }], PREF is [{ "aaiEnrichmentIgnoreSSLCertificateErrors": "true", "publisherMaxRecoveryQueueSize": "100000", "subscriberConsumerId": "c12", "aaiVNFEnrichmentAPIPath": "/aai/v11/network/generic-vnfs/generic-vnf", "aaiEnrichmentUserPassword": "demo123456!", "publisherHostName": "message-router.onap", "aaiEnrichmentPortNumber": "8443", "publisherPollingInterval": "20000", "subscriberProtocol": "http", "aaiEnrichmentHost": "aai.onap.svc.cluster.local", "enableRedisCaching": "false", "subscriberContentType": "application/json", "subscriberHostName": "message-router.onap", "redisHosts": "dcae-redis.onap.svc.cluster.local:6379", "publisherContentType": "application/json", "subscriberTopicName": "unauthenticated.VES_MEASUREMENT_OUTPUT", "aaiVMEnrichmentAPIPath": "/aai/v11/search/nodes-query", "publisherMaxBatchSize": "1", "publisherProtocol": "http", "publisherHostPort": "3904", "subscriberMessageLimit": "-1", "tca_policy": "", "enableAAIEnrichment": "true", "publisherTopicName": "unauthenticated.DCAE_CL_OUTPUT", "subscriberPollingInterval": "30000", "aaiEnrichmentProtocol": "https", "enableAlertCEFFormat": "false", "subscriberConsumerGroup": "OpenDCAE-clamp", "subscriberHostPort": "3904", "aaiEnrichmentUserName": "dcae@dcae.onap.org", "subscriberTimeoutMS": "-1" }], POLICY is [{ "domain": "measurementsForVfScaling", "metricsPerEventName": [ { "policyScope": "test", "policyName": "test", "thresholds": [ { "direction": "LESS", "severity": "CRITICAL", "closedLoopControlName": "LOOP_vLoadBalancerMS_v2_0_vLoadBalancerMS0_k8s-tca-clamp-policy-05082019", "fieldPath": "$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta", "version": "1.0.0", "closedLoopEventStatus": "ONSET", "thresholdValue": 10 } ], "eventName": "test", "controlLoopSchemaType": "VNF", "policyVersion": "1.0.0" } ] }] 5c5 < "tcaAlertsAbatementTableTTLSeconds": 1728000, --- > "tcaAlertsAbatementTableTTLSeconds": "1728000", 8c8 < "tcaVESAlertsTableTTLSeconds": 1728000, --- > "tcaVESAlertsTableTTLSeconds": "1728000", 10,11c10,11 < "tcaVESMessageStatusTableTTLSeconds": 86400, < "thresholdCalculatorFlowletInstances": 2 --- > "tcaVESMessageStatusTableTTLSeconds": "86400", > "thresholdCalculatorFlowletInstances": "2" TCA config changed 6,7c6,7 < "aaiEnrichmentUserName": "DCAE", < "aaiEnrichmentUserPassword": "DCAE", --- > "aaiEnrichmentUserName": "dcae@dcae.onap.org", > "aaiEnrichmentUserPassword": "demo123456!", 13d12 < "redisHosts": "NONE", 22,23c21,23 < "subscriberConsumerGroup": "OpenDCAEc12", < "subscriberConsumerId": "c12", --- > "redisHosts": "dcae-redis.onap.svc.cluster.local:6379", > "subscriberConsumerGroup": "OpenDCAE-clamp", > "subscriberConsumerId": "c12-analytics-tca", 32c32 < "tca_policy": "{\"domain\":\"measurementsForVfScaling\",\"metricsPerEventName\":[{\"eventName\":\"vFirewallBroadcastPackets\",\"controlLoopSchemaType\":\"VNF\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicUsageArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"LESS_OR_EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ONSET\"},{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicUsageArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":700,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"vLoadBalancer\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vDNS-6f37f56d-a87d-4b85-b6a9-cc953cf779b3\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicUsageArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"Measurement_vGMUX\",\"controlLoopSchemaType\":\"VNF\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ABATED\"},{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"GREATER\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]}]}" --- > "tca_policy": "{ \"domain\": \"measurementsForVfScaling\", \"metricsPerEventName\": [ { \"policyScope\": \"test\", \"policyName\": \"test\", \"thresholds\": [ { \"direction\": \"LESS\", \"severity\": \"CRITICAL\", \"closedLoopControlName\": \"LOOP_vLoadBalancerMS_v2_0_vLoadBalancerMS0_k8s-tca-clamp-policy-05082019\", \"fieldPath\": \"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\", \"version\": \"1.0.0\", \"closedLoopEventStatus\": \"ONSET\", \"thresholdValue\": 10 } ], \"eventName\": \"test\", \"controlLoopSchemaType\": \"VNF\", \"policyVersion\": \"1.0.0\" } ]}" TCA preference updated Newly received configuration/preference differ from the running instance's. reload confg Verifying DMaaP topic: unauthenticated.VES_MEASUREMENT_OUTPUT@message-router.onap:3904 (will block until topic ready) ==> Check topic [unauthenticated.VES_MEASUREMENT_OUTPUT] availbility on message-router.onap:3904 ==> MR topic listing received, check topic availbility ==> Topic [unauthenticated.VES_MEASUREMENT_OUTPUT] ready Stopping TCADMaaPMRPublisherWorker, TCADMaaPMRSubscriberWorker, and TCAVESCollectorFlow ... done Deleting application dcae-tca http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca Deleting artifact http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/artifacts/dcae-analytics-cdap-tca/versions/2.2.1 ... Loading artifact /opt/tca/dcae-analytics-cdap-tca.2.2.1.jar to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/artifacts/dcae-analytics-cdap-tca... Artifact added successfully Loading configuration /opt/tca/tca_app_config.json to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca Deploy Complete Loading preferences /opt/tca/tca_app_preferences.json to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca/preferences Starting TCADMaaPMRPublisherWorker, TCADMaaPMRSubscriberWorker, and TCAVESCollectorFlow ... TCADMaaPMRPublisherWorker status: {"status":"RUNNING"} TCADMaaPMRSubscriberWorker status: {"status":"RUNNING"} TCAVESCollectorFlow status: {"status":"RUNNING"} ======================================================> Thu May 9 19:01:44 UTC 2019 TCADMaaPMRPublisherWorker status: {"status":"RUNNING"} TCADMaaPMRSubscriberWorker status: {"status":"RUNNING"} TCAVESCollectorFlow status: {"status":"RUNNING"} tca_poll_policy: Retrieving all-in-one config at config-binding-service:10000/service_component_all/sa2750ae3d77946e29b6461505604a999-dcaegen2-analytics-tca tca_poll_policy: CONFIG is [{ "tcaVESAlertsTableTTLSeconds": "1728000", "thresholdCalculatorFlowletInstances": "2", "tcaAlertsAbatementTableTTLSeconds": "1728000", "tcaAlertsAbatementTableName": "TCAAlertsAbatementTable", "appName": "dcae-tca", "appDescription": "DCAE Analytics Threshold Crossing Alert Application", "tcaSubscriberOutputStreamName": "TCASubscriberOutputStream", "tcaVESMessageStatusTableTTLSeconds": "86400", "tcaVESAlertsTableName": "TCAVESAlertsTable", "tcaVESMessageStatusTableName": "TCAVESMessageStatusTable" }], PREF is [{ "aaiEnrichmentIgnoreSSLCertificateErrors": "true", "publisherMaxRecoveryQueueSize": "100000", "subscriberConsumerId": "c12", "aaiVNFEnrichmentAPIPath": "/aai/v11/network/generic-vnfs/generic-vnf", "aaiEnrichmentUserPassword": "demo123456!", "publisherHostName": "message-router.onap", "aaiEnrichmentPortNumber": "8443", "publisherPollingInterval": "20000", "subscriberProtocol": "http", "aaiEnrichmentHost": "aai.onap.svc.cluster.local", "enableRedisCaching": "false", "subscriberContentType": "application/json", "subscriberHostName": "message-router.onap", "redisHosts": "dcae-redis.onap.svc.cluster.local:6379", "publisherContentType": "application/json", "subscriberTopicName": "unauthenticated.VES_MEASUREMENT_OUTPUT", "aaiVMEnrichmentAPIPath": "/aai/v11/search/nodes-query", "publisherMaxBatchSize": "1", "publisherProtocol": "http", "publisherHostPort": "3904", "subscriberMessageLimit": "-1", "tca_policy": "", "enableAAIEnrichment": "true", "publisherTopicName": "unauthenticated.DCAE_CL_OUTPUT", "subscriberPollingInterval": "30000", "aaiEnrichmentProtocol": "https", "enableAlertCEFFormat": "false", "subscriberConsumerGroup": "OpenDCAE-clamp", "subscriberHostPort": "3904", "aaiEnrichmentUserName": "dcae@dcae.onap.org", "subscriberTimeoutMS": "-1" }], POLICY is [{ "domain": "measurementsForVfScaling", "metricsPerEventName": [ { "policyScope": "test", "policyName": "test", "thresholds": [ { "direction": "LESS", "severity": "CRITICAL", "closedLoopControlName": "LOOP_vLoadBalancerMS_v2_0_vLoadBalancerMS0_k8s-tca-clamp-policy-05082019", "fieldPath": "$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta", "version": "1.0.0", "closedLoopEventStatus": "ONSET", "thresholdValue": 10 } ], "eventName": "test", "controlLoopSchemaType": "VNF", "policyVersion": "1.0.0" } ] }] Newly received configuration/preference identical from the running instance's ======================================================> Thu May 9 19:02:14 UTC 2019