0401 - CLAMP deployment logs root@sb01-nfs:~# kubectl get pods -n onap | grep analytics dep-dcae-tca-analytics-5974fcf8dc-2jgjv 2/2 Running 0 26h dep-s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-ttxwf2 2/2 Running 0 10m Policy Retrieved http://10.12.6.99:30270/ui/#/dc1/kv/s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca%3Apolicies/items/MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3/edit {"policyName": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3.1-0-0.xml", "name": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3", "config": {"tca_policy": {"domain": "measurementsForVfScaling", "metricsPerEventName": [{"policyScope": "test", "policyName": "test", "thresholds": [{"direction": "LESS", "severity": "CRITICAL", "closedLoopControlName": "LOOP_testos", "fieldPath": "$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta", "version": "1.0.2", "closedLoopEventStatus": "ONSET", "thresholdValue": 0.0}], "eventName": "test", "controlLoopSchemaType": "VM", "policyVersion": "1.0.0"}]}}, "type_version": "1.0.0", "version": "1.0.0", "policyVersion": "1.0.0", "type": "onap.policies.monitoring.cdap.tca.hi.lo.app", "metadata": {"policy-id": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3", "policy-version": "1.0.0"}} Deployment Executions LOG bash-4.2$ cfy events list -e CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2 Listing events for execution id CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2 [include_logs=True] Execution CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2 not found bash-4.2$ cfy events list -e bcdac212-22ee-46aa-af0a-93fd1b0a2c72 Listing events for execution id bcdac212-22ee-46aa-af0a-93fd1b0a2c72 [include_logs=True] 2020-04-01 21:37:32.835 CFY Starting 'install' workflow execution 2020-04-01 21:37:33.450 CFY [tca_policy_fxpqsx] Creating node instance 2020-04-01 21:37:34.167 CFY [tca_policy_fxpqsx.create] Sending task 'dcaepolicyplugin.policy_get' 2020-04-01 21:37:34.833 LOG [tca_policy_fxpqsx.create] INFO: getting service_url at http://consul:8500/v1/catalog/service/policy_handler 2020-04-01 21:37:35.465 LOG [tca_policy_fxpqsx.create] INFO: getting kv at http://consul:8500/v1/kv/dcaepolicyplugin 2020-04-01 21:37:35.465 LOG [tca_policy_fxpqsx.create] INFO: got 200 for service_url at http://consul:8500/v1/catalog/service/policy_handler response: [] 2020-04-01 21:37:35.465 LOG [tca_policy_fxpqsx.create] INFO: got 404 for kv at http://consul:8500/v1/kv/dcaepolicyplugin response: 2020-04-01 21:37:35.465 LOG [tca_policy_fxpqsx.create] INFO: getting latest policy from http://policy-handler/policy_latest/MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3 headers={"X-ECOMP-RequestID": "5dbf210e-e366-4e10-a689-8414d01aa2ca"} 2020-04-01 21:37:35.465 LOG [tca_policy_fxpqsx.create] INFO: latest policy for policy_id(MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3) status(200) response: {"policy_id": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3", "policy_body": {"type": "onap.policies.monitoring.cdap.tca.hi.lo.app", "type_version": "1.0.0", "name": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3", "version": "1.0.0", "metadata": {"policy-id": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3", "policy-version": "1.0.0"}, "policyName": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3.1-0-0.xml", "policyVersion": "1.0.0", "config": {"tca_policy": {"domain": "measurementsForVfScaling", "metricsPerEventName": [{"policyScope": "test", "thresholds": [{"version": "1.0.2", "severity": "CRITICAL", "thresholdValue": 0.0, "closedLoopEventStatus": "ONSET", "closedLoopControlName": "LOOP_testos", "direction": "LESS", "fieldPath": "$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta"}], "eventName": "test", "policyVersion": "1.0.0", "controlLoopSchemaType": "VM", "policyName": "test"}]}}}} 2020-04-01 21:37:35.465 LOG [tca_policy_fxpqsx.create] INFO: found policy MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3: {"policy_body": {"policyName": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3.1-0-0.xml", "name": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3", "config": {"tca_policy": {"domain": "measurementsForVfScaling", "metricsPerEventName": [{"policyScope": "test", "policyName": "test", "thresholds": [{"direction": "LESS", "severity": "CRITICAL", "closedLoopControlName": "LOOP_testos", "fieldPath": "$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta", "version": "1.0.2", "closedLoopEventStatus": "ONSET", "thresholdValue": 0.0}], "eventName": "test", "controlLoopSchemaType": "VM", "policyVersion": "1.0.0"}]}}, "type_version": "1.0.0", "version": "1.0.0", "policyVersion": "1.0.0", "type": "onap.policies.monitoring.cdap.tca.hi.lo.app", "metadata": {"policy-id": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3", "policy-version": "1.0.0"}}, "policy_id": "MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3"} 2020-04-01 21:37:35.465 LOG [tca_policy_fxpqsx.create] INFO: exit policy_get 2020-04-01 21:37:35.465 CFY [tca_policy_fxpqsx.create] Task succeeded 'dcaepolicyplugin.policy_get' 2020-04-01 21:37:36.062 CFY [tca_policy_fxpqsx] Node instance created 2020-04-01 21:37:36.062 CFY [tca_policy_fxpqsx] Configuring node instance: nothing to do 2020-04-01 21:37:36.062 CFY [tca_policy_fxpqsx] Starting node instance: nothing to do 2020-04-01 21:37:36.656 CFY [tca_policy_fxpqsx] Node instance started 2020-04-01 21:37:36.656 CFY [tca_k8s_i4sp66] Creating node instance 2020-04-01 21:37:36.656 CFY [tca_k8s_i4sp66.create] Sending task 'k8splugin.create_for_components' 2020-04-01 21:37:39.168 LOG [tca_k8s_i4sp66.create] INFO: Added config for s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca 2020-04-01 21:37:39.863 LOG [tca_k8s_i4sp66.create] INFO: Done setting up: s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca 2020-04-01 21:37:39.863 LOG [tca_k8s_i4sp66.create] INFO: response 200 for store_policies http://consul:8500/v1/txn: text={"Results":[{"KV":{"LockIndex":0,"Key":"s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca:policies/event","Flags":0,"Value":null,"CreateIndex":18338,"ModifyIndex":18338}},{"KV":{"LockIndex":0,"Key":"s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca:policies/items/MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3","Flags":0,"Value":null,"CreateIndex":18338,"ModifyIndex":18338}}],"Errors":null} txn=[{"KV": {"Verb": "delete-tree", "Key": "s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca:policies/"}}, {"KV": {"Verb": "set", "Value": "eyJhY3Rpb24iOiAiZ2F0aGVyZWQiLCAidGltZXN0YW1wIjogIjIwMjAtMDQtMDFUMjE6Mzc6MzkuMTUyWiIsICJ1cGRhdGVfaWQiOiAiNTgzZTlmODUtNDM5Zi00YWFjLWFmZDctNzRkNmI4NDJiOGJmIiwgInBvbGljaWVzX2NvdW50IjogMX0=", "Key": "s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca:policies/event"}}, {"KV": {"Verb": "set", "Value": "eyJwb2xpY3lOYW1lIjogIk1JQ1JPU0VSVklDRV92TEJfQ0RTX3YxXzBfYXBwXzFfMF8wX2RSMy4xLTAtMC54bWwiLCAibmFtZSI6ICJNSUNST1NFUlZJQ0VfdkxCX0NEU192MV8wX2FwcF8xXzBfMF9kUjMiLCAiY29uZmlnIjogeyJ0Y2FfcG9saWN5IjogeyJkb21haW4iOiAibWVhc3VyZW1lbnRzRm9yVmZTY2FsaW5nIiwgIm1ldHJpY3NQZXJFdmVudE5hbWUiOiBbeyJwb2xpY3lTY29wZSI6ICJ0ZXN0IiwgInBvbGljeU5hbWUiOiAidGVzdCIsICJ0aHJlc2hvbGRzIjogW3siZGlyZWN0aW9uIjogIkxFU1MiLCAic2V2ZXJpdHkiOiAiQ1JJVElDQUwiLCAiY2xvc2VkTG9vcENvbnRyb2xOYW1lIjogIkxPT1BfdGVzdG9zIiwgImZpZWxkUGF0aCI6ICIkLmV2ZW50Lm1lYXN1cmVtZW50c0ZvclZmU2NhbGluZ0ZpZWxkcy52TmljUGVyZm9ybWFuY2VBcnJheVsqXS5yZWNlaXZlZFRvdGFsUGFja2V0c0RlbHRhIiwgInZlcnNpb24iOiAiMS4wLjIiLCAiY2xvc2VkTG9vcEV2ZW50U3RhdHVzIjogIk9OU0VUIiwgInRocmVzaG9sZFZhbHVlIjogMC4wfV0sICJldmVudE5hbWUiOiAidGVzdCIsICJjb250cm9sTG9vcFNjaGVtYVR5cGUiOiAiVk0iLCAicG9saWN5VmVyc2lvbiI6ICIxLjAuMCJ9XX19LCAidHlwZV92ZXJzaW9uIjogIjEuMC4wIiwgInZlcnNpb24iOiAiMS4wLjAiLCAicG9saWN5VmVyc2lvbiI6ICIxLjAuMCIsICJ0eXBlIjogIm9uYXAucG9saWNpZXMubW9uaXRvcmluZy5jZGFwLnRjYS5oaS5sby5hcHAiLCAibWV0YWRhdGEiOiB7InBvbGljeS1pZCI6ICJNSUNST1NFUlZJQ0VfdkxCX0NEU192MV8wX2FwcF8xXzBfMF9kUjMiLCAicG9saWN5LXZlcnNpb24iOiAiMS4wLjAifX0=", "Key": "s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca:policies/items/MICROSERVICE_vLB_CDS_v1_0_app_1_0_0_dR3"}}] 2020-04-01 21:37:39.863 CFY [tca_k8s_i4sp66.create] Task succeeded 'k8splugin.create_for_components' 2020-04-01 21:37:39.863 CFY [tca_k8s_i4sp66] Node instance created 2020-04-01 21:37:40.458 CFY [tca_k8s_i4sp66] Configuring node instance: nothing to do 2020-04-01 21:37:40.458 CFY [tca_k8s_i4sp66] Starting node instance 2020-04-01 21:37:40.458 CFY [tca_k8s_i4sp66.start] Sending task 'k8splugin.create_and_start_container_for_components' 2020-04-01 21:37:41.961 LOG [tca_k8s_i4sp66.start] INFO: Starting k8s deployment for s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca, image: nexus3.onap.org:10001/onap/org.onap.dcaegen2.deployments.tca-cdap-container:1.2.2, env: {u'AAIHOST': u'aai.onap.svc.cluster.local', u'CBS_HOST': u'config-binding-service', 'DCAE_CA_CERTPATH': u'/opt/dcae/cacert/cacert.pem', u'SERVICE_TAGS': u'', u'CBS_PORT': u'10000', u'CONSUL_PORT': u'8500', u'DMAAPPUBTOPIC': u'unauthenticated.DCAE_CL_OUTPUT', 'CONSUL_HOST': u'consul-server.onap', 'CBS_CONFIG_URL': 'https://config-binding-service:10443/service_component_all/s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca', u'DMAAPSUBTOPIC': u'unauthenticated.VES_MEASUREMENT_OUTPUT', 'CONFIG_BINDING_SERVICE': u'config_binding_service', u'AAIPORT': u'8443', u'DMAAPPORT': u'3904', u'DMAAPHOST': u'message-router.onap.svc.cluster.local'}, kwargs: {'readiness': {}, 'labels': {'cfydeployment': u'CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2', 'cfynodeinstance': u'tca_k8s_i4sp66', 'cfynode': u'tca_k8s'}, 'tls_info': {}, 'envs': {u'CONSUL_HOST': u'consul-server.onap', u'DMAAPSUBTOPIC': u'unauthenticated.VES_MEASUREMENT_OUTPUT', u'AAIHOST': u'aai.onap.svc.cluster.local', u'CONSUL_PORT': u'8500', u'CONFIG_BINDING_SERVICE': u'config_binding_service', u'CBS_HOST': u'config-binding-service', u'DMAAPPORT': u'3904', u'SERVICE_TAGS': u'', u'CBS_PORT': u'10000', u'DMAAPHOST': u'message-router.onap.svc.cluster.local', u'DMAAPPUBTOPIC': u'unauthenticated.DCAE_CL_OUTPUT', u'AAIPORT': u'8443'}, 'liveness': {}, 'resource_config': {}, 'volumes': [], 'log_info': {u'log_directory': u'/opt/app/TCAnalytics/logs'}, 'ports': [u'11011:32012'], 'k8s_location': u'central'} 2020-04-01 21:37:42.463 LOG [tca_k8s_i4sp66.start] INFO: Passing k8sconfig: {'tls': {u'component_cert_dir': u'/opt/dcae/cacert', u'cert_path': u'/opt/app/osaaf', u'image': u'nexus3.onap.org:10001/onap/org.onap.dcaegen2.deployments.tls-init-container:2.1.0', u'ca_cert_configmap': u'dev-dcae-bootstrap-dcae-cacert', u'component_ca_cert_path': u'/opt/dcae/cacert/cacert.pem'}, 'filebeat': {u'config_map': u'dev-dcae-filebeat-configmap', u'config_path': u'/usr/share/filebeat/filebeat.yml', u'log_path': u'/var/log/onap', u'image': u'docker.elastic.co/beats/filebeat:5.5.0', u'data_path': u'/usr/share/filebeat/data', u'config_subpath': u'filebeat.yml'}, 'consul_dns_name': u'consul-server.onap', 'image_pull_secrets': [u'onap-docker-registry-key'], 'namespace': u'onap', 'consul_host': 'consul-server:8500', 'cbs': {'base_url': 'https://config-binding-service:10443/service_component_all'}, 'default_k8s_location': u'central'} 2020-04-01 21:37:42.463 LOG [tca_k8s_i4sp66.start] INFO: k8s deployment initiated successfully for s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca: {'services': ['s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca', 'xs1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca'], 'namespace': u'onap', 'location': u'central', 'deployment': 'dep-s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca'} 2020-04-01 21:37:42.463 LOG [tca_k8s_i4sp66.start] INFO: Waiting up to 1800 secs for s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca to become ready 2020-04-01 21:37:44.179 LOG [tca_k8s_i4sp66.start] INFO: k8s deployment is ready for: s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca 2020-04-01 21:37:44.926 LOG [tca_k8s_i4sp66.start] INFO: Done starting: s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca 2020-04-01 21:37:44.926 CFY [tca_k8s_i4sp66.start] Task succeeded 'k8splugin.create_and_start_container_for_components' 2020-04-01 21:37:44.926 CFY [tca_k8s_i4sp66] Node instance started 2020-04-01 21:37:45.592 CFY 'install' workflow execution succeeded Total events: 36 TCA log root@sb01-nfs:~# kubectl logs -f -n onap dep-s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-ttxwf2 Error from server (BadRequest): a container name must be specified for pod dep-s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-ttxwf2, choose one of: [s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca filebeat] root@sb01-nfs:~# kubectl logs -f -n onap dep-s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-ttxwf2 s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca Generting preference file Starting TCA-CDAP in standalone mode Wed Apr 1 21:37:43 UTC 2020 Starting CDAP Standalone (SDK) ............. Standalone CDAP started successfully. Connect to the CDAP UI at http://localhost:11011 CDAP Started, waiting CDAP ready on localhost:11015 ... Creating namespace cdap_tca_hi_lo ... Namespace 'cdap_tca_hi_lo' created successfully. Stopping TCADMaaPMRPublisherWorker, TCADMaaPMRSubscriberWorker, and TCAVESCollectorFlow ... 'application:cdap_tca_hi_lo.dcae-tca.-SNAPSHOT' was not found.'application:cdap_tca_hi_lo.dcae-tca.-SNAPSHOT' was not found.'application:cdap_tca_hi_lo.dcae-tca.-SNAPSHOT' was not found.done Deleting application dcae-tca http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca 'application:cdap_tca_hi_lo.dcae-tca.-SNAPSHOT' was not found. Deleting artifact http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/artifacts/dcae-analytics-cdap-tca/versions/2.3.0 ... 'artifact:cdap_tca_hi_lo.dcae-analytics-cdap-tca.2.3.0' was not found. Loading artifact /opt/tca/dcae-analytics-cdap-tca.2.3.0.jar to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/artifacts/dcae-analytics-cdap-tca... Artifact added successfully Loading configuration /opt/tca/tca_app_config.json to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca Deploy Complete Loading preferences /opt/tca/tca_app_preferences.json to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca/preferences Starting TCADMaaPMRPublisherWorker, TCADMaaPMRSubscriberWorker, and TCAVESCollectorFlow ... TCADMaaPMRPublisherWorker status: {"status":"RUNNING"} TCADMaaPMRSubscriberWorker status: {"status":"RUNNING"} TCAVESCollectorFlow status: {"status":"RUNNING"} TCA-CDAP standalone mode initialization completed, with 3 / 3 up TCA environment: I am s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca, CBS K8S Service Name and port is config-binding-service:10000 ======================================================> Wed Apr 1 21:38:02 UTC 2020 TCADMaaPMRPublisherWorker status: {"status":"RUNNING"} TCADMaaPMRSubscriberWorker status: {"status":"RUNNING"} TCAVESCollectorFlow status: {"status":"RUNNING"} tca_poll_policy: Retrieving all-in-one config at config-binding-service:10000/service_component_all/s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca tca_poll_policy: CONFIG is [{ "tcaVESAlertsTableTTLSeconds": "1728000", "thresholdCalculatorFlowletInstances": "2", "tcaAlertsAbatementTableTTLSeconds": "1728000", "tcaAlertsAbatementTableName": "TCAAlertsAbatementTable", "appName": "dcae-tca", "appDescription": "DCAE Analytics Threshold Crossing Alert Application", "tcaSubscriberOutputStreamName": "TCASubscriberOutputStream", "tcaVESMessageStatusTableTTLSeconds": "86400", "tcaVESAlertsTableName": "TCAVESAlertsTable", "tcaVESMessageStatusTableName": "TCAVESMessageStatusTable" }], PREF is [{ "aaiEnrichmentIgnoreSSLCertificateErrors": "true", "publisherMaxRecoveryQueueSize": "100000", "subscriberConsumerId": "c12", "aaiVNFEnrichmentAPIPath": "/aai/v11/network/generic-vnfs/generic-vnf", "aaiEnrichmentUserPassword": "demo123456!", "publisherHostName": "message-router.onap.svc.cluster.local", "aaiEnrichmentPortNumber": "8443", "publisherPollingInterval": "20000", "subscriberProtocol": "http", "aaiEnrichmentHost": "aai.onap.svc.cluster.local", "enableRedisCaching": "false", "subscriberContentType": "application/json", "subscriberHostName": "message-router.onap.svc.cluster.local", "redisHosts": "dcae-redis.onap.svc.cluster.local:6379", "publisherContentType": "application/json", "subscriberTopicName": "unauthenticated.VES_MEASUREMENT_OUTPUT", "aaiVMEnrichmentAPIPath": "/aai/v11/search/nodes-query", "publisherMaxBatchSize": "1", "publisherProtocol": "http", "publisherHostPort": "3904", "subscriberMessageLimit": "-1", "tca_policy": "", "enableAAIEnrichment": "true", "publisherTopicName": "unauthenticated.DCAE_CL_OUTPUT", "subscriberPollingInterval": "30000", "aaiEnrichmentProtocol": "https", "enableAlertCEFFormat": "false", "subscriberConsumerGroup": "OpenDCAE-clamp", "subscriberHostPort": "3904", "aaiEnrichmentUserName": "dcae@dcae.onap.org", "subscriberTimeoutMS": "-1" }], POLICY is [{ "domain": "measurementsForVfScaling", "metricsPerEventName": [ { "policyScope": "test", "policyName": "test", "thresholds": [ { "direction": "LESS", "severity": "CRITICAL", "closedLoopControlName": "LOOP_testos", "fieldPath": "$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta", "version": "1.0.2", "closedLoopEventStatus": "ONSET", "thresholdValue": 0 } ], "eventName": "test", "controlLoopSchemaType": "VM", "policyVersion": "1.0.0" } ] }] 5c5 < "tcaAlertsAbatementTableTTLSeconds": 1728000, --- > "tcaAlertsAbatementTableTTLSeconds": "1728000", 8c8 < "tcaVESAlertsTableTTLSeconds": 1728000, --- > "tcaVESAlertsTableTTLSeconds": "1728000", 10,11c10,11 < "tcaVESMessageStatusTableTTLSeconds": 86400, < "thresholdCalculatorFlowletInstances": 2 --- > "tcaVESMessageStatusTableTTLSeconds": "86400", > "thresholdCalculatorFlowletInstances": "2" TCA config changed 6,7c6,7 < "aaiEnrichmentUserName": "DCAE", < "aaiEnrichmentUserPassword": "DCAE", --- > "aaiEnrichmentUserName": "dcae@dcae.onap.org", > "aaiEnrichmentUserPassword": "demo123456!", 13d12 < "redisHosts": "NONE", 22,23c21,23 < "subscriberConsumerGroup": "OpenDCAEc12", < "subscriberConsumerId": "c12", --- > "redisHosts": "dcae-redis.onap.svc.cluster.local:6379", > "subscriberConsumerGroup": "OpenDCAE-clamp", > "subscriberConsumerId": "c12-analytics-tca", 32c32 < "tca_policy": "{\"domain\":\"measurementsForVfScaling\",\"metricsPerEventName\":[{\"eventName\":\"vFirewallBroadcastPackets\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"LESS_OR_EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ONSET\"},{\"closedLoopControlName\":\"ControlLoop-vFirewall-d0a1dfc6-94f5-4fd4-a5b5-4630b438850a\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":700,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"vLoadBalancer\",\"controlLoopSchemaType\":\"VM\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vDNS-6f37f56d-a87d-4b85-b6a9-cc953cf779b3\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\",\"thresholdValue\":300,\"direction\":\"GREATER_OR_EQUAL\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]},{\"eventName\":\"Measurement_vGMUX\",\"controlLoopSchemaType\":\"VNF\",\"policyScope\":\"DCAE\",\"policyName\":\"DCAE.Config_tca-hi-lo\",\"policyVersion\":\"v0.0.1\",\"thresholds\":[{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"EQUAL\",\"severity\":\"MAJOR\",\"closedLoopEventStatus\":\"ABATED\"},{\"closedLoopControlName\":\"ControlLoop-vCPE-48f0c2c3-a172-4192-9ae3-052274181b6e\",\"version\":\"1.0.2\",\"fieldPath\":\"$.event.measurementsForVfScalingFields.additionalMeasurements[*].arrayOfFields[0].value\",\"thresholdValue\":0,\"direction\":\"GREATER\",\"severity\":\"CRITICAL\",\"closedLoopEventStatus\":\"ONSET\"}]}]}" --- > "tca_policy": "{ \"domain\": \"measurementsForVfScaling\", \"metricsPerEventName\": [ { \"policyScope\": \"test\", \"policyName\": \"test\", \"thresholds\": [ { \"direction\": \"LESS\", \"severity\": \"CRITICAL\", \"closedLoopControlName\": \"LOOP_testos\", \"fieldPath\": \"$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta\", \"version\": \"1.0.2\", \"closedLoopEventStatus\": \"ONSET\", \"thresholdValue\": 0 } ], \"eventName\": \"test\", \"controlLoopSchemaType\": \"VM\", \"policyVersion\": \"1.0.0\" } ]}" TCA preference updated Newly received configuration/preference differ from the running instance's. reload confg Verifying DMaaP topic: unauthenticated.VES_MEASUREMENT_OUTPUT@message-router.onap.svc.cluster.local:3904 (will block until topic ready) ==> Check topic [unauthenticated.VES_MEASUREMENT_OUTPUT] availbility on message-router.onap.svc.cluster.local:3904 ==> MR topic listing received, check topic availbility ==> Topic [unauthenticated.VES_MEASUREMENT_OUTPUT] ready Stopping TCADMaaPMRPublisherWorker, TCADMaaPMRSubscriberWorker, and TCAVESCollectorFlow ... done Deleting application dcae-tca http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca Deleting artifact http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/artifacts/dcae-analytics-cdap-tca/versions/2.3.0 ... Loading artifact /opt/tca/dcae-analytics-cdap-tca.2.3.0.jar to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/artifacts/dcae-analytics-cdap-tca... Artifact added successfully Loading configuration /opt/tca/tca_app_config.json to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca Deploy Complete Loading preferences /opt/tca/tca_app_preferences.json to http://localhost:11015/v3/namespaces/cdap_tca_hi_lo/apps/dcae-tca/preferences Starting TCADMaaPMRPublisherWorker, TCADMaaPMRSubscriberWorker, and TCAVESCollectorFlow ... TCADMaaPMRPublisherWorker status: {"status":"RUNNING"} TCADMaaPMRSubscriberWorker status: {"status":"RUNNING"} TCAVESCollectorFlow status: {"status":"RUNNING"} ======================================================> Wed Apr 1 21:38:46 UTC 2020 TCADMaaPMRPublisherWorker status: {"status":"RUNNING"} TCADMaaPMRSubscriberWorker status: {"status":"RUNNING"} TCAVESCollectorFlow status: {"status":"RUNNING"} tca_poll_policy: Retrieving all-in-one config at config-binding-service:10000/service_component_all/s1910b9b4e998443ebffbc0ad0708a316-dcaegen2-analytics-tca tca_poll_policy: CONFIG is [{ "tcaVESAlertsTableTTLSeconds": "1728000", "thresholdCalculatorFlowletInstances": "2", "tcaAlertsAbatementTableTTLSeconds": "1728000", "tcaAlertsAbatementTableName": "TCAAlertsAbatementTable", "appName": "dcae-tca", "appDescription": "DCAE Analytics Threshold Crossing Alert Application", "tcaSubscriberOutputStreamName": "TCASubscriberOutputStream", "tcaVESMessageStatusTableTTLSeconds": "86400", "tcaVESAlertsTableName": "TCAVESAlertsTable", "tcaVESMessageStatusTableName": "TCAVESMessageStatusTable" }], PREF is [{ "aaiEnrichmentIgnoreSSLCertificateErrors": "true", "publisherMaxRecoveryQueueSize": "100000", "subscriberConsumerId": "c12", "aaiVNFEnrichmentAPIPath": "/aai/v11/network/generic-vnfs/generic-vnf", "aaiEnrichmentUserPassword": "demo123456!", "publisherHostName": "message-router.onap.svc.cluster.local", "aaiEnrichmentPortNumber": "8443", "publisherPollingInterval": "20000", "subscriberProtocol": "http", "aaiEnrichmentHost": "aai.onap.svc.cluster.local", "enableRedisCaching": "false", "subscriberContentType": "application/json", "subscriberHostName": "message-router.onap.svc.cluster.local", "redisHosts": "dcae-redis.onap.svc.cluster.local:6379", "publisherContentType": "application/json", "subscriberTopicName": "unauthenticated.VES_MEASUREMENT_OUTPUT", "aaiVMEnrichmentAPIPath": "/aai/v11/search/nodes-query", "publisherMaxBatchSize": "1", "publisherProtocol": "http", "publisherHostPort": "3904", "subscriberMessageLimit": "-1", "tca_policy": "", "enableAAIEnrichment": "true", "publisherTopicName": "unauthenticated.DCAE_CL_OUTPUT", "subscriberPollingInterval": "30000", "aaiEnrichmentProtocol": "https", "enableAlertCEFFormat": "false", "subscriberConsumerGroup": "OpenDCAE-clamp", "subscriberHostPort": "3904", "aaiEnrichmentUserName": "dcae@dcae.onap.org", "subscriberTimeoutMS": "-1" }], POLICY is [{ "domain": "measurementsForVfScaling", "metricsPerEventName": [ { "policyScope": "test", "policyName": "test", "thresholds": [ { "direction": "LESS", "severity": "CRITICAL", "closedLoopControlName": "LOOP_testos", "fieldPath": "$.event.measurementsForVfScalingFields.vNicPerformanceArray[*].receivedTotalPacketsDelta", "version": "1.0.2", "closedLoopEventStatus": "ONSET", "thresholdValue": 0 } ], "eventName": "test", "controlLoopSchemaType": "VM", "policyVersion": "1.0.0" } ] }] Newly received configuration/preference identical from the running instance's ======================================================> Wed Apr 1 21:39:16 UTC 2020 CLAMP UNdeploy ------------- Deployment-Handler log 2020-04-01T21:59:25.353Z|2020-04-01T21:59:26.017Z|466f001c-416c-4e48-a606-4de612912446|||deployment-handler.onap|DELETE /dcae-deployments/CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2?connectionTimeToLive=5000||COMPLETE|202||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO||10.42.8.10|664|deployment-handler.onap|10.42.3.53||||||||ExecutionId: 7b92f873-fb3f-41e5-b007-3f5bcd9997f5 2020-04-01T21:59:27.340Z|2020-04-01T21:59:27.397Z|fc236919-70d4-41bc-8ab8-cc407bd296a9|||deployment-handler.onap|GET /dcae-deployments/CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2/operation/7b92f873-fb3f-41e5-b007-3f5bcd9997f5?connectionTimeToLive=5000||COMPLETE|200||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO||10.42.8.10|57|deployment-handler.onap|10.42.3.53||||||||Workflow type: uninstall -- execution status: processing 2020-04-01T21:59:42.864Z|2020-04-01T21:59:42.864Z|7ecfc6c5-1909-4070-99bf-b09c69d7fb6a|||10.42.8.10|GET /||COMPLETE|200||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO||10.42.8.10|0|10.42.8.10|10.0.0.13||||||||{"server":{"name":"onap-dcae-deployment-handler","description":"ONAP DCAE Deployment Handler","version":"6.1.0","branch":"","commit":"unspecified","commit_datetime":"","server_instance_uuid":"0e413880-9c6a-4569-86e7-4a5bf1f3a9d4"},"apiVersion":"5.1.0","links":{"info":"/","internal-health":"/healthcheck","service-health":"/servicehealth","deployments":"/dcae-deployments","policy":"/policy","swagger-ui":"/swagger-ui"}} 2020-04-01T22:00:12.864Z|2020-04-01T22:00:12.864Z|61348196-e7ab-4c18-b7d2-7f810b660acf|||10.42.8.10|GET /||COMPLETE|200||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO||10.42.8.10|0|10.42.8.10|10.0.0.13||||||||{"server":{"name":"onap-dcae-deployment-handler","description":"ONAP DCAE Deployment Handler","version":"6.1.0","branch":"","commit":"unspecified","commit_datetime":"","server_instance_uuid":"0e413880-9c6a-4569-86e7-4a5bf1f3a9d4"},"apiVersion":"5.1.0","links":{"info":"/","internal-health":"/healthcheck","service-health":"/servicehealth","deployments":"/dcae-deployments","policy":"/policy","swagger-ui":"/swagger-ui"}} 2020-04-01T21:59:25.353Z|2020-04-01T22:00:16.894Z|466f001c-416c-4e48-a606-4de612912446|||deployment-handler.onap|DELETE /dcae-deployments/CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2?connectionTimeToLive=5000||COMPLETE|200||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO|||51541|deployment-handler.onap|10.42.3.53||||||||Undeployed id: CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2 2020-04-01T22:00:42.863Z|2020-04-01T22:00:42.864Z|d4391e8f-0728-4a59-aa4f-3ef0b3b13034|||10.42.8.10|GET /||COMPLETE|200||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO||10.42.8.10|1|10.42.8.10|10.0.0.13||||||||{"server":{"name":"onap-dcae-deployment-handler","description":"ONAP DCAE Deployment Handler","version":"6.1.0","branch":"","commit":"unspecified","commit_datetime":"","server_instance_uuid":"0e413880-9c6a-4569-86e7-4a5bf1f3a9d4"},"apiVersion":"5.1.0","links":{"info":"/","internal-health":"/healthcheck","service-health":"/servicehealth","deployments":"/dcae-deployments","policy":"/policy","swagger-ui":"/swagger-ui"}} .. 2020-04-01T22:03:16.181Z|2020-04-01T22:03:16.243Z|7386be9c-9fe0-4942-b71a-e97deb053084|||deployment-handler.onap|GET /dcae-deployments/CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2/operation/7b92f873-fb3f-41e5-b007-3f5bcd9997f5?connectionTimeToLive=5000||ERROR|404||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO||10.42.8.10|62|deployment-handler.onap|10.42.3.53||||||||{"status":404,"message":"Status 404 from CM API -- error code: not_found_error -- message: Requested `Execution` with ID `7b92f873-fb3f-41e5-b007-3f5bcd9997f5` was not found","stack":["Error: Status 404 from CM API -- error code: not_found_error -- message: Requested `Execution` with ID `7b92f873-fb3f-41e5-b007-3f5bcd9997f5` was not found"," at exports.createDispatcherError (/opt/app/dh/lib/dispatcher-error.js:42:10)"," at normalizeError (/opt/app/dh/lib/deploy.js:84:7)"," at /opt/app/dh/lib/deploy.js:267:9"," at process._tickCallback (internal/process/next_tick.js:68:7)"]} 2020-04-01T22:03:39.420Z|2020-04-01T22:03:39.488Z|99684c13-1a88-45bf-a3d0-eb44aebf57cb|||deployment-handler.onap|GET /dcae-deployments/CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2/operation/7b92f873-fb3f-41e5-b007-3f5bcd9997f5?connectionTimeToLive=5000||ERROR|404||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO||10.42.8.10|68|deployment-handler.onap|10.42.3.53||||||||{"status":404,"message":"Status 404 from CM API -- error code: not_found_error -- message: Requested `Execution` with ID `7b92f873-fb3f-41e5-b007-3f5bcd9997f5` was not found","stack":["Error: Status 404 from CM API -- error code: not_found_error -- message: Requested `Execution` with ID `7b92f873-fb3f-41e5-b007-3f5bcd9997f5` was not found"," at exports.createDispatcherError (/opt/app/dh/lib/dispatcher-error.js:42:10)"," at normalizeError (/opt/app/dh/lib/deploy.js:84:7)"," at /opt/app/dh/lib/deploy.js:267:9"," at process._tickCallback (internal/process/next_tick.js:68:7)"]} 2020-04-01T22:03:42.864Z|2020-04-01T22:03:42.864Z|4c11b93a-27bf-40b3-acaf-78a2cd2d0653|||10.42.8.10|GET /||COMPLETE|200||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO||10.42.8.10|0|10.42.8.10|10.0.0.13||||||||{"server":{"name":"onap-dcae-deployment-handler","description":"ONAP DCAE Deployment Handler","version":"6.1.0","branch":"","commit":"unspecified","commit_datetime":"","server_instance_uuid":"0e413880-9c6a-4569-86e7-4a5bf1f3a9d4"},"apiVersion":"5.1.0","links":{"info":"/","internal-health":"/healthcheck","service-health":"/servicehealth","deployments":"/dcae-deployments","policy":"/policy","swagger-ui":"/swagger-ui"}} 2020-04-01T22:04:01.413Z|2020-04-01T22:04:01.472Z|66ecf838-47bc-4c0a-b8f2-a15c91d2454e|||deployment-handler.onap|GET /dcae-deployments/CLAMP_9c9f3626-048e-45b3-b173-ad4cabb76dd2/operation/7b92f873-fb3f-41e5-b007-3f5bcd9997f5?connectionTimeToLive=5000||ERROR|404||0e413880-9c6a-4569-86e7-4a5bf1f3a9d4|INFO||10.42.8.10|59|deployment-handler.onap|10.42.3.53||||||||{"status":404,"message":"Status 404 from CM API -- error code: not_found_error -- message: Requested `Execution` with ID `7b92f873-fb3f-41e5-b007-3f5bcd9997f5` was not found","stack":["Error: Status 404 from CM API -- error code: not_found_error -- message: Requested `Execution` with ID `7b92f873-fb3f-41e5-b007-3f5bcd9997f5` was not found"," at exports.createDispatcherError (/opt/app/dh/lib/dispatcher-error.js:42:10)"," at normalizeError (/opt/app/dh/lib/deploy.js:84:7)"," at /opt/app/dh/lib/deploy.js:267:9"," at process._tickCallback (internal/process/next_tick.js:68:7)"]} bash-4.2$ cfy deployment list Listing all deployments... Deployments: +---------------+---------------+--------------------------+--------------------------+--------------+----------------+------------+ | id | blueprint_id | created_at | updated_at | availability | tenant_name | created_by | +---------------+---------------+--------------------------+--------------------------+--------------+----------------+------------+ | pgaas_initdb | pgaas_initdb | 2020-03-31 19:30:11.093 | 2020-03-31 19:30:11.093 | tenant | default_tenant | admin | | hv-ves | hv-ves | 2020-03-31 19:30:33.039 | 2020-03-31 19:30:33.039 | tenant | default_tenant | admin | | holmes_rules | holmes_rules | 2020-03-31 19:30:34.130 | 2020-03-31 19:30:34.130 | tenant | default_tenant | admin | | ves | ves | 2020-03-31 19:30:34.344 | 2020-03-31 19:30:34.344 | tenant | default_tenant | admin | | tca | tca | 2020-03-31 19:30:34.462 | 2020-03-31 19:30:34.462 | tenant | default_tenant | admin | | prh | prh | 2020-03-31 19:30:34.470 | 2020-03-31 19:30:34.470 | tenant | default_tenant | admin | | ves-tls | ves-tls | 2020-03-31 19:30:34.774 | 2020-03-31 19:30:34.774 | tenant | default_tenant | admin | | tcagen2 | tcagen2 | 2020-03-31 19:30:34.909 | 2020-03-31 19:30:34.909 | tenant | default_tenant | admin | | holmes_engine | holmes_engine | 2020-03-31 19:31:26.278 | 2020-03-31 19:31:26.278 | tenant | default_tenant | admin | +---------------+---------------+--------------------------+--------------------------+--------------+----------------+------------+ root@sb01-nfs:~# kubectl get pods -n onap | grep analytics dep-dcae-tca-analytics-5974fcf8dc-2jgjv 2/2 Running 0 26h