...
All test blueprint should be uploaded into into https://git.onap.org/dcaegen2/platform/blueprints/tree/blueprints/reference_templates
Currently we have the following blueprints:
...
Pre-requisite for running the test blueprints:
1) Add the following key/value into consul with "dmaap-plugin" as the key.
Note: This step might not be needed, in particular "protocol" : "http" can cause a problem with dmaap-bc connection. Default configuration will be added into consul upon Cloudify Container deployment. dmaap kv into consul
{
"dmaap" :
{
"username": "whatever",
"password": "whatever",
"owner" : "dcaeorch",
"protocol" : "http"
}
}
2) Add (With the help of DBCL owner) add location san-francisco into DMaap DBCL if the location is not in there yet.
Deployment Steps
<steps for running blueprint listed earlier >
...
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# cfy install -b test0 -d test0 -i dmaap_inputs.yaml test_mr_pubsub_extra.yaml
Uploading blueprint test_mr_pubsub_extra.yaml...
test_mr_pubsub_ex... yaml |#################################################################################################| 100.0%
Blueprint uploaded. The blueprint's id is test0
Creating new deployment from blueprint test0...
Deployment created. The deployment's id is test0
Executing workflow install on deployment test0 [timeout=900 seconds]
Deployment environment creation is pending...
2019-05-10 23:09 20:53:0754.512 252 CFY <test0> Starting 'create_deployment_environment' workflow execution
2019-05-10 23:09 20:53:0854.088 881 CFY <test0> Installing deployment plugins
2019-05-10 23:09 20:53:0854.088 881 CFY <test0> Sending task 'cloudify_agent.operations.install_plugins'
2019-05-10 23:09 20:53:0854.088 881 CFY <test0> Task started 'cloudify_agent.operations.install_plugins'
2019-05-10 23:09 20:53:0855.742 568 LOG <test0> INFO: Installing plugin: k8s
2019-05-10 23:09 20:53:0856.742 181 LOG <test0> INFO: Using existing installation of managed plugin: 99e0f852-a688-4ecf-b606-37df263f6fa0 [package_name: k8splugin, package_version: 1.4.13, supported_platform: linux_x86_64, distribution: centos, distribution_release: core]
2019-05-10 23:09 20:53:0856.742 181 LOG <test0> INFO: Installing plugin: dmaapplugin
2019-05-10 23:09 20:53:0957.987 576 LOG <test0> INFO: Using existing installation of managed plugin: d8abab9c-2e52-4caa-a9fe-d74bf24609ad [package_name: dmaap, package_version: 1.3.2, supported_platform: any]
2019-05-10 23:09 20:53:0957.987 576 CFY <test0> Task succeeded 'cloudify_agent.operations.install_plugins'
2019-05-10 23:09 20:53:0957.987 576 CFY <test0> Skipping starting deployment policy engine core - no policies defined
2019-05-10 23:09 20:53:0957.987 576 CFY <test0> Creating deployment work directory
2019-05-10 23:09 20:53:0957.987 576 CFY <test0> 'create_deployment_environment' workflow execution succeeded
2019-05-09 2010 23:5310:1501.444 752 CFY <test0> Starting 'install' workflow execution
2019-05-09 2010 23:5310:1703.083 571 CFY <test0> [topic00topic01_incvxjxjti5i] Creating node instance
2019-05-09 2010 23:5310:1704.718 268 CFY <test0> [topic01topic00_34hei2ehyrmr] Creating node instance
2019-05-09 2010 23:5310:1704.718 268 CFY <test0> [topic00topic01_incvxjxjti5i.create] Sending task 'dmaapplugin.mr_lifecycle.create_topic'
2019-05-09 2010 23:5310:1804.396 268 CFY <test0> [topic01topic00_34hei2ehyrmr.create] Sending task 'dmaapplugin.mr_lifecycle.create_topic'
2019-05-09 2010 23:5310:1905.322 961 LOG <test0> [topic00topic01_incvxjxjti5i.create] INFO: Attempting to create topic name topic00topic01_name
2019-05-09 2010 23:5310:1906.826 612 LOG <test0> [topic00topic01_incvxjxjti5i.create] INFO: Posting to URL: http://dmaap-bc:8080/webapi/topics with body: {'txenable': False, 'globalMrURLowner': u'message-routerdcaeorch', 'replicationCase': u'REPLICATION_EDGE_TO_CENTRAL_TO_GLOBAL', 'topicDescription': 'No description provided', 'ownertopicName': u'dcaeorchtopic01_name', 'topicNametxenable': u'topic00'False}
2019-05-09 2010 23:5310:1906.826 612 LOG <test0> [topic01topic00_34hei2ehyrmr.create] INFO: Attempting to create topic name topic00_name topic01
2019-05-09 2010 23:5310:1906.826 612 LOG <test0> [topic01topic00_34hei2ehyrmr.create] INFO: Posting to URL: http://dmaap-bc:8080/webapi/topics with body: {'owner': u'dcaeorch', 'topicDescription': 'No description provided', 'topicName': u'topic01', 'replicationCase': u'REPLICATION_EDGE_TO_CENTRALtopic00_name', 'txenable': False}
2019-05-09 2010 23:5310:2108.331 715 CFY <test0> [topic01topic00_34hei2ehyrmr.create] Task succeeded 'dmaapplugin.mr_lifecycle.create_topic'
2019-05-09 2010 23:5310:2109.965 321 CFY <test0> [topic00topic01_incvxjxjti5i.create] Task succeeded 'dmaapplugin.mr_lifecycle.create_topic'
2019-05-09 2010 23:5310:2109.965 321 CFY <test0> [topic01topic00_34hei2ehyrmr] Node instance created
2019-05-09 2010 23:5310:2109.965 321 CFY <test0> [topic00topic01_incvxjxjti5i] Node instance created
2019-05-09 2010 23:5310:2209.648 960 CFY <test0> [topic01topic00_34hei2ehyrmr] Configuring node instance: nothing to do
2019-05-09 2010 23:5310:2209.648 960 CFY <test0> [topic00topic01_incvxjxjti5i] Configuring node instance: nothing to do
2019-05-09 2010 23:5310:2209.648 960 CFY <test0> [topic01topic00_34hei2ehyrmr] Starting node instance: nothing to do
2019-05-09 2010 23:5310:2210.648 570 CFY <test0> [topic00topic01_incvxjxjti5i] Starting node instance: nothing to do
2019-05-09 2010 23:5310:2310.375 570 CFY <test0> [topic01topic00_34hei2ehyrmr] Node instance started
2019-05-09 2010 23:5310:2310.995 570 CFY <test0> [topic00topic01_incvxjxjti5i] Node instance started
2019-05-09 2010 23:5310:2411.700 241 CFY <test0> [client00web_server_cowri2cqf9i4] Creating node instance
2019-05-09 2010 23:5310:2511.368 925 CFY <test0> [client00web_server_cowri2cqf9i4.create] Sending task 'k8splugin.create_for_components_with_streams'
2019-05-09 2010 23:5310:2916.247 273 LOG <test0> [client00web_server_cowri2cqf9i4.create] INFO: Done setting up: sc972b27b7f5d4835976efbe93316e253Added config for s61b2002abe554457a78050174c431719-nginx-web
2019-05-09 2010 23:5310:2816.560 784 LOG <test0> [client00web_server_cowri2cqf9i4.create] INFO: Added config for sc972b27b7f5d4835976efbe93316e253: Done setting up: s61b2002abe554457a78050174c431719-nginx-web
2019-05-09 2010 23:5310:2917.247 527 CFY <test0> [client00web_server_cowri2cqf9i4.create] Task succeeded 'k8splugin.create_for_components_with_streams'
2019-05-09 2010 23:5310:2918.857 146 CFY <test0> [client00web_server_cowri2cqf9i4] Node instance created
2019-05-09 2010 23:5310:2918.857 146 CFY <test0> [client00web_server_cowri2cqf9i4] Pre-configuring relationships
2019-05-09 2010 23:5310:2918.857 146 CFY <test0> [preconfigure] Sending task 'dmaapplugin.mr_relationships.add_mr_publisher'
2019-05-09 2010 23:5310:3220.143 266 LOG <test0> [preconfigure] INFO: Posting to URL: http://dmaap-bc:8080/webapi/mr_clients with body: {'action': ['view', 'pub'], 'clientRole': u'org.onap.dcae.pnfPublisher', 'fqtn': u'Attempting to add web_server as publisher to topic org.onap.dmaap.mr.topic00', 'dcaeLocationName': u'san-francisco'}_name
2019-05-09 2010 23:5310:3120.518 266 LOG <test0> [preconfigure] INFO: Attempting to add client00 web_server as publisher to topic org.onap.dmaap.mr.topic00_name
2019-05-09 2010 23:5310:3220.143 788 LOG <test0> [preconfigure] INFO: Added publisher id 1557435211391 1557529820110 to feed org.onap.dmaap.mr.topic00_name at san-francisco
2019-05-09 2010 23:5310:3220.777 788 CFY <test0> [preconfigure] Task succeeded 'dmaapplugin.mr_relationships.add_mr_publisher'
2019-05-09 2010 23:5310:3221.777 470 CFY <test0> [preconfigure] Sending task 'dmaapplugin.mr_relationships.add_mr_subscriber'
2019-05-09 2010 23:5310:3323.963 467 LOG <test0> [preconfigure] INFO: Attempting to add client00 web_server as subscriber to topic org.onap.dmaap.mr.topic01_name
2019-05-09 2010 23:5310:3424.601 004 LOG <test0> [preconfigure] INFO: Posting to URL: http://dmaap-bc:8080/webapi/mr_clients with body: {'action': ['view', 'sub'], 'clientRole': u'org.onap.dcae.pnfSubscriber', 'fqtn': u'org.onap.dmaap.mr.topic01_name', 'dcaeLocationName': u'san-francisco'}
2019-05-09 2010 23:5310:3424.601 004 LOG <test0> [preconfigure] INFO: Added subscriber id 1557435213810 1557529823378 to feed org.onap.dmaap.mr.topic01_name at san-francisco
2019-05-09 2010 23:5310:3524.180 658 CFY <test0> [preconfigure] Task succeeded 'dmaapplugin.mr_relationships.add_mr_subscriber'
2019-05-09 2010 23:5310:3524.180 658 CFY <test0> [client00web_server_cowri2cqf9i4] Relationships pre-configured
2019-05-09 2010 23:5310:3525.802 402 CFY <test0> [client00web_server_cowri2cqf9i4] Configuring node instance: nothing to do
2019-05-09 2010 23:5310:3525.802 402 CFY <test0> [client00web_server_cowri2cqf9i4] Starting node instance
2019-05-09 2010 23:5310:3525.802 998 CFY <test0> [client00web_server_cowri2cqf9i4.start] Sending task 'k8splugin.create_and_start_container_for_components_with_streams'
2019-05-09 2010 23:5310:3727.229 038 LOG <test0> [client00web_server_cowri2cqf9i4.start] INFO: Starting k8s deployment for sc972b27b7f5d4835976efbe93316e253s61b2002abe554457a78050174c431719-nginx-web, image: nginx, env: {'CONSUL_HOST': u'consul-server.onap', 'SERVICE_TAGS': 'test0', 'CONFIG_BINDING_SERVICE': 'config-binding-service'}, kwargs: {'readiness': {u'endpoint': u'/', u'type': u'http'}, 'labels': {'cfydeployment': u'test0', 'cfynodeinstance': u'client00web_server_cowri2cqf9i4', 'cfynode': u'client00web_server'}, 'tls_info': {}, 'envs': {'SERVICE_TAGS': 'test0'}, 'liveness': {}, 'resource_config': {}, 'volumes': [], 'log_info': {}, 'ports': [u'80:0'], 'k8s_location': u'central'}
2019-05-09 2010 23:5310:3727.732 542 LOG <test0> [client00web_server_cowri2cqf9i4.start] INFO: Passing k8sconfig: {'tls': {u'cert_path': u'/opt/tls/shared', u'image': u'nexus3.onap.org:10001/onap/org.onap.dcaegen2.deployments.tls-init-container:1.0.3'}, 'filebeat': {u'config_map': u'dcae-filebeat-configmap', u'config_path': u'/usr/share/filebeat/filebeat.yml', u'log_path': u'/var/log/onap', u'image': u'docker.elastic.co/beats/filebeat:5.5.0', u'data_path': u'/usr/share/filebeat/data', u'config_subpath': u'filebeat.yml'}, 'consul_dns_name': u'consul-server.onap', 'image_pull_secrets': [u'onap-docker-registry-key'], 'namespace': u'onap', 'consul_host': 'consul-server:8500', 'default_k8s_location': u'central'}
2019-05-09 2010 23:5310:3828.354 181 LOG <test0> [client00web_server_cowri2cqf9i4.start] INFO: k8s deployment initiated successfully for sc972b27b7f5d4835976efbe93316e253s61b2002abe554457a78050174c431719-nginx-web: {'services': ['sc972b27b7f5d4835976efbe93316e253s61b2002abe554457a78050174c431719-nginx-web'], 'namespace': u'onap', 'location': u'central', 'deployment': 'dep-sc972b27b7f5d4835976efbe93316e253s61b2002abe554457a78050174c431719-nginx-web'}
2019-05-09 2010 23:5310:3828.354 181 LOG <test0> [client00web_server_cowri2cqf9i4.start] INFO: Waiting up to 1800 secs for sc972b27b7f5d4835976efbe93316e253s61b2002abe554457a78050174c431719-nginx-web to become ready
2019-05-09 2010 23:5410:3655.905 773 LOG <test0> [client00web_server_cowri2cqf9i4.start] INFO: k8s deployment is ready for: sc972b27b7f5d4835976efbe93316e253Done starting: s61b2002abe554457a78050174c431719-nginx-web
2019-05-09 2010 23:5410:3755.429 251 LOG <test0> [client00web_server_cowri2cqf9i4.start] INFO: Done starting: sc972b27b7f5d4835976efbe93316e253k8s deployment is ready for: s61b2002abe554457a78050174c431719-nginx-web
2019-05-09 2010 23:5410:3856.176 506 CFY <test0> [client00web_server_cowri2cqf9i4.start] Task succeeded 'k8splugin.create_and_start_container_for_components_with_streams'
2019-05-09 2010 23:5410:3857.176 058 CFY <test0> [client00web_server_cowri2cqf9i4] Node instance started
2019-05-09 2010 23:5410:3857.792 058 CFY <test0> 'install' workflow execution succeeded
Finished executing workflow install on deployment test0
* Run 'cfy events list -e 99a9d61a7a4e25eb-e62ccf1e-4e834d91-ae3e9004-baa20a8eea3960e4ecdff536' to retrieve the execution's events/logs
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/topics/"org.onap.dmaap.mr.topic00_name" | python -mjson.tool
% Total Total % Received % Xferd Average Speed Time Time Speed Time Time Time Current
Dload Upload Total Spent Dload Upload Total Spent Left Speed
100 738 100 738 0 0 27245 100 715 100 715 0 0 36634 0 --:--:-- --:--:-- --:--:-- 2838437631
{
"clients": [
{
"action": [
"view",
"pub"
],
"clientRole": "org.onap.dcae.pnfPublisher",
"dcaeLocationName": "san-francisco",
"fqtn": "org.onap.dmaap.mr.topic00_name",
"lastMod": "2019-05-09T2010T23:5310:3120.39111",
"mrClientId": "15574352113911557529820110",
"status": "VALID",
"topicURL": "http://message-router:3904/events/org.onap.dmaap.mr.topic00_name"
}
],
"fqtn": "org.onap.dmaap.mr.topic00_name","globalMrURL": "message-router",
"lastMod": "2019-05-09T2010T23:5310:1906.247078",
"owner": "dcaeorch",
"partitionCount": "2",
"publisherRole": "org.onap.dmaap.mr.topic00_name.publisher",
"replicationCase": "REPLICATION_EDGE_TO_CENTRAL_TO_GLOBALNONE",
"replicationCount": "1",
"status": "VALID",
"subscriberRole": "org.onap.dmaap.mr.topic00_name.subscriber",
"topicDescription": "No description provided",
"topicName": "topic00_name",
"type": "topic"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/topics/"org.onap.dmaap.mr.topic01_name" | python -mjson.tool
% Total Total % Received % Xferd Average Speed Time Time Speed Time Time Time Current
Dload Upload Total Spent Dload Upload Total Spent Left Speed
100 697 100 697 0 0 47062 100 717 100 717 0 0 43184 0 --:--:-- --:--:-- --:--:-- 4978544812
{
"clients": [
{
"action": [
"view",
"sub"
],
"clientRole": "org.onap.dcae.pnfSubscriber",
"dcaeLocationName": "san-francisco",
"fqtn": "org.onap.dmaap.mr.topic01_name",
"lastMod": "2019-05-09T2010T23:5310:3323.81378",
"mrClientId": "15574352138101557529823378",
"status": "VALID",
"topicURL": "http://message-router:3904/events/org.onap.dmaap.mr.topic01_name"
}
],
"fqtn": "org.onap.dmaap.mr.topic01_name",
"lastMod": "2019-05-09T2010T23:5310:1905.448877",
"owner": "dcaeorch",
"partitionCount": "2",
"publisherRole": "org.onap.dmaap.mr.topic01_name.publisher",
"replicationCase": "REPLICATION_EDGE_TO_CENTRALNONE",
"replicationCount": "1",
"status": "VALID",
"subscriberRole": "org.onap.dmaap.mr.topic01_name.subscriber",
"topicDescription": "No description provided",
"topicName": "topic01_name",
"type": "topic"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/mr_clients/15574352113911557529820110 | python -mjson.tool
% Total Total % Received % Xferd Average Speed Speed Time Time Time Time Time Current
Dload Upload Total Spent Dload Upload Total Spent Left Speed
100 311 100 311 0 0 4675 100 320 100 320 0 0 9200 0 --:--:-- --:--:-- --:--:-- 471211428
{
"action": [
"view",
"pub"
],
"clientRole": "org.onap.dcae.pnfPublisher",
"dcaeLocationName": "san-francisco",
"fqtn": "org.onap.dmaap.mr.topic00_name",
"lastMod": "2019-05-09T2010T23:5310:3120.39111",
"mrClientId": "15574352113911557529820110",
"status": "VALID",
"topicURL": "http://message-router:3904/events/org.onap.dmaap.mr.topic00_name",
"type": "mr_Client"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/mr_clients/15574352138101557529823378 | python -mjson.tool
% Total Total % Received % Xferd Average Speed Time Time Speed Time Time Time Current
Dload Upload Total Spent Dload Upload Total Spent Left Speed
100 311 100 311 0 0 9155 0 100 322 100 322 0 0 7471 0 --:--:-- --:--:-- --:--:-- 94247666
{
"action": [
"view",
"sub"
],
"clientRole": "org.onap.dcae.pnfSubscriber",
"dcaeLocationName": "san-francisco",
"fqtn": "org.onap.dmaap.mr.topic01_name",
"lastMod": "2019-05-09T2010T23:5310:3323.81378",
"mrClientId": "15574352138101557529823378",
"status": "VALID",
"topicURL": "http://message-router:3904/events/org.onap.dmaap.mr.topic01_name",
"type": "mr_Client"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# cfy uninstall test0
Executing workflow uninstall on deployment test0 [timeout=900 seconds]
2019-05-09 21:19:31.746 CFY <test0> Starting 'uninstall' workflow execution
2019-05-09 21:19:33.549 CFY <test0> [client00_cowri2] Stopping node instance
2019-05-09 21:19:34.227 CFY <test0> [client00_cowri2.stop] Sending task 'k8splugin.stop_and_remove_container'
2019-05-09 21:19:39.435 CFY <test0> [client00_cowri2.stop] Task succeeded 'k8splugin.stop_and_remove_container'
2019-05-09 21:19:40.087 CFY <test0> [client00_cowri2] Stopped node instance
2019-05-09 21:19:40.087 CFY <test0> [client00_cowri2] Unlinking relationships
2019-05-09 21:19:40.768 CFY <test0> [unlink] Sending task 'dmaapplugin.mr_relationships.delete_mr_client'
2019-05-09 21:19:41.896 LOG <test0> [unlink] INFO: Attempting to delete client 1557435213810
2019-05-09 21:19:42.399 LOG <test0> [unlink] INFO: Deleting URL: http://dmaap-bc:8080/webapi/mr_clients/1557435213810
2019-05-09 21:19:42.399 LOG <test0> [unlink] INFO: Deleted client 1557435213810
2019-05-09 21:19:42.946 CFY <test0> [unlink] Task succeeded 'dmaapplugin.mr_relationships.delete_mr_client'
2019-05-09 21:19:42.946 CFY <test0> [unlink] Sending task 'dmaapplugin.mr_relationships.delete_mr_client'
2019-05-09 21:19:44.465 LOG <test0> [unlink] INFO: Attempting to delete client 1557435211391
2019-05-09 21:19:45.183 LOG <test0> [unlink] INFO: Deleting URL: http://dmaap-bc:8080/webapi/mr_clients/1557435211391
2019-05-09 21:19:45.183 LOG <test0> [unlink] INFO: Deleted client 1557435211391
2019-05-09 21:19:45.771 CFY <test0> [unlink] Task succeeded 'dmaapplugin.mr_relationships.delete_mr_client'
2019-05-09 21:19:45.771 CFY <test0> [client00_cowri2] Relationships unlinked
2019-05-09 21:19:45.771 CFY <test0> [client00_cowri2] Deleting node instance
2019-05-09 21:19:46.505 CFY <test0> [client00_cowri2.delete] Sending task 'k8splugin.cleanup_discovery'
2019-05-09 21:19:48.010 CFY <test0> [client00_cowri2.delete] Task succeeded 'k8splugin.cleanup_discovery'
2019-05-09 21:19:48.659 CFY <test0> [client00_cowri2] Deleted node instance
2019-05-09 21:19:49.224 CFY <test0> [topic00_incvxj] Stopping node instance
2019-05-09 21:19:49.224 CFY <test0> [topic01_34hei2] Stopping node instance
2019-05-09 21:19:49.224 CFY <test0> [topic01_34hei2] Stopped node instance: nothing to do
2019-05-09 21:19:49.904 CFY <test0> [topic00_incvxj] Stopped node instance: nothing to do
2019-05-09 21:19:49.904 CFY <test0> [topic01_34hei2] Unlinking relationships
2019-05-09 21:19:50.454 CFY <test0> [topic00_incvxj] Unlinking relationships
2019-05-09 21:19:50.454 CFY <test0> [topic01_34hei2] Relationships unlinked
2019-05-09 21:19:50.454 CFY <test0> [topic00_incvxj] Relationships unlinked
2019-05-09 21:19:51.111 CFY <test0> [topic01_34hei2/opt/consul/bin/consul kv export | grep key
"key": "dcae-dashboard",
"key": "dcae-hv-ves-collector",
"key": "dcae-prh",
"key": "dcae-snmptrap-collector",
"key": "dcae-tca-analytics",
"key": "dcae-ves-collector",
"key": "deployment_handler",
"key": "dmaap-plugin",
"key": "holmes-engine-mgmt",
"key": "holmes-rule-mgmt",
"key": "k8s-plugin",
"key": "s61b2002abe554457a78050174c431719-nginx-web",
"key": "s61b2002abe554457a78050174c431719-nginx-web:dmaap",
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# /opt/consul/bin/consul kv get s61b2002abe554457a78050174c431719-nginx-web:dmaap | python -mjson.tool
{
"topic00": {
"client_id": "1557529820110",
"client_role": "org.onap.dcae.pnfPublisher",
"location": "san-francisco",
"topic_url": "http://message-router:3904/events/org.onap.dmaap.mr.topic00_name"
},
"topic01": {
"client_id": "1557529823378",
"client_role": "org.onap.dcae.pnfSubscriber",
"location": "san-francisco",
"topic_url": "http://message-router:3904/events/org.onap.dmaap.mr.topic01_name"
}
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# cfy uninstall test0
Executing workflow uninstall on deployment test0 [timeout=900 seconds]
2019-05-10 23:14:49.904 CFY <test0> Starting 'uninstall' workflow execution
2019-05-10 23:14:52.322 CFY <test0> [web_server_cqf9i4] Stopping node instance
2019-05-10 23:14:53.438 CFY <test0> [web_server_cqf9i4.stop] Sending task 'k8splugin.stop_and_remove_container'
2019-05-10 23:15:01.207 CFY <test0> [web_server_cqf9i4.stop] Task succeeded 'k8splugin.stop_and_remove_container'
2019-05-10 23:15:01.921 CFY <test0> [web_server_cqf9i4] Stopped node instance
2019-05-10 23:15:02.464 CFY <test0> [web_server_cqf9i4] Unlinking relationships
2019-05-10 23:15:02.464 CFY <test0> [unlink] Sending task 'dmaapplugin.mr_relationships.delete_mr_client'
2019-05-10 23:15:06.207 LOG <test0> [unlink] INFO: Deleting URL: http://dmaap-bc:8080/webapi/mr_clients/1557529823378
2019-05-10 23:15:05.464 LOG <test0> [unlink] INFO: Attempting to delete client 1557529823378
2019-05-10 23:15:06.207 LOG <test0> [unlink] INFO: Deleted client 1557529823378
2019-05-10 23:15:06.207 CFY <test0> [unlink] Task succeeded 'dmaapplugin.mr_relationships.delete_mr_client'
2019-05-10 23:15:06.867 CFY <test0> [unlink] Sending task 'dmaapplugin.mr_relationships.delete_mr_client'
2019-05-10 23:15:07.929 LOG <test0> [unlink] INFO: Attempting to delete client 1557529820110
2019-05-10 23:15:08.469 LOG <test0> [unlink] INFO: Deleting URL: http://dmaap-bc:8080/webapi/mr_clients/1557529820110
2019-05-10 23:15:08.469 LOG <test0> [unlink] INFO: Deleted client 1557529820110
2019-05-10 23:15:09.102 CFY <test0> [unlink] Task succeeded 'dmaapplugin.mr_relationships.delete_mr_client'
2019-05-10 23:15:09.102 CFY <test0> [web_server_cqf9i4] Relationships unlinked
2019-05-10 23:15:09.645 CFY <test0> [web_server_cqf9i4] Deleting node instance
2019-05-09 2110 23:1915:5109.111 645 CFY <test0> [topic00_incvxj] Deleting node instanceweb_server_cqf9i4.delete] Sending task 'k8splugin.cleanup_discovery'
2019-05-09 2110 23:1915:5112.111 474 CFY <test0> [topic01web_34hei2server_cqf9i4.delete] Sending task Task succeeded 'dmaapplugink8splugin.mr_lifecycle.delete_topiccleanup_discovery'
2019-05-09 2110 23:1915:5113.690 113 CFY <test0> [topic00_incvxj.delete] Sending task 'dmaapplugin.mr_lifecycle.delete_topic'web_server_cqf9i4] Deleted node instance
2019-05-09 2110 23:1915:5413.373 LOG 773 CFY <test0> [topic01_xjti5i] Stopping node instance
2019-05-10 23:15:14.311 CFY <test0> [topic00_ehyrmr] Stopping node instance34hei2.delete] INFO: Deleting URL: http://dmaap-bc:8080/webapi/topics/org.onap.dmaap.mr.topic01
2019-05-09 2110 23:1915:5315.839 LOG 004 CFY <test0> [topic01_34hei2.delete] INFO: Attempting to delete topic org.onap.dmaap.mr.topic01xjti5i] Stopped node instance: nothing to do
2019-05-09 2110 23:1915:5415.373 LOG 004 CFY <test0> [topic00_incvxjehyrmr] Stopped node instance: nothing to do
2019-05-10 23:15:15.623 CFY <test0> [topic01_xjti5i] Unlinking relationships.delete] INFO: Deleting URL: http://dmaap-bc:8080/webapi/topics/org.onap.dmaap.mr.topic00
2019-05-09 2110 23:1915:5416.373 LOG 196 CFY <test0> [topic00_incvxj.delete] INFO: Attempting to delete topic org.onap.dmaap.mr.topic00ehyrmr] Unlinking relationships
2019-05-09 2110 23:1915:5516.023 196 CFY <test0> [topic00topic01_xjti5i] Relationships unlinked
2019-05-10 23:15:16.807 CFY <test0> [topic01_xjti5i] Deleting node instanceincvxj.delete] Task succeeded 'dmaapplugin.mr_lifecycle.delete_topic'
2019-05-09 2110 23:1915:5517.023 481 CFY <test0> [topic00_incvxj] Deleted node instanceehyrmr] Relationships unlinked
2019-05-09 2110 23:1915:5517.023 481 CFY <test0> [topic01_34hei2xjti5i.delete] Task succeeded Sending task 'dmaapplugin.mr_lifecycle.delete_topic'
2019-05-09 2110 23:1915:5518.700 122 CFY <test0> [topic01topic00_34hei2ehyrmr] Deleted Deleting node instance
2019-05-09 2110 23:1915:5618.265 CFY <test0> 'uninstall' workflow execution succeeded
Finished executing workflow uninstall on deployment test0
* Run 'cfy events list -e c64fff98-4277-4f07-8905-284c50c61f1c' to retrieve the execution's events/logs
Deleting deployment test0...
Deployment deleted
Deleting blueprint test0...
An error occurred on the server: 400: Can't delete blueprint test0 - There exist deployments for this blueprint; Deployments ids: test0
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# cfy blueprints delete test0
Deleting blueprint test0...
Blueprint deleted
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints122 CFY <test0> [topic00_ehyrmr.delete] Sending task 'dmaapplugin.mr_lifecycle.delete_topic'
2019-05-10 23:15:19.570 LOG <test0> [topic01_xjti5i.delete] INFO: Attempting to delete topic org.onap.dmaap.mr.topic01_name
2019-05-10 23:15:20.084 LOG <test0> [topic01_xjti5i.delete] INFO: Deleting URL: http://dmaap-bc:8080/webapi/topics/org.onap.dmaap.mr.topic01_name
2019-05-10 23:15:20.616 CFY <test0> [topic01_xjti5i.delete] Task succeeded 'dmaapplugin.mr_lifecycle.delete_topic'
2019-05-10 23:15:20.616 CFY <test0> [topic01_xjti5i] Deleted node instance
2019-05-10 23:15:21.133 LOG <test0> [topic00_ehyrmr.delete] INFO: Attempting to delete topic org.]# curl http://dmaap-bc:8080/webapi/topics/org.onap.dmaap.mr.topic00 | python -mjson.tool
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left _name
2019-05-10 23:15:21.133 LOG <test0> [topic00_ehyrmr.delete] INFO: Deleting URL: http://dmaap- Speed
100 92 100 92 0 0 842 0 --:--:-- --:--:-- --:--:-- 844
{
"code": 404,
"fields": "fqtn",
"message": "topic with fqtn org.onap.dmaap.mr.topic00 not found"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/topics/org.onap.dmaap.mr.topic001| python -mjson.tool
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 93 100 93 0 0 540 0 --:--:-- --:--:-- --:--:-- 540
{
"code": 404,
"topic00_name
2019-05-10 23:15:21.849 CFY <test0> [topic00_ehyrmr.delete] Task succeeded 'dmaapplugin.mr_lifecycle.delete_topic'
2019-05-10 23:15:22.628 CFY <test0> [topic00_ehyrmr] Deleted node instance
2019-05-10 23:15:23.263 CFY <test0> 'uninstall' workflow execution succeeded
Finished executing workflow uninstall on deployment test0
* Run 'cfy events list -e 352271ca-ed0d-4823-9ebf-b2fd827f1e83' to retrieve the execution's events/logs
Deleting deployment test0...
Deployment deleted
Deleting blueprint test0...
An error occurred on the server: 400: Can't delete blueprint test0 - There exist deployments for this blueprint; Deployments ids: test0
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# cfy blueprints delete test0
Deleting blueprint test0...
Blueprint deleted
[fields": "fqtn",
"message": "topic with fqtn org.onap.dmaap.mr.topic001 not found"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/topics/"org.onap.dmaap.mr_clients/1557435211391.topic00_name" | python -mjson.tool
% Total Total % Received % Xferd Average Speed Time Time Speed Time Time Time Current
Dload Upload Total Spent Dload Upload Total Spent Left Speed
100 81 100 81 0 0 4404 100 97 100 97 0 0 10192 0 --:--:-- --:--:-- --:--:-- 450010777
{
"code": 404,
"fields": "mrClientIdfqtn",
"message": "mrClientId 1557435211391 topic with fqtn org.onap.dmaap.mr.topic00_name not found"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/topics/"org.onap.dmaap.mr_clients/1557435213810.topic01_name" | python -mjson.tool
% Total Total % Received % Xferd Average Speed Time Speed Time Time Time Time Current
Dload Upload Total Spent Dload Upload Total Spent Left Speed
100 81 100 81 0 0 1889 0 100 97 100 97 0 0 6631 0 --:--:-- --:--:-- --:--:-- 19286928
{
"code": 404,
"fields": "mrClientIdfqtn",
"message": "mrClientId 1557435213810 not topic with fqtn org.onap.dmaap.mr.topic01_name not found"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]#
Examples of deploy/un-deploy commands, the curl commands for checking DMaap DBCL configuration, and screen output for all the blueprints are available in the attached file. <link to be added later>
Validation
<expected logs + consul entry + curl commands/postman + any other steps for verification from MS standpoint>
After deploying a blueprint, we run curl commands to query DMaap DBCL configuration. For example, after deploying test_mr_pubsub.yaml, we can check whether topic00 is created in DBCL:
curl http://dmaap-bc:8080/webapi/mr_clients/1557529820110 | python -mjson.tool
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 81 100 81 0 0 9157 0 --:--:-- --:--:-- --:--:-- 10125
{
"code": 404,
"fields": "mrClientId",
"message": "mrClientId 1557529820110 not found"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/mr_clients/1557529823378 | python -mjson.tool
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 81 100 81 0 0 1762 0 --:--:-- --:--:-- --:--:-- 3240
{
"code": 404,
"fields": "mrClientId",
"message": "mrClientId 1557529823378 not found"
}
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# /opt/consul/bin/consul kv export | grep key
"key": "dcae-dashboard",
"key": "dcae-hv-ves-collector",
"key": "dcae-prh",
"key": "dcae-snmptrap-collector",
"key": "dcae-tca-analytics",
"key": "dcae-ves-collector",
"key": "deployment_handler",
"key": "dmaap-plugin",
"key": "holmes-engine-mgmt",
"key": "holmes-rule-mgmt",
"key": "k8s-plugin",
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]#
The screen output for all the blueprints are available in the attached file. <link to be added later>
Validation
<expected logs + consul entry + curl commands/postman + any other steps for verification from MS standpoint>
After deploying a blueprint, we run curl commands to query DMaap DBCL configuration. For example, after deploying test_mr_pubsub.yaml, we can check whether topic00 is created in DBCL:
curl http://dmaap-bc:8080/webapi/topics/"org.onap.dmaap.mr.topic00_name" | python -mjson.tool
The return value of the query command is:
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/topics/"org.onap.dmaap.mr.topic00_name" | python -mjson.tool
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 715 100 715 0 0 36634 0 --:--:-- --:--:-- --:--:-- 37631
{
"clients": [
{
"action": [
"view",
"pub"
],
"clientRole": "org.onap.dcae.pnfPublisher",
"dcaeLocationName": "san-francisco",
"fqtn": "org.onap.dmaap.mr.topic00_name",
"lastMod": "2019-05-10T23:10:20.11",
"mrClientId": "1557529820110",
"status": "VALID",
"topicURL": "http://message-router:3904/events/org.onap.dmaap.mr.topic00_name"
}
],
"fqtn": "org.onap.dmaap.mr.topic00_name",
"lastMod": "2019-05-10T23:10:06.078",
"owner": "dcaeorch",
"partitionCount": "2",
"publisherRole": "org.onap.dmaap.mr.topic00_name.publisher",
"replicationCase": "REPLICATION_NONE",
"replicationCount": "1",
"status": "VALID",
"subscriberRole": "curl http://dmaap-bc:8080/webapi/topics/org.onap.dmaap.mr.topic00 | python -mjson.tool_name.subscriber",
"topicDescription": "No description provided",
"topicName": "topic00_name",
"type": "topic"
}
The output contains the client ID associated with the topic ("mrClientId": "1557529820110"). We use the client ID to check the client creation in DBCLThe return value of the query command is:
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/topics/org.onap.dmaap.mr.topic00mr_clients/1557529820110 | python -mjson.tool
% Total Total % Received % Xferd Average Speed Speed Time Time Time Time Time CurrentDload Upload Total Spent
Dload Upload Total Spent Left Speed
100 738 100 738 0 0 27245 100 320 100 320 0 0 9200 0 --:--:-- --:--:-- --:--:-- 28384
{
"clients": [11428
{
"action": [
"view",
"pub"
],
"clientRole": "org.onap.dcae.pnfPublisher",
"dcaeLocationName": "san-francisco",
"fqtn": "org.onap.dmaap.mr.topic00_name",
"lastMod": "2019-05-09T2010T23:5310:3120.39111",
"mrClientId": "15574352113911557529820110",
"status": "VALID",
"topicURL": "http://message-router:3904/events/org.onap.dmaap.mr.topic00_name"
}
],
"fqtntype": "org.onap.dmaap.mr.topic00",
"globalMrURL": "message-router",
"lastMod": "2019-05-09T20:53:19.247",
"owner": "dcaeorch",
"partitionCount": "2",
"publisherRole": "org.onap.dmaap.mr.topic00.publisher",
"replicationCase": "REPLICATION_EDGE_TO_CENTRAL_TO_GLOBAL",
"replicationCount": "1",
"status": "VALID",
"subscriberRole": "org.onap.dmaap.mr.topic00.subscriber",
"topicDescription": "No description provided",
"topicName": "topic00",
"type": "topic"
}
The output contains the client ID associated with the topic ("mrClientId": "1557435211391"). We use the client ID to check the client creation in DBCL:
"mr_Client"
}
Similarly we can verify the creation of topic01 and its client.
The consul kv should contain the service's information.
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# /opt/consul/bin/consul kv export | grep key
"key": "dcae-dashboard",
"key": "dcae-hv-ves-collector",
"key": "dcae-prh",
"key": "dcae-snmptrap-collector",
"key": "dcae-tca-analytics",
"key": "dcae-ves-collector",
"key": "deployment_handler",
"key": "dmaap-plugin",
"key": "holmes-engine-mgmt",
"key": "holmes-rule-mgmt",
"key": "k8s-plugin",
"key": "s61b2002abe554457a78050174c431719-nginx-web",
"key": "s61b2002abe554457a78050174c431719-nginx-web:dmaap",
The detailed dmaap information of the new service is available in the value of key s61b2002abe554457a78050174c431719-nginx-web:dmaap:
[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# /opt/consul/bin/consul kv get s61b2002abe554457a78050174c431719-nginx-web:dmaap | python -mjson.tool
{
"topic00": {
"client_id": "1557529820110",
"client_role[root@dev-dcaegen2-dcae-bootstrap-55cb5596b7-phdct blueprints]# curl http://dmaap-bc:8080/webapi/mr_clients/1557435211391 | python -mjson.tool
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 311 100 311 0 0 4675 0 --:--:-- --:--:-- --:--:-- 4712
{
"action": [
"view",
"pub"
],
"clientRole": "org.onap.dcae.pnfPublisher",
"dcaeLocationNamelocation": "san-francisco",
"fqtn": " "topic_url": "http://message-router:3904/events/org.onap.dmaap.mr.topic00_name"
},
"lastModtopic01": "2019-05-09T20:53:31.391{
"client_id": "1557529823378",
"mrClientIdclient_role": "1557435211391org.onap.dcae.pnfSubscriber",
"statuslocation": "VALIDsan-francisco",
"topicURLtopic_url": "http://message-router:3904/events/org.onap.dmaap.mr.topic00",
"type": "mr_Clienttopic01_name"
}
...
}
After validation we undeploy the blueprints with command "cfy uninstall test0". Then we rerun the validation to make sure that the newly create topics and their clients are deleted from DMaap DBCL and consul.