Introduction
The documentation aims in providing brief overview on the process involved in onboarding new MS onto DCAE GEN2 controller platform and integration with SDC, Policy and CLAMP for modelling, design and service instantiation.A more comprehensive documentation will be follow and delivered part of documentation project.
The DCAE Controller includes following components (some of them are docker containers). The platform docker components will be deployed via platform level blueprint. This is outside of the scope of this document.
- Cloudify Manager
- Consul
- DeploymentHander
- Policy-Handler
- ServiceChangeHandler
- Inventory-API
- Postgres
- Registrator
- ConfigBinding Service
- CDAP Broker
For component/MS to be deployed into DCAE platform would go through below phases
- Onboarding Phase
- Design Phase
- Runtime
Onboarding
During this phase, each of the component owner should create a meta data describing the components.
There are two main artifacts required to be defined
Data-Formats
Data formats are descriptions of data---they are the data contract between your component and other components. You need to describe the available outputs and assumed inputs of your components as data formats. These data descriptions are onboarded into SDC
Schema Definition
Example: VES-4.27.2-data-format
Component-spec
The component specification is a JSON that is used to describe and configure your component. The component specification contains the following top-level groups of information:
- Component metadata
- Component interfaces including the associated data formats
- Configuration parameters
- Auxiliary details
- List of artifacts
Schema Definition
Example: VESCollector
vescollector-componentspec.json
The developers will upload the spec (data-formats, component spec) developed into catalog using dcae_cli/tosca tool. Once validated, spec’s will be published into SDC catalog so they can be used for service creation.
Design Phase
Design comprises of two steps.
Template creation
The TOSCA models generated from onboarding is used here to do this composition. Using SDC designer tool – individual reusable templates are created and stored in catalog.
Service Composition
Once the designer template is created, they can be used for Service composition (in SDC/CLAMP) to generate a Cloudify blueprint.
Once approved, SDC sends notification via an event onto a message router topic for DCAE-ServiceChangeHandler, which queries SDC to retrieve the blueprint and store into DCAE inventory.
Runtime
Instantiation flow is triggered by update from ASDC/CLAMP where the DCAE controller deploys the components associated with service which is identified in the cloudify blueprint.
Once Dispatcher receives the triggering event (e.g. instantiation of service/component), it gets the corresponding blueprint from Inventory and then loads into Cloudify manager where the blue print is executed to deploy the service components.
The complete flow with DCAE platform is depicted below.
Sample code to fetch configuration from Configbinding service
Configuration from DCAE Controller
For Docker containers, the configuration identified part of MS component-spec is retrieved from Configbinding service during application start-up; the data is represented as key-value pair. The Docker MS should parse the configuration and apply within MS as required.
Below is sample Configuration for VESCollector retrieved from DCAE platform (configbinding service).
{
"collector.keystore.alias": "dynamically generated",
"collector.service.port": 8080,
"collector.keystore.file.location": "/opt/app/dcae-certificate/keystore.jks"
"header.authflag": 0,
"collector.service.secure.port": -1,
"collector.schema.file": "./etc/CommonEventFormat_27.2.json",
"tomcat.maxthreads": "200",
"collector.dmaap.streamid": "fault=sec_fault,roadm-sec-to-hp|syslog=sec_syslog|heartbeat=sec_heartbeat|measurementsForVfScaling=sec_measurement|mobileFlow=sec_mobileflow|other=sec_other|stateChange=sec_statechange|thresholdCrossingAlert=sec_thresholdCrossingAlert",
"collector.schema.checkflag": 1,
"collector.keystore.passwordfile": "/opt/app/dcae-certificate/.password",
"collector.inputQueue.maxPending": 8096,
"header.authlist": "userid1,base64encodepwd1|userid2,base64encodepwd2",
"sec_measurement": {
"dmaapUserName": "m06682@secCollector.att.com",
"dmaapPassword": "dummy!",
"topic_url": "https://dcae-local.homer.att.com:3905/events/com.att.dcae.dmaap.FTL2.SEC-FAULT-OUTPUT"
},
"sec_fault_unsecure": {
"topic_url": "http://ueb.it.att.com:3904/events/DCAE-SE-COLLECTOR-EVENTS-DEV"
},
"sec_fault": {
"dmaapUserName": "m06682@secCollector.att.com",
"dmaapPassword": "dummy!",
"topic_url": "https://dcae-local.homer.att.com:3905/events/com.att.dcae.dmaap.FTL2.SEC-MEASUREMENT-OUTPUT"
},
"sec_measurement_unsecure": {
"topic_url": "http://ueb.it.att.com:3904/events/DCAE-SE-COLLECTOR-EVENTS-DEV"
}
}