Project Maturity Review for DCAE

Review Submission Date : 08 Jul 2020 

Project Description: 

DCAE project provides intelligence for ONAP to support automation (via open-loop and CL) by performing network data collections, analytics & correlation and trigger actionable rootcause events.

DCAE components are classified between platform and service components.  DCAE Platform refers to the set of controller components which manages deployment and LCM of DCAE service components. The DCAE services components includes all the microservices - collectors, analytics and event processor which supports active data-flows and processing as required by ONAP usecases.

The architecture of DCAE targets flexible, micros-service oriented, model based component design and deployment. DCAE also offers support for multi-site collection and analytics operations which are essential for large ONAP deployments. 

Project Landing Page:  Data Collection Analytics and Events Project

Project Meeting Minutes: DCAE Project Meetings

Leadership Resources :

Project & Release History

• How long the project has been an active:  DCAE Project has been an active ONAP Project since Amsterdam and has participated in ALL releases through Frankfurt.
• Release Participation:  All ONAP releases
• Engagement levels for past releases (up to 3): 
  • Commits per Release:  see below
  • Contributors per Release: see below
  • Companies per release: see below

Statistics taken from Bitergia : https://onap.biterg.io/app/kibana#/dashboard/Overview

Bitergia Statistics from the Last 2 Years

• Use Cases:  DCAE is pretty much involved in all use cases as DCAE services components are involved in collection/analytics processing.

  • vFirewall

  • Scale Out

  • vCPE

  • CCVPN

  • 5G OOF SON

  • BBS

  • MDONS
  • E2E Slicing 

Architecture Alignment:

• Latest review (Frankfurt) happened on : Jan'2020 -  DCAE R6 - M3 Architecture Review
• Latest Architecture documentation : ARC DCAE Component Description - Guilin (R7) Release  & https://wiki.onap.org/pages/viewpage.action?pageId=84656882 (Pending review)

Artifact Information:

DCAE project includes following repositores. DCAE components are classified between core-platform and service components which are dynamic in nature. 

Platform Components

• dcaegen2/deployments  - For hosting configurations and several init containers for deployments
• dcaegen2/platform  - Top level repo for dcaegen2/platform (contains sub-projects)
• dcaegen2/platform/blueprints - Blueprint for DCAE controller and bootstrap container
• dcaegen2/platform/configbinding  - Configbinding api service
• dcaegen2/platform/deployment-handler Deployment handler providing interface to CLAMP/Dashboard
• dcaegen2/platform/inventory-api - DCAE inventory API service
• dcaegen2/platform/plugins - Plugins for DCAE controller (cloudify)
• dcaegen2/platform/policy-handler  - Policy handler to retrieve active policy configuration for DCAE services
• dcaegen2/platform/servicechange-handler   -  Service Change handler for retrieving blueprints from SDC via DMaap
• dcaegen2/utils  - For hosting utility/tools code used cross components
• ccsdk/dashboard  - DCAE Dashboard for operation/management 
• dcaegen2 -  Documentation repo

Service Components

• dcaegen2/analytics/tca  - Threshold crossing analytics based on CDAP
• dcaegen2/analytics/tca-gen2 - Standalone TCA based on Sping-boot
• dcaegen2/collectors/datafile -  Data File collector
• dcaegen2/collectors/hv-ves - High Volume VES Collector 
• dcaegen2/collectors/restconf - RESTConf Collector
• dcaegen2/collectors/snmptrap  - SNMP Trap collector 
• dcaegen2/collectors/ves -  VNF Event Streaming collector
• dcaegen2/services   - DCAE Service component (contains sub-projects)
• dcaegen2/services/heartbeat - Missing Heartbeat Micro Services
• dcaegen2/services/mapper - VES Mapper Micro Services
• dcaegen2/services/pm-mapper - Mapper to process files from DR and transform to VES
• dcaegen2/services/prh - PNF Registration Handler
• dcaegen2/services/sdk - Common SDK repo for all DCAE Services (R4)
• dcaegen2/services/son-handler - SON-handler service

Code Coverage: https://sonarcloud.io/organizations/onap/projects?search=dcaegen

Deliverables

• Docker containers 
• DCAE Libraries
• Wagon files 

Documentation

• DCAE Architecture
• DCAE Deployment
• DCAE Design Platform 
• DCAE SDK
• DCAE Offered API's
• Onboarding Specification
• DCAE Performance Test

User Guide 

• DCAE MOD Userguide
• DCAE Service Component

Integation Support

DCAE team has been improving upon current CSIT and automated test via gating. In Frankfurt, DCAE team worked with Integration to setup several usecase test part of "Smoke Usecases" executed under gating job. Following service/usecase flow are incorporated in the gating

• 5gbulkpm
• hv-ves
• pnf-registrate

Companies that run ONAP DCAE

To our knowledge, the following companies have used ONAP DCAE components : AT&T, Bell Canada, Nokia, Ericsson, Wipro, China Mobile. As VES is approved standard for xNF integration for ONAP, many of DCAE collector/services are actively used for data collection/processing. 

DCAE Platform is running in production within AT&T since 2017. 

Other Information:

Being one of largest ONAP project (40+ active containers, 30+ repository), DCAE strives to adhere to ONAP code quality by improving its codebase with each release.  Many companies have already contributed to DCAE, showing the interest of the community for the project. DCAE components is also a starting point to discuss standards and implement representations of xNFs. 

VES standardization which is now recently adopted by 3GPP was successful through active contribution/support from DCAE team. VES is also used a internal event standard for all communications with analytics/correlation MS to simplify integration of new services.

DCAE plays vital role in control Loop execution in ONAP. DCAE team has been working on CL committee with CLAMP and Policy team to simplify control loop design and execution in ONAP.

DCAE Demo/Videos

• Frankfurt Release - PMSH and TCA-GEN2 
• Frankfurt Release - MOD & Acumos Adapter  
• ONAP Community Awards: El-Alto Release (Demos Only) (Awarded as Winner)
• Dublin Release -  PM-Mapper & BBS_Event Processor MS
• Dublin Release - VES-Mapper and SON-Handler MS 
• Dublin Release - Dashboard & DCAE Multisite deploy (K8s plugin) 
• Dublin Release - RESTConf Collector & Heartbeat MS
• Dublin Release - Blueprint generator 
• Dublin Release - Datalake (PoC):
• Dublin Release - Walkthrough on BP generation to ONAP K8S deployment via Dashboard
• Dublin Release - Helm Plugin

DCAE Presentation

• ONS Conference in California (2018)
• OPEN DDF Plugfest in Nozay, France (2019)
• DCAE Orchestration for Edge deployment - California (2019)
• Presentation at LF June DDF in Sweden (2019)
• ONAP DDF Plugfest in Belgium (2019)