Integrating PNDA

Created by Donald Hunter, last modified on Oct 05, 2018

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

The goal of this DCAE project is to provide the PNDA platform as a deployment option that delivers a big-data analytics platform as part of DCAE.

Overview

Overview presentation of DCAE-PNDA-Overview.pdf.

High level summary of tasks:

Installation of PNDA within DCAE:

Create blueprint for PNDA infrastructure deployment with Cloudify DCAEGEN2-366
Build and package PNDA mirror DCAEGEN2-367
Deploy PNDA onto infra using Saltstack DCAEGEN2-368

Health-Check (PNDA to integrate with DCAE health check):

Implement PNDA monitoring in Consul DCAEGEN2-369

Enable Application Deployment on PNDA via DCAE:

Develop Cloudify plugin for PNDA package deployment DCAEGEN2-370

Data Integration (Enable PNDA to receive data from DCAE collectors like VES, etc.)

Integrate PNDA with DMaaP DCAEGEN2-371

Applications for PNDA

Create PNDA applications for test/demo purposes (e.g. similar to current TCA)
( DCAEGEN2-632 - Getting issue details... STATUS - partially worked on as part of DCAEGEN2-371 - Getting issue details... STATUS )

Release related information

Casablanca M3 Milestone for PNDA integration into DCAE:

Support for HDFS API,
- VES data available in HDFS
Support for Spark Streaming API
Support for Spark Batch API
Jupyter Notebook

PNDA 5.0 Components versions

The source of truth regarding versions is available in the PNDA 5.0 release note.

Component	Version
Kafka	1.1.0
Kafka Manager	1.3.3.15
PNDA Deployment Manager	XXX
PNDA Package Repository	XXX
PNDA Console	XXX
Gobblin	0.11.0
Flink	1.4.2
Knox	1.1.0
HortonWorks	2.6.5
	Hadoop	2.7.3
	HBase	1.1.2
	Hive	2.1.0
	Spark	1.6.3
	Spark	2.3.0
	Oozie	4.2.0
Grafana	5.1.3
OpenTSDB	2.3.0
Consul	1.0.3
Jupyter	4.2.1

pnda API's

As part of the ongoing dcae integration with the pnda data platform, here are some pointers defining the provided pnda API’s:

Platform Data Management: https://github.com/pndaproject/platform-data-mgmnt/blob/develop/data-service/README.md
Platform Deployment Manager https://github.com/pndaproject/platform-deployment-manager#api-documentation
Platform Package Repository https://github.com/pndaproject/platform-package-repository#repository-api

List of JIRA tickets associated with PNDA for DCAE - Casablanca

Key	Summary	T	Created	Updated	Due	Assignee	Reporter	P	Status	Resolution

Loading...

Refresh

List of JIRA tickets associated with PNDA for DCAE - Backlog

Key	Summary	T	Created	Updated	Due	Assignee	Reporter	P	Status	Resolution

Loading...

Refresh

Content presented at ONS.EU 2018

PNDA Integration into ONAP DCAE - Slideset

PNDA Analytics Application within DCAEgen2 - Video

ONAP DCAE vFW Data in PNDA - Recording.m4v

No labels