You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 49 Next »

The purpose of the page is to:

  1. Design the Model Driven CPS PoC REQ-384 - Getting issue details... STATUS
  2. Start the design of a stand-alone CPS
  3. Engage with the CPS community on the design of the stand-alone CPS
  4. Review with the ARCHCOM to ensure broad ONAP community awareness and agreed direction

PoC Overview Diagram

Topic Areas

Topic AreaDescription

MODEL DRIVEN SCHEMA: Relates to Design time activities. SDC operation. Distribution of the CSAR and the Model-driven Schema coming from Design time

UPDATE: Takes incoming Standards Defined VES event from DCAE (PNF) and is published on DMAAP

SYNCHRONIZATION: C&PS synchronizes to A&AI, which allows it to get the latest view of what is in A&AI and align it with the C&PS data records.

SERVICE PROVIDER INTERFACE: The C&PS interface to the DBMS

C&PS API: The API that allows other micro-services and other components to access C&PS DB with CRUD operations.

Scope

Base scope

  • Read/write persisted Configuration Management data:
    • defined by xNF (simple YANG model), published as YANG
  • Models deployed @ runtime with no ONAP platform impacts or LCM events
  • Show the benefits in terms of constraint validation, access and upgrade

Stretch target

Adapt behavior of CPS on read/write based on information in the model:

  • Change notification emissions driven by the model
  • Interaction with temporal data store, synergize with State Management PoC
  • Volatile/prolific xNF data read-through (e.g. state data) – may be used to support histogram
  • Model made available to CPS (Configuration and Persistency Service) using existing onboarding via SDC
  • Provide some indication of dimension and user access characteristics that will be provided by CPS

Proof points

  • Demonstrate Create/read operations using YANG fragments against a CPS backed by very simple schema / schema-less repository
  • Demonstrate ability to deploy / upgrade YANG fragments at run-time
  • Demonstrate CPS behavior driven by YANG model
  • Provide architecture vision and roadmap for a target architecture, supported use cases, non-functional requirements towards an ONAP Project

Out of scope

  • Automating the ingestion of models from SDC or controller (unless we get to it in the stretch target). The model LCM interface will be exercised manually during the PoC.
  • Syncing with A&AI. The PoC will work on a fixed topology

High Level Design

Context of CPS

Interface IdPurpose

AAIE-1Read and maintain relevant parts of the topology

SDCE-6React to CSAR packages (on-boarded in SDC) that contain models of interest

CPS-E-01Model lifecycle (add and remove models)

CPS-E-02Data access interface (CRUD)

CPS-E-03Notification of data change (configured by model)

C4 diagram of main components

Logical view of the CPS as a project

Participant NameFunctional purposePoC handling
YANG Model parserConverts YANG models into java objectsRequired
YANG Data parserConverts data compliant with a YANG model into java primitives, assists the CPS coreRequired
Model storeKeeps a local cache of the structures and relationships (generated from the YANG models) required by the CPSRequired
SDC Model loaderSubscribes to DMaaP for CSAR publication. Parses and extracts the models from the CSAR and gives them to the mirror serviceNot required
Topology syncDoes initial sync and maintains an up to date view of the active topology state. Informs the mirror service of any changesNot required
Mirror serviceEncapsulation of all model and data access that relates to xNFNot required
Mirror Data accessREST interface that provides access to xNF dataNot required
CPS CoreProvides validation of and access to data. Is agnostic to the DB technology and schemaRequired
CPS Data accessProvides REST CRUD access to the dataRequired
CPS notificationProvides a DMaaP notification in the event that (1) data is changed and (2) it has been tagged/marked for notifcationRequired for stretch
PostgreSQL pluginMaps the java primitive representation of the YANG data objects to their DB technology (PostgreSQL) and schema specifics (SQL)Required
PostgreSQLDatabase Management System for current dataRequired
Temporal [Stack]Placeholder for logical components representing the temporal handling of dataNot required
Temporal DBDatabase Management System for temporal dataNot required

The blue software encapsulates the handling of models and data related to xNF (mirrored data). This implementation is not required to prove the model driven aspects of the CPS.

The pink software encapsulates the integration with other data stores. This is being taken by the temporal DB PoC. This PoC needs to provide a feed of change notifications for any joint demonstrations. Configuring the parts of the model that will emit change notifications is part of the stretch goal.

Model handling

Below a simplified view of model handling artifacts and their relationships.

Model artefacts

The run-time artifacts are shaded (orange). A typical simplified flow:

  • A document representing xNF data is given to the CPS.
  • It will parse (and validate) the document,
  • Map data to the generic DB schema and store data.

In order for this to work:

  • The document must be compliant to an xNF schema model. This schema model describes the structure of the data and any constraints that need to be checked to ensure integrity.
  • The xNF schema model must be written in YANG. This language describes syntax and capabilities (basic concepts).
  • A Yang parser is required to interpret documents compliant with the YANG language. The parser is dependent on the language.
  • To store data in a DBMS, typically a schema is required. This is denoted above as, 'Generic schema model'.
  • Obviously the xNF schema model and the Generic schema model are not the same. Therefor a mapping is required. Depending on how simple/generic/abstract the generic schema model, the mapping may be coupled with either the language or the xNF schema model. One of the aims of the PoC is to be agnostic to the xNF model at run-time, thus the mapping is made to the YANG language.
  • To support multiple container run-times (Java, Python, Go, Rust, ...) for the CPS, the mapping is described in a 'Language Capability Map'.
  • The model mapper depends on the language capability map and the Yang parser (in particular the java representation of the language features).

Model ingestion

Model ingestion is subject to a design discussion. See below. This section will be updated when that discussion has been concluded and a decision made.

Note that for the purposes of the PoC, model ingestion will be via a model life-cycle REST interface.

Model upgrade

T.B.D. See Upgrade of models for discussion and decision

Backward compatibility

See decision for more information. Compatibility will be provided by either a dedicated component, or ONAP applications depending on legacy interfaces will be updated. This will depend on resources.

Detailed design

Key sequences/flows

Add a model

Store data (including validation)

Read data

Reading data is very similar to storing data. The uuid of the model instance is assumed. Validation is not needed. Queries will need to be processed and mapped to DB technology specifics.

Upgrade a model

T.B.D. Needs to wait until upgrade behavior is specified.

Adapt change notification behavior as described in model

T.B.D. Show how the model spec is used to control interactions between CPS Core and CPS Notification

Interfaces

Style and payload structure

Pending decisions: Data Representation and Interface style

REST payload structure
Java payload structure
Access methods
NameInterfaceDescriptionParametersReturn
Add modelCPS-E-01Add a YANG model to the CPS so that compliant data may be stored & retrieved
  • YANG model
Some identifier
Remove modelCPS-E-01Mark a model for removal, and remove when no data remains that relies on the model
  • Model identifier
Success/Number of model instances still using model
Upgrade modelCPS-E-01T.B.D
  • YANG model
  • Model identifier
-
Create model instanceCPS-E-02Prepare the underlying DB for the storage of data compliant to the model.
  • Model identifier
  • Instance unique identifier
Model instance identifier
Delete model instanceCPS-E-02Remove the data and any artifacts from the underlying DB
  • Instance unique identifier
Success/Failure
Create dataCPS-E-02[Validate &] Store data compliant to a model
  • Instance unique identifier
  • Data structure/document
Success/Failure
Replace dataCPS-E-02[Validate &] Store data compliant to a model in place of existing data
  • Instance unique identifier
  • Data structure/document
Success/Failure
Update dataCPS-E-02[Validate &] Update data that is (1) compliant to a model and (2) already stored
  • Instance unique identifier
  • Data structure/document
Success/Failure
Delete dataCPS-E-02Remove data from a model instance
  • Instance unique identifier
  • Data structure/document
Success/Failure
Data change notificationCPS-E-03Notify interested parties that data (marked as interesting by the model) has been modified
  • Instance unique identifier
  • Data structure/document
  • Previous data structure/document
-
Service Provider Interface (SPI)

T.B.D. An internal interface that defines how the CPS Core will interact with the DBMS. The design of the SPI will be informed by agreed CPS behavior and minimum requirements for the DBMS.

The SPI is required to ensure that different DB technologies can be used in different deployments.

Behavior

T.B.D.: Eventual consistency; Data integrity guarantees; Fast failure; Progress; Cancellation;

REST

Will be specified as part of the PoC execution, and updated/referenced from here

This will follow REST rules and guidelines as defined by ONAP documentation (TODO: add link)

Java

Will be specified as part of the PoC execution, and updated/referenced from here

Decision reference

Issues decisions and assumptions

  • No labels