Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Minimum Viable Product

...

  • CI/CD running on onapci.org
  • Automatic unit testing, CSIT testing, and end-to-end testing
  • Guidelines, frameworks, or best practice recommendations on S3P testing for ONAP project teams

Functionalities

List the functionalities that this release is committing to deliver by providing a link to JIRA Epics and Stories. In the JIRA Priority field, specify the priority (either High, Medium, Low). The priority will be used in case de-scoping is required. Don't assign High priority to all functionalities.

...

Jira
serverONAP JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
maximumIssues20
jqlQueryproject=sanbox and issuetype in (story)
serverId425b2b0a-557c-3c0c-b515-579789cceedb

Longer term roadmap

...

It provides all the cross-project infrastructure framework and DevOps toolchain (Continuous Integration, etc.), code and scripts, best practice guidance, benchmark and testing reports and white papers related to:

  • Cross-project Continuous System Integration Testing (CSIT)
  • End-to-End (ETE) release use cases testing with VNFs with repeatability
  • CI/CD to ONAP community integration labs
  • Reference VNFs that can be used to show how the ONAP platform handles

Release Deliverables

Indicate the outcome (Executable, Source Code, Library, API description, Tool, Documentation, Release Note...) of this release.

To fill out
Deliverable NameDeliverable DescriptionTo fill out
oParentPOM file with recommended Java library versions
RobotExecutable for integration use case testing
DemoExecutable for use case VNFs
IntegrationScripts to deploy ONAP and test use cases

Sub-Components

List all sub-components part of this release.
Activities related to sub-components must be in sync with the overall release.

...

Refering to CII Badging Security Program and Platform Maturity Requirements, fill out the table below by indicating the actual level , the targeted level for the current release and the evidences on how you plan to achieve the targeted level.

Area

Actual Level

Targeted Level for current Release

How, Evidences

Comments

ManageabilityNot Measured

  • 1 – single logging system across components; instantiation in < 1 hour
  • 2 – ability to upgrade a single component; tracing across components; externalized configuration management
PerformanceNot Measured

  • 0 -- none
  • 1 – baseline performance criteria identified and measured
  • 2 & 3 – performance improvement plans created & implemented
Stability
Resiliency
  • 0 – none
  • 1 – 72 hours component level soak w/random transactions
  • 2 – 72 hours platform level soak w/random transactions
  • 3 – 6 months track record of reduced defect rate
Resiliency
3

Will cover geo-redundancy if lab env supports it.

All Integration team will perform platform-level testing similar to:

Beijing Release Resiliency Testing Status

  • 0 – none
  • 1 – manual failure and recovery (< 30 minutes)
  • 2 – automated detection and recovery (single site)
  • 3 – automated detection and recovery (geo redundancy)
ScalabilityNot Measured

  • 0 – no ability to scale
  • 1 – single site horizontal scaling
  • 2 – geographic scaling
  • 3 – scaling across multiple ONAP instances
SecurityNot Measured

  • 0 – none
  • 1 – CII Passing badge + 50% Test Coverage
  • 2 – CII Silver badge; internal communication encrypted; role-based access control and authorization for all calls
  • 3 – CII Gold
Scalability
Stability2

Integration team will perform platform-level testing similar to:

Beijing Release Stability Testing Status (w/ OOM)

Beijing Release Stability Testing Status (w/ HEAT)

  • 0 –
no ability to scale
  • none
  • 1 –
single site horizontal scaling
  • 72 hours component level soak w/random transactions
  • 2 –
geographic scalingManageability
  • 1 – single logging system across components; instantiation in < 1 hour
  • 2 – ability to upgrade a single component; tracing across components; externalized configuration management
Usability
  • 72 hours platform level soak w/random transactions
  • 3 –
scaling across multiple ONAP instances
  • 6 months track record of reduced defect rate
UsabilityNot Measured

  • 1 – user guide; deployment documentation; API documentation
  • 2 – UI consistency; usability testing; tutorial documentation


  • API Incoming Dependencies

...

API NameAPI DescriptionAPI Definition DateAPI Delivery dateAPI Definition link (i.e.swagger)
To fill outHigh level description of the APIDate for which the API is reviewed and agreedTo fill outLink toward the detailed API description
  • API Outgoing Dependencies

API this project is delivering to other projects.

...

SDC BE APISDC Backend APIM3M3
SO APISO REST APIM3M3
A&AI APIA&AI REST APIM3M3
SDNC APISDNC REST API for preloadM3M3
  • API Outgoing Dependencies

None

...

  • Third Party Products Dependencies

Third Party Products mean products that are mandatory to provide services for your components. Development of new functionality in third party product may or not be expected.
List the Third Party Products (OpenStack, ODL, RabbitMQ, ElasticSearch,Crystal Reports, ...).


Name

Description

Version

To fill outTo fill out

Chaos MonkeyResilience Testing tool

Docker

Container platform
JenkinsCI/CD tool
JMeterPerformance Testing tool
OpenstackCloud OS
RobotTesting framework
To fill out

In case there are specific dependencies  (Centos 7 vs Ubuntu 16. Etc.) list them as well.

...

Describe the plan to integrate and test the release deliverables within the overall ONAP system.
Confirm that resources have been allocated to perform such activities.

The goal is to automate all the unit testing, CSIT testing, and end-to-end testing in release Casablanca. The detailed test roles and responsibilities are listed below.

Types of Testing

Dev.

(Project Team)

CSIT

(Project Team)

E2E

(Integration Team)

S3P

(Project + Integration)

Usability Testingx


Unit Testingx


Stability Testing


x
Security Testing


x
Scalability Testing


x
Regression Testingxxxx
Performance Testing


x
Integration/Pair-Wise Testing
x

Install/Uninstall Testingx


Feature/Functional Testingx


End-to-End Testing

x
ONAP Upgrade Testingx
x
  • Gaps

This section is used to document a limitation on a functionality or platform support. We are currently aware of this limitation and it will be delivered in a future Release.
List identified release gaps (if any), and its impact.

...

Risk identifiedMitigation PlanContingency Plan
Need additional lab resources (RAM, disk, network bandwidth, etc.)NoneNoneTo fill outTo fill outTo fill out
  • Resources

Fill out the Resources Committed to the Release centralized page.

...