DRAFT PROPOSAL FOR COMMENTS
The content of this template is expected to be fill out for M1 Release Planning Milestone.
Info | ||
---|---|---|
| ||
Use the "Copy" and "Move" options (available under the ..., top right of this page) to duplicate this template into your project wiki. |
Table of Contents | ||
---|---|---|
|
Overview
Project Name | Enter the name of the project |
---|---|
Target Release Name | Enter the name of the release you are targeting to deliverDublin |
Project Lifecycle State | Either Incubation, Core, Mature. Refer to ONAP Charter, section 3.3 Project Lifecycle for further information |
Participating Company List the company participating in this release. At least 3-4 organizations, including an operator are recommended. | AT&T, CMCC, China Telecom, ENEA, Ericsson, Huawei, Intel, Nokia, Orange |
Scope
What is this release trying to address?
...
Scope | Priority | Committer Lead | Resources Committed | Epic | Dependencies | ||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Do Not Break the Build | Highest | Yang Xu | Yang Xu Marco Platania |
| |||||||||||||||||||||||||||||||||
oParent Update for Security Vulnerability | Highest |
| |||||||||||||||||||||||||||||||||||
Use Case Testing | Highest | everyone in integration team, see use case owners below | |||||||||||||||||||||||||||||||||||
ONAP CI Enhancement | Highest |
| |||||||||||||||||||||||||||||||||||
Maintain ONAP Integration Testing Infrastructure | Highest |
| |||||||||||||||||||||||||||||||||||
S3P Testing Enhancement | High |
| |||||||||||||||||||||||||||||||||||
vCPE Use Case Test Automation | High |
| |||||||||||||||||||||||||||||||||||
Use Case Development for vFW and Scaling | High |
| |||||||||||||||||||||||||||||||||||
CIA Project | High |
|
Use Cases
Use Case Test Cases | Lab | Responsible | EPIC | |
---|---|---|---|---|
1 | vFW / vDNS | Intel / Windriver | ||
2 | vCPE Integration Test Case | Intel / Windriver | ||
3 | vCPE with TOSCA VNF Test Case | CMCC | ||
4 | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Status | TLab | ||
5 | 5G - PNF PnP - Integration Test Status | TLab | ||
6 | 5G - Bulk PM - Test Status | Intel / Windriver | ||
7 | 5G - OOF and PCI - Integration Test Cases | Intel / Windriver | ||
8 | Scale Out - Integration Test Cases and Status | Intel / Windriver | ||
9 | CCVPN Integration Test Cases | CMCC | ||
10 | vFW/vDNS HPA Regression and Enhancement Testing(HPA & Cloud Agnostic Intent - R3 Test Plan) | Intel / Windriver | ||
11 | Change Management - Flexible Designer & Orchestrator | Intel / Windriver | ||
12 | Change Management - Traffic Management- | Intel / Windriver | ||
13 | Intel / Windriver | |||
14 | Change Management - Schedule optimization | Intel / Windriver | ||
15 | BBS (Broadband Service) | Swisscom, CMCC, Huawei, Nokia | ||
16 | 5G Slicing (scope is not clear, need to wait for TSC requirement) | AT&T, Nokia, Ericsson | ||
17 | vFW on ARM (no integration commitment, vendor will cover all tests) | ARM, ENEA | ||
18 | Model driven control loop design | AT&T, Nokia | Testing confirmed by AT&T | |
19 | K8S based cloud region support | Intel, VMWare | Testing confirmed by Intel | |
20 | Distributed Analytics as a Service (Dublin Summary) - Edge Automation | VMWare, Intel | Testing confirmed by Intel | |
21 | Consistent ID of a Cloud Region | Windriver, AT&T, CMCC | Need to talk to Bin Yang about testing resource |
Minimum Viable Product
- CI/CD running on onapci.org
- Automatic unit testing, CSIT testing, and end-to-end testing
- Guidelines, frameworks, or best practice recommendations on S3P testing for ONAP project teams
Describe the problem being solved by this release
Use Cases
Describe the use case this release is targeted for (better if reference to customer use case).
Minimum Viable Product
...
Functionalities
List the functionalities that this release is committing to deliver by providing a link to JIRA Epics and Stories. In the JIRA Priority field, specify the priority (either High, Medium, Low). The priority will be used in case de-scoping is required. Don't assign High priority to all functionalities.
Epics
Jira server ONAP JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution maximumIssues 20 jqlQuery project=sanbox "integration" and issuetype in (epic) ="epic" and status!=closed serverId 425b2b0a-557c-3c0c-b515-579789cceedb
Stories
Jira server ONAP JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution maximumIssues 20 jqlQuery project=sanbox integration and issuetype in (story) and status!=closed serverId 425b2b0a-557c-3c0c-b515-579789cceedb
Longer term roadmap
...
It provides all the cross-project infrastructure framework and DevOps toolchain (Continuous Integration, etc.), code and scripts, best practice guidance, benchmark and testing reports and white papers related to:
- Cross-project Continuous System Integration Testing (CSIT)
- End-to-End (ETE) release use cases testing with VNFs with repeatability
- CI/CD to ONAP community integration labs
- Reference VNFs that can be used to show how the ONAP platform handles
- VNF installation and
- VNF life cycle management
- VNF Requirement compliance
Release Deliverables
Indicate the outcome (Executable, Source Code, Library, API description, Tool, Documentation, Release Note...) of this release.
Deliverable Name | Deliverable Description | To fill out | To fill out|
---|---|---|---|
oParent | POM file with recommended Java library versions | ||
Robot | Executable for integration use case testing | ||
Demo | Executable for use case VNFs | ||
Integration | Scripts to deploy ONAP and test use cases |
Sub-Components
List all sub-components part of this release.
Activities related to sub-components must be in sync with the overall release.
Sub-components are repositories and are consolidated in a single centralized place. Edit the Release Components name for your project in the centralized page.
Architecture
High level architecture diagram
At that stage within the Release, the team is expected to provide more Architecture details describing how the functional modules are interacting.
...
Anyone reading this section should have a good understanding of all the interacting modules.
Platform Maturity
Refering to CII Badging Security Program and Platform Maturity Requirements, fill out the table below by indicating the actual level , the targeted level for the current release and the evidences on how you plan to achieve the targeted level.
Area | Actual Level | Targeted Level for current Release | How, Evidences | Comments |
---|---|---|---|---|
Manageability | Not Measured | 1, partial of 2 |
| |
Performance | Not Measured | Not Measured |
| |
Resiliency |
2 |
- 0 – none
- 1 – 72 hours component level soak w/random transactions
- 2 – 72 hours platform level soak w/random transactions
- 3 – 6 months track record of reduced defect rate
3 | Will cover geo-redundancy if lab env supports it. All Integration team will perform platform-level testing similar to: |
| ||
Scalability | Not Measured | Note Measured |
| |
Security | Not Measured | Not Measured |
|
Stability | 2 | 2 | Integration team will perform platform-level testing similar to: |
|
|
|
|
- 1 – single logging system across components; instantiation in < 1 hour
- 2 – ability to upgrade a single component; tracing across components; externalized configuration management
| ||||
Usability | Not Measured | Not Measured |
|
API Incoming Dependencies
List the API this project is expecting from other projects.
Prior to Release Planning review, Team Leads must agreed on the date by which the API will be fully defined. The API Delivery date must not be later than the release API Freeze date.
...
API Name | API Description | API Definition Date | API Delivery date | API Definition link (i.e.swagger) |
---|---|---|---|---|
To fill out | High level description of the API | Date for which the API is reviewed and agreed | To fill out | Link toward the detailed API description |
API Outgoing Dependencies
API this project is delivering to other projects.
...
SDC BE API | SDC Backend API | M3 | M3 | |
SO API | SO REST API | M3 | M3 | |
A&AI API | A&AI REST API | M3 | M3 | |
SDNC API | SDNC REST API for preload | M3 | M3 |
API Outgoing Dependencies
None
...
Third Party Products Dependencies
Third Party Products mean products that are mandatory to provide services for your components. Development of new functionality in third party product may or not be expected.
List the Third Party Products (OpenStack, ODL, RabbitMQ, ElasticSearch,Crystal Reports, ...).
Name | Description | Version |
---|
Chaos Monkey | Resilience Testing tool | |
Docker | Container platform | |
Jenkins | CI/CD tool | |
JMeter | Performance Testing tool | |
Openstack | Cloud OS | |
Robot | Testing framework |
In case there are specific dependencies (Centos 7 vs Ubuntu 16. Etc.) list them as well.
Testing and Integration Plans
Provide a description of the testing activities (unit test, functional test, automation,...) that will be performed by the team within the scope of this release.
Describe the plan to integrate and test the release deliverables within the overall ONAP system.
Confirm that resources have been allocated to perform such activities.
The goal is to automate all the unit testing, CSIT testing, and end-to-end testing in release Casablanca. The detailed test roles and responsibilities are listed below.
Types of Testing | Dev. (Project Team) | CSIT (Project Team) | E2E (Integration Team) | S3P (Project + Integration) |
---|---|---|---|---|
Usability Testing | x | |||
Unit Testing | x | |||
Stability Testing | x | |||
Security Testing | x | |||
Scalability Testing | x | |||
Regression Testing | x | x | x | x |
Performance Testing | x | |||
Integration/Pair-Wise Testing | x | |||
Install/Uninstall Testing | x | |||
Feature/Functional Testing | x | |||
End-to-End Testing | x | |||
ONAP Upgrade Testing | x | x |
Gaps
This section is used to document a limitation on a functionality or platform support. We are currently aware of this limitation and it will be delivered in a future Release.
List identified release gaps (if any), and its impact.
Gaps identified | Impact |
---|---|
To fill out | To fill out |
Known Defects and Issues
Provide a link toward the list of all known project bugs.
Jira | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
|
Risks
List the risks identified for this release along with the plan to prevent the risk to occur (mitigation) and the plan of action in the case the risk would materialized (contingency).
Risk identified | Mitigation Plan | Contingency Plan | |||
---|---|---|---|---|---|
Need additional lab resources (RAM, disk, network bandwidth, etc.) | None | None | To fill out | To fill out | To fill out |
Resources
Fill out the Resources Committed to the Release centralized page.
Release Milestone
The milestones are defined at the Release Level and all the supporting project agreed to comply with these dates.
Team Internal Milestone
This section is optional and may be used to document internal milestones within a project team or multiple project teams. For instance, in the case the team has made agreement with other team to deliver some artifacts on a certain date that are not in the release milestone, it is erecommended to provide these agreements and dates in this section.
...
Date | Project | Deliverable |
---|---|---|
To fill out | To fill out | To fill out |
Documentation, Training
- Highlight the team contributions to the specific document related to he project (Config guide, installation guide...).
- Highlight the team contributions to the overall Release Documentation and training asset
- High level list of documentation, training and tutorials necessary to understand the release capabilities, configuration and operation.
- Documentation includes items such as:
- Installation instructions
- Configuration instructions
- Developer guide
- End User guide
- Admin guide
- ...
Note | ||
---|---|---|
| ||
The Documentation project will provide the Documentation Tool Chain to edit, configure, store and publish all Documentation asset. |
Other Information
Vendor Neutral
If this project is coming from an existing proprietary codebase, ensure that all proprietary trademarks, logos, product names, etc. have been removed. All ONAP deliverables must comply with this rule and be agnostic of any proprietary symbols.
Free and Open Source Software
FOSS activities are critical to the delivery of the whole ONAP initiative. The information may not be fully available at Release Planning, however to avoid late refactoring, it is critical to accomplish this task as early as possible.
List all third party Free and Open Source Software used within the release and provide License type (BSD, MIT, Apache, GNU GPL,... ).
In the case non Apache License are found inform immediately the TSC and the Release Manager and document your reasoning on why you believe we can use a non Apache version 2 license.
...