Color Guide
ONLY Completed items should be green.
COMPLETED
PROGRESSING >= 90%
PROGRESSING <90%
TARGET COMPLETION
# | Use CaseFunctional Requirement Nonfunctional Requirement | Test Cases | Lab | IntegrationTest Lead | Status(remaining days of effort) | TSC Feedback | Details | Doc status | CI integration* | Components involved | Comments |
---|---|---|---|---|---|---|---|---|---|---|---|
1 | Model Driven Control Loop Design | Testing with GRA_API in VID/SO/SDNC (vDNS is part of scale out use case below #11) | Intel / Windriver Azure | PROGRESSING >=90% MAY 15TH | Distribtion COMPLETED Instantiation COMPLETED Control Loop PROGRESSING Policy Event to APPC APPC HTTPS/HTTP problem in procesing DMaaP message | https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfw.html#docs-vfw minor updates Blocker: - INT-1568Getting issue details... STATUS | ? | SDC Dmaap SDNC SO AAI Policy ... | |||
3 | vCPE(tosca) - Integration test cases | CMCC / Intel | COMPLETED | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE_with_Tosca_VNF.html minor updates | Yes | SDC Dmaap AAI Multicloud VFC UUI Modeling ... | |||||
4 | 5G - Realtime PM and High Volume Stream Data Collection | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | Intel / Windriver | COMPLETED | Test Cases passed on RC0 Test status: 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm | Yes | DCAE | |||
5 | 5G - PNF PnP - Integration Test Cases | Intel / Windriver | PROGRESSING >= 90% ??? | Candidate to be descoped from Frankfurt since no update or to move under POC #1 Can you please provide an estimate about how many days of effort left/Target date completion? #2 Any blocker? If yes then please provide JIRA Ticket | Test Cases passed on RC0 | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_5g_pnf_pnp.html#docs-5g-pnf-pnp minor updates | Already in CI gate | 16.04: Currently released image for SO-BPMN (1.6.0 form27'th of March) is not working. Image from today 16.04 is sufficient and works. v2/onap/so/bpmn-infra/manifests/1.6.0-20200416T0645 | |||
6 | 5G - Bulk PM - Test Status | Ericsson Lab | James Cuddy | COMPLETED | #1 Can you please provide your tests results? #2 Any automated tests? | ||||||
7 | 5G - Configuration with NETCONF | 5G - PNF Configuration via Netconf - Test Status | Intel/ Windriver | PROGRESSING <90% ??? | Candidate to be descoped from Frankfurt since no update or to move under POC #1 Can you please provide an estimate about how many days of effort left/Target date completion? #2 Any blocker? If yes then please provide JIRA Ticket | Minor updates | Yes | ||||
8 | 5G - Preonboarding/Onboarding - Test Status | Intel / Windriver | PNF Preonboarding (VNF SDK): PNF Onboarding (SDC): | PROGRESSING >= 90% ??? | Candidate to be descoped from Frankfurt since no update or to move under POC #1 Can you please provide an estimate about how many days of effort left/Target date completion? #2 Any blocker? If yes then please provide JIRA Ticket | 16.04: New image has been released /onap/vnfsdk/refrepo:1.5.1
| |||||
9 | 5G - OOF SON: OOF (SON) in R5 El Alto, OOF (SON) in R6 Frankfurt | Integration Test | OWL / Windriver | PROGRESSING <90% MAY 20TH updated on 6th May | Test is in progress. | Use case: https://docs.onap.org/en/dublin/submodules/integration.git/docs/docs_5G_oof_pci.html SON-Handler MS (DCAE): https://onap.readthedocs.io/en/latest/submodules/dcaegen2.git/docs/sections/services/son-handler/index.html Updates for Frankfurt submitted (INT-1466 and DCAEGEN2-2104) | Stretch goal, will take this up in next release | DCAE (SON-Handler MS), Policy, SDN-C, OOF | Use case integration test cases status can be found in below page | ||
10 | E2E Network Slicing | Test Status | Windriver/CMCC | PROGRESSING <90% MAY 15TH | Test is in progress. | Use case documentation submitted (INT-1468). | Stretch goal, will take this up in next release. | UUI, EXT-API, SO, OOF (Test only: SDC, A&AI, Poilcy) | |||
11 | Scale Out | Scale Out - Integration Test Cases and Status | Intel / Windriver | #2 Any blocker? If yes then please provide JIRA Ticket | minor updates | APPC VID DCAE SO Policy ... | Some new platform capabilities have been developed in SO and CDS. If they can’t be used for some reason, we’ll fall back to using the current process. | ||||
12 | CCVPN-E LINE over OTN NNI | CCVPN Integration Test Cases | Huawei | PROGRESSING >= 90% MAY 8TH | #1 Any blocker? If yes then please provide JIRA Ticket | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope | SDNC AAI OOF UUI | ||||
12.1 | CCVPN - MDONS | MDONS Integration Test Case | Fujitsu/Orange | PROGRESSING >= 90% MAY 8TH | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope | SO - C A&AI - C SDN-C - C UUI - C SDC - TO ExtAPI - TO | |||||
13 | HPA vFW/vDNS | vFW/vDNS HPA Testing(Test Plan 1 inHPA & Cloud Agnostic Intent - R3 Test Plan) | Intel / Windriver | PROGRESSING <90% MAY 15 | Is it possible to provide a target date since it is not clear when "a couple of days" was entered? | Testing has been started in OOF project - Windriver lab Manual testing has been progressing Current issue affecting/blocking progress is: - OPTFRA-750Getting issue details... STATUS Other known issues: Using patch from - CLI-269Getting issue details... STATUS to manually use CLI updates for loading policies. As with line 20 below, manual workaround for the following is being used: - MSB-467Getting issue details... STATUS | https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfwHPA.html#docs-vfw-hpa | SO SDC VID OOF Policy SDNC AAI | |||
14 | Change Management - Flexible Designer & Orchestrator | Steps: 1) Designing custom workflows with Workflow Designer 2) Distributing custom workflows to SO 3) Deploying the custom workflow in SO 4) Sending workflow metadata to VID 5) Triggering custom workflow execution from VID 6) Executing custom workflows in SO | Intel / Windriver | NOT A CANDIDATE FOR FRANKFURT | Candidate to be descoped from Frankfurt since no update or to move under POC #1 Can you please provide an estimate about how many days of effort left/Target date completion? #2 Any blocker? If yes then please provide JIRA Ticket | 1) Designing custom workflows with Workflow Designer – 100% 2) Distributing custom workflows to SO – Was 100% in Dublin Issues arose with SDC Distribution in El Alto and remain unresolved – 80% working now. However, SO does work properly with manual WF distribution and workaround notes are posted on the wiki 3) Deploying the custom workflow in SO – 100% 4) Sending workflow metadata to VID – 100% 5) Triggering custom workflow execution from VID – 100% 6) Executing custom workflows in SO – Execution mechanism 100%, Building Blocks – 60% (Had many issues with test environment & APPC blocking testing from Nov-Jan) 7) Pause for Manual Task – 100% | |||||
15 | Steps: 1) Instantiation of vFWDT 2) Configuration of OOF Policies for vFWDT 3) Execution of OSDF/HAS requests for data collection 4) Configuration of VNF profiles in CDT 5) Configuration of Ansible Server 6) Execution of the workflow | Intel / Windriver | PROGRESSING >= 90% MAY 9TH To be completed Till May 9th. Requires functional integration lab to complete Policy/OOF integration test. | #1 Any blocker? If yes then please provide JIRA Ticket/Target date completion? | 1) PASS 2) IN PROGRESS 3) PASS 4) PASS 5) PASS 6) PASS 90% Completed | El Alto doc good: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFWDT.html#docs-vfw-traffic but major updates needed (as the use cases evolved) Major documentation change completed https://gerrit.onap.org/r/c/integration/+/102853 Minor change with policy upload change still to be updated. | No Use case will be semi-automated. All the steps can be performed with scripts but still CI scripts needs to be build. Planned for next release. | SDC AAI SO VID OOF Policy APPC | Use case will be renamed and include upgrade | ||
16 | PNF Software Upgrade
| Steps: 1) Execute custom PNF SW Upgrade WF from SO 2) SO send conventional LCM API to SDNC/CCSDK 3) Controller send ansible commands to AS 4) AS contact EM with ansible | Huawei | #1 Can you please provide your tests results? #2 Any automated tests? | |||||||
17 | Change Management - Schedule Optimization | Intel / Windriver | NOT A CANDIDATE FOR FRANKFURT | Candidate to be descoped from Frankfurt since no update or to move under POC #1 Can you please provide an estimate about how many days of effort left/Target date completion? #2 Any blocker? If yes then please provide JIRA Ticket | |||||||
18 | BBS Broadband Service Use Case (Frankfurt) | BBS Integration Test Cases (Frankfurt) | BBS Swisscom Lab | 45% COMPLETED MAY 7TH? Swisscom lab is closed. We cannot continue testing BBS for now (due to vendor hardware dependencies). Waiting on the set up of a second lab at UNH-IOL (ongoing) | Have you any indication when the lab will be up again? We are targeting to meet RC2 this month | Frankfurt doc: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_BBS.html | No, planned for future releases | we need to find a solution to emulate 3rd party controllers first. Our use case relies on physical equipment and external controllers and we can only test it in the Swisscom lab at the moment. We may have a second lab with the required equipment in UNH-IOL, but it is not confirmed yet. | |||
19 | VSP Compliance and Validation Check within SDC (Frankfurt) - Phase 2 | VSP Compliance Check within SDC - Integration Test Plan | Vodafone | COMPLETED | https://onap-sdc.readthedocs.io/en/latest/consumedapis.html https://onap-doc.readthedocs.io/projects/onap-sdc/en/latest/externaltesting.html | No | SDC VTP | ||||
20 | K8S based Cloud Region Support - vFW Use case | intel / Windriver | PROGRESSING >= 90% MAY 15 | Is it possible to provide a target date since it is not clear when "a couple of days" was entered? | completed test with manual workaround for following 3 items: Known issues: - MSB-467Getting issue details... STATUS using manual workaround to get past this for now - MULTICLOUD-1053Getting issue details... STATUS will need to be sorted out - SDC-2972Getting issue details... STATUS using manual workaround to get past this for now. After above are fixed, a retest can be made to verify. | ||||||
21 | K8S based Cloud Region Support - EdgeXFoundry Use case | Deploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud | Intel/ Windriver | PROGRESSING >= 90% MAY 15 | Candidate to be descoped from Frankfurt since no update or to move under POC #1 Can you please provide an estimate about how many days of effort left/Target date completion? | same as line above: initial tests completed using the workarounds described in line #20. | |||||
22 | ORAN A1 Adapter Implemented in ONAP (SDNR) | A1 Adapter Test Cases | Intel/Windriver | PROGRESSING >= 90% MAY 15TH | Candidate to be descoped from Frankfurt since no update or to move under POC #1 Can you please provide an estimate about how many days of effort left/Target date completion? #2 Any blocker? If yes then please provide JIRA Ticket | ||||||
23 | PNF Software Upgrade using direct Netconf/Yang interface with PNF | PNF Software Upgrade Using direct NETCONF/YANG interfacewithPNFTestCases | Intel | #1 Can you please provide your tests results? #2 Any automated tests? | |||||||
24 | Enable PNF software version at onboarding | PNF Software Information Onboarding Test Cases | Ericsson Lab | André Schmid | #1 Can you please provide your tests results? #2 Any automated tests? | ||||||
25 | K8s CDS Support (vFW_CDS_CNF) - REQ-182Getting issue details... STATUS (SO and CDS Macro flow with Helm Chart) |
| Intel/Windriver | Candidate to be descoped from Frankfurt since no update or to move under POC #1 Can you please provide an estimate about how many days of effort left/Target date completion? | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFW_CNF_CDS.html but needs to be updated according to latest verification status | ||||||
26 | ETSI Alignment SO plugin to support SOL003 to connect to an external VNFM | - SO-2683Getting issue details... STATUS Manual testing for package management is done. Due to delay on the package management notification issues for SDC and ETSI Catalog Manager SOL001 VNFD handling discrepancies, CSIT test has been delayed. Now, the discrepancies are resolved. Will update the status again by May 6th based on the progress. PROGRESSING <90% MAY 15TH | #2 Any blocker? If yes then please provide JIRA Ticket | ||||||||
27 | SOL 004 (VNF Package Security) | 5G - Preonboarding/Onboarding - Test Status | Ericsson, Intel / Windriver | All activities, status (incl. days to completion) of this item are embedded into “5G - Preonboarding/Onboarding - Test Status” | Please see item “5G - Preonboarding/Onboarding - Test Status” | Please see item “5G - Preonboarding/Onboarding - Test Status” | Please see item “5G - Preonboarding/Onboarding - Test Status” | Please see item “5G - Preonboarding/Onboarding - Test Status” | All activities, status (incl. days to completion) of this item are embedded into “5G - Preonboarding/Onboarding - Test Status” | ||
28 | xNF communication security enhancements. | xNF communication security enhancements - Tests Description and Status | COMPLETED | Tes Cases passed on RC0. Test status: xNF communication security enhancements - Tests Description and Status | Yes | DCAE | |||||
30 | PNF Software Upgrade
| PNF software upgrade in R6 Frankfurt | Huawei | #1 Can you please provide your tests results? #2 Any automated tests? | |||||||
31 | 5G - 5G NRM Network Resource Model (Configuration Mgmt) | 5G Network Resource Model (NRM) Configuration in R6 Frankfurt | Huawei | #1 Can you please provide your tests results #2 Any automated tests? | |||||||
37 | Configuration with NETCONF in Frankfurt/R6 | Detailed Steps carried out for performing E2E Testcases can be found at : E2E Integration Testing for NETCONF over TLS Configuration- Test Case | Ajay Deep Singh | PROGRESSING <90% MAY 8TH | Expected to be completed by next week. | Yes | AAF-Certservice, SDNC, Netconf-Pnp-Simulator | ||||
38 | E2E Automation vLB w/CDS Use Case (Frankfurt) NOTE: SO is using Config Assign & Config Deploy building blocks. SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation will be a separate test case.[row below] | Steps: Design Time 1) CBA Package onboarding CDS 2) SDC VSP, VF, Service Creation and onbaording for vLB. Run Time: 1) SO send Marcro requst to SDNC GR-API 2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution 3) SO sends request to CDS for Config Assign. 4) SO sends request to Openstack for vLB Instantiation 5) SO send request to CDS for ConfigDeploy | Intel / Windriver | COMPLETED | #1 Can you please provide your tests results? #2 Any automated tests? | CDS, SDNC, SO, Policy, Naming MS, Netbox | |||||
39 | Telstra | COMPLETED | #1 Can you please provide your tests results? #2 Any automated tests? | ||||||||
40 | WinLAB | Sandeep Shah | PROGRESSING <90% ??? | Candidate to be descoped from Frankfurt since no update or to move under POC #1 Can you please provide an estimate about how many days of effort left/Target date completion? #2 Any blocker? If yes then please provide JIRA Ticket | SDN-C (CC-SDK) using MariaDB | Sandeep is leading the Integration & Development. | |||||
Use cases without resources for Frankfurt | |||||||||||
2 | Use Case: Residential Broadband vCPE (Approved) | vCPE Integration Test Case | Intel / Windriver | PROGRESSING <90% ??? During May 4 PTL meeting, Morgan Richomme reports that this issue may need to be de-scoped since there are no resources available for integration test. | Not restested as part of Frankfurt release | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE.html | No | ||||
29 | HPA vIPsec | vIPsec HPA testing | Intel / Windriver | Not tested | Not restested as part of Frankfurt release | ||||||
Pairwise testing | |||||||||||
32 | TOSCA Compliant Policy types | Pairwise Testing | Intel / Windriver | COMPLETED | #1 Can you please provide your tests results? #2 Any automated tests? | ||||||
33 | Policy Update Notifications | Pairwise Testing | Intel / Windriver | COMPLETED | #1 Can you please provide your tests results? #2 Any automated tests? | ||||||
34 | CLAMP Deployment of Policies to PDP Groups | Pairwise Testing | Intel / Windriver | COMPLETED | #1 Can you please provide your tests results? #2 Any automated tests? | ||||||
35 | Integration of CDS as an Actor | Integration Testing | Intel / Windriver | COMPLETED | #1 Can you please provide your tests results? #2 Any automated tests? | Policy - CDS integration test was successfully completed in SB01 lab for vFW use case. CLAMP - Policy integration test was successfully completed in SB01 lab for vFW use case. | - REQ-33Getting issue details... STATUS https://docs.onap.org/en/latest/submodules/policy/parent.git/docs/development/actors/cds/cds.html | Policy Framework CDS A&AI CLAMP | |||
36 | Component Upgrades to the new Policy Lifecycle API | Pairwise Testing | Intel / Windriver | COMPLETED | #1 Can you please provide your tests results? #2 Any automated tests? | ||||||
Misc | |||||||||||
Robot Keyword Testing | |||||||||||
init | BDF | OK | |||||||||
health | Integrated in gate | COMPLETED | |||||||||
eteHelm-k8.sh | BDF* | OK | Not integrated in gate but onap-k8s and onap-helm (not based on Robot) Integrated in Gate | ||||||||
healthdist | Integrated in gate | COMPLETED | |||||||||
instantiateVFWCLGRA | BDF | OK | |||||||||
demo-k8s.sh -n onap vfwclosedloop <png_ip> | BDF | OK | |||||||||
instantiateVFWDTGRA | BDF | OK | |||||||||
distributeVCPE | BDF | OK | |||||||||
distributeVCPEResCust | |||||||||||
sdc-dcae-d | |||||||||||
vcpe.py | |||||||||||
postinstall | Integrated in gate | COMPLETED | |||||||||
72 Hour Stability Run | onboard/instantiate | ||||||||||
closedloop | |||||||||||
HTTP Certificate Expiry Test (verify_cert.sh) | clamp 3/2020 dmaap 3/2020 | Tobe integrated in gate, raise an error in CI when 1 of the certificates is about to expire (in 2 weeks?) | |||||||||
27 | Component/memory optimization: Ongoing Assessment | OOM | Addressed by OOM in Guilin | ||||||||
29 | S3P- Geo-Redundancy | Integration | Not tested as part of Frankfurt release | No resources | |||||||
35 | Health Checks for PODS | Percentage coverage of Health Checks for Running PODS | Integration | Hard to define...and to test | |||||||
36 | New Installation Tests in 4 labs | Intel/Windriver | Integration | Reccurent activity | |||||||
Orange (Rocky) | Morgan Richomme | ||||||||||
Ericsson Lab (Rocky) | |||||||||||
DT |
- DCAEGEN2-1539Getting issue details... STATUS
*: CI integration: the goal is to introduce the use case in CI daily chains for Frankfurt. Ths table could be completed with a CI dashboard where the use cases will be run every day.
As it should be runnable in any lab, some constraints need to be considered:
- no proprietary VNFs
- use cases must be self-content , third party equiments may not be present in all labs.
- infrastructure setup/teardown shall be clear: the use case must be runnable from a clean ONAP installation. These resources must be cleaned at the end of the test ,
- results shall be pushed to a common DB. It is recommended ot use xtesting to run the tests (robotframework, python, bash, unit test drivers)