Color Guide
ONLY Completed items should be green.
COMPLETED
PROGRESSING >= 90%
PROGRESSING <90%
# | Use CaseFunctional Requirement Nonfunctional Requirement | Test Cases | Lab | IntegrationTest Lead | Status(remaining days of effort) | TSC Feedback | Details | Doc status | CI integration* | Components involved | Comments |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Model Driven Control Loop Design | Testing with GRA_API in VID/SO/SDNC (vDNS is part of scale out use case below #11) | Intel / Windriver Azure | PROGRESSING <90% | Distribtion COMPLETED Instantiation COMPLETED Control Loop PROGRESSING | https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfw.html#docs-vfw minor updates INT-1568 - Getting issue details... STATUS | ? | SDC Dmaap SDNC SO AAI Policy ... | |||
| 2 | Use Case: Residential Broadband vCPE (Approved) | vCPE Integration Test Case | Intel / Windriver | PROGRESSING <90% | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE.html | No | |||||
| 3 | vCPE with TOSCA MODELING-354 - Getting issue details... STATUS VFC-1654 - Getting issue details... STATUS USECASEUI-438 - Getting issue details... STATUS | vCPE(tosca) with HPA - Integration test cases | CMCC / Intel | PROGRESSING >= 90% Remaining days: 1 The related doc needs to update | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE_with_Tosca_VNF.html minor updates | Yes | SDC Dmaap AAI Multicloud VFC UUI Modeling ... | ||||
| 4 | 5G - Realtime PM and High Volume Stream Data Collection | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | Intel / Windriver | PROGRESSING >= 90% | Test Cases passed on RC0 | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm | Yes | DCAE | |||
| 5 | 5G - PNF PnP REQ-134 - Getting issue details... STATUS | 5G - PNF PnP - Integration Test Cases | Intel / Windriver | PROGRESSING >= 90% | Test Cases passed on RC0 | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_5g_pnf_pnp.html#docs-5g-pnf-pnp minor updates | Already in CI gate | 16.04: Currently released image for SO-BPMN (1.6.0 form27'th of March) is not working. Image from today 16.04 is sufficient and works. v2/onap/so/bpmn-infra/manifests/1.6.0-20200416T0645 | |||
| 6 | 5G - Bulk PM "Data Plane" | 5G - Bulk PM - Test Status | Ericsson Lab | PROGRESSING <90% | |||||||
| 7 | 5G - Configuration with NETCONF | 5G - PNF Configuration via Netconf - Test Status | Intel/ Windriver | PROGRESSING <90% | Minor updates | Yes | |||||
| 8 | 5G - PNF Pre-Onboarding & Onboarding REQ-135 - Getting issue details... STATUS | 5G - Preonboarding/Onboarding - Test Status | Intel / Windriver | PNF Preonboarding (VNF SDK): PNF Onboarding (SDC): | PROGRESSING >= 90% | SOL004 option 1 need to be checked manually in VNFSDK SDC-2981 - Getting issue details... STATUS - blocks automated test cases for SOL004 in PNF Onboarding part | 16.04: New image has been released /onap/vnfsdk/refrepo:1.5.1
| ||||
| 9 | 5G - OOF SON: OOF (SON) in R5 El Alto, OOF (SON) in R6 Frankfurt | Integration Test | OWL / Windriver | PROGRESSING <90% Current outlook for completion: May 15th. Will update the status again by May 1st based on this week's progress. | Use case: https://docs.onap.org/en/dublin/submodules/integration.git/docs/docs_5G_oof_pci.html SON-Handler MS (DCAE): https://onap.readthedocs.io/en/latest/submodules/dcaegen2.git/docs/sections/services/son-handler/index.html Updates for Frankfurt submitted (INT-1466 and DCAEGEN2-2104) | Stretch goal, will be re-visited end of March | DCAE (SON-Handler MS), Policy, SDN-C, OOF | Use case integration test cases status can be found in below page | |||
| 10 | E2E Network Slicing | Test Status | Windriver/CMCC | PROGRESSING <90% Current outlook for completion: May 15th. Will update the status again by May 1st based on this week's progress. | Use case documentation submitted (INT-1468). | Stretch goal, may not be possible within Frankfurt time frame | UUI, EXT-API, SO, OOF (Test only: SDC, A&AI, Poilcy) | ||||
| 11 | Scale Out | Scale Out - Integration Test Cases and Status | Intel / Windriver | Testing Status (Frankfurt Scaling) PROGRESSING <90% | minor updates | APPC VID DCAE SO Policy ... | Some new platform capabilities have been developed in SO and CDS. If they can’t be used for some reason, we’ll fall back to using the current process. | ||||
| 12 | CCVPN-E LINE over OTN NNI | CCVPN Integration Test Cases | Huawei | PROGRESSING >= 90% Estimated Completion: 8th May | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope | SDNC AAI OOF UUI | |||||
| 12.1 | CCVPN - MDONS | MDONS Integration Test Case | Fujitsu/Orange | PROGRESSING >= 90% Estimated completion by May 8th | Test Environment:
Current blocker: SO-2827 - Getting issue details... STATUS | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope | SO - C A&AI - C SDN-C - C UUI - C SDC - TO ExtAPI - TO | ||||
| 13 | HPA vFW/vDNS | vFW/vDNS HPA Testing(Test Plan 1 inHPA & Cloud Agnostic Intent - R3 Test Plan) | Intel / Windriver | PROGRESSING <90% | Testing has been started in OOF project - Windriver lab
| https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfwHPA.html#docs-vfw-hpa | SO SDC VID OOF Policy SDNC AAI | ||||
| 14 | Change Management - Flexible Designer & Orchestrator | Steps: 1) Designing custom workflows with Workflow Designer 2) Distributing custom workflows to SO 3) Deploying the custom workflow in SO 4) Sending workflow metadata to VID 5) Triggering custom workflow execution from VID 6) Executing custom workflows in SO | Intel / Windriver | PROGRESSING <90% | 1) Designing custom workflows with Workflow Designer – 100% 2) Distributing custom workflows to SO – Was 100% in Dublin Issues arose with SDC Distribution in El Alto and remain unresolved – 80% working now. However, SO does work properly with manual WF distribution and workaround notes are posted on the wiki 3) Deploying the custom workflow in SO – 100% 4) Sending workflow metadata to VID – 100% 5) Triggering custom workflow execution from VID – 100% 6) Executing custom workflows in SO – Execution mechanism 100%, Building Blocks – 60% (Had many issues with test environment & APPC blocking testing from Nov-Jan) 7) Pause for Manual Task – 100% | ||||||
| 15 | Change Management Frankfurt Extensions REQ-187 - Getting issue details... STATUS REQ-191 - Getting issue details... STATUS | Steps: 1) Instantiation of vFWDT 2) Configuration of OOF Policies for vFWDT 3) Execution of OSDF/HAS requests for data collection 4) Configuration of VNF profiles in CDT 5) Configuration of Ansible Server 6) Execution of the workflow | Intel / Windriver | PROGRESSING >= 90% To be completed Till May 9th. Requires functional integration lab to complete Policy/OOF integration test. | 1) PASS 2) IN PROGRESS 3) PASS 4) PASS 5) PASS 6) PASS 90% Completed | El Alto doc good: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFWDT.html#docs-vfw-traffic but major updates needed (as the use cases evolved) Major documentation change completed https://gerrit.onap.org/r/c/integration/+/102853 Minor change with policy upload change still to be updated. | No Use case will be semi-automated. All the steps can be performed with scripts but still CI scripts needs to be build. Planned for next release. | SDC AAI SO VID OOF Policy APPC | Use case will be renamed and include upgrade | ||
| 16 | PNF Software Upgrade
| Steps: 1) Execute custom PNF SW Upgrade WF from SO 2) SO send conventional LCM API to SDNC/CCSDK 3) Controller send ansible commands to AS 4) AS contact EM with ansible | Huawei | INT-1207 - Getting issue details... STATUS COMPLETED | Documentation containing new scenarios will be upadted in R6. INT-1209 - Getting issue details... STATUS | ||||||
| 17 | Change Management - Schedule Optimization | Intel / Windriver | PROGRESSING <90% | ||||||||
| 18 | BBS Broadband Service Use Case (Frankfurt) | BBS Integration Test Cases (Frankfurt) | BBS Swisscom Lab | BLOCKED 45% Remaining days: 4 Risk: Swisscom integration lab will be closed from Apr 30. No more testing for BBS will be possible beyond that date. We are trying to set up a second lab at UNH-IOL | Details: BBS Integration Test Cases (Frankfurt) Integration testing started in BBS Swisscom Lab Current blocker: SO-2827 - Getting issue details... STATUS | Frankfurt doc: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_BBS.html | No, planned for future releases | we need to find a solution to emulate 3rd party controllers first. Our use case relies on physical equipment and external controllers and we can only test it in the Swisscom lab at the moment. We may have a second lab with the required equipment in UNH-IOL, but it is not confirmed yet. | |||
| 19 | VSP Compliance and Validation Check within SDC (Frankfurt) - Phase 2 | VSP Compliance Check within SDC - Integration Test Plan | Vodafone | COMPLETED | https://onap-sdc.readthedocs.io/en/latest/consumedapis.html https://onap-doc.readthedocs.io/projects/onap-sdc/en/latest/externaltesting.html | No | SDC VTP | ||||
| 20 | K8S based Cloud Region Support - vFW Use case | Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud REQ-182 - Getting issue details... STATUS | intel / Windriver | PROGRESSING >= 90% | completed test with manual workaround for following 3 items: Known issues: MSB-467 - Getting issue details... STATUS using manual workaround to get past this for now MULTICLOUD-1053 - Getting issue details... STATUS will need to be sorted out SDC-2972 - Getting issue details... STATUS using manual workaround to get past this for now. | ||||||
| 21 | K8S based Cloud Region Support - EdgeXFoundry Use case | Deploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud | Intel/ Windriver | PROGRESSING >= 90% | same as line above: | ||||||
| 22 | ORAN A1 Adapter Implemented in ONAP (SDNR) | A1 Adapter Test Cases | Intel/Windriver | PROGRESSING <90% | |||||||
| 23 | PNF Software Upgrade using direct Netconf/Yang interface with PNF | PNF Software Upgrade Using direct NETCONF/YANG interfacewithPNFTestCases | Intel | INT-1308 - Getting issue details... STATUS COMPLETED | INT-1450 - Getting issue details... STATUS Documentation is updated with new use cases in Frankfurt | ||||||
| 24 | Enable PNF software version at onboarding | PNF Software Information Onboarding Test Cases | Ericsson Lab | André Schmid | INT-1307 - Getting issue details... STATUS COMPLETED | ||||||
| 25 | K8s CDS Support (vFW_CDS_CNF) REQ-182 - Getting issue details... STATUS (SO and CDS Macro flow with Helm Chart) | TO BE DEFINED | Currently testing in internal lab. Tests in public integration lab not started yet. | INT-1184 - Getting issue details... STATUS PROGRESSING >= 90% | Currently successfully verified with workarounds. BLOCKERS: SDC-2972 - Getting issue details... STATUS MULTICLOUD-1053 - Getting issue details... STATUS MSB-467 - Getting issue details... STATUS | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFW_CNF_CDS.html but needs to be updated according to latest verification status | |||||
| 26 | ETSI Alignment SO plugin to support SOL003 to connect to an external VNFM | SO-2683 - Getting issue details... STATUS CSIT for ETSI package management is being tested We plan to complete the CSIT by RC0 completion PROGRESSING <90% | |||||||||
| 27 | SOL 004 (VNF Package Security) | 5G - Preonboarding/Onboarding - Test Status | Ericsson, Intel / Windriver | All activities, status (incl. days to completion) of this item are embedded into “5G - Preonboarding/Onboarding - Test Status” | Please see item “5G - Preonboarding/Onboarding - Test Status” | Please see item “5G - Preonboarding/Onboarding - Test Status” | Please see item “5G - Preonboarding/Onboarding - Test Status” | Please see item “5G - Preonboarding/Onboarding - Test Status” | All activities, status (incl. days to completion) of this item are embedded into “5G - Preonboarding/Onboarding - Test Status” | ||
| 28 | xNF communication security enhancements. | xNF communication security enhancements - Tests Description and Status | PROGRESSING >= 90% | CSIT's are passed on released image | Yes | DCAE | |||||
| 29 | HPA vIPsec | vIPsec HPA testing | Intel / Windriver | Not tested | Not restested as part of Frankfurt release | ||||||
| 30 | PNF Software Upgrade
| PNF software upgrade in R6 Frankfurt | Huawei |
INT-1212
-
Getting issue details...
STATUS
COMPLETED | INT-1209 - Getting issue details... STATUS | ||||||
| 31 | 5G - 5G NRM Network Resource Model (Configuration Mgmt) | 5G Network Resource Model (NRM) Configuration in R6 Frankfurt | Huawei |
INT-1245
-
Getting issue details...
STATUS
COMPLETED | New documentation to be created, as it is a new use case for Frankfurt INT-1514 - Getting issue details... STATUS | ||||||
| 32 | TOSCA Compliant Policy types | Pairwise Testing | Intel / Windriver | COMPLETED | REQ-21 - Getting issue details... STATUS | ||||||
| 33 | Policy Update Notifications | Pairwise Testing | Intel / Windriver | COMPLETED | REQ-25 - Getting issue details... STATUS | ||||||
| 34 | CLAMP Deployment of Policies to PDP Groups | Pairwise Testing | Intel / Windriver | COMPLETED | REQ-29 - Getting issue details... STATUS | ||||||
| 35 | Integration of CDS as an Actor | Integration Testing | Intel / Windriver | COMPLETED | Policy - CDS integration test was successfully completed in SB01 lab for vFW use case. CLAMP - Policy integration test was successfully completed in SB01 lab for vFW use case. | REQ-33 - Getting issue details... STATUS https://docs.onap.org/en/latest/submodules/policy/parent.git/docs/development/actors/cds/cds.html | Policy Framework CDS A&AI CLAMP | ||||
| 36 | Component Upgrades to the new Policy Lifecycle API | Pairwise Testing | Intel / Windriver | COMPLETED | REQ-162 - Getting issue details... STATUS | POLICY-2486 - Getting issue details... STATUS | |||||
| 37 | Configuration with NETCONF in Frankfurt/R6 REQ-76 - Getting issue details... STATUS REQ-140 - Getting issue details... STATUS | Detailed Steps carried out for performing E2E Testcases can be found at : E2E Integration Testing for NETCONF over TLS Configuration- Test Case | Ajay Deep Singh | PROGRESSING <90% | INT-1295 - Getting issue details... STATUS | Yes | AAF-Certservice SDNC Netconf-Pnp-Simulator | ||||
| 38 | E2E Automation vLB w/CDS Use Case (Frankfurt) NOTE: SO is using Config Assign & Config Deploy building blocks. SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation will be a separate test case.[row below] | Steps: Design Time 1) CBA Package onboarding CDS 2) SDC VSP, VF, Service Creation and onbaording for vLB. Run Time: 1) SO send Marcro requst to SDNC GR-API 2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution 3) SO sends request to CDS for Config Assign. 4) SO sends request to Openstack for vLB Instantiation 5) SO send request to CDS for ConfigDeploy | Intel / Windriver | COMPLETED | CDS, SDNC, SO, Policy, Naming MS, Netbox | ||||||
| 39 | Telstra | COMPLETED | |||||||||
| 40 | REQ-267 - Getting issue details... STATUS | WinLAB | Sandeep Shah | PROGRESSING <90% | (Read the Docs entry in progress) being done under Integration Jira-1526 INT-1526 - Getting issue details... STATUS | SDN-C (CC-SDK) using MariaDB | Sandeep is leading the Integration & Development. | ||||
| Misc | |||||||||||
Robot Keyword Testing | |||||||||||
| init | BDF | OK | |||||||||
| health | Integrated in gate | COMPLETED | |||||||||
| eteHelm-k8.sh | BDF* | OK | Not integrated in gate but onap-k8s and onap-helm (not based on Robot) Integrated in Gate | ||||||||
| healthdist | Integrated in gate | COMPLETED | |||||||||
instantiateVFWCLGRA | BDF | OK | |||||||||
| demo-k8s.sh -n onap vfwclosedloop <png_ip> | BDF | OK | |||||||||
| instantiateVFWDTGRA | BDF | OK | |||||||||
| distributeVCPE | BDF | OK | |||||||||
| distributeVCPEResCust | |||||||||||
| sdc-dcae-d | |||||||||||
| vcpe.py | |||||||||||
| postinstall | Integrated in gate | COMPLETED | |||||||||
| 72 Hour Stability Run | onboard/instantiate | ||||||||||
| closedloop | |||||||||||
HTTP Certificate Expiry Test (verify_cert.sh) | clamp 3/2020 dmaap 3/2020 | Tobe integrated in gate, raise an error in CI when 1 of the certificates is about to expire (in 2 weeks?) | |||||||||
| 27 | Component/memory optimization: Ongoing Assessment | OOM | Addressed by OOM in Guilin | ||||||||
| 29 | S3P- Geo-Redundancy | Integration | Not tested as part of Frankfurt release | No resources | |||||||
| 35 | Health Checks for PODS | Percentage coverage of Health Checks for Running PODS | Integration | Hard to define...and to test | |||||||
| 36 | New Installation Tests in 4 labs | Intel/Windriver | Integration | Reccurent activity | |||||||
| Orange (Rocky) | Morgan Richomme | ||||||||||
| Ericsson Lab (Rocky) | |||||||||||
| DT | |||||||||||
DCAEGEN2-1539 - Getting issue details... STATUS
*: CI integration: the goal is to introduce the use case in CI daily chains for Frankfurt. Ths table could be completed with a CI dashboard where the use cases will be run every day.
As it should be runnable in any lab, some constraints need to be considered:
- no proprietary VNFs
- use cases must be self-content , third party equiments may not be present in all labs.
- infrastructure setup/teardown shall be clear: the use case must be runnable from a clean ONAP installation. These resources must be cleaned at the end of the test ,
- results shall be pushed to a common DB. It is recommended ot use xtesting to run the tests (robotframework, python, bash, unit test drivers)