Early Drop testing will focus on automated testing via robot and other test scripts. We will not have 100% coverage but should have enough sanity testing to confirm the changes for El Alto have not created breakage.
WORK IN PROGRESS - focus will be automated testing so some rows will be deleted from the table - this is a copy of Dublin as a starting point to trim down
Color Guide
For 2019-08-01 - ONLY Completed items should be green.
COMPLETED
PROGRESSING >= 90%
PROGRESSING <90%
| # | Use Case Functional Requirement Nonfunctional Requirement | Test Cases | Lab | Integration Test Lead | Status (remaining days of effort) | Video URL | Detailed Test Status | Quick Notes |
|---|---|---|---|---|---|---|---|---|
| 1 | Model Driven Control Loop Design | (vDNS is part of scale out use case below #10) | Intel / Windriver | Planned | ||||
| 2 | Use Case: Residential Broadband vCPE (Approved) | vCPE Integration Test Case | Intel / Windriver | Planned | ||||
| 3 | vCPE with TOSCA | vCPE(tosca) with HPA - Integration test cases | Intel / Windriver | |||||
| 4 | 5G - Realtime PM and High Volume Stream Data Collection | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | Intel / Windriver | Planned (hv-ves ete script) | ||||
| 5 | 5G - PNF PnP | 5G - PNF PnP - Integration Test Cases | Intel / Windriver | Planned Heat and Tosca | ||||
| 6 | 5G - Bulk PM | 5G - Bulk PM - Test Status | Intel / Windriver SB-02 | Andrew to check (Rachel ?) | ||||
| 7 | 5G - Configuration with NETCONF | 5G - PNF Configuration via Netconf - Test Status | Intel/ Windriver | Andrew to check (Rachel ?) | ||||
| 8 | 5G - Preonboarding/Onboarding - Test Status | Intel / Windriver | PNF Preonboarding (VNF SDK): PNF Onboarding (SDC): | Planned | ||||
| 9 | 5G - OOF and PCI | 5G - OOF and PCI - Integration Test Cases | Windriver | N/A | No automation done yet, and not planned for El Alto. We will be doing some manual tests. | |||
| 10 | Scale Out | Scale Out - Integration Test Cases and Status (vLB) | Intel / Windriver | Planned | ||||
| 11 | CCVPN | CCVPN Integration Test Cases | CMCC | Hardware required not known if in ED testing scope | ||||
| 12 | HPA vFW/vDNS | vFW/vDNS HPA Testing(Test Plan 1 inHPA & Cloud Agnostic Intent - R3 Test Plan) | Intel / Windriver | Planned | ||||
| 13 | Change Management - Flexible Designer & Orchestrator | Steps: 1) Designing custom workflows with Workflow Designer 2) Distributing custom workflows to SO 3) Deploying the custom workflow in SO 4) Sending workflow metadata to VID 5) Triggering custom workflow execution from VID 6) Executing custom workflows in SO | Intel / Windriver | Most likely | ||||
| 14 | Steps: 1) Creating VNF profile using CDT 2) Designing custom workflows with Workflow Designer 3) Distributing custom workflows to SO 4) Deploying the custom workflow in SO 5) Sending workflow metadata to VID 6) Triggering custom workflow execution from VID 7) Executing custom workflows in SO | Intel / Windriver | Brian to follow Lukasz | |||||
| 15 | Change Management - 5G PNG Software Upgrade | Change Management - 5G PNF Software Upgrade Integration Test Status | Intel / Windriver | unlikely | ||||
| 16 | Change Management - Schedule Optimization | Intel / Windriver | unlikely | |||||
| 17 | BBS Broadband Service Use Case (Dublin) | BBS Use Case Tracking (Dublin Release)#Testing | BBS Swisscom Lab | Requires Swisscom Lab | ||||
| 18 | VSP Compliance Check within SDC (Dublin) - Phase 1 | VSP Compliance Check within SDC - Integration Test Plan | Vodafone | |||||
| 19 | K8S based Cloud Region Support - vFW Use case | Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud | intel / Windriver | |||||
| 20 | K8S based Cloud Region Support - EdgeXFoundry Use case | Deploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud | Intel/ Windriver | |||||
| 21 | 5G: Network Slicing Modeling | Amdocs | ||||||
| 25 | Improve our E2E Process Automation | Planned Abdel with automated robot | ||||||
| 30 | SOL 004 (VNF Package Security) | 5G - Preonboarding/Onboarding - Test Status | Ericsson, Intel / Windriver | Possibly with PNF pre-onboarding | ||||
| 31 | xNF communication security enhancements. | xNF communication security enhancements - Tests Description and Status | Planned to add CSIT | |||||
| 34 | HPA vIPsec | vIPsec HPA testing | Intel / Windriver | Planned | ||||
| 35 | Health Checks for PODS | Percentage coverage of Health Checks for Running PODS | Integration | |||||
| 36 | New Installation Tests in 3 labs | |||||||
| Intel/Windriver | Planned | |||||||
| Orange | Planned | |||||||
| TBD Lab #3 | Investigating | |||||||
| OWL ? | Brian to to talk to Tracy | |||||||
| Robot Keyword Testing | ||||||||
| init_robot | PASS - staging | |||||||
| init | PASS - staging | AAI/AAF authentication work around | ||||||
| health | ||||||||
| eteHelm-k8.sh | 43/49 PASS - staging | CLAMP, OOF-CMSO , Policy, Portal, SDNC (zero length response from 1 pod), SO (2 pods) | ||||||
| healthdist | SDC group type doesnt exist error at Catalog Resource | |||||||
| instantiateVFWCL | Same error as healthdist |
8/14/2019
SB-00 - oom-staging for testing 43/49 working. up to SDC model onboarding healthdist stage.
cassandra config issue for SDC - re-deploying SDC ; Cassandra tuning for windriver with multiple clients ?
integration-staging-daily - day of testing
integration-release-daily - day of testing
SB01/SB02 - shutdown for resources
Labs for Testing
Integration Team:
Integration-release-daily: this should be main lab for automated script testing
Integration-staging-daily: for patch testing in advance of updates to release-daily
Integration-SB00
Integration-SB04
Project Teams
Integration-Design (Available) : SDC model onboarding and distribution
Integration-Instantiation (In Progress) : VID instantiate to VNF deployed - DEFERRED
Integration-ClosedLoop (Available) : VNF already instantiated. DCAE, Policy, AAI, APPC,SDNC flows