...
# | Use CaseFunctional Requirement Nonfunctional Requirement | Test Cases | Lab | IntegrationTest Lead | RC0 Status(remaining days of effort) | RC1Status | RC2 Status | TSC Feedback (RC2) | Details | Doc status | CI integration* | Components involved | Comments | ||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Model Driven Control Loop Design | Testing with GRA_API in VID/SO/SDNC (vDNS is part of scale out use case below #11) | Intel / Windriver Azure |
(need to regression on final dockers) |
| Waiting feedback about regression on final dockers | Distribtion
Instantiation
Control Loop
Work around applied for appc.properties in Jira | https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfw.html#docs-vfw minor updates
Blocker:
| ? | SDC Dmaap SDNC SO AAI Policy Appc ... | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
3 | vCPE with TOSCA
| vCPE(tosca) - Integration test cases | CMCC / Intel |
|
| https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE_with_Tosca_VNF.html minor updates | WIP
| SDC Dmaap AAI Multicloud VFC UUI Modeling ... | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4 | 5G - Realtime PM and High Volume Stream Data Collection | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | Intel / Windriver |
|
| Test Cases passed on RC0 Test status: 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm | Yes | DCAE | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
5 | 5G - PNF PnP
| 5G - PNF PnP - Integration Test Cases | Intel / Windriver |
|
| Test Cases passed on RC0 | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_5g_pnf_pnp.html#docs-5g-pnf-pnp minor updates | Already in CI gate | 16.04: Currently released image for SO-BPMN (1.6.0 form27'th of March) is not working. Image from today 16.04 is sufficient and works. v2/onap/so/bpmn-infra/manifests/1.6.0-20200416T0645 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
6 | 5G - Bulk PM
| 5G - Bulk PM - Test Status | Ericsson Lab | James Cuddy |
|
|
| Introduced in Gate after RC1 |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
8 |
SOL 004 (VNF Package Security)
| 5G - Preonboarding/Onboarding - Test Status | Intel / Windriver | PNF Preonboarding (VNF SDK): PNF Onboarding (SDC): |
| Did we complete the testing? If not then what's the new target date? | SOL004 option 1 need to be checked manually in VNFSDK
| 16.04: New image has been released /onap/vnfsdk/refrepo:1.5.1
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
9 | 5G - OOF SON: OOF (SON) in R5 El Alto, OOF (SON) in R6 Frankfurt | Integration Test | OWL / Windriver |
updated on 20th May | Test is in progress. | Use case: https://docs.onap.org/en/dublin/submodules/integration.git/docs/docs_5G_oof_pci.html SON-Handler MS (DCAE): https://onap.readthedocs.io/en/latest/submodules/dcaegen2.git/docs/sections/services/son-handler/index.html Updates for Frankfurt submitted (INT-1466 and DCAEGEN2-2104) | Stretch goal, will take this up in next release | DCAE (SON-Handler MS), Policy, SDN-C, OOF | Use case integration test cases status can be found in below page | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
10 | E2E Network Slicing | Test Status | Windriver/CMCC |
| Test is in progress. | Use case documentation submitted (INT-1468). | Stretch goal, will take this up in next release. | UUI, EXT-API, SO, OOF (Test only: SDC, A&AI, Poilcy) |
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
11 | Scale Out | Scale Out - Integration Test Cases and Status | Intel / Windriver |
| minor updates | APPC VID DCAE SO Policy ... | Some new platform capabilities have been developed in SO and CDS. If they can’t be used for some reason, we’ll fall back to using the current process. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
12 | CCVPN-E LINE over OTN NNI | CCVPN Integration Test Cases | Huawei |
|
|
| We have an issue in the SDNC DG (SDNC-1184), which will be fixed by May 12th. After that, the integration test will be completed. | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope | SDNC AAI OOF UUI | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
12.1 | CCVPN - MDONS | MDONS Integration Test Case | Fujitsu/Orange |
| Did we complete the testing? If not then what's the new target date? | Test Environment:
Current blocker: | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope | SO - C A&AI - C SDN-C - C UUI - C SDC - TO ExtAPI - TO | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
13 | HPA vFW/vDNS | vFW/vDNS HPA Testing(Test Plan 1 inHPA & Cloud Agnostic Intent - R3 Test Plan) | Intel / Windriver |
| One pass has been more or less completed with workarounds the following bugs:
As with line 20 below, manual workaround for the following is being used:
Other known issues: Using patch from
| https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfwHPA.html#docs-vfw-hpa | SO SDC VID OOF Policy SDNC AAI | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
15 | Change Management Frankfurt Extensions
| Steps: 1) Instantiation of vFWDT 2) Configuration of OOF Policies for vFWDT 3) Execution of OSDF/HAS requests for data collection 4) Configuration of VNF profiles in CDT 5) Configuration of Ansible Server 6) Execution of the workflow | Intel / Windriver |
Updated 12th of May |
Updated 14th of May | 1) PASS 2) PASS/WORKAROUND 3) PASS 4) PASS 5) PASS 6) PASS 90% Completed PASSED conditionally with a workaround for
| El Alto doc good: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFWDT.html#docs-vfw-traffic but major updates needed (as the use cases evolved) Major documentation change completed https://gerrit.onap.org/r/c/integration/+/102853 Minor change with policy upload change still to be updated. Documentation update completed. | No Use case will be semi-automated. All the steps can be performed with scripts but still CI scripts needs to be build. Planned for next release. | SDC AAI SO VID OOF Policy APPC | Use case will be renamed and include upgrade | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
16 | PNF Software Upgrade
| Steps: 1) Execute custom PNF SW Upgrade WF from SO 2) SO send conventional LCM API to SDNC/CCSDK 3) Controller send ansible commands to AS 4) AS contact EM with ansible | Huawei |
|
| Test results: Test Status of Enhancement on PNF S/W Upgrade with EM with Ansible | Documentation containing new scenarios will be upadted in R6.
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
18 | BBS Broadband Service Use Case (Frankfurt) | BBS Integration Test Cases (Frankfurt) | BBS Swisscom Lab |
Swisscom lab is closed. Update (May 14): after some issues with the ONAP installation procedure, UNH-IOL is ready. BBS use case set up is ongoing. We need one more week to complete BBS testing cases | Frankfurt doc: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_BBS.html | No, planned for future releases | we need to find a solution to emulate 3rd party controllers first. Our use case relies on physical equipment and external controllers and we can only test it in the Swisscom lab at the moment. We may have a second lab with the required equipment in UNH-IOL, but it is not confirmed yet. | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
19 | VSP Compliance and Validation Check within SDC (Frankfurt) - Phase 2 | VSP Compliance Check within SDC - Integration Test Plan | Vodafone |
|
| https://onap-sdc.readthedocs.io/en/latest/consumedapis.html https://onap-doc.readthedocs.io/projects/onap-sdc/en/latest/externaltesting.html | No | SDC VTP | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
20 | K8S based Cloud Region Support - vFW Use case | Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud
| intel / Windriver |
| Did we complete the testing? If not then what's the new target date? | completed test with manual workaround for following 3 items: Known issues:
After above are fixed, a retest can be made to verify. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
21 | K8S based Cloud Region Support - EdgeXFoundry Use case | Deploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud | Intel/ Windriver |
| Did we complete the testing? If not then what's the new target date? | same as line above: initial tests completed using the workarounds described in line #20. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
22 | ORAN A1 Adapter Implemented in ONAP (SDNR) | A1 Adapter Test Cases | Intel/Windriver |
| Did we complete the testing? If not then what's the new target date? | Need to re-test SSL enabled HTTPS ports among DMAAP message router, SDNC DMAAP listener and SDNC dockers
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
23 | PNF Software Upgrade using direct Netconf/Yang interface with PNF | PNF Software Upgrade Using direct NETCONF/YANG interfacewithPNFTestCases | Intel |
|
|
Documentation is updated with new use cases in Frankfurt | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
24 | Enable PNF software version at onboarding | PNF Software Information Onboarding Test Cases | Ericsson Lab | André Schmid |
|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
25 | K8s CDS Support (vFW_CDS_CNF)
|
| Private lab + Intel/Windriver community lab |
Updated 07.05 |
With workarounds for
Updated 14.05 | Did we complete the testing? If not then what's the new target date? | Currently successfully verified with workarounds. Raw recording of live verification session in Windriver lab BLOCKERS:
Fix under this last ticket is currently under verification | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFW_CNF_CDS.html but needs to be updated according to latest verification status | Automation of usecase targeted for G release | 07.05: Currently usecase has been verified to work both in internal and windriver lab with workaround. Ongoing tests regarding verifying fixes provided under blocker jiras. 08.05: Removed blocker jiras that were tested for being corrected. 14.05: Updating fix brought under MSB-467 to fully cover issue, as previous patch was found incomplete | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||
26 | ETSI Alignment SO plugin to support SOL003 to connect to an external VNFM and ETSI package management |
| Ericsson Lab |
Manual testing for package management is done. Due to delay on the package management notification issues for SDC and ETSI Catalog Manager SOL001 VNFD handling discrepancies, CSIT test has been delayed. Now, the discrepancies are resolved.
Note: The ETSI-Alignment package management test is completedWill update the status again by May 6th based on the progress.
| Progressing <90% |
Status | ||||
---|---|---|---|---|
|
|
No,
CSIT Automation of use case targeted for G release
Jira | ||||||
---|---|---|---|---|---|---|
|
Merged with record 8
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Tes Cases passed on RC0. Test status: xNF communication security enhancements - Tests Description and Status
Yes
PNF Software Upgrade
- PNF / PNF Software Upgrade with EM with Netconf
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Test results:
Test Status of PNF S/W Upgrade with EM with Netconf/Yang interface
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
New documentation to be created, as it is a new use case for Frankfurt
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Policy - CDS integration test was successfully completed in SB01 lab for vFW use case.
CLAMP - Policy integration test was successfully completed in SB01 lab for vFW use case.
Jira | ||||||
---|---|---|---|---|---|---|
|
https://docs.onap.org/en/latest/submodules/policy/parent.git/docs/development/actors/cds/cds.html
Policy Framework
CDS
A&AI
CLAMP
Configuration with NETCONF in Frankfurt/R6
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Jira | ||||||
---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
AAF-Certservice, SDNC,
Netconf-Pnp-Simulator
E2E Automation vLB w/CDS Use Case (Frankfurt)
NOTE: SO is using Config Assign & Config Deploy building blocks.
SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation will be a separate test case.[row below]
Steps:
Design Time
1) CBA Package onboarding CDS
2) SDC VSP, VF, Service Creation and onbaording for vLB.
Run Time:
1) SO send Marcro requst to SDNC GR-API
2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution
3) SO sends request to CDS for Config Assign.
4) SO sends request to Openstack for vLB Instantiation
5) SO send request to CDS for ConfigDeploy
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
SO issue with heat stack creation. Jira is open.
Jira | ||||||
---|---|---|---|---|---|---|
|
Steps:
Jira | ||||||
---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Jira | ||||||
---|---|---|---|---|---|---|
|
Jira | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||||
---|---|---|---|---|---|---|
|
(Updated May 7 2020)
Integration work will be part of OOF / SON / PCI Use Case.
will have the same integration status as that use case.
(Read the Docs entry in progress) being done under Integration Jira-1526
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
E2E Automation vLB w/CDS Use Case (Frankfurt)
SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation.
Steps:
Design Time
1) CBA Package onboarding CDS
2) SDC VSP, VF, Service Creation and onbaording for vLB.
Run Time:
1) SO send Marcro requst to SDNC GR-API
2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution
3) SO sends request to CDS for ControllerExecutionBB with scope of vnf and action of config-assign.
4) SO sends request to Openstack for vLB Instantiation
5) SO send request to CDS for ControllerExecutionBB with scope of vnf and action of config-deploy.
COMPLETED
COMPLETED
NOTE: in order for this use case to work out of the box. The following patches need to be merged to frankfurt release:
- Naming MS Changes based on new policy api: (Biju)
- Naming MS Changes based on new policy api: (Biju)
- SO Patch: fixes for scale out: (Janani)
vCPE Integration Test Case
PROGRESSING <90%
???
During May 4 PTL meeting, Morgan Richomme reports that this issue may need to be de-scoped since there are no resources available for integration test.
Not restested as part of Frankfurt release
5G - PNF Configuration via Netconf - Test Status
Intel/
Windriver
This item is duplicate.
Please see line #37 for work related to this feature in R6.
Minor updates
Steps:
1) Designing custom workflows with Workflow Designer
2) Distributing custom workflows to SO
3) Deploying the custom workflow in SO
4) Sending workflow metadata to VID
5) Triggering custom workflow execution from VID
6) Executing custom workflows in SO
Status | ||||
---|---|---|---|---|
|
Not restested as part of Frankfurt release
1) Designing custom workflows with Workflow Designer – 100%
2) Distributing custom workflows to SO – Was 100% in Dublin Issues arose with SDC Distribution in El Alto and remain unresolved – 80% working now. However, SO does work properly with manual WF distribution and workaround notes are posted on the wiki
3) Deploying the custom workflow in SO – 100%
4) Sending workflow metadata to VID – 100%
5) Triggering custom workflow execution from VID – 100%
6) Executing custom workflows in SO – Execution mechanism 100%, Building Blocks – 60% (Had many issues with test environment & APPC blocking testing from Nov-Jan)
7) Pause for Manual Task – 100%
Status | ||||
---|---|---|---|---|
|
Not restested as part of Frankfurt release
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00.
Additional testing is covered via the vFW, Scale Out, vFW CDS use cases.
Automated test for vFW updated:
Jira | ||||||
---|---|---|---|---|---|---|
|
No other automated tests for CLAMP as this was tested manually using CLAMP GUI.
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Testing completed via POLICY/DCAE pairwise testing completed by RC0.
No automated tests.
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00.
Additional testing is covered via the vFW, Scale Out, vFW CDS use cases.
No automated tests as this is done manually via the CLAMP GUI.
Jira | ||||||
---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Policy/CCSDK testing was successfully completed via pairwise testing in SB01 by RC0.
Policy/OOF testing successfully completed by RC1 and was done in SB01.
No automated tests.
Jira | ||||||
---|---|---|---|---|---|---|
|
Jira | ||||||
---|---|---|---|---|---|---|
|
Robot Keyword Testing
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
instantiateVFWCLGRA
Status | ||||
---|---|---|---|---|
|
HTTP Certificate Expiry Test
(verify_cert.sh)
clamp 3/2020
dmaap 3/2020
Tobe integrated in gate, raise an error in CI when 1 of the certificates is about to expire (in 2 weeks?)
Integration
...