...
# | Use CaseFunctional Requirement Nonfunctional Requirement | Test Cases | Lab | IntegrationTest Lead | Status(remaining days of effort) | TSC Feedback | Details | Doc status | CI integration* | Components involved | Comments | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
1 | Model Driven Control Loop Design | Testing with GRA_API in VID/SO/SDNC (vDNS is part of scale out use case below #11) | Intel / Windriver Azure | Recommended for a GO
(need to regression on final dockers) | Recommended for a GO | Distribtion
Instantiation
Control Loop
Work around applied for appc.properties in Jira | https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfw.html#docs-vfw minor updates
Blocker:
| ? | SDC Dmaap SDNC SO AAI Policy Appc ... | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
3 | vCPE with TOSCA
| vCPE(tosca) - Integration test cases | CMCC / Intel |
| Recommended for a GO | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE_with_Tosca_VNF.html minor updates | Yes | SDC Dmaap AAI Multicloud VFC UUI Modeling ... | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
4 | 5G - Realtime PM and High Volume Stream Data Collection | 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | Intel / Windriver |
| Recommended for a GO | Test Cases passed on RC0 Test status: 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases | https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm | Yes | DCAE | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
5 | 5G - PNF PnP
| 5G - PNF PnP - Integration Test Cases | Intel / Windriver |
| Recommended for a GO | Test Cases passed on RC0 | https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_5g_pnf_pnp.html#docs-5g-pnf-pnp minor updates | Already in CI gate | 16.04: Currently released image for SO-BPMN (1.6.0 form27'th of March) is not working. Image from today 16.04 is sufficient and works. v2/onap/so/bpmn-infra/manifests/1.6.0-20200416T0645 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
6 | 5G - Bulk PM
| 5G - Bulk PM - Test Status | Ericsson Lab | James Cuddy |
| Recommended for a GO |
|
| 7 | 5G - Configuration with NETCONF | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
8 |
| 5G - Preonboarding/Onboarding | 5G - PNF Configuration via Netconf - Test Status | Intel / | This item is duplicate. Please see line #37 for work related to this feature in R6. | Minor updates | Yes | Windriver | PNF Preonboarding (VNF SDK): PNF Onboarding (SDC): |
| Recommended for a GO | 8 | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Anchor | PNF-Onboarding | PNF-Onboarding | 5G - PNF Pre-Onboarding & Onboarding||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Jira | ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
server | ONAP JIRA | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution | SOL004 option 1 need to be checked manually in VNFSDK
|
| REQ
| 135
| 5G - Preonboarding/Onboarding - Test Status | Intel / Windriver | PNF Preonboarding (VNF SDK): PNF Onboarding (SDC): |
| Recommended for a GO | - blocks automated test cases for SOL004 in PNF Onboarding part SOL004 option 1 need to be checked manually in VNFSDK Jira | | server |
Jira | |
---|---|
|
ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key
VNFSDK-582
Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key VNFSDK-582
Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key VNFSDK-581
581
16.04:
New image has been released /onap/vnfsdk/refrepo:1.5.1
- package integrity rules are present (SOL004 option 1) - need to have prepared automated test cases
- PNF SW update validation rules are present need to have prepared automated test cases
- Full integration automation of pre-onboarding and onboarding tests is ongoing
Integration Test
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
updated on 6th May
Recommended for a GO
Use case: https://docs.onap.org/en/dublin/submodules/integration.git/docs/docs_5G_oof_pci.html
SON-Handler MS (DCAE): https://onap.readthedocs.io/en/latest/submodules/dcaegen2.git/docs/sections/services/son-handler/index.html
Updates for Frankfurt submitted (INT-1466 and DCAEGEN2-2104)
Use case integration test cases status can be found in below page
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
Use case documentation submitted (INT-1468).
UUI, EXT-API, SO, OOF
(Test only: SDC, A&AI, Poilcy)
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Scale Out - Integration Test Cases and Status
Recommended for a GO
#2 Any blocker? If yes then please provide JIRA Ticket
minor updates
APPC
VID
DCAE
SO
Policy
...
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Any blocker? If yes then please provide JIRA Ticket Jira server ONAP JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 425b2b0a-557c-3c0c-b515-579789cceedb key SDNC-1184
https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn
updates will be based on Frankfurt scope
SDNC
AAI
OOF
UUI
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
Test Environment:
- Mater branch instance in Fujitsu
- Windriver SB00
- Issue at VNF resource 'certify'
Current blocker: Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key SO-2827
https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn
updates will be based on Frankfurt scope
SO - C
A&AI - C
SDN-C - C
UUI - C
SDC - TO
ExtAPI - TO
vFW/vDNS HPA Testing
(Test Plan 1 in
HPA & Cloud Agnostic Intent - R3 Test Plan)Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
Testing has been started in OOF project - Windriver lab
Manual testing has been progressing
Current issue affecting/blocking progress is:
Jira | ||||||
---|---|---|---|---|---|---|
|
Other known issues:
Using patch from
Jira | ||||||
---|---|---|---|---|---|---|
|
As with line 20 below, manual workaround for the following is being used:
Jira | ||||||
---|---|---|---|---|---|---|
|
SO
SDC
VID
OOF
Policy
SDNC
AAI
Change Management Frankfurt Extensions
Jira | ||||||
---|---|---|---|---|---|---|
|
Jira | ||||||
---|---|---|---|---|---|---|
|
Steps:
1) Instantiation of vFWDT
2) Configuration of OOF Policies for vFWDT
3) Execution of OSDF/HAS requests for data collection
4) Configuration of VNF profiles in CDT
5) Configuration of Ansible Server
6) Execution of the workflow
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Requires functional integration lab to complete Policy/OOF integration test.
Updated 7th of May
Recommended for a GO
1) PASS
2) IN PROGRESS/BLOCKED
3) PASS
4) PASS
5) PASS
6) PASS
90% Completed
BLOCKED by
Jira | ||||||
---|---|---|---|---|---|---|
|
El Alto doc good: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFWDT.html#docs-vfw-traffic
but major updates needed (as the use cases evolved)
Major documentation change completed https://gerrit.onap.org/r/c/integration/+/102853
Minor change with policy upload change still to be updated.
No
Use case will be semi-automated. All the steps can be performed with scripts but still CI scripts needs to be build. Planned for next release.
SDC
AAI
SO
VID
OOF
Policy
APPC
PNF Software Upgrade
- PNF / Enhancement on PNF Software Upgrade with EM with Ansible
Steps:
1) Execute custom PNF SW Upgrade WF from SO
2) SO send conventional LCM API to SDNC/CCSDK
3) Controller send ansible commands to AS
4) AS contact EM with ansible
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
Test results:
Test Status of Enhancement on PNF S/W Upgrade with EM with Ansible
Documentation containing new scenarios will be upadted in R6.
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||||
---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Swisscom lab is closed. Waiting on the set up of a second lab at UNH-IOL (ongoing)
Update: UNH-IOL lab set up needs additional 1-2 days
We will do our best to finish BBS tests by May 14th, but it is challenging
Recommended for a GO
Frankfurt doc: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_BBS.html
No, planned for future releases
Status | ||||
---|---|---|---|---|
|
https://onap-sdc.readthedocs.io/en/latest/consumedapis.html
https://onap-doc.readthedocs.io/projects/onap-sdc/en/latest/externaltesting.html
SDC
VTP
Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud
Jira | ||||||
---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
completed test with manual workaround for following 3 items:
Known issues:
Jira | ||||||
---|---|---|---|---|---|---|
|
Jira | ||||||
---|---|---|---|---|---|---|
|
Jira | ||||||
---|---|---|---|---|---|---|
|
After above are fixed, a retest can be made to verify.
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
Status | ||||
---|---|---|---|---|
|
Status | ||||||
---|---|---|---|---|---|---|
|
Recommended for a GO
Need to re-test SSL enabled HTTPS ports among DMAAP message router, SDNC DMAAP listener and SDNC dockers
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
Jira server ONAP JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 425b2b0a-557c-3c0c-b515-579789cceedb key INT-1450
Documentation is updated with new use cases in Frankfurt
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
K8s CDS Support (vFW_CDS_CNF)
Jira | ||||||
---|---|---|---|---|---|---|
|
- Installation of KUD k8s environment
- Configuration of k8s tenant in AAI
- Configuration of kud/k8s region in multicloud
- Configuration of kud/k8s region in SO
- Modification of SO BPMN configuration
- Onboarding of artifacts to SDC
- Design and distribution of service in SDC
- Instantiation of Service with SO
Jira | ||||||
---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Updated 07.05
Recommended for a GO
Currently successfully verified with workarounds.
Raw recording of live verification session in Windriver lab
BLOCKERS:
Jira server ONAP JIRA columns key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution serverId 425b2b0a-557c-3c0c-b515-579789cceedb key SDC-2972 Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key MULTICLOUD-1053 Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key MSB-467
Fixes under these Jira are currently under verification
ETSI Alignment
SO plugin to support SOL003 to connect to an external VNFM
Jira | ||||||
---|---|---|---|---|---|---|
|
Manual testing for package management is done. Due to delay on the package management notification issues for SDC and ETSI Catalog Manager SOL001 VNFD handling discrepancies, CSIT test has been delayed. Now, the discrepancies are resolved.
Will update the status again by May 6th based on the progress.
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#2 Any blocker? If yes then please provide JIRA Ticket
5G - Preonboarding/Onboarding - Test Status
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
Tes Cases passed on RC0. Test status: xNF communication security enhancements - Tests Description and Status
Yes
PNF Software Upgrade
- PNF / PNF Software Upgrade with EM with Netconf
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
Test results:
Test Status of PNF S/W Upgrade with EM with Netconf/Yang interface
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
New documentation to be created, as it is a new use case for Frankfurt
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Configuration with NETCONF in Frankfurt/R6
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Policy - CDS integration test was successfully completed in SB01 lab for vFW use case.
CLAMP - Policy integration test was successfully completed in SB01 lab for vFW use case.
Jira | ||||||
---|---|---|---|---|---|---|
|
https://docs.onap.org/en/latest/submodules/policy/parent.git/docs/development/actors/cds/cds.html
Policy Framework
CDS
A&AI
CLAMP
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
Jira | ||
---|---|---|
|
Expected to be completed by next week.
|
AAF-Certservice, SDNC,
Netconf-Pnp-Simulator
Currently Blocked on below issues:
|
|
Jira | |||||
---|---|---|---|---|---|
|
|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||||
---|---|---|---|---|---|---|
|
Recommended for a GO
At present one test case is getting failed due to :
Jira | ||||
---|---|---|---|---|
|
|
E2E Automation vLB w/CDS Use Case (Frankfurt)
NOTE: SO is using Config Assign & Config Deploy building blocks.
SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation will be a separate test case.[row below]
Steps:
Design Time
1) CBA Package onboarding CDS
2) SDC VSP, VF, Service Creation and onbaording for vLB.
Run Time:
1) SO send Marcro requst to SDNC GR-API
2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution
3) SO sends request to CDS for Config Assign.
4) SO sends request to Openstack for vLB Instantiation
5) SO send request to CDS for ConfigDeploy
Expected to be completed by next week.
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
AAF-Certservice, SDNC,
Netconf-Pnp-Simulator
Currently Blocked on below issues:
Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key SDNC-1155
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
SO issue with heat stack creation. Jira is open.
Jira
Jira | |
---|---|
|
|
|
|
E2E Automation vLB w/CDS Use Case (Frankfurt)
NOTE: SO is using Config Assign & Config Deploy building blocks.
SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation will be a separate test case.[row below]
Steps:
Design Time
1) CBA Package onboarding CDS
2) SDC VSP, VF, Service Creation and onbaording for vLB.
Run Time:
1) SO send Marcro requst to SDNC GR-API
2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution
3) SO sends request to CDS for Config Assign.
4) SO sends request to Openstack for vLB Instantiation
5) SO send request to CDS for ConfigDeploy
Status | |||
---|---|---|---|
|
Steps:
Jira | ||||||
---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
SO issue with heat stack creation. Jira is open.
Jira | |||||
---|---|---|---|---|---|
|
|
|
|
|
|
|
CONFIGURATION & PERSISTENCY SERVICE R6
Status | ||||
---|---|---|---|---|
| ||||
Status | ||||
colour | Blue | |||
title | May 20 |
(Updated May 7 2020)
Recommended for a GO
Benjamin Cheung to update status by May 8.
|
Recommended for a GO
Jira | ||||||
---|---|---|---|---|---|---|
|
Integration work will be part of OOF / SON / PCI Use Case.
will have the same integration status as that use case.
(Read the Docs entry in progress) being done under Integration Jira-1526
Jira | ||
---|---|---|
|
|
Status | ||||
---|---|---|---|---|
|
Status | ||||||
---|---|---|---|---|---|---|
|
(Updated May 7 2020)
Recommended for a GO
Benjamin Cheung to update status by May 8.
Integration work will be part of OOF / SON / PCI Use Case.
will have the same integration status as that use case.
(Read the Docs entry in progress) being done under Integration Jira-1526
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
vCPE Integration Test Case
PROGRESSING <90%
???
During May 4 PTL meeting, Morgan Richomme reports that this issue may need to be de-scoped since there are no resources available for integration test.
vCPE Integration Test Case
PROGRESSING <90%
???
During May 4 PTL meeting, Morgan Richomme reports that this issue may need to be de-scoped since there are no resources available for integration test.
Not restested as part of Frankfurt release
Steps:
1) Designing custom workflows with Workflow Designer
2) Distributing custom workflows to SO
3) Deploying the custom workflow in SO
4) Sending workflow metadata to VID
5) Triggering custom workflow execution from VID
6) Executing custom workflows in SO
Not restested as part of Frankfurt release
5G - PNF Configuration via Netconf - Test Status
Intel/
Windriver
This item is duplicate.
Please see line #37 for work related to this feature in R6.
Minor updates
Steps:
1) Designing custom workflows with Workflow Designer
2
1) Designing custom workflows with Workflow Designer – 100%
2) Distributing custom workflows to SO
3) Deploying the custom workflow in SO
4) Sending workflow metadata to VID
5) Triggering custom workflow execution from VID
6) Executing custom workflows in SO
7) Pause for Manual Task – 100%
Status | ||||
---|---|---|---|---|
|
Not restested as part of Frankfurt release
1) Designing custom workflows with Workflow Designer – 100%
2) Distributing custom workflows to SO – Was 100% in Dublin Issues arose with SDC Distribution in El Alto and remain unresolved – 80% working now. However, SO does work properly with manual WF distribution and workaround notes are posted on the wiki
3) Deploying the custom workflow in SO – 100%
4) Sending workflow metadata to VID – 100%
5) Triggering custom workflow execution from VID – 100%
6) Executing custom workflows in SO – Execution mechanism 100%, Building Blocks – 60% (Had many issues with test environment & APPC blocking testing from Nov-Jan)
7) Pause for Manual Task – 100%
Status | ||||
---|---|---|---|---|
|
Not restested as part of Frankfurt release
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00.
Additional testing is covered via the vFW, Scale Out, vFW CDS use cases.
Automated test for vFW updated:
Jira | ||||||
---|---|---|---|---|---|---|
|
No other automated tests for CLAMP as this was tested manually using CLAMP GUI.
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Testing completed via
CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00.
Additional testing is covered via the vFW, Scale Out, vFW CDS use cases.
Automated test for vFW updated:
Jira | ||||||
---|---|---|---|---|---|---|
|
No other automated tests for CLAMP as this was tested manually using CLAMP GUI
.
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Testing completed via CLAMPPOLICY/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00.
Additional testing is covered via the vFW, Scale Out, vFW CDS use cases.
DCAE pairwise testing completed by RC0.
No automated testsNo automated tests as this is done manually via the CLAMP GUI.
Jira | ||||||||
---|---|---|---|---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00.
Additional testing is covered via the vFW, Scale Out, vFW CDS use cases.
No automated tests as this is done manually via the CLAMP GUI
Policy - CDS integration test was successfully completed in SB01 lab for vFW use case.
CLAMP - Policy integration test was successfully completed in SB01 lab for vFW use case.
Jira | ||||||
---|---|---|---|---|---|---|
|
https://docs.onap.org/en/latest/submodules/policy/parent.git/docs/development/actors/cds/cds.html
Policy Framework
CDS
A&AI
|
Status | ||||
---|---|---|---|---|
|
Recommended for a GO
#1 Can you please provide your tests results?
#2 Any automated tests?
Policy/CCSDK testing was successfully completed via pairwise testing in SB01 by RC0.
Policy/OOF testing successfully completed by RC1 and was done in SB01.
No automated tests.
Jira | ||||||
---|---|---|---|---|---|---|
|
Jira | ||||||
---|---|---|---|---|---|---|
|
Robot Keyword Testing
Status | ||||
---|---|---|---|---|
|
Status | ||||
---|---|---|---|---|
|
instantiateVFWCLGRA
Status | ||||
---|---|---|---|---|
|
HTTP Certificate Expiry Test
(verify_cert.sh)
clamp 3/2020
dmaap 3/2020
Tobe integrated in gate, raise an error in CI when 1 of the certificates is about to expire (in 2 weeks?)
Integration
...