You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 223 Next »

Color Guide

ONLY Completed items should be green. 

COMPLETED

PROGRESSING >= 90%

PROGRESSING <90%

TARGET COMPLETION

#

Use Case

Functional Requirement

Nonfunctional Requirement

Test Cases

Lab

Integration

Test Lead

Status

(remaining days of effort)

 TSC Feedback

Details

Doc status

CI integration*

Components involved

Comments

1

vFW

Model Driven Control Loop Design 

vFWCL

Testing with GRA_API in VID/SO/SDNC


(vDNS is part of scale out use case below #11)


Intel / Windriver

Azure

Recommended for a GO

COMPLETED

(need to regression on final dockers)

Recommended for a GO

Distribtion

COMPLETED

Instantiation

COMPLETED

Control Loop

COMPLETED

Work around applied for appc.properties in Jira

Blocker:

INT-1568 - Getting issue details... STATUS


APPC-1876 - Getting issue details... STATUS


?

SDC

Dmaap

SDNC

SO

AAI

Policy

Appc

...


3

vCPE with TOSCA

MODELING-354 - Getting issue details... STATUS

VFC-1654 - Getting issue details... STATUS

USECASEUI-438 - Getting issue details... STATUS


vCPE(tosca) - Integration test cases

CMCC / Intel 

COMPLETED

Recommended for a GO

https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE_with_Tosca_VNF.html

minor updates

Yes

SDC

Dmaap

AAI

Multicloud

VFC

UUI

Modeling

...



45G - Realtime PM and High Volume Stream Data Collection5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases

Intel / Windriver

COMPLETED


Recommended for a GO

Test Cases passed on RC0

Test status:

5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases

https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm

Yes

CSIT's

DCAE
5

5G - PNF PnP

REQ-134 - Getting issue details... STATUS

5G - PNF PnP - Integration Test Cases

Intel / Windriver

COMPLETED


Recommended for a GO

Test Cases passed on RC0

https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_5g_pnf_pnp.html#docs-5g-pnf-pnp

minor updates

Already in CI gate

16.04:

Currently released image for SO-BPMN (1.6.0 form27'th of March) is not working.

Image from today 16.04 is sufficient and works. v2/onap/so/bpmn-infra/manifests/1.6.0-20200416T0645 
→ There will be need to release new SO images

6

 5G - Bulk PM

REQ-129 - Getting issue details... STATUS


5G - Bulk PM - Test Status

Ericsson LabJames Cuddy

COMPLETED

Recommended for a GO



DCAEGEN2-2217 - Getting issue details... STATUS



DCAEGEN2-2217 - Getting issue details... STATUS

75G - Configuration with NETCONF

5G - PNF Configuration via Netconf - Test Status

Intel/

Windriver


This item is duplicate.

Please see line #37 for work related to this feature in R6.



https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5G_Configuration_over_NETCONF.html#docs-5g-configuration-over-netconf

Minor updates

Yes

8

5G - PNF Pre-Onboarding & Onboarding

REQ-135 - Getting issue details... STATUS

5G - Preonboarding/Onboarding - Test Status

Intel / Windriver

PNF Preonboarding (VNF SDK):

Marcin Przybysz

Krzysztof Kuzmicki

Dermot Melia

PNF Onboarding (SDC):

Andy Walshe

PROGRESSING >= 90%

15.05

Recommended for a GO


SOL004 option 1 need to be checked manually in VNFSDK 

SDC-2981 - Getting issue details... STATUS   - blocks automated test cases for SOL004 in PNF Onboarding part

VNFSDK-582 - Getting issue details... STATUS

VNFSDK-581 - Getting issue details... STATUS



16.04:

New image has been released /onap/vnfsdk/refrepo:1.5.1 

  • package integrity rules are present (SOL004 option 1) - need to have prepared  automated test cases
  • PNF SW update validation rules are present need to have prepared  automated test cases
  • Full integration  automation of pre-onboarding and onboarding tests is ongoing
95G - OOF SON: OOF (SON) in R5 El Alto, OOF (SON) in R6 Frankfurt

Integration Test

OWL / Windriver

PROGRESSING <90%

MAY 20TH

updated on 6th May

Recommended for a GO

Test is in progress.

Use case: https://docs.onap.org/en/dublin/submodules/integration.git/docs/docs_5G_oof_pci.html

SON-Handler MS (DCAE): https://onap.readthedocs.io/en/latest/submodules/dcaegen2.git/docs/sections/services/son-handler/index.html

Updates for Frankfurt submitted (INT-1466 and DCAEGEN2-2104)

Stretch goal, will take this up in next releaseDCAE (SON-Handler MS), Policy, SDN-C, OOF

Use case integration test cases status can be found in below page

Integration Test


10E2E Network SlicingTest StatusWindriver/CMCC

PROGRESSING <90%

MAY 15TH

updated on May 6th

Recommended for a GO

Test is in progress.

Use case documentation submitted (INT-1468). 

Stretch goal, will take this up in next release.

UUI, EXT-API, SO, OOF

(Test only: SDC, A&AI, Poilcy)

OPTFRA-749 - Getting issue details... STATUS

11Scale Out

Scale Out - Integration Test Cases and Status

Intel / Windriver

Recommended for a GO

#2 Any blocker? If yes then please provide JIRA Ticket


https://onap.readthedocs.io/en/lastest/submodules/integration.git/docs/docs_scaleout.html#docs-scaleout

minor updates


APPC

VID

DCAE

SO

Policy

...

Some new platform capabilities have been developed in SO and CDS. If they can’t be used for some reason, we’ll fall back to using the current process.
12CCVPN-E LINE over OTN NNICCVPN Integration Test CasesHuawei

PROGRESSING >= 90%

MAY 8TH



Recommended for a GO

#1 Any blocker? If yes then please provide JIRA Ticket


https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn

updates will be based on  Frankfurt scope


SDNC

AAI

OOF

UUI


12.1CCVPN - MDONSMDONS Integration Test Case Fujitsu/Orange

PROGRESSING >= 90%

MAY 8TH


Recommended for a GO


Test Environment:

  1. Mater branch instance  in Fujitsu
  2. Windriver SB00
    1. Issue at VNF resource 'certify' 

Current  blocker: SO-2827 - Getting issue details... STATUS

https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn

updates will be based on  Frankfurt scope


SO - C

A&AI - C

SDN-C - C

UUI - C

SDC - TO

ExtAPI - TO


13HPA vFW/vDNS

vFW/vDNS HPA Testing

(Test Plan 1 in

HPA & Cloud Agnostic Intent - R3 Test Plan)
Intel / Windriver

PROGRESSING <90%

MAY 15

Recommended for a GO



Testing has been started in OOF project - Windriver lab

Manual testing has been progressing

Current issue affecting/blocking progress is:  OPTFRA-750 - Getting issue details... STATUS

Other known issues:

Using patch from  CLI-269 - Getting issue details... STATUS  to manually use CLI updates for loading policies.


As with line 20 below, manual workaround for the following is being used:  MSB-467 - Getting issue details... STATUS  

https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfwHPA.html#docs-vfw-hpa

SO

SDC

VID

OOF

Policy

SDNC

AAI


15

Change Management Frankfurt Extensions


REQ-187 - Getting issue details... STATUS

REQ-191 - Getting issue details... STATUS

Steps:

1) Instantiation of vFWDT

2) Configuration of OOF Policies for vFWDT

3) Execution of OSDF/HAS requests for data collection

4) Configuration of VNF profiles in CDT

5) Configuration of Ansible Server

6) Execution of the workflow


Intel / Windriver

PROGRESSING >= 90%

MAY 15TH

Requires functional integration lab to complete Policy/OOF integration test.

Updated 7th of May

Recommended for a GO


1) PASS

2) IN PROGRESS/BLOCKED

3) PASS

4) PASS

5) PASS

6) PASS

90% Completed

BLOCKED by non-functional OOF instance to continue tests on SB-00.

AAF-1141 - Getting issue details... STATUS

El Alto doc good: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFWDT.html#docs-vfw-traffic

but major updates needed (as the use cases evolved)


Major documentation change completed https://gerrit.onap.org/r/c/integration/+/102853

Minor change with policy upload change still to be updated.


No

Use case will be semi-automated. All the steps can be performed with scripts but still CI scripts needs to be build. Planned for next release.

SDC

AAI

SO

VID

OOF

Policy

APPC

Use case will be renamed and include upgrade
16

PNF Software Upgrade

  • PNF / Enhancement on PNF Software Upgrade with EM with Ansible

Steps:

1) Execute custom PNF SW Upgrade WF from SO

2) SO send conventional LCM API to SDNC/CCSDK

3) Controller send ansible commands to AS

4) AS contact EM with ansible

Huawei

INT-1207 - Getting issue details... STATUS

COMPLETED

Recommended for a GO

Test results:

Test Status of Enhancement on PNF S/W Upgrade with EM with Ansible

Documentation containing new scenarios will be upadted in R6.

INT-1209 - Getting issue details... STATUS




18BBS Broadband Service Use Case (Frankfurt)BBS Integration Test Cases (Frankfurt)BBS Swisscom Lab

45% COMPLETED

MAY 14TH

Swisscom lab is closed. Waiting on the set up of a second lab at UNH-IOL (ongoing)

Update: UNH-IOL lab set up needs additional 1-2 days 

We will do our best to finish BBS tests by May 14th, but it is challenging

Recommended for a GO

Frankfurt doc: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_BBS.html 

No, planned for future releases


we need to find a solution to emulate 3rd party controllers first. Our use case relies on physical equipment and external controllers and we can only test it in the Swisscom lab at the moment. We may have a second lab with the required equipment in UNH-IOL, but it is not confirmed yet.
19VSP Compliance and Validation Check within SDC (Frankfurt) - Phase 2VSP Compliance Check within SDC - Integration Test PlanVodafoneRecommended for a GO

https://wiki.onap.org/display/DW/VSP+Compliance+and+Validation+Check+within+SDC+%28Frankfurt%29+-+Phase+2#VSPComplianceandValidationCheckwithinSDC(Frankfurt)Phase2-VSPComplianceCheckwithinSDC-IntegrationTestPlan

https://onap-sdc.readthedocs.io/en/latest/consumedapis.html

https://onap-doc.readthedocs.io/projects/onap-sdc/en/latest/externaltesting.html

No

SDC

VTP


20K8S based Cloud Region Support - vFW Use case

Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud REQ-182 - Getting issue details... STATUS

intel / Windriver

PROGRESSING >= 90%

MAY 15

Recommended for a GO

completed test with manual workaround for following 3 items:

Known issues:

MSB-467 - Getting issue details... STATUS  using manual workaround to get past this for now

MULTICLOUD-1053 - Getting issue details... STATUS  will need to be sorted out

SDC-2972 - Getting issue details... STATUS  using manual workaround to get past this for now.

After above are fixed, a retest can be made to verify.





21K8S based Cloud Region Support - EdgeXFoundry Use caseDeploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes CloudIntel/ Windriver

PROGRESSING >= 90%

MAY 15

Recommended for a GO


same as line above: initial tests completed using the workarounds described in line #20.



22ORAN A1 Adapter Implemented in ONAP (SDNR) A1 Adapter Test CasesIntel/Windriver

PROGRESSING >= 90%

MAY 15TH

Recommended for a GO

Need to re-test SSL enabled HTTPS ports among DMAAP message router, SDNC DMAAP listener and SDNC dockers

SDNC-1183 - Getting issue details... STATUS

SDNC-1138 - Getting issue details... STATUS

SDNC-1167 - Getting issue details... STATUS






23PNF Software Upgrade using direct Netconf/Yang interface with PNFPNF Software Upgrade Using direct NETCONF/YANG interfacewithPNFTestCasesIntel

INT-1308 - Getting issue details... STATUS

COMPLETED

Recommended for a GO





24Enable PNF software version at onboardingPNF Software Information Onboarding Test CasesEricsson LabAndré Schmid

INT-1307 - Getting issue details... STATUS

COMPLETED

Recommended for a GO






25

K8s CDS Support (vFW_CDS_CNF) REQ-182 - Getting issue details... STATUS (SO and CDS Macro flow with Helm Chart)

  1. Installation of KUD k8s environment
  2. Configuration of k8s tenant in AAI
  3. Configuration of kud/k8s region in multicloud
  4. Configuration of kud/k8s region in SO
  5. Modification of SO BPMN configuration
  6. Onboarding of artifacts to SDC
  7. Design and distribution of service in SDC
  8. Instantiation of Service with SO
Private lab + Intel/Windriver community lab

INT-1184 - Getting issue details... STATUS PROGRESSING >= 90%

MAY 15TH

Updated 07.05

Recommended for a GO

Currently successfully verified with workarounds.

Raw recording of live verification session in Windriver lab

BLOCKERS:

SDC-2972 - Getting issue details... STATUS MULTICLOUD-1053 - Getting issue details... STATUS MSB-467 - Getting issue details... STATUS

Fixes under these Jira are currently under verification

https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFW_CNF_CDS.html but needs to be updated according to latest verification statusAutomation of usecase targeted for G release
07.05: Currently usecase has been verified to work both in internal and windriver lab with workaround. Ongoing tests regarding verifying fixes provided under blocker jiras.
26

ETSI Alignment

SO plugin to support SOL003 to connect to an external VNFM



SO-2683 - Getting issue details... STATUS

Manual testing for package management is done. Due to delay on the package management notification issues for SDC and ETSI Catalog Manager SOL001 VNFD handling discrepancies, CSIT test has been delayed. Now, the discrepancies are resolved.

Will update the status again by May 6th based on the progress.

PROGRESSING <90%

MAY 15TH

Recommended for a GO

#2 Any blocker? If yes then please provide JIRA Ticket






27SOL 004 (VNF Package Security)

5G - Preonboarding/Onboarding - Test Status

Ericsson, Intel / WindriverAll activities, status (incl. days to completion) of this item are embedded into “5G - Preonboarding/Onboarding - Test Status
Please see item 5G - Preonboarding/Onboarding - Test StatusPlease see item 5G - Preonboarding/Onboarding - Test StatusPlease see item 5G - Preonboarding/Onboarding - Test StatusPlease see item 5G - Preonboarding/Onboarding - Test StatusAll activities, status (incl. days to completion) of this item are embedded into “5G - Preonboarding/Onboarding - Test Status
28xNF communication security enhancements.xNF communication security enhancements - Tests Description and Status

COMPLETED

Recommended for a GO

Tes Cases passed on RC0. Test status: xNF communication security enhancements - Tests Description and Status


Yes

CSIT's

DCAE
30

PNF Software Upgrade

  • PNF / PNF Software Upgrade with EM with Netconf
PNF software upgrade in R6 FrankfurtHuawei
INT-1212 - Getting issue details... STATUS

COMPLETED

Recommended for a GO

Test results:

Test Status of PNF S/W Upgrade with EM with Netconf/Yang interface

INT-1209 - Getting issue details... STATUS




315G - 5G NRM Network Resource Model (Configuration Mgmt)5G Network Resource Model (NRM) Configuration in R6 FrankfurtHuawei
INT-1245 - Getting issue details... STATUS

COMPLETED

Recommended for a GO


New documentation to be created, as it is a new use case for Frankfurt

INT-1514 - Getting issue details... STATUS




37

Configuration with NETCONF in Frankfurt/R6

REQ-76 - Getting issue details... STATUS

REQ-140 - Getting issue details... STATUS

Detailed Steps carried out for performing E2E Testcases can be found at :  E2E Integration Testing for NETCONF over TLS Configuration- Test Case
Ajay Deep Singh

PROGRESSING <90%

MAY 8TH

Recommended for a GO

At present one test case is getting failed due to :

SDNC-1177 - Getting issue details... STATUS


Expected to be completed by next week.

INT-1295 - Getting issue details... STATUS

Yes

AAF-Certservice,  SDNC,

Netconf-Pnp-Simulator

Currently Blocked on below issues: 

SDNC-1155 - Getting issue details... STATUS

SDNC-1177 - Getting issue details... STATUS


38

E2E Automation vLB w/CDS Use Case (Frankfurt)


NOTE: SO is using Config Assign & Config Deploy building blocks. 


SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation will be a separate test case.[row below]

Steps:

Design Time

1) CBA Package onboarding CDS

2) SDC VSP, VF, Service Creation and onbaording for vLB.


Run Time: 

1) SO send Marcro requst to SDNC GR-API

2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution

3) SO sends request to CDS for Config Assign.

4) SO sends request to Openstack for vLB Instantiation 

5) SO send request to CDS for ConfigDeploy

Intel / Windriver

COMPLETED


Recommended for a GO




CDS, SDNC, SO, Policy, Naming MS, Netbox

SO issue with heat stack creation. Jira is open. 


SO-2802 - Getting issue details... STATUS

39

3rd Party Operational Domain Manager

Steps:

Steps to test SDC changes

SDC-2879 - Getting issue details... STATUS

Telstra

COMPLETED


Recommended for a GO

SDC-2879 - Getting issue details... STATUS






40

REQ-267 - Getting issue details... STATUS

CONFIGURATION & PERSISTENCY SERVICE R6


WinLAB

PROGRESSING <90%

???

Recommended for a NO GO

Candidate to be descoped from Frankfurt since no update or to move under POC

#1 Can you please provide an estimate about how many days of effort left/Target date completion?

#2 Any blocker? If yes then please provide JIRA Ticket

Benjamin Cheung to update status by May 8.

Integration work will be part of OOF / SON / PCI Use Case.


will have the same integration status as that use case.

(Read the Docs entry in progress) being done under Integration Jira-1526

INT-1526 - Getting issue details... STATUS


SDN-C (CC-SDK) using MariaDBSandeep is leading the Integration & Development.
Use cases without resources for Frankfurt
2Use Case: Residential Broadband vCPE (Approved)

vCPE Integration Test Case

Intel / Windriver


PROGRESSING <90%

???

During May 4 PTL meeting, Morgan Richomme reports that this issue may need to be de-scoped since there are no resources available for integration test.

Not restested as part of Frankfurt release


https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE.htmlNo


14Change Management - Flexible Designer & Orchestrator

Steps:

1) Designing custom workflows with Workflow Designer

2) Distributing custom workflows to SO

3) Deploying the custom workflow in SO

4) Sending workflow metadata to VID

5) Triggering custom workflow execution from VID

6) Executing custom workflows in SO

Intel / Windriver
NOT A CANDIDATE FOR FRANKFURT


Not restested as part of Frankfurt release


1) Designing custom workflows with Workflow Designer – 100%

2) Distributing custom workflows to SO – Was 100% in Dublin Issues arose with SDC Distribution in El Alto and remain unresolved – 80% working now. However, SO does work properly with manual WF distribution and workaround notes are posted on the wiki

3) Deploying the custom workflow in SO – 100%

4) Sending workflow metadata to VID – 100%

5) Triggering custom workflow execution from VID – 100%

6) Executing custom workflows in SO – Execution mechanism 100%, Building Blocks – 60% (Had many issues with test environment & APPC blocking testing from Nov-Jan)

7) Pause for Manual Task – 100%





17Change Management - Schedule Optimization
Intel / Windriver

NOT A CANDIDATE FOR FRANKFURT


Not restested as part of Frankfurt release






29HPA vIPsecvIPsec HPA testingIntel / WindriverNot testedNot restested as part of Frankfurt release




Pairwise testing
32TOSCA Compliant Policy typesPairwise TestingIntel / Windriver

COMPLETED

Recommended for a GO

#1 Can you please provide your tests results?

#2 Any automated tests?

Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00.

Additional testing is covered via the vFW, Scale Out, vFW CDS use cases.

Automated test for vFW updated:

INT-1350 - Getting issue details... STATUS

No other automated tests for CLAMP as this was tested manually using CLAMP GUI.

REQ-21 - Getting issue details... STATUS




33Policy Update NotificationsPairwise TestingIntel / Windriver

COMPLETED

Recommended for a GO

#1 Can you please provide your tests results?

#2 Any automated tests?

Testing completed via POLICY/DCAE pairwise testing completed by RC0.


No automated tests.

REQ-25 - Getting issue details... STATUS




34CLAMP Deployment of Policies to PDP GroupsPairwise TestingIntel / Windriver

COMPLETED

Recommended for a GO

#1 Can you please provide your tests results?

#2 Any automated tests?

Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00.

Additional testing is covered via the vFW, Scale Out, vFW CDS use cases.


No automated tests as this is done manually via the CLAMP GUI.

REQ-29 - Getting issue details... STATUS




35Integration of CDS as an ActorIntegration TestingIntel / Windriver

COMPLETED

Recommended for a GO

#1 Can you please provide your tests results?

#2 Any automated tests?

Policy - CDS integration test was successfully completed in SB01 lab for vFW use case.

CLAMP - Policy integration test was successfully completed in SB01 lab for vFW use case.


Policy Framework

CDS

A&AI

CLAMP


36Component Upgrades to the new Policy Lifecycle APIPairwise TestingIntel / Windriver

COMPLETED

Recommended for a GO

#1 Can you please provide your tests results?

#2 Any automated tests?

Policy/CCSDK testing was successfully completed via pairwise testing in SB01 by RC0.

Policy/OOF testing successfully completed by RC1 and was done in SB01.

No automated tests.

REQ-162 - Getting issue details... STATUS




POLICY-2486 - Getting issue details... STATUS


Misc




















Robot Keyword Testing





init_robot








init
BDFOK





health
Integrated in gate

COMPLETED







eteHelm-k8.sh
BDF*OK

Not integrated in gate but onap-k8s and onap-helm (not based on Robot) Integrated in Gate


healthdist
Integrated in gate

COMPLETED







instantiateVFWCLGRA


BDFOK





demo-k8s.sh -n onap vfwclosedloop <png_ip>
BDFOK





instantiateVFWDTGRA
BDFOK





distributeVCPE
BDFOK





distributeVCPEResCust








sdc-dcae-d








vcpe.py








postinstall
Integrated in gate

COMPLETED







72 Hour Stability Runonboard/instantiate








closedloop








HTTP Certificate Expiry Test

(verify_cert.sh)



clamp 3/2020

dmaap 3/2020





Tobe integrated in gate, raise an error in CI when 1 of the certificates is about to expire (in 2 weeks?)




27Component/memory optimization: Ongoing Assessment
OOM


Addressed by OOM in Guilin


29S3P- Geo-Redundancy
Integration
Not tested as part of Frankfurt release
No resources


35Health Checks for PODSPercentage coverage of Health Checks for Running PODSIntegration


Hard to define...and to test


36


New Installation Tests in 4 labs


Intel/Windriver 
Integration











Reccurent activity















Orange  (Rocky)Morgan Richomme 
Ericsson Lab  (Rocky)
DT


DCAEGEN2-1539 - Getting issue details... STATUS


*: CI integration: the goal is to introduce the use case in CI daily chains for Frankfurt. Ths table could be completed with a CI dashboard where the use cases will be run every day.

As it should be runnable in any lab, some constraints need to be considered:

  • no proprietary VNFs                                            
  • use cases must be self-content , third party equiments may not be present in all labs.
  • infrastructure setup/teardown shall be clear: the use case must be runnable from a clean ONAP installation. These resources must be cleaned at the end of the test ,
  • results shall be pushed to a common DB. It is recommended ot use xtesting to run the tests (robotframework, python, bash, unit test drivers)















  • No labels