2: Frankfurt Release Integration Testing Status

Color Guide

ONLY Completed items should be green.

COMPLETED

PROGRESSING >= 90%

PROGRESSING <90%

#	Use Case Functional Requirement Nonfunctional Requirement	Test Cases	Lab	Integration Test Lead	Status (remaining days of effort)	Details	Doc status	CI integration*	Components involved	Comments
1	vFW Model Driven Control Loop Design	vFWCL Testing with GRA_API in VID/SO/SDNC (vDNS is part of scale out use case below #11)	Intel / Windriver Azure	Brian Freeman Marco Platania	PROGRESSING <90%	Distribtion COMPLETED Instantiation COMPLETED Control Loop PROGRESSING	https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfw.html#docs-vfw minor updates log.vFWCLGRA.20200415.tar.gz	?	SDC Dmaap SDNC SO AAI Policy ...
2	Use Case: Residential Broadband vCPE (Approved)	vCPE Integration Test Case	Intel / Windriver		PROGRESSING <90%		https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE.html	No
3	vCPE with TOSCA	vCPE(tosca) with HPA - Integration test cases	CMCC / Intel	Huang Haibin Liping Zhao	PROGRESSING <90%		https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE%20with%20Tosca%20VNF.html minor updates	Yes
4	5G - Realtime PM and High Volume Stream Data Collection	5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases	Intel / Windriver	Marcin Przybysz	PROGRESSING	Test Cases passed on RC0	https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm	Yes CSIT's	DCAE
5	5G - PNF PnP REQ-134 - Getting issue details... STATUS	5G - PNF PnP - Integration Test Cases	Intel / Windriver	Marcin Przybysz Krzysztof Kuzmicki	PROGRESSING <90%		https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_5g_pnf_pnp.html#docs-5g-pnf-pnp minor updates	Already in CI gate		16.04: Currently released image for SO-BPMN (1.6.0 form27'th of March) is not working. Image from today 16.04 is sufficient and works. v2/onap/so/bpmn-infra/manifests/1.6.0-20200416T0645 → There will be need to release new SO images
6	5G - Bulk PM "Data Plane"	5G - Bulk PM - Test Status	Ericsson Lab	user-3784d Liam Burke	PROGRESSING <90%
7	5G - Configuration with NETCONF	5G - PNF Configuration via Netconf - Test Status	Intel/ Windriver	Rahul Tyagi Eric Moore Raj Gumma	PROGRESSING <90%		https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5G_Configuration_over_NETCONF.html#docs-5g-configuration-over-netconf Minor updates	Yes
8	5G - PNF Pre-Onboarding & Onboarding REQ-135 - Getting issue details... STATUS	5G - Preonboarding/Onboarding - Test Status	Intel / Windriver	PNF Preonboarding (VNF SDK): Marcin Przybysz Krzysztof Kuzmicki Dermot Melia PNF Onboarding (SDC): Andy Walshe	PROGRESSING <90%					16.04: New image has been released /onap/vnfsdk/refrepo:1.5.1 package integrity rules are present (SOL004 option 1) - need to have prepared automated test cases PNF SW update validation rules are present need to have prepared automated test cases Full integration automation of pre-onboarding and onboarding tests is ongoing
9	5G - OOF SON: OOF (SON) in R5 El Alto, OOF (SON) in R6 Frankfurt	Integration Test	OWL / Windriver	Reshmasree c	PROGRESSING <90%		Use case: https://docs.onap.org/en/dublin/submodules/integration.git/docs/docs_5G_oof_pci.html SON-Handler MS (DCAE): https://onap.readthedocs.io/en/latest/submodules/dcaegen2.git/docs/sections/services/son-handler/index.html Updates for Frankfurt submitted (INT-1466 and DCAEGEN2-2104)	Stretch goal, will be re-visited end of March	DCAE (SON-Handler MS), Policy, SDN-C, OOF
10	E2E Network Slicing	Test Status	Windriver/CMCC	Chuanyu Chen Zhang Min Swaminathan Seetharaman	PROGRESSING <90%		Use case documentation submitted (INT-1468).	Stretch goal, may not be possible within Frankfurt time frame	UUI, EXT-API, SO, OOF (Test only: SDC, A&AI, Poilcy)
11	Scale Out	Scale Out - Integration Test Cases and Status	Intel / Windriver	Scott Blandford, Marco Platania	Testing Status (Frankfurt Scaling) PROGRESSING <90%		https://onap.readthedocs.io/en/lastest/submodules/integration.git/docs/docs_scaleout.html#docs-scaleout minor updates		APPC VID DCAE SO Policy ...	Some new platform capabilities have been developed in SO and CDS. If they can’t be used for some reason, we’ll fall back to using the current process.
12	CCVPN-E LINE over OTN NNI	CCVPN Integration Test Cases	Huawei	Gaurav Agrawal	PROGRESSING <90%		https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope		SDNC AAI OOF UUI
12.1	CCVPN - MDONS	MDONS Integration Test Case	Fujitsu/Orange	Xin Miao	PROGRESSING <90%		https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope		SO - C A&AI - C SDN-C - C UUI - C CCSDK-C SDC - TO ExtAPI - TO
13	HPA vFW/vDNS	vFW/vDNS HPA Testing (Test Plan 1 in HPA & Cloud Agnostic Intent - R3 Test Plan)	Intel / Windriver	Eric Multanen	PROGRESSING <90%		https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfwHPA.html#docs-vfw-hpa		SO SDC VID OOF Policy SDNC AAI
14	Change Management - Flexible Designer & Orchestrator	Steps: 1) Designing custom workflows with Workflow Designer 2) Distributing custom workflows to SO 3) Deploying the custom workflow in SO 4) Sending workflow metadata to VID 5) Triggering custom workflow execution from VID 6) Executing custom workflows in SO	Intel / Windriver	Ajay Mahimkar Elena Kuleshov Chris Rapposelli-Manzo	PROGRESSING <90%		1) Designing custom workflows with Workflow Designer – 100% 2) Distributing custom workflows to SO – Was 100% in Dublin Issues arose with SDC Distribution in El Alto and remain unresolved – 80% working now. However, SO does work properly with manual WF distribution and workaround notes are posted on the wiki 3) Deploying the custom workflow in SO – 100% 4) Sending workflow metadata to VID – 100% 5) Triggering custom workflow execution from VID – 100% 6) Executing custom workflows in SO – Execution mechanism 100%, Building Blocks – 60% (Had many issues with test environment & APPC blocking testing from Nov-Jan) 7) Pause for Manual Task – 100%
15	Change Management Frankfurt Extensions REQ-187 - Getting issue details... STATUS REQ-191 - Getting issue details... STATUS	Steps: 1) Instantiation of vFWDT 2) Configuration of OOF Policies for vFWDT 3) Execution of OSDF/HAS requests for data collection 4) Configuration of VNF profiles in CDT 5) Configuration of Ansible Server 6) Execution of the workflow	Intel / Windriver	Lukasz Rajewski	PROGRESSING <90%		El Alto doc good: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFWDT.html#docs-vfw-traffic but major updates needed (as the use cases evolved) Documentation change is in progress https://gerrit.onap.org/r/c/integration/+/102853	No Not sure if full automation will be possible – depends on automation of APPC/CDT part.		Use case will be renamed and include upgrade
16	PNF Software Upgrade PNF / Enhancement on PNF Software Upgrade with EM with Ansible	Steps: 1) Execute custom PNF SW Upgrade WF from SO 2) SO send conventional LCM API to SDNC/CCSDK 3) Controller send ansible commands to AS 4) AS contact EM with ansible	Huawei	yaoguang wang Enbo Wang	INT-1207 - Getting issue details... STATUS COMPLETED		Documentation containing new scenarios will be upadted in R6. INT-1209 - Getting issue details... STATUS
17	Change Management - Schedule Optimization		Intel / Windriver	Ajay Mahimkar Jerry Flood	PROGRESSING <90%
18	BBS Broadband Service Use Case (Frankfurt)	BBS Integration Test Cases (Frankfurt)	BBS Swisscom Lab	David Perez Caparros Daniel Balsiger	PROGRESSING <90% Remaining days: 4 Risk: Swisscom integration lab will be closed from Apr 30. No more testing for BBS will be possible beyond that date. We are trying to set up a second lab at UNH-IOL	Details: BBS Use Case Tracking (Frankfurt Release) Integration testing started in BBS Swisscom Lab Current blocker: SO-2827 - Getting issue details... STATUS	Frankfurt doc: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_BBS.html	No, planned for future releases		we need to find a solution to emulate 3rd party controllers first. Our use case relies on physical equipment and external controllers and we can only test it in the Swisscom lab at the moment. We may have a second lab with the required equipment in UNH-IOL, but it is not confirmed yet.
19	VSP Compliance and Validation Check within SDC (Frankfurt) - Phase 2	VSP Compliance Check within SDC - Integration Test Plan	Vodafone	Prabhu Balan	Testing Status COMPLETED		https://wiki.onap.org/display/DW/VSP+Compliance+and+Validation+Check+within+SDC+%28Frankfurt%29+-+Phase+2#VSPComplianceandValidationCheckwithinSDC(Frankfurt)Phase2-VSPComplianceCheckwithinSDC-IntegrationTestPlan https://onap-sdc.readthedocs.io/en/latest/consumedapis.html https://onap-doc.readthedocs.io/projects/onap-sdc/en/latest/externaltesting.html	No	SDC VTP
20	K8S based Cloud Region Support - vFW Use case	Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cl REQ-182 - Getting issue details... STATUS oud	intel / Windriver	Ritu Sood Eric Multanen	PROGRESSING <90%
21	K8S based Cloud Region Support - EdgeXFoundry Use case	Deploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud	Intel/ Windriver	Kiran Kamineni	PROGRESSING <90%
22	ORAN A1 Adapter Implemented in ONAP (SDNR)	A1 Adapter Test Cases	Intel/Windriver	Sandeep Shah	PROGRESSING <90%
23	PNF Software Upgrade using direct Netconf/Yang interface with PNF	PNF Software Upgrade Using direct NETCONF/YANG interfacewithPNFTestCases	Intel	Raj Gumma Rahul Tyagi	INT-1308 - Getting issue details... STATUS COMPLETED		https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5G_PNF_Software_Upgrade.html#docs-5g-pnf-software-upgrade INT-1450 - Getting issue details... STATUS Documentation is updated with new use cases in Frankfurt
24	Enable PNF software version at onboarding	PNF Software Information Onboarding Test Cases	Ericsson Lab	André Schmid	INT-1307 - Getting issue details... STATUS COMPLETED
25	K8s CDS Support (vFW_CDS_CNF) REQ-182 - Getting issue details... STATUS (SO and CDS Macro flow with Helm Chart)	TO BE DEFINED	Currently testing in internal lab. Tests in official integration lab not started yet.	Konrad Bańka Lukasz Rajewski	INT-1184 - Getting issue details... STATUS PROGRESSING <90%		https://gerrit.onap.org/r/#/c/integration/+/101900/4 - in review
26	ETSI Alignment SO plugin to support SOL003 to connect to an external VNFM			Fernando Oliveira Byung-Woo Jun	SO-2683 - Getting issue details... STATUS CSIT for ETSI package management is being tested We plan to complete the CSIT by RC0 completion PROGRESSING <90%
27	Component/memory optimization: Ongoing Assessment			Eric Debeau Adolfo Perez-Duran Mike Elliott
29	S3P- Geo-Redundancy			Jason Hunt Mike Elliott
30	SOL 004 (VNF Package Security)	5G - Preonboarding/Onboarding - Test Status	Ericsson, Intel / Windriver	Samuli Kuusela	Status of this item is embedded into & equal to status of “5G - Preonboarding/Onboarding - Test Status”
31	xNF communication security enhancements.	xNF communication security enhancements - Tests Description and Status		Marcin Przybysz				Yes CSIT's	DCAE
34	HPA vIPsec	vIPsec HPA testing	Intel / Windriver	Ruoyu Ying
35	Health Checks for PODS	Percentage coverage of Health Checks for Running PODS	Integration	Brian Freeman Sylvain Desbureaux
36	New Installation Tests in 4 labs	Intel/Windriver		Brian Freeman
		Orange (Rocky)		Morgan Richomme
		Ericsson Lab (Rocky)		Andrew Fenner
		DT		Andreas Geissler
37	PNF Software Upgrade PNF / PNF Software Upgrade with EM with Netconf	PNF software upgrade in R6 Frankfurt	Huawei	yaoguang wang Enbo Wang	INT-1212 - Getting issue details... STATUS COMPLETED		INT-1209 - Getting issue details... STATUS
38	5G - 5G NRM Network Resource Model (Configuration Mgmt)	5G Network Resource Model (NRM) Configuration in R6 Frankfurt	Huawei	yaoguang wang Cheng Huang	INT-1245 - Getting issue details... STATUS COMPLETED		New documentation to be created, as it is a new use case for Frankfurt INT-1514 - Getting issue details... STATUS
39	TOSCA Compliant Policy types	Pairwise Testing	Intel / Windriver	Pamela Dragosh Gervais-Martial Ngueko	COMPLETED		REQ-21 - Getting issue details... STATUS
40	Policy Update Notifications	Pairwise Testing	Intel / Windriver	Pamela Dragosh Vijay Venkatesh Kumar	COMPLETED		REQ-25 - Getting issue details... STATUS
41	CLAMP Deployment of Policies to PDP Groups	Pairwise Testing	Intel / Windriver	Pamela Dragosh Gervais-Martial Ngueko	COMPLETED		REQ-29 - Getting issue details... STATUS
42	Integration of CDS as an Actor	TBD	Intel / Windriver	Bruno Sakoto Ram Krishna Verma Yuriy Malakov	PROGRESSING <90%		REQ-33 - Getting issue details... STATUS
42	Component Upgrades to the new Policy Lifecycle API	Pairwise Testing	Intel / Windriver	Pamela Dragosh Shankaranarayanan Puzhavakath Narayanan Yuriy Malakov	COMPLETED		REQ-162 - Getting issue details... STATUS			POLICY-2486 - Getting issue details... STATUS
43	Configuration with NETCONF in Frankfurt/R6 REQ-76 - Getting issue details... STATUS REQ-140 - Getting issue details... STATUS	Detailed Steps carried out for performing E2E Testcases can be found at : E2E Integration Testing for NETCONF over TLS Configuration- Test Case		Ajay Deep Singh	PROGRESSING <90%		INT-1295 - Getting issue details... STATUS	Yes	AAF-Certservice SDNC Netconf-Pnp-Simulator	Currently Blocked on below issues: AAF-1121 - Getting issue details... STATUS SDNC-1155 - Getting issue details... STATUS
44	E2E Automation vLB w/CDS Use Case (Frankfurt) NOTE: SO is using Config Assign & Config Deploy building blocks. SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation will be a separate test case.[row below]	Steps: Design Time 1) CBA Package onboarding CDS 2) SDC VSP, VF, Service Creation and onbaording for vLB. Run Time: 1) SO send Marcro requst to SDNC GR-API 2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution 3) SO sends request to CDS for Config Assign. 4) SO sends request to Openstack for vLB Instantiation 5) SO send request to CDS for ConfigDeploy	Intel / Windriver	Abdelmuhaimen Seaudi Yuriy Malakov	COMPLETED				CDS, SDNC, SO, Policy, Naming MS, Netbox	SO issue with heat stack creation. Jira is open. SO-2802 - Getting issue details... STATUS
45	3rd Party Operational Domain Manager	Steps: Steps to test SDC changes SDC-2879 - Getting issue details... STATUS	Telstra	Divyang Patel	COMPLETED
46	REQ-267 - Getting issue details... STATUS CONFIGURATION & PERSISTENCY SERVICE R6		WinLAB	Sandeep Shah	PROGRESSING <90%		(Read the Docs entry in progress) being done under Integration Jira-1526 INT-1526 - Getting issue details... STATUS		SDN-C (CC-SDK) using MariaDB	Sandeep is leading the Integration & Development.
	Robot Keyword Testing
		~~init_robot~~
		init		BDF	OK
		health		BDF	OK
		eteHelm-k8.sh		BDF	OK
		healthdist		BDF	OK
		instantiateVFWCLGRA		BDF	OK
		demo-k8s.sh -n onap vfwclosedloop <png_ip>		BDF	OK
		instantiateVFWDTGRA		BDF	OK
		distributeVCPE		BDF	OK
		distributeVCPEResCust
		sdc-dcae-d
		vcpe.py
		postinstall		BDF	OK

	72 Hour Stability Run	onboard/instantiate
		closedloop
	HTTP Certificate Expiry Test (verify_cert.sh)			clamp 3/2020 dmaap 3/2020

DCAEGEN2-1539 - Getting issue details... STATUS

*: CI integration: the goal is to introduce the use case in CI daily chains for Frankfurt. Ths table could be completed with a CI dashboard where the use cases will be run every day.

As it should be runnable in any lab, some constraints need to be considered:

no proprietary VNFs
use cases must be self-content , third party equiments may not be present in all labs.
infrastructure setup/teardown shall be clear: the use case must be runnable from a clean ONAP installation. These resources must be cleaned at the end of the test ,
results shall be pushed to a common DB. It is recommended ot use xtesting to run the tests (robotframework, python, bash, unit test drivers)

Space shortcuts

Page tree

Color Guide

#

Use Case

Test Cases

Lab

Integration

Test Lead

Status

Details

Doc status

CI integration*

Components involved

Comments

vCPE Integration Test Case

vCPE(tosca) with HPA - Integration test cases

Marcin Przybysz

5G - PNF PnP - Integration Test Cases

Marcin Przybysz

Krzysztof Kuzmicki

5G - Bulk PM - Test Status

5G - PNF Configuration via Netconf - Test Status

5G - Preonboarding/Onboarding - Test Status

Integration Test

Scale Out - Integration Test Cases and Status

Scott Blandford,

Marco Platania

vFW/vDNS HPA Testing

(Test Plan 1 in

5G - Preonboarding/Onboarding - Test Status