2: Frankfurt Release Integration Testing Status

Color Guide

ONLY Completed items should be green.

COMPLETED

PROGRESSING >= 90%

PROGRESSING <90%

TARGET COMPLETION

#	Use Case Functional Requirement Nonfunctional Requirement	Test Cases	Lab	Integration Test Lead	RC0 Status (remaining days of effort)	RC1 Status	RC2 Status	TSC Feedback (RC2)	Details	Doc status	CI integration*	Components involved	Comments
1	vFW Model Driven Control Loop Design	vFWCL Testing with GRA_API in VID/SO/SDNC (vDNS is part of scale out use case below #11)	Intel / Windriver Azure	Brian Freeman Marco Platania	COMPLETED (need to regression on final dockers)	COMPLETED		Waiting feedback about regression on final dockers	Distribtion COMPLETED Instantiation COMPLETED Control Loop COMPLETED Work around applied for appc.properties in Jira	https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfw.html#docs-vfw minor updates log.vFWCLGRA.20200415.tar.gz Blocker: INT-1568 - Getting issue details... STATUS APPC-1876 - Getting issue details... STATUS	?	SDC Dmaap SDNC SO AAI Policy Appc ...
3	vCPE with TOSCA MODELING-354 - Getting issue details... STATUS VFC-1654 - Getting issue details... STATUS USECASEUI-438 - Getting issue details... STATUS	vCPE(tosca) - Integration test cases	CMCC / Intel	Huang Haibin Liping Zhao	COMPLETED	COMPLETED				https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE_with_Tosca_VNF.html minor updates	WIP INT-1355 - Getting issue details... STATUS	SDC Dmaap AAI Multicloud VFC UUI Modeling ...
4	5G - Realtime PM and High Volume Stream Data Collection	5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases	Intel / Windriver	Marcin Przybysz	COMPLETED	COMPLETED	COMPLETED		Test status: 5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases	https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5g_rtpm.html#docs-realtime-pm	Yes CSIT's	DCAE
5	5G - PNF PnP REQ-134 - Getting issue details... STATUS	5G - PNF PnP - Integration Test Cases	Intel / Windriver	Marcin Przybysz Krzysztof Kuzmicki	COMPLETED	COMPLETED			Test Cases passed on RC0	https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_5g_pnf_pnp.html#docs-5g-pnf-pnp minor updates	Already in CI gate		16.04: Currently released image for SO-BPMN (1.6.0 form27'th of March) is not working. Image from today 16.04 is sufficient and works. v2/onap/so/bpmn-infra/manifests/1.6.0-20200416T0645 → There will be need to release new SO images
6	5G - Bulk PM REQ-129 - Getting issue details... STATUS	5G - Bulk PM - Test Status	Ericsson Lab	James Cuddy	COMPLETED	COMPLETED	CCOMPLETEDOMPLETED			DCAEGEN2-2217 - Getting issue details... STATUS	Introduced in Gate after RC1		DCAEGEN2-2217 - Getting issue details... STATUS
8	5G - PNF Pre-Onboarding & Onboarding SOL 004 (VNF Package Security) REQ-135 - Getting issue details... STATUS	5G - Preonboarding/Onboarding - Test Status	Intel / Windriver	PNF Preonboarding (VNF SDK): Marcin Przybysz Krzysztof Kuzmicki Dermot Melia PNF Onboarding (SDC): Andy Walshe	PROGRESSING >= 90% 15.05	COMPLETED		image 1.5.2 that has been release on 22nd of May contains all corrections waiting to have it in OOM for Frankfurt		SOL004 option 1 need to be checked manually in VNFSDK SDC-2981 - Getting issue details... STATUS - blocks automated test cases for SOL004 in PNF Onboarding part VNFSDK-582 - Getting issue details... STATUS VNFSDK-581 - Getting issue details... STATUS			16.04: New image has been released /onap/vnfsdk/refrepo:1.5.1 package integrity rules are present (SOL004 option 1) - need to have prepared automated test cases PNF SW update validation rules are present need to have prepared automated test cases Full integration automation of pre-onboarding and onboarding tests is ongoing
9	5G - OOF SON: OOF (SON) in R5 El Alto, OOF (SON) in R6 Frankfurt	Integration Test	OWL / Windriver	Reshmasree c	COMPLETED	COMPLETED	PROGRESSING Expected to be completed by June 12 (updated on June 11).	Completed testing in Winlab.		Use case: https://docs.onap.org/en/dublin/submodules/integration.git/docs/docs_5G_oof_pci.html SON-Handler MS (DCAE): https://onap.readthedocs.io/en/latest/submodules/dcaegen2.git/docs/sections/services/son-handler/index.html Updates for Frankfurt submitted (INT-1466 and DCAEGEN2-2104)	Stretch goal, will take this up in next release	DCAE (SON-Handler MS), Policy, SDN-C, OOF	Use case integration test cases status can be found in below page Integration Test
10	E2E Network Slicing	Test Status	Windriver/CMCC	Chuanyu Chen Zhang Min Swaminathan Seetharaman	COMPLETED	COMPLETED	COMPLETED Updated 15.06	Completed testing in CMCC lab.	RC2 is Completed	Use case documentation submitted (INT-1468).	Stretch goal, will take this up in next release.	UUI, EXT-API, SO, OOF (Test only: SDC, A&AI, Poilcy)	OPTFRA-749 - Getting issue details... STATUS
11	Scale Out	Scale Out - Integration Test Cases and Status	Intel / Windriver	Scott Blandford, Marco Platania	Testing Status (Frankfurt Scaling) COMPLETED MAY 21	COMPLETED	PROGRESSING JUNE 15 Manual Scaling has completed Still need to complete Auto scaling			https://onap.readthedocs.io/en/lastest/submodules/integration.git/docs/docs_scaleout.html#docs-scaleout minor updates		APPC VID DCAE SO Policy ...	Some new platform capabilities have been developed in SO and CDS. If they can’t be used for some reason, we’ll fall back to using the current process.
12	CCVPN-E LINE over OTN NNI	CCVPN Integration Test Cases	Huawei	Gaurav Agrawal	COMPLETED MAY 12	COMPLETED		SDNC-1184 - Getting issue details... STATUS	We have an issue in the SDNC DG (SDNC-1184), which will be fixed by May 12th. After that, the integration test will be completed.	https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope		SDNC AAI OOF UUI
12.1	CCVPN - MDONS	MDONS Integration Test Case	Fujitsu/Orange	Xin Miao	COMPLETED MAY 15TH	COMPLETED	Verified SO-2955 - Getting issue details... STATUS COMPLETED	~~Did we complete the testing? If not then what's the new target date?~~ ~~Xin Miao We were blocked by issue SO-2955. After SO-2967 is fixed, test is completed by 05/29~~. SO-2967 - Getting issue details... STATUS Verified in Fujitsu Lab	Test Environment: Master branch instance in Fujitsu Windriver SB00 ~~Issue at VNF resource 'certify' (Fixed)~~ ~~Expect SO 1.6.1 to be deployed where the blocking issues and. (Upgrade on May 21st)~~ Current blocker: SO-2827 - Getting issue details... STATUS Fixed	https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_CCVPN.html#docs-ccvpn updates will be based on Frankfurt scope		SO - C A&AI - C SDN-C - C UUI - C SDC - TO ExtAPI - TO
13	HPA vFW/vDNS	vFW/vDNS HPA Testing (Test Plan 1 in HPA & Cloud Agnostic Intent - R3 Test Plan)	Intel / Windriver	Eric Multanen	COMPLETED MAY 22	COMPLETED	COMPLETED (based on previous testing)		One pass has been more or less completed with workarounds the following bugs: SO-2940 - Getting issue details... STATUS OPTFRA-750 - Getting issue details... STATUS OPTFRA-756 - Getting issue details... STATUS As with line 20 below, manual workaround for the following is being used: MSB-467 - Getting issue details... STATUS Other known issues: Using patch from CLI-269 - Getting issue details... STATUS to manually use CLI updates for loading policies. Not required - as curl commands can also be used. Calling this done based on testing done with workaround/fixes for the above noted issues.	https://onap.readthedocs.io/en/elalto/submodules/integration.git/docs/docs_vfwHPA.html#docs-vfw-hpa		SO SDC VID OOF Policy SDNC AAI
15	Change Management Frankfurt Extensions REQ-187 - Getting issue details... STATUS REQ-191 - Getting issue details... STATUS	Steps: 1) Instantiation of vFWDT 2) Configuration of OOF Policies for vFWDT 3) Execution of OSDF/HAS requests for data collection 4) Configuration of VNF profiles in CDT 5) Configuration of Ansible Server 6) Execution of the workflow	Intel / Windriver	Lukasz Rajewski	COMPLETED Updated 12th of May	COMPLETED Updated 14th of May	COMPLETED Updated 15.06		1) PASS 2) PASS 3) PASS 4) PASS 5) PASS 6) PASS RC2 100% Completed WORKAROUND FOR SO-2983 - Getting issue details... STATUS APPC can't read information about VNFC because of the missing relations in AAI	El Alto doc good: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFWDT.html#docs-vfw-traffic but major updates needed (as the use cases evolved) Major documentation change completed https://gerrit.onap.org/r/c/integration/+/102853 Minor change with policy upload change still to be updated. Documentation update completed.	No Use case will be semi-automated. All the steps can be performed with scripts but still CI scripts needs to be build. Planned for next release.	SDC AAI SO VID OOF Policy APPC	Use case will be renamed and include upgrade
16	PNF Software Upgrade PNF / Enhancement on PNF Software Upgrade with EM with Ansible	Steps: 1) Execute custom PNF SW Upgrade WF from SO 2) SO send conventional LCM API to SDNC/CCSDK 3) Controller send ansible commands to AS 4) AS contact EM with ansible	Huawei	yaoguang wang Enbo Wang	INT-1207 - Getting issue details... STATUS COMPLETED	COMPLETED	COMPLETED		Test results: Test Status of Enhancement on PNF S/W Upgrade with EM with Ansible	https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5G_PNF_Software_Upgrade_ansible_with_EM.html INT-1209 - Getting issue details... STATUS
18	BBS Broadband Service Use Case (Frankfurt)	BBS Integration Test Cases (Frankfurt)	BBS Swisscom Lab	David Perez Caparros Daniel Balsiger	COMPLETED MAY 29 Swisscom lab is closed. SO-2827 - Getting issue details... STATUS SO-2955 - Getting issue details... STATUS Found a workaround for BBS APEX policy, see: POLICY-2463 - Getting issue details... STATUS	COMPLETED BBS requires the latest SDNC docker image: sdnc-image:1.8-STAGING-latest	COMPLETED BBS requires the latest SDNC docker image: sdnc-image:1.8-STAGING-latest		Details: BBS Integration Test Cases (Frankfurt)	Frankfurt doc: https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_BBS.html	No, planned for future releases		we need to find a solution to emulate 3rd party controllers first. Our use case relies on physical equipment and external controllers and we can only test it in the Swisscom lab at the moment. We may have a second lab with the required equipment in UNH-IOL, but it is not confirmed yet.
19	VSP Compliance and Validation Check within SDC (Frankfurt) - Phase 2	VSP Compliance Check within SDC - Integration Test Plan	Vodafone	Prabhu Balan	Testing Status COMPLETED	COMPLETED				https://wiki.onap.org/display/DW/VSP+Compliance+and+Validation+Check+within+SDC+%28Frankfurt%29+-+Phase+2#VSPComplianceandValidationCheckwithinSDC(Frankfurt)Phase2-VSPComplianceCheckwithinSDC-IntegrationTestPlan https://onap-sdc.readthedocs.io/en/latest/consumedapis.html https://onap-doc.readthedocs.io/projects/onap-sdc/en/latest/externaltesting.html	No	SDC VTP
20	K8S based Cloud Region Support - vFW Use case	Deploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud REQ-182 - Getting issue details... STATUS	intel / Windriver	Ritu Sood Eric Multanen	PROGRESSING >= 90% MAY 15	COMPLETED	COMPLETED (based on previous testing)		completed test with manual workaround for following 3 items: Known issues: MSB-467 - Getting issue details... STATUS using manual workaround to get past this for now (fixes for this have been tested and verified) MULTICLOUD-1053 - Getting issue details... STATUS has been resolved. SDC-2972 - Getting issue details... STATUS using manual workaround to get past this for now. (reported to be working now) After above are fixed, a retest can be made to verify. Calling this done based on testing done with fixes/workarounds of known issues.
21	K8S based Cloud Region Support - EdgeXFoundry Use case	Deploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes Cloud	Intel/ Windriver	Eric Multanen	PROGRESSING >= 90% MAY 15	COMPLETED	COMPLETED (based on previous testing)		same as line #20.
22	ORAN A1 Adapter Implemented in ONAP (SDNR)	A1 Adapter Test Cases	Intel/Windriver	Sandeep Shah	PROGRESSING >= 90% MAY 15TH	COMPLETED	COMPLETED based on previous testing		Need to re-test SSL enabled HTTPS ports among DMAAP message router, SDNC DMAAP listener and SDNC dockers SDNC-1183 - Getting issue details... STATUS SDNC-1138 - Getting issue details... STATUS SDNC-1167 - Getting issue details... STATUS OOM-2400 - Getting issue details... STATUS				All bug fixes, related to HTTPS support, have been tested successfully.
23	PNF Software Upgrade using direct Netconf/Yang interface with PNF	PNF Software Upgrade Using direct NETCONF/YANG interfacewithPNFTestCases	Intel	Rahul Tyagi	INT-1308 - Getting issue details... STATUS COMPLETED	COMPLETED	COMPLETED			https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5G_PNF_Software_Upgrade.html#docs-5g-pnf-software-upgrade INT-1450 - Getting issue details... STATUS Documentation is updated with new use cases in Frankfurt
24	Enable PNF software version at onboarding	PNF Software Information Onboarding Test Cases	Ericsson Lab	André Schmid	INT-1307 - Getting issue details... STATUS COMPLETED	COMPLETED	COMPLETED
25	K8s CDS Support (vFW_CDS_CNF) REQ-182 - Getting issue details... STATUS (SO and CDS Macro flow with Helm Chart)	Installation of KUD k8s environment Configuration of k8s tenant in AAI Configuration of kud/k8s region in multicloud Configuration of kud/k8s region in SO Modification of SO BPMN configuration Onboarding of artifacts to SDC Design and distribution of service in SDC Instantiation of Service with SO	Private lab + Intel/Windriver community lab	Konrad Bańka Lukasz Rajewski	INT-1184 - Getting issue details... STATUS PROGRESSING >= 90% MAY 15TH Updated 07.05	COMPLETED With workarounds for MSB-467 - Getting issue details... STATUS Updated 14.05	COMPLETED JUNE 15THSuccessful isntantiation with bumped SDNC and CDS image: 1.8.4-STAGING-latest for SDNC 0.7.4-STAGING-latest for CDS blueprints processor Updated 11.06 Updated 23.06 - completed		Currently successfully verified with manually cherry picked changes from RC2 candidate. Waiting for RC2 to verify again. Raw recording of live verification session in Windriver lab	https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vFW_CNF_CDS.html but needs to be updated according to latest verification status	Automation of usecase targeted for G release		07.05: Currently usecase has been verified to work both in internal and windriver lab with workaround. Ongoing tests regarding verifying fixes provided under blocker jiras. 08.05: Removed blocker jiras that were tested for being corrected. 14.05: Updating fix brought under MSB-467 to fully cover issue, as previous patch was found incomplete
26	ETSI Alignment SO plugin to support SOL003 to connect to an external VNFM and ETSI package management	SDC users onboards SOL004 VNF package to SDC SDC users distributes SOL004 VNF package to ONAP SO SO receives the SOL004 VNF packages from SDC ONAP SO triggers ETSI Catalog Manager to store the original vendor SOL004 VNF package ETSI Catalog Manager gets the SOL004 VNF package from SDC and stores it to its database ETSI Catalog Manager sends a package notification to SOL003 Adapter SOL004 Adapter forwards the notification to SVNFM (Simulator) SVNFM queries SOL003 Adapter for the SOL004 VNF package SOL003 Adapter queries ETSI Catalog Manager for the SOL004 VNF package ETSI Catalog Manager returns the SOL004 VNF package to the SOL003 Adapter SOL003 Adapter returns the SOL004 VNF package to the SVNFM	Ericsson Lab	Fernando Oliveira Byung-Woo Jun	COMPLETED Note: The ETSI-Alignment package management test is completed MAY 15TH						No, CSIT Automation of use case targeted for G release SO-2683 - Getting issue details... STATUS		Its CSIT testing will be implemented in the Guilin release. For Frankfurt, the test for defined test cases is completed.
27	Merged with record 8	Merged with record 8	Merged with record 8	Merged with record 8	Merged with record 8
28	xNF communication security enhancements.	xNF communication security enhancements - Tests Description and Status		Marcin Przybysz	COMPLETED	COMPLETED	COMPLETED		Test status: xNF communication security enhancements - Tests Description and Status		Yes CSIT's	DCAE
30	PNF Software Upgrade PNF / PNF Software Upgrade with EM with Netconf	PNF software upgrade in R6 Frankfurt	Huawei	yaoguang wang Enbo Wang	INT-1212 - Getting issue details... STATUS COMPLETED	COMPLETED	COMPLETED		Test results: Test Status of PNF S/W Upgrade with EM with Netconf/Yang interface	INT-1209 - Getting issue details... STATUS https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5G_PNF_Software_Upgrade_netconf_with_EM.html
31	5G - 5G NRM Network Resource Model (Configuration Mgmt)	5G Network Resource Model (NRM) Configuration in R6 Frankfurt	Huawei	yaoguang wang Cheng Huang	INT-1245 - Getting issue details... STATUS COMPLETED	COMPLETED	COMPLETED			Documentation was updated as a new use case for Frankfurt: https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5G_NRM_Configuration.html INT-1514 - Getting issue details... STATUS
35	Integration of CDS as an Actor	Integration Testing	Intel / Windriver	Bruno Sakoto Ram Krishna Verma Yuriy Malakov	COMPLETED	COMPLETED	COMPLETED		Policy - CDS integration test was successfully completed in SB01 lab for vFW use case. CLAMP - Policy integration test was successfully completed in SB01 lab for vFW use case.	REQ-33 - Getting issue details... STATUS https://docs.onap.org/en/latest/submodules/policy/parent.git/docs/development/actors/cds/cds.html Testing of VNF support in CDS Actor Testing of PNF support in CDS Actor		Policy Framework CDS A&AI CLAMP	Requires workaround or merge in order for use case to work out of the box in Frankfurt release. CCSDK-2425 - Getting issue details... STATUS
37	Configuration with NETCONF in Frankfurt/R6 REQ-76 - Getting issue details... STATUS REQ-140 - Getting issue details... STATUS	Detailed Steps carried out for performing E2E Testcases can be found at : E2E Integration Testing for NETCONF over TLS Configuration- Test Case		Ajay Deep Singh	COMPLETED	COMPLETED	COMPLETED		Test Result: E2E Integration Test for NETCONF/TLS Configuration Test Cases	INT-1295 - Getting issue details... STATUS	Yes	AAF-Certservice, SDNC, Netconf-Pnp-Simulator
38	E2E Automation vLB w/CDS Use Case (Frankfurt) NOTE: SO is using Config Assign & Config Deploy building blocks. SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation will be a separate test case.[row below]	Steps: Design Time 1) CBA Package onboarding CDS 2) SDC VSP, VF, Service Creation and onbaording for vLB. Run Time: 1) SO send Marcro requst to SDNC GR-API 2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution 3) SO sends request to CDS for Config Assign. 4) SO sends request to Openstack for vLB Instantiation 5) SO send request to CDS for ConfigDeploy	Intel / Windriver	Abdelmuhaimen Seaudi Yuriy Malakov	COMPLETED	COMPLETED	COMPLETED					CDS, SDNC, SO, Policy, Naming MS, Netbox	SO issue with heat stack creation. SO-2802 - Getting issue details... STATUS Requires workaround or merge in order for use case to work out of the box in Frankfurt release. CCSDK-2425 - Getting issue details... STATUS
39	3rd Party Operational Domain Manager	Steps: Steps to test SDC changes SDC-2879 - Getting issue details... STATUS	Telstra	Divyang Patel	COMPLETED	COMPLETED	COMPLETED	SDC-2879 - Getting issue details... STATUS
40	REQ-267 - Getting issue details... STATUS CONFIGURATION & PERSISTENCY SERVICE R6		WinLAB	Reshmasree c Swaminathan Seetharaman	COMPLETED	COMPLETED	PROGRESSING Expected to be completed by June 12 (updated on June 11).	Completed testing in Winlab.	Integration work will be part of OOF / SON / PCI Use Case. will have the same integration status as that use case.	(Read the Docs entry in progress) being done under Integration Jira-1526 INT-1526 - Getting issue details... STATUS		SDN-C (CC-SDK) using MariaDB	Sandeep is leading the Integration & Development.
41	E2E Automation vLB w/CDS Use Case (Frankfurt) SO Marco Instantiation using Controller Execution Building Block [new for Frankfurt] for vLB Instantiation.	Steps: Design Time 1) CBA Package onboarding CDS 2) SDC VSP, VF, Service Creation and onbaording for vLB. Run Time: 1) SO send Marcro requst to SDNC GR-API 2) SDNC GR-API send request to CDS, Netbox, Naming for instantiation resource auto resolution 3) SO sends request to CDS for ControllerExecutionBB with scope of vnf and action of config-assign. 4) SO sends request to Openstack for vLB Instantiation 5) SO send request to CDS for ControllerExecutionBB with scope of vnf and action of config-deploy.	Intel / Windriver	Abdelmuhaimen Seaudi Yuriy Malakov	COMPLETED	COMPLETED	COMPLETED					CDS, SDNC, SO, Policy, Naming MS, Netbox	NOTE: in order for this use case to work out of the box. The following patches need to be merged to frankfurt release Requires workaround or merge in order for use case to work out of the box in Frankfurt release. CCSDK-2425 - Getting issue details... STATUS CLOSED TICKETS: Naming MS Changes based on new policy api: (Biju) https://gerrit.onap.org/r/c/oom/+/107423 Naming MS Changes based on new policy api: (Biju) https://gerrit.onap.org/r/c/oom/+/107425 SO Patch: fixes for scale out: (Janani) https://gerrit.onap.org/r/c/so/+/107752
Use cases without resources for Frankfurt
2	Use Case: Residential Broadband vCPE (Approved)	vCPE Integration Test Case	Intel / Windriver		PROGRESSING <90% ??? During May 4 PTL meeting, Morgan Richomme reports that this issue may need to be de-scoped since there are no resources available for integration test.			Not restested as part of Frankfurt release		https://docs.onap.org/en/latest/submodules/integration.git/docs/docs_vCPE.html	No
7	5G - Configuration with NETCONF	5G - PNF Configuration via Netconf - Test Status	Intel/ Windriver		This item is duplicate. Please see line #37 for work related to this feature in R6.					https://onap.readthedocs.io/en/latest/submodules/integration.git/docs/docs_5G_Configuration_over_NETCONF.html#docs-5g-configuration-over-netconf Minor updates	Yes
14	Change Management - Flexible Designer & Orchestrator	Steps: 1) Designing custom workflows with Workflow Designer 2) Distributing custom workflows to SO 3) Deploying the custom workflow in SO 4) Sending workflow metadata to VID 5) Triggering custom workflow execution from VID 6) Executing custom workflows in SO	Intel / Windriver	Ajay Mahimkar Elena Kuleshov Chris Rapposelli-Manzo	NOT A CANDIDATE FOR FRANKFURT			Not restested as part of Frankfurt release		1) Designing custom workflows with Workflow Designer – 100% 2) Distributing custom workflows to SO – Was 100% in Dublin Issues arose with SDC Distribution in El Alto and remain unresolved – 80% working now. However, SO does work properly with manual WF distribution and workaround notes are posted on the wiki 3) Deploying the custom workflow in SO – 100% 4) Sending workflow metadata to VID – 100% 5) Triggering custom workflow execution from VID – 100% 6) Executing custom workflows in SO – Execution mechanism 100%, Building Blocks – 60% (Had many issues with test environment & APPC blocking testing from Nov-Jan) 7) Pause for Manual Task – 100%
17	Change Management - Schedule Optimization		Intel / Windriver	Ajay Mahimkar Jerry Flood	NOT A CANDIDATE FOR FRANKFURT			Not restested as part of Frankfurt release
29	HPA vIPsec	vIPsec HPA testing	Intel / Windriver	Ruoyu Ying	Not tested			Not restested as part of Frankfurt release
Pairwise testing
32	TOSCA Compliant Policy types	Pairwise Testing	Intel / Windriver	Pamela Dragosh Gervais-Martial Ngueko	COMPLETED	COMPLETED	COMPLETED	Recommended for a GO #1 Can you please provide your tests results? #2 Any automated tests?	Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00. Additional testing is covered via the vFW, Scale Out, vFW CDS use cases. Automated test for vFW updated: INT-1350 - Getting issue details... STATUS No other automated tests for CLAMP as this was tested manually using CLAMP GUI.	REQ-21 - Getting issue details... STATUS
33	Policy Update Notifications	Pairwise Testing	Intel / Windriver	Pamela Dragosh Vijay Venkatesh Kumar	COMPLETED	COMPLETED	COMPLETED	Recommended for a GO #1 Can you please provide your tests results? #2 Any automated tests?	Testing completed via POLICY/DCAE pairwise testing completed by RC0. No automated tests.	REQ-25 - Getting issue details... STATUS
34	CLAMP Deployment of Policies to PDP Groups	Pairwise Testing	Intel / Windriver	Pamela Dragosh Gervais-Martial Ngueko	COMPLETED	COMPLETED	COMPLETED	Recommended for a GO #1 Can you please provide your tests results? #2 Any automated tests?	Testing completed via CLAMP/Policy pairwise testing over the time period between M4 and RC1 in SB01/SB00. Additional testing is covered via the vFW, Scale Out, vFW CDS use cases. No automated tests as this is done manually via the CLAMP GUI.	REQ-29 - Getting issue details... STATUS
36	Component Upgrades to the new Policy Lifecycle API	Pairwise Testing	Intel / Windriver	Pamela Dragosh Shankaranarayanan Puzhavakath Narayanan Yuriy Malakov	COMPLETED	COMPLETED	COMPLETED	Recommended for a GO #1 Can you please provide your tests results? #2 Any automated tests?	Policy/CCSDK testing was successfully completed via pairwise testing in SB01 by RC0. Policy/OOF testing successfully completed by RC1 and was done in SB01. No automated tests.	REQ-162 - Getting issue details... STATUS			POLICY-2486 - Getting issue details... STATUS

Misc
	Robot Keyword Testing	~~init_robot~~
		init		BDF	OK
		health		Integrated in gate	COMPLETED
		eteHelm-k8.sh		BDF*	OK					Not integrated in gate but onap-k8s and onap-helm (not based on Robot) Integrated in Gate
		healthdist		Integrated in gate	COMPLETED
		instantiateVFWCLGRA		BDF	OK
		demo-k8s.sh -n onap vfwclosedloop <png_ip>		BDF	OK
		instantiateVFWDTGRA		BDF	OK
		distributeVCPE		BDF	OK
		distributeVCPEResCust
		sdc-dcae-d
		vcpe.py
		postinstall		Integrated in gate	COMPLETED
		72 Hour Stability Run	onboard/instantiate		COMPLETED
			closedloop		COMPLETED
	HTTP Certificate Expiry Test (verify_cert.sh)			clamp 3/2020 dmaap 3/2020						Tobe integrated in gate, raise an error in CI when 1 of the certificates is about to expire (in 2 weeks?)
27	Component/memory optimization: Ongoing Assessment		OOM	Eric Debeau Adolfo Perez-Duran Mike Elliott						Addressed by OOM in Guilin
29	S3P- Geo-Redundancy		Integration	Jason Hunt Mike Elliott				Not tested as part of Frankfurt release		No resources
35	Health Checks for PODS	Percentage coverage of Health Checks for Running PODS	Integration	Brian Freeman Sylvain Desbureaux						Hard to define...and to test
36	New Installation Tests in 4 labs	Intel/Windriver	Integration	Brian Freeman Marco Platania						Reccurent activity
		Orange (Rocky)		Morgan Richomme
		Ericsson Lab (Rocky)		Andrew Fenner
		DT		Andreas Geissler

DCAEGEN2-1539 - Getting issue details... STATUS

*: CI integration: the goal is to introduce the use case in CI daily chains for Frankfurt. Ths table could be completed with a CI dashboard where the use cases will be run every day.

As it should be runnable in any lab, some constraints need to be considered:

no proprietary VNFs
use cases must be self-content , third party equiments may not be present in all labs.
infrastructure setup/teardown shall be clear: the use case must be runnable from a clean ONAP installation. These resources must be cleaned at the end of the test ,
results shall be pushed to a common DB. It is recommended ot use xtesting to run the tests (robotframework, python, bash, unit test drivers)

Space shortcuts

Page tree

Color Guide

#

Use Case

Test Cases

Lab

Integration

Test Lead

RC0 Status

RC1

Status

RC2 Status

TSC Feedback (RC2)

Details

Doc status

CI integration*

Components involved

Comments

Scott Blandford,

vFW/vDNS HPA Testing

(Test Plan 1 in

Merged with record 8

6 Comments