Color Guide

For 2019-06-03 - ONLY Completed items should be green. 

COMPLETED

PROGRESSING >= 90%

PROGRESSING <90%

#


Use Case

Functional Requirement

Nonfunctional Requirement

Test CasesLabIntegration Test Lead

Status

(remaining days of effort)

Video URL

Detailed Test Status

Quick Notes
1

vFW

Model Driven Control Loop Design 

vFW


(vDNS is part of scale out use case below #10)


Intel / Windriver

Brian Freeman / Marco Platania

COMPLETED

on both SNAPSHOT and Release versions




Instantiate working for both.

Closed Loop in progress

vFW to VES : PASS

VES to TCA : PASS

TCA to Policy : Default policy needs to be changed : targetType: VM

Policy to APPC: PASS with SNAPSHOT

APPC to vPNG: PASS with SNAPSHOT. 

vFW: PASS. Waiting to regression test release containers


INT-1078 - Getting issue details... STATUS

DCAEGEN2-1510 - Getting issue details... STATUS

POLICY-1685 - Getting issue details... STATUS

POLICY-1778 - Getting issue details... STATUS

POLICY-1780 - Getting issue details... STATUS

APPC-1604 - Getting issue details... STATUS

APPC-1610 - Getting issue details... STATUS

2Use Case: Residential Broadband vCPE (Approved)

vCPE Integration Test Case

Intel / Windriver

Yang Xu / Brian Freeman

COMPLETED


vCPE (Heat) - Dublin Test Status

Done VNF onboarding, service design for infra and rescust, model distribution, infra and customer services instantiation

Closed loop tests have done VNF event generation, vescollector, DCAE(TCA), Policy and APPC

SO-1927 - Getting issue details... STATUS

SO-1922 - Getting issue details... STATUS

APPC-1614 - Getting issue details... STATUS

SO-1906 - Getting issue details... STATUS

SDC-2299 - Getting issue details... STATUS

SO-1861 - Getting issue details... STATUS

SO-1873 - Getting issue details... STATUS

AAI-2406 - Getting issue details... STATUS

PORTAL-571 - Getting issue details... STATUS

3vCPE with TOSCA

vCPE(tosca) with HPA - Integration test cases

Intel / Windriver

Huang Haibin

Yan Yang



DESCOPED (60% TEST COMPLETION)



vCPE(tosca) with HPA - Integration test status

VFC-1397 - Getting issue details... STATUS

VFC-1399 - Getting issue details... STATUS

VFC-1402 - Getting issue details... STATUS

VFC-1406 - Getting issue details... STATUS

PORTAL-593 - Getting issue details... STATUS

MULTICLOUD-657 - Getting issue details... STATUS

45G - Realtime PM and High Volume Stream Data Collection5G - Real Time PM and High Volume Stream Data Collection - Integration Test Cases

Intel / Windriver

Marcin Przybysz Marek Pondel

COMPLETED


5G - Real Time PM and High Volume Stream Data Collection - Test Status Dublin
55G - PNF PnP

5G - PNF PnP - Integration Test Cases

Intel / Windriver

20.05.2019 COMPLETED ON STAGING

03.06.2019 COMPLETED ON RELEASE (SB02)


Dublin Release Integration Testing Status

There is no possibility to distribute model for PNF due SDNC issues  (lack of one table in SDNC db) SDNC-756 - Getting issue details... STATUS and SDNC-757 - Getting issue details... STATUS .
After applying WO from SDNC-756 - Getting issue details... STATUS model has been distributed and everything works fine. Waiting for correction in SDNC

Failed on Release lab WindRiver SB02 bug SDNC-756 - Getting issue details... STATUS reopened

6 5G - Bulk PM

5G - Bulk PM - Test Status

Intel / Windriver

SB-02

user-3784d Liam Burke


COMPLETED




75G - Configuration with NETCONF

5G - PNF Configuration via Netconf - Test Status

Intel/

Windriver

Rahul Tyagi

Eric Moore

Raj Gumma

COMPLETED ON ERICSSON LAB

COMPLETED ON SB-02




This test is in continuity of PNF PnP test case which is at no. 5.

Completed this test in Ericsson Local Lab with PnP PNF on-boarding. Starting to test it in Windriver Lab. Few Issues impacting this test are:

SO-1857 - Getting issue details... STATUS

Root cause of the exception is handled in jira,

CCSDK-1354 - Getting issue details... STATUS

SO-1856 - Getting issue details... STATUS

SO-1855 - Getting issue details... STATUS


SDNC-759 - Getting issue details... STATUS

Due to this issue SDNC-756 not able to deploy service using VID, using a WA to do that stated in the below bug.

SDNC-769 - Getting issue details... STATUS

Unable to distribute the service.

SDNC-756 - Getting issue details... STATUS

CCSDK-1318 - Getting issue details... STATUS

Existing Blueprints failing due to a bug in CDS Config Deploy 

CCSDK-1384 - Getting issue details... STATUS

8

5G - PNF Pre-Onboarding & Onboarding


5G - Preonboarding/Onboarding - Test Status

Intel / Windriver

PNF Preonboarding (VNF SDK):

Marcin Przybysz

Krzysztof Kuzmicki

Dermot Melia

PNF Onboarding (SDC):

Andy Walshe

PNF Onboarding (SDC)

COMPLETED

PNF Preonboarding (VNF SDK):

COMPLETED - ONE BUG REPORTED FOR ELALTO

logged medium level bug


5G - PNF E2E Pre-Onboarding & Onboarding Integration Test Status

Successfully completed PNF Onboarding testing in Ericsson and WindRiver labs. Manually applied workaround to db for SDNC-756 - Getting issue details... STATUS in WindRiver lab.

Very old images used for VNFSDK and CLI in ONAP DUBLIN:

CLI-168 - Getting issue details... STATUS

VNFSDK-407 - Getting issue details... STATUS

Instruction in read the docks fro offline VTP platform setup is not correct

VNFSDK-408 - Getting issue details... STATUS

Preonborading bugs for validation rules found by Dermot Melia

VNFSDK-412 - Getting issue details... STATUS

VNFSDK-410 - Getting issue details... STATUS

VNFSDK-411 - Getting issue details... STATUS

VNFSDK-414 - Getting issue details... STATUS

VNFSDK-418 - Getting issue details... STATUS

95G - OOF and PCI 

5G - OOF and PCI - Integration Test Cases

Windriver

Swaminathan Seetharaman

krishna moorthy

COMPLETED. - 2 known issues (Medium): CCSDK-1399 and CCSDK-1400


Integration Testing

Integration testing in Windriver lab. IT#017 test case will be performed again as soon as CCSDK-1399 and CCSDK-1400 are delivered

DCAEGEN2-1529 - Getting issue details... STATUS

OPTFRA-505 - Getting issue details... STATUS

OPTFRA-508 - Getting issue details... STATUS

1 test case involving SDN-R could not be completed (IT#017). The following Jiras were raised related to this test case, and the code fixes are delivered.

CCSDK-1364 - Getting issue details... STATUS

SDNC-772 - Getting issue details... STATUS

The DMaaP listener docker with the code fix is not yet deployed in SB-00 where the testing is done. The code, fix however, is already merged on to Dublin and Master branches. So, once the latest docker is deployed, we will continue and complete the test case either at Windriver.

10Scale Out

Scale Out - Integration Test Cases and Status

Intel / Windriver

Scott Blandford, Marco Platania

100% COMPLETED



Scale Out with manual trigger has been tested by directly calling SO instead of using VID


11CCVPNCCVPN Integration Test CasesCMCC

Yan Yang

100% COMPLETED

Dublin Scope to be reviewed in alignment with what it is currently certified


REDEFINED to match the scope of completed testing - Jim Baker 



CCVPN Test Status

SDC-2284 - Getting issue details... STATUS

SDC-2286 - Getting issue details... STATUS  

OOM-1843 - Getting issue details... STATUS

VFC-1375 - Getting issue details... STATUS

SDNC-764 - Getting issue details... STATUS

SDNC-753 - Getting issue details... STATUS

POLICY-1774 - Getting issue details... STATUS

The CMCC lab had a relocation plan at the beginning of this year. But for special reasons, the plan is now ahead of schedule. this week all equipment has to be powered off. For this particular reason, we can't continue our tests. so we plan to test the remaining test cases in the next release,

12HPA vFW/vDNS

vFW/vDNS HPA Testing

(Test Plan 1 in

HPA & Cloud Agnostic Intent - R3 Test Plan)		Intel / Windriver

Itohan Ukponmwan

Eric Multanen

100% COMPLETED


vFW/vDNS with HPA Integration Test Status (Dublin)

SO-1871 - Getting issue details... STATUS  

OPTFRA-499 - Getting issue details... STATUS  - Both SO1-871 and OPTFRA-499 refer to change from http to https on OOF API side. Found workaround, a fix has been submitted for the second issue and is currently being tested.

OPTFRA-506 - Getting issue details... STATUS  - Done

OPTFRA-511 - Getting issue details... STATUS  - We can work around 511 and have reduced to medium, removed integration tag.

SO-1939 - Getting issue details... STATUS  - Done

need to remove oof_directives from the user_directives parameter

13Change Management - Flexible Designer & Orchestrator

Steps:

1) Designing custom workflows with Workflow Designer

2) Distributing custom workflows to SO

3) Deploying the custom workflow in SO

4) Sending workflow metadata to VID

5) Triggering custom workflow execution from VID

6) Executing custom workflows in SO

Intel / Windriver

Ajay Mahimkar

Elena Kuleshov

Priyanshu Agarwal

Chris Rapposelli-Manzo

COMPLETED




SDC build discrepancy where Workflow Designer does not work in ONAP env. but does in SDC local env. 

SO-1911 - Getting issue details... STATUS

SO-1942 - Getting issue details... STATUS

SO-1923 - Getting issue details... STATUS

SO-1925 - Getting issue details... STATUS

Distribution of BPMN from SDC to SO is now resolved!!!

We now have an issue on auto deploy of activity specs to SDC - SO-1996 (the specs get created, but SDC returns 201 instead of 200 specified in the Wiki, SO made a change to accept 201 too), it is merged and is in today's daily build (6/6/19)


Testing complete on the user-defined workflow with setting/unsetting in-maint flag. Testing for in-place software upgrade would be done in El Alto

14

Traffic Distribution

Change Management Dublin Extensions

Steps:

1) Creating VNF profile using CDT

2) Designing custom workflows with Workflow Designer

3) Distributing custom workflows to SO

4) Deploying the custom workflow in SO

5) Sending workflow metadata to VID

6) Triggering custom workflow execution from VID

7) Executing custom workflows in SO

Intel / Windriver

Lukasz Rajewski

Michal Chabiera

Tomek Osinski

Ajay Mahimkar

Elena Kuleshov

COMPLETED



OPTFRA-483 - Getting issue details... STATUS

OPTFRA-492 - Getting issue details... STATUS

OPTFRA-494 - Getting issue details... STATUS

OPTFRA-498 - Getting issue details... STATUS

APPC-1576 - Getting issue details... STATUS

APPC-1604 - Getting issue details... STATUS

APPC-1611 - Getting issue details... STATUS

APPC-1612 - Getting issue details... STATUS

APPC-1613 - Getting issue details... STATUS

SDC-2287 - Getting issue details... STATUS

POLICY-1766 - Getting issue details... STATUS

CCSDK-1371 - Getting issue details... STATUS

  • vFWDT service being deployed with robot
  • CDT configured for vPGN (DistributeTraffic and DistributeTrafficCheck LCMs) and for vFW (DistributeTrafficCheck)
  • Workflow build outside of SO with Python Script that uses REST APIs of OOF, AAI and APPC
  • OOF interaction works and OOF delivers candidates for traffic distribution. 
  • DistributeTraffic and DistributeTrafficCheck playbooks implemented
  • APPC is able to send to execute DistributeTraffic and DistributeTrafficCheck LCM on Ansible server

Note:

SO workflow cannot be build with WorkFlow designer - we need it for workflow development. It is taken decision to move building workflow in SO/WorkFlow designer in El Alto and to build DT workflow in Dublin outside of SO - with REST APIs of OOF, APPC and AAI. As a consequence we built use case workflow in Python

15Change Management - 5G PNG Software Upgrade

Change Management - 5G PNF Software Upgrade Integration Test Status

Intel / Windriver

yaoguang wang

Ruchira Agarwal


COMPLETED



Completed this test in Huawei Local Lab.
16Change Management - Schedule Optimization
Intel / Windriver

Ajay Mahimkar

Jerry Flood

COMPLETED



Completed!!
17BBS Broadband Service Use Case (Dublin)BBS Use Case Tracking (Dublin Release)#TestingBBS Swisscom Lab

David Perez Caparros Daniel Balsiger

COMPLETED:

- Phase 1: Service creation and activation + Nomadic ONT (Test cases #[A-D]) COMPLETED

- Phase 2 (moved to El Alto): E2E Service Termination (Test cases #[E]). Jira SO-1994


Note: POLICY-1835 and POLICY-1831 should be included in Dublin


BBS Integration Test Cases

DCAEGEN2-1496 - Getting issue details... STATUS

DCAEGEN2-1500 - Getting issue details... STATUS

DCAEGEN2-1499 - Getting issue details... STATUS

INT-1075 - Getting issue details... STATUS

SO-1578 - Getting issue details... STATUS

SO-1910 - Getting issue details... STATUS

SO-1913 - Getting issue details... STATUS

SO-1928 - Getting issue details... STATUS

SO-1930 - Getting issue details... STATUS

SO-1931 - Getting issue details... STATUS

SO-1933 - Getting issue details... STATUS

https://gerrit.onap.org/r/#/c/87497/

https://gerrit.onap.org/r/#/c/so/+/88935/

SDNC-783 - Getting issue details... STATUS

SDNC-784 - Getting issue details... STATUS

DCAEGEN2-1596 - Getting issue details... STATUS

SO-1993 - Getting issue details... STATUS

POLICY-1831 - Getting issue details... STATUS POLICY-1835 - Getting issue details... STATUS

SDNC-791 - Getting issue details... STATUS


El Alto (not blockers for BBS in Dublin):

SO-1994 - Getting issue details... STATUS   SO-1938 - Getting issue details... STATUS

EXTAPI-248 - Getting issue details... STATUS

EXTAPI-249 - Getting issue details... STATUS

DCAEGEN2-1611 - Getting issue details... STATUS

18VSP Compliance Check within SDC (Dublin) - Phase 1VSP Compliance Check within SDC - Integration Test PlanVodafone

Prabhu Balan

COMPLETED




19K8S based Cloud Region Support - vFW Use caseDeploy vFW Helm Chart using Multicloud K8s Plugin in Kubernetes Cloudintel / Windriver

Akhila Kishore

Ritu Sood

COMPLETED



MULTICLOUD-655 - Getting issue details... STATUS

Work around is found for R4.  Actual fix will be made in R5.


20K8S based Cloud Region Support - EdgeXFoundry Use caseDeploy EdgeXFoundry Helm Chart using Multicloud K8s Plugin in Kubernetes CloudIntel/ Windriver

Akhila Kishore

Kiran Kamineni

COMPLETED



MULTICLOUD-645 - Getting issue details... STATUS

SO-1907 - Getting issue details... STATUS

MULTICLOUD-650 - Getting issue details... STATUS

215G: Network Slicing Modeling
AmdocsBorislav Glozman

N/A



No integration testing is expected.

A potential model of network slice was presented using SDC features.

22Consistent ID of a Cloud Region
WindriverBin Yang

DESCOPED (50% TEST COMPLETION)


Bin: Prefer defer this requirement to El Alto Release.


Use Case Tracking in Dublin Release

VID-482 - Getting issue details... STATUS

MULTICLOUD-656 - Getting issue details... STATUS

MULTICLOUD-651 - Getting issue details... STATUS

Service instantiating with GR-API failed due to:

SO-1904 - Getting issue details... STATUS

SO-1995 - Getting issue details... STATUS

Creating VF Moduel failed with GR-API and selecting CloudRegion3(CloudOwner3)  (other than the default one): I am not sure which project (VID/SO/SDNC) should take care of this issue, sent email to discuss email list and wait for response

Details can be found: Deploy vLB to Multiple Cloud Regions


23Modularity

Seshu Kumar Mudiganti , Fari Behi

COMPLETE




24

ETSI Alignment

SO plugin to support SOL003 to connect to an external VNFM



Fernando Oliveira

Byung-Woo Jun

COMPLETE

Create+instantiation is completed


Note:

Termination+Deletion is almost  but has a minor issue, it will be done in El Alto





Due to lack of SDC SOL004 VNF support in Dublin, automated CSIT testing has been deferred to El Alto under SO-1899 - Getting issue details... STATUS

In Dublin, manual-based (sending REST requests) test has been done for SO/VNFM Adapter to test VNFM Adapter functionalities. Currently, VNFM Adapter API function testing with VNFM Simulator is completed, and the team is working on the SO workflows (which invoking VNFM Adapter) testing.   

VNF creation+ instantiation testing is 100%

Terminate+Delete integration testing will be done in El Alto

Dublin test cases, SO VNFM Adapter Test Case

25Improve our E2E Process Automation

Eric Debeau

Alexis de Talhouët

Abdelmuhaimen Seaudi

Yuriy Malakov

Marco Platania

COMPLETE

VIDEO URL: 

E2E Automation vDNS w/ CDS Use Case - ONAP-03-Run Time- Video Demo for vDNS CDS Dublin

E2E Automation Testing Status with CDS


Dublin Highest Bugs: 


SO-1985 - Getting issue details... STATUS

SO-1882 - Getting issue details... STATUS   – Requires retest. 

SO-1870 - Getting issue details... STATUS  


CCSDK-1344 - Getting issue details... STATUS  -Fix to be submitted 5/23.


SO-1892 - Getting issue details... STATUS  - Steve S recommend to update the reference data to include "*" for serviceType. Patch needs to be updated. 


OOM-1867 - Getting issue details... STATUS  


High: 

SDNC-756 - Getting issue details... STATUS

CCSDK-1339 - Getting issue details... STATUS   - code merged to master. Cherry pick to dublin required. 


CCSDK-1331 - Getting issue details... STATUS



SO-1889 - Getting issue details... STATUS  

SO-1857 - Getting issue details... STATUS  –. waiting to be reviewed and merged to dublin/master branch.



26S3P - Footprint Optimization (Integration with Alpine)

Eric Debeau

 Adolfo Perez-Duran Mike Elliott Michael O'Brien

N/A


No specific tests. Default containers used in OOM are optimized.

(plus) 20190523 update - RKE 0.2.1 is now processor independent (no amd64 images - supporting arm now

  OOM-1598 - Getting issue details... STATUS

Arm testing on  LOG-331 - Getting issue details... STATUS

27Component/memory optimization: Ongoing Assessment

Eric Debeau

 Adolfo Perez-Duran Mike Elliott Michael O'Brien

N/A




28Global optimization (e.g. shared DB) - stretch goal=shared PostgreSQL; shared MariaDB

Eric Debeau

 Adolfo Perez-Duran Mike Elliott Michael O'Brien

COMPLETE

AAI - PASS

SDC - PASS

SO - PASS

SDNC - PASS


Integration testing underway to validate. 

AAI and SDC using Shared Cassandra delivered.

SO and SDNC using Shared Mariadb-Galera delivered.


PASS if application installs and functions on shared datastores.

29S3P- Geo-Redundancy

Jason Hunt , Mike Elliott

COMPLETED



Basically the update is both OOF and Portal are successfully using MUSIC in Dublin (E2E testing has no MUSIC-related issue now) and their code exercise MUSIC geo-redundancy across the US more or less every day in production.
30SOL 004 (VNF Package Security)

5G - Preonboarding/Onboarding - Test Status

Ericsson, Intel / Windriver

Samuli Kuusela

SDC:

COMPLETED


VNF SDK:COMPLETED - ONE BUG REPORTED FOR ELALTO

logged medium level bug


5G - PNF E2E Pre-Onboarding & Onboarding Integration Test Status

Note: SOL004 test cases are an integral part of the 5G PNF pre-onboarding/onboarding test cases.

For both SDC and VNF SDK following applies:
SOL004 security is supported for PNF and VNF packages, but has not explicitly been verified with VNF package.

VNF SDK:

VNFSDK-414 - Getting issue details... STATUS delivered

Another bug has been found:

VNFSDK-418 - Getting issue details... STATUS

31xNF communication security enhancements.xNF communication security enhancements - Tests Description and Status

Marcin Przybysz

COMPLETED


xNF communication security enhancements - Tests Description and Status

DCAEGEN2-1523 - Getting issue details... STATUS

DCAEGEN2-1539 - Getting issue details... STATUS

DCAEGEN2-1440 - Getting issue details... STATUS

DCAEGEN2-1541 - Getting issue details... STATUS


32Locale/Internationalization language support

Tao Shen

COMPLETED



PORTAL-565 - Getting issue details... STATUS

33Angular 6 Upgrade of ONAP Portal and SDKPortal R4 Dublin Functional Test Cases (includes Angular 6 upgrade tests)Intel / Windriver

Manoop Talasila, Sireesh Chintamani

COMPLETED


Angular 6 Upgrade tests are run locally by the test lead (Sireesh Chintamani ) on the portal/sdk screens after pairwise testing is passed on SDK - Portal Pair Wise Testing for Dublin Release

PORTAL-272 - Getting issue details... STATUS

34HPA vIPsecvIPsec HPA testingIntel / WindriverRuoyu Ying

COMPLETED



Need double check for last step on vf module creation

35Health Checks for PODSPercentage coverage of Health Checks for Running PODSIntegration

Brian Freeman , Sylvain Desbureaux

Reporting only for Dublin

N/A



55% Yes

22% No

23% Still being researched

docker_containers.ods
























































DCAEGEN2-1539 - Getting issue details... STATUS





8 Comments

  1. Srinivasa Addepalli

    Kiran Kamineni , Ritu Sood Eric Multanen , Liang Ding ,  libo zhu and Akhila Kishore

    Glad to see "COMPLETED" status on "K8S based Cloud Region Support - EdgeXFoundry Use case".  Congratulation on passing this major milestone of deploying containers in K8S Cloud regions from ONAP.

  2. Srinivasa Addepalli

    Ritu Sood and Kiran Kamineni

    Please check  MULTICLOUD-655 - Getting issue details... STATUS  and try to solve the problem by Tuesday, if possible.

  3. Srinivasa Addepalli

    Kiran Kamineni , Ritu Sood,  Eric Multanen , Liang Ding ,  libo zhu and Akhila Kishore

    great work guys,  Great to see the status of vFW with K8S COMPLETE. 

    It is real proof that both VNFs and CNFs can coexist on the same K8S Cluster.  

    In vFW case: packet generator & firewall are deployed as VMs and sink is deployed as container.

    FYI Ravi Chunduru , Viswanath Kumar Skand Priya, ramki krishnan Prem Sankar Gopannan , Amar Kapadia and Samuli Silvius

    Srini


    1. Viswanath Kumar Skand Priya

      Kudos to entire team !

  4. Srinivasa Addepalli

    Itohan Ukponmwan   Eric Multanen  and Marcus Williams

    Kudos to you on successfully completing the vFW/vDNS HPA use cases on R4


  5. Michal Ptacek

    Great job guys, is it possible to share on this page what is the base commit in OOM charts used for this test results ? If not all docker images were released or will be changed even later, it would be good to know on what versions of images (unambiguously identified by commit in OOM) were used.

  6. Brian Freeman

    Please update your status if you are not at 100% in a test case/area each day so we have accurate status for priority settings and for the TSC review

  7. Yang Xu

    Rahul Tyagi Eric Moore Raj Gumma blueprintprocessor is already updated to 0.4.5. Could you mark your use case (no. 7 in list) test complete?