Versions Compared

Old Version 30

changes.mady.by.user Joseph O'Leary

Saved on

compared with

New Version Current

changes.mady.by.user LUKAI

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Gliffy Diagram
namePM Mapper Sequence Diagram Copy Copy
pagePin1


Gliffy Diagram
namePM Mapper Sequence Diagram Copy
pagePin1



Table of Contents

End to End flow to be Tested:  DCAE 3GPP PM Mapper

:

Gliffy Diagram
namePM Mapper Sequence Diagram
pagePin711

High Level Test Cases and Status:  DCAE 3GPP PM Mapper

:

PM mapper is able to retrieve PM dataNot yet tested PM mapper can validate the data using schema (e.g. 3gpp xml format).Not yet tested any file validation errors are logged.Not yet tested 3GPP responds appropriately when invalid metadata is provided
#Test CasesStatus
1Verify PM Mapper is able to query config data from Receive Configuration From Config Binding Service

Status
colourGreen
titlePASS

2Verify PM Mapper is able subscribe to expected DR feed.Health Check returns 200 when a REST GET request to healthcheck url

Status
colourGreen
titlePASS

3Verify 3GPP PM Mapper responds appropriately when no metadata is provided.

Status
colourGreen
title

PASS

4Verify 3GPP PM Mapper responds appropriately when invalid metadata is provided

Status
colourGreen
title

PASS

5Verify
Status
titlethat PM Mapper logs successful when a file that contains no measdata is provided

Status
colourGreen
titlePASS

6

Verify PM mapper creates expected VES PM events for the mapped data.

Status
titleNot yet tested

7

Verify any mapping errors are logged.

Status
titleNot yet tested

8

Verify mapped events are publish on Message Router.

Status
titleNot yet tested

9Verify PM Mapper send delete request for corresponding PM files to Data Router once events are published in Message Router.

Status
titleNot yet tested

that PM Mapper throws Event failed validation against schema error when no managed element content is provided

Status
colourGreen
titlePASS

7Verify that PM Mapper maps Type-C xml file and publish 3gpp perf VES events to message router

Status
colourGreen
titlePASS

8

Verify 3GPP PM Mapper maps Type-A file based on counter filtering and publish 3gpp perf VES events to message router

Status
colourGreen
titlePASS

9Verify that PM Mapper correctly identifies a file that should not be mapped based on metadata filtering10Verify 3GPP PM Mapper Responds appropriately when no metadata is provided.

Status
colourGreen
titlePASS

11
10

Verify

that PM Mapper

correctly identifies a non-xml file.

Status
colourGreen
titlePASS


Test environment requirements for above test cases:

  • sample data files available on DmaaP DR
    • e.g. 3GPP PM files used in DCAE Data File Collector testing, or equivalent available in DR
  • Test environment reqs:
    • DMaaP R4, at minimum need DR running and configured for Bulk PM support
    • DCAE 3GPP PM Mapper installed and configured for 3GPP data handling
      • i.e. configured for 3GPP PM parsing and event creation

Detailed Description PM Mapper Feature Testcases

:

< To - Do > - In progress


Test Case ID

PM_Mapper_01

Test Case NameVerify PM Mapper is able to query config data from Receive Configuration From Config Binding Service
DescriptionPM Mapper is able to query config data from Config Binding Service once it is deployed.
ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.
Testing Steps


StepsExpected Result
  •  PM Mapper query to config_binding_service for config data.

PM Mapper successfully query it's config data from config_binding_service.

/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:

2019-02-14T14:44:57.306Z    main    INFO    org.onap.dcaegen2.services.pmmapper.config.ConfigHandler        Received pm-mapper configuration from ConfigBinding Service:\n{"pm-mapper-filter": "{ \"filters\":[]}", "3GPP.schema.file": "{\"3GPP_Schema\":\"./etc/3GPP_relaxed_schema.xsd\"}", "streams_subscribes": {"dmaap_subscriber": {"type": "data_router", "aaf_username": null, "aaf_password": null, "dmaap_info": {"location": "csit-pmmapper", "delivery_url": "3gpppmmapper", "username": "username", "password": "password", "subscriber_id": "subsriber_id"}}}, "streams_publishes": {"pm_mapper_handle_out": {"type": "message_router", "aaf_password": null, "dmaap_info": {"topic_url": "https://message-router:3904/events/org.onap.dmaap.onapCSIT.pm_mapper", "client_role": "org.onap.dmaap.client.pub", "location": "csit-pmmapper", "client_id": null}, "aaf_username": null}}, "buscontroller_feed_id": "1", "buscontroller_feed_subscription_endpoint": "http://dmaap-bc:8080/webapi/dr_subs", "services_calls": {}}   

  • Upon failure, PM Mapper should log proper error message.
Log appropriate error message.


Conclusion (Pass /Fail)PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/
Testing LabEricsson Lab / CSIT


Test Case ID

PM_Mapper_02

Test Case NameVerify
PM Mapper is able subscribe to expected DR feed
Health Check returns 200 when a REST GET request to healthcheck url.
Description
PM Mapper subscribes to Data Router through bus controller after receiving config data from config_binding_service
Verifies that when the healthcheck endpoint is called, 200 response is returned to indicate that pm-mapper micro-service is running.
ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.
Testing Steps


StepsExpected Result
Once PM Mapper receive config data from config_binding_service, PM Mapper subscribing to Data Router through bus controller.
  • Send a GET request to pm-mapper healthcheck.



No Format
curl -v GET <PM Mapper IP>:8081/healthcheck


HTTP/1.1 200 OK



Conclusion (Pass /Fail)

PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/

Testing LabEricsson Lab


PM Mapper successfully subscribes to Data Router.

/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:

2019-02-14T14:28:11.348Z    main    INFO    org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber        Starting subscription to DataRouter        ENTRY    

2019-02-14T14:28:11.348Z    main    INFO    org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber        39d38cfa-fa5b-4b2f-a3db-fbd19c01fedf        INVOKE [ SYNCHRONOUS ]    

2019-02-14T14:28:11.419Z    main    INFO    org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber        Request to bus controller executed with Response Code: '201' and Response Event: 'Created'.

  • Check subscriber info in Data Router.

Data Router has subscription entry in it's database.

curl -k https://172.18.0.6:8443/internal/prov

{
"feeds": [
{"suspend":false,"groupid":0,"description":"PM Mapper Feed","version":"1","authorization":{"endpoint_addrs":[],"classification":"unclassified","endpoint_ids":[{"password":"89qtolvgb6n7w5r","id":"tmp_ch389e2m9iu2bl7"}]},"last_mod":1550155491000,"deleted":false,"feedid":1,"name":"pmmapper","business_description":"","publisher":"bulkpm","links":{"subscribe":"https://dmaap-dr-prov/subscribe/1","log":"https://dmaap-dr-prov/feedlog/1","publish":"https://dmaap-dr-prov/publish/1","self":"https://dmaap-dr-prov/feed/1"},"created_date":1550155491000}
],
"groups": [
],
"subscriptions": [
{"subid":1,"suspend":false,"delivery":{"use100":false,"password":"password","user":"username","url":"3gpppmmapper"},"last_mod":1550155497000,"subscriber":"DGL","feedid":1,"groupid":0,"metadataOnly":false,"links":{"feed":"https://dmaap-dr-prov/feed/1","log":"https://dmaap-dr-prov/sublog/1","self":"https://dmaap-dr-prov/subs/1"},"created_date":1550155497000}
],
...

..

.

Test Case ID

PM_Mapper_03

Test Case NameVerify 3GPP PM Mapper Responds appropriately when no metadata is provided
Description

Verify 3GPP PM Mapper responds 400 with the message "Missing Metadata." when no metadata is provided.

ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.
Testing Steps


StepsExpected Result
  • Send a request to the pm-mapper without a metadata header.


No Format
curl -X PUT <PM Mapper IP>:8081/delivery
Missing Metadata.


/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:

No Format
2019-02-20T14:11:25.879Z	XNIO-1 I/O-10	INFO	org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber	InstanceUUID=02bc37e3-4959-4ce5-b1fd-d93b21c7751d, RequestID=09012095-be25-4990-9e51-32701c6e3f1b, ServiceName=/delivery, InvocationID=430ede44-7fe5-4476-873a-e101ae65af73, InvokeTimestamp=2019-02-20T14:11:25.878Z, PartnerName=, ClientIPAddress=/127.0.0.1, ServerFQDN=localhost			ENTRY	
2019-02-20T14:11:25.881Z	XNIO-1 I/O-10	INFO	org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber	InstanceUUID=02bc37e3-4959-4ce5-b1fd-d93b21c7751d, RequestID=09012095-be25-4990-9e51-32701c6e3f1b, ServiceName=/delivery, InvocationID=430ede44-7fe5-4476-873a-e101ae65af73, InvokeTimestamp=2019-02-20T14:11:25.878Z, PartnerName=, ClientIPAddress=/127.0.0.1, ServerFQDN=localhost	Bad Request: no metadata found under 'X-ATT-DR-META' header.	org.onap.dcaegen2.services.pmmapper.exceptions.NoMetadataException: Metadata Not found.
2019-02-20T14:11:25.889Z	XNIO-1 I/O-10	INFO	org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber	ResponseCode=, InstanceUUID=02bc37e3-4959-4ce5-b1fd-d93b21c7751d, RequestID=09012095-be25-4990-9e51-32701c6e3f1b, ServiceName=/delivery, ResponseDescription=, InvocationID=430ede44-7fe5-4476-873a-e101ae65af73, Severity=, InvokeTimestamp=2019-02-20T14:11:25.878Z, PartnerName=, ClientIPAddress=/127.0.0.1, ServerFQDN=localhost, StatusCode=			EXIT




Conclusion (Pass /Fail)

PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/

Testing LabEricsson Lab/CSIT


Test Case ID

PM_Mapper_

03Description

04

Test Case NameVerify
PM mapper is able to retrieve PM data.
3GPP PM Mapper responds appropriately when invalid metadata is provided
Description

Verify 3GPP PM Mapper responds 400 with the message "Malformed Metadata." when invalid metadata is provided

ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.
Testing Steps


StepsExpected Result
Conclusion (Pass /Fail)Testing LabEricsson LabTest Case ID

PM_Mapper_04

Test Case NameVerify mapper can validate the data using schema (e.g. 3gpp xml format).DescriptionReleaseDublinPre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.Testing StepsStepsExpected ResultConclusion (Pass /Fail)Testing LabEricsson LabTest Case ID

PM_Mapper_05

Test Case NameVerify any file validation errors are logged.DescriptionReleaseDublinPre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.Testing StepsStepsExpected ResultConclusion (Pass /Fail)Testing LabEricsson LabTest Case ID

PM_Mapper_06

Test Case NameVerify mapper creates expected VES PM events for the mapped data.DescriptionReleaseDublinPre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.Testing StepsStepsExpected ResultConclusion (Pass /Fail)Testing LabEricsson LabTest Case ID

PM_Mapper_07

Test Case NameVerify any mapping errors are logged.DescriptionReleaseDublinPre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.Testing StepsStepsExpected ResultConclusion (Pass /Fail)Testing LabEricsson LabTest Case ID

PM_Mapper_08

Test Case NameVerify mapped events are publish on Message Router.DescriptionReleaseDublinPre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.Testing StepsStepsExpected ResultConclusion (Pass /Fail)Testing LabEricsson LabTest Case ID

PM_Mapper_09

Test Case NameVerify PM Mapper send delete request for corresponding PM files to Data Router once events are published in Message Router.DescriptionReleaseDublin
  • Send a request to the pm-mapper with invalid metadata header.


No Format
curl  -X PUT <PM Mapper IP>:8081/delivery -H 'X-ATT-DR-META: not metadata'
Malformed Metadata.

/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:


No Format
2019-02-21T08:41:33.422Z	XNIO-1 I/O-10	INFO	org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber	InstanceUUID=ea927d94-a91c-42f5-a145-138ee56259fe, RequestID=05def218-0d62-4e04-9b84-93424b410af4, ServiceName=/delivery, InvocationID=5e0015e9-87f4-46a4-975f-a82a2e308926, InvokeTimestamp=2019-02-21T08:41:33.421Z, PartnerName=, ClientIPAddress=/127.0.0.1, ServerFQDN=localhost			ENTRY	
2019-02-21T08:41:33.425Z	XNIO-1 I/O-10	INFO	org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber	InstanceUUID=ea927d94-a91c-42f5-a145-138ee56259fe, RequestID=05def218-0d62-4e04-9b84-93424b410af4, ServiceName=/delivery, InvocationID=5e0015e9-87f4-46a4-975f-a82a2e308926, InvokeTimestamp=2019-02-21T08:41:33.421Z, PartnerName=, ClientIPAddress=/127.0.0.1, ServerFQDN=localhost	Bad Request: Failure to parse metadata




Conclusion (Pass /Fail)

PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/

Testing LabEricsson Lab/CSIT
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.Testing StepsStepsExpected ResultConclusion (Pass /Fail)Testing LabEricsson Lab


Test Case ID

PM_Mapper_

10

05

Test Case NameVerify
3GPP PM Mapper Responds appropriately when no metadata is providedDescription

Verify 3GPP PM Mapper responds 400 with the message "Missing Metadata." when no metadata is provided.

ReleaseDublinPre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.Testing StepsStepsExpected ResultSend a request to the pm-mapper without a metadata header.
No Format
curl -X PUT <PM Mapper IP>:8081/delivery
Missing Metadata.
PM mapper can validate the pm file that contains no measdata using schema (e.g. 3gpp xml format).
DescriptionVerifies that a pm xml file with no measdata validates using 3GPP xml format with a 200 response and "XML validation successful" is outputted to the pm-mapper_output.log
ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.
Testing Steps


StepsExpected Result


  • Send a request to the pm-mapper with valid pm data (no_measdata.xml)


No Format
curl -v -X PUT localhost:8081/delivery/pm  -H "Content-Type:application/xml"  -H 'X-DMAAP-DR-META:{"productName": "NrRadio","vendorName": "Ericsson","lastEpochMicrosec": "1538478000000","sourceName": "oteNB5309","startEpochMicrosec": "1538478900000","timeZoneOffset": "UTC+05:00","location": "ftpes://192.168.0.101:22/ftp/rop/A20161224.1045-1100.bin.gz","compression": "gzip","fileFormatType": "org.3GPP.32.435#measCollec","fileFormatVersion": "V9"}' --data @tests/dcaegen2-pmmapper/pmmapper/assets/no_measdata.xml -H 'X-DMAAP-DR-PUBLISH-ID: 2' -H 'X-ONAP-RequestID: 2'

HTTP/1.1 200 OK.


/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:

No Format
2019-03-07T13:54:21.346Z	-4	INFO	org.onap.dcaegen2.services.pmmapper.mapping.Mapper	InstanceUUID=d57a755d-cc56-4c1f-bbdc-1c28ff5d2f81, RequestID=2, ServiceName=/delivery/pm, InvocationID=afbcedd4-578a-41fb-b426-c6a5e8937e17, InvokeTimestamp=2019-03-07T13:54:21.335Z, PartnerName=, ClientIPAddress=/172.18.0.1, ServerFQDN=localhost	XML validation successful



Conclusion (Pass /Fail)

PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/

Testing LabEricsson Lab


Test Case ID

PM_Mapper_06

Test Case NameVerify that PM mapper throws Event Failed validation against schema error when no managed element content is provided..
DescriptionVerifies that when a invalid pm xml file is validated using 3GPP xml format then "XML validation failed" is outputted to the pm-mapper_output.log
ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.
Testing Steps


StepsExpected Result
  • Send a request to the pm-mapper with invalid pm data (no_managed_element.xml)



No Format
curl -v -X PUT localhost:8081/delivery/pm  -H "Content-Type:application/xml"  -H 'X-DMAAP-DR-META:{"productName": "NrRadio","vendorName": "Ericsson","lastEpochMicrosec": "1538478000000","sourceName": "oteNB5309","startEpochMicrosec": "1538478900000","timeZoneOffset": "UTC+05:00","location": "ftpes://192.168.0.101:22/ftp/rop/A20161224.1045-1100.bin.gz","compression": "gzip","fileFormatType": "org.3GPP.32.435#measCollec","fileFormatVersion": "V9"}' --data @tests/dcaegen2-pmmapper/pmmapper/assets/no_managed_element.xml -H 'X-DMAAP-DR-PUBLISH-ID: 2' -H 'X-ONAP-RequestID: 2'

/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:

No Format
2019-03-06T15:47:19.720Z	-3	INFO	org.onap.dcaegen2.services.pmmapper.mapping.Mapper	InstanceUUID=d57a755d-cc56-4c1f-bbdc-1c28ff5d2f81, RequestID=2, ServiceName=/delivery/pm, InvocationID=1712fba7-e073-47d3-b1bd-0c428a83fdb9, InvokeTimestamp=2019-03-06T15:47:18.717Z, PartnerName=, ClientIPAddress=/172.18.0.1, ServerFQDN=localhost	XML validation failed




Conclusion (Pass /Fail)

PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/

Testing LabEricsson Lab


Test Case ID

PM_Mapper_07

Test Case NameVerify that PM Mapper maps Type-C xml file and publish 3gpp perf VES events to message router.
DescriptionVerifies that PM Mapper maps Type-C xml files correctly and publishes 3gpp perf VES events to message router
ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.
Testing Steps


StepsExpected Result
  • Send valid Type-C pm files to Data Router with proper meta data


No Format
curl -v -X PUT https://${DMAAP_DR_IP}:8443/publish/1/C20190328.0000-0015.xml --data-binary @tests/dcaegen2-pmmapper/pmmapper/assets/A20181002.0000-1000-0015-1000_5G.xml -H "Content-Type:application/octet-stream"  -H 'X-DMAAP-DR-META:{"productName": "gnb","vendorName": "Ericsson","lastEpochMicrosec": "1538478000000","sourceName": "csit","startEpochMicrosec": "1538478900000","timeZoneOffset": "UTC+05:00","location": "pm.xml","compression": "gzip","fileFormatType": "org.3GPP.32.435#measCollec","fileFormatVersion": "V9"}' -H "Authorization: Basic cG1tYXBwZXI6cG1tYXBwZXI=" -H "X-DMAAP-DR-ON-BEHALF-OF: pmmapper" --location-trusted -k

/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:


No Format
2019-04-11T11:32:33.531Z	-3	INFO	org.onap.dcaegen2.services.pmmapper.messagerouter.VESPublisher	InstanceUUID=108fa1dc-04d8-441d-b0fc-817b8a5119b0, RequestID=93a7c5dd-9cc7-435a-9bc0-2a60d8dd94ae, ServiceName=/delivery/C20190328.0000-0015.xml, InvocationID=f4a58b3e-617c-487b-b831-516f5f17066d, InvokeTimestamp=2019-04-11T11:32:33.451Z, PartnerName=, ClientIPAddress=/172.18.0.8, ServerFQDN=dcae-pm-mapper	Publishing VES events to messagerouter.


  • Verify that PM Mapper correctly published.


No Format
curl http://${DMAAP_MR_IP}:3904/events/PM_MAPPER/CG1/C1?timeout=1000 > /tmp/mr.log

/tmp/mr.log:


No Format
["{","    \"event\": {","        \"commonEventHeader\": {","    \"domain\": \"perf3gpp\",","    \"eventId\": \"c352db6d-0226-4c29-a0ed-183232d0cb7f\",","    \"sequence\": 0,","    \"eventName\": \"perf3gpp_gnb-Ericsson_pmMeasResult\",","    \"sourceName\": \"csit\",","    \"reportingEntityName\": \"\",","    \"priority\": \"Normal\",","    \"startEpochMicrosec\": 951912000000,","    \"lastEpochMicrosec\": 951912900000,","    \"version\": \"4.0\",","    \"vesEventListenerVersion\": \"7.1\",","    \"timeZoneOffset\": \"UTC+05:00\"","}","","    ,","        \"perf3gppFields\": {","    \"perf3gppFieldsVersion\": \"1.0\",","    \"measDataCollection\": {","    \"granularityPeriod\": 951912870000,","    \"measuredEntityUserName\": \"RNC Telecomville\",","    \"measuredEntityDn\": \"SubNetwork=CountryNN,MeContext=MEC-Gbg-1,ManagedElement=RNC-Gbg-1\",","    \"measuredEntitySoftwareVersion\": \"\",","    \"measInfoList\": [","    {","        \"measInfoId\": {","            \"sMeasInfoId\": \"\"","        },","        \"measTypes\": {","    \"sMeasTypesList\":[","       \"attTCHSeizures\",","       \"succTCHSeizures\",","       \"attImmediateAssignProcs\",","       \"succImmediateAssignProcs\"","    ]","}",",","        \"measValuesList\": [","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-997\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"234\"","            },","            {","                \"p\": 2,","                \"sValue\": \"345\"","            },","            {","                \"p\": 3,","                \"sValue\": \"567\"","            },","            {","                \"p\": 4,","                \"sValue\": \"789\"","            }","        ]","   }",",","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-998\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"890\"","            },","            {","                \"p\": 2,","                \"sValue\": \"901\"","            },","            {","                \"p\": 3,","                \"sValue\": \"123\"","            },","            {","                \"p\": 4,","                \"sValue\": \"234\"","            }","        ]","   }",",","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-999\",","        \"suspectFlag\": \"true\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"456\"","            },","            {","                \"p\": 2,","                \"sValue\": \"567\"","            },","            {","                \"p\": 3,","                \"sValue\": \"678\"","            },","            {","                \"p\": 4,","                \"sValue\": \"789\"","            }","        ]","   }","","]","","    },","    {","        \"measInfoId\": {","            \"sMeasInfoId\": \"ENodeBFunction\"","        },","        \"measTypes\": {","    \"sMeasTypesList\":[","       \"attTCHSeizures1\",","       \"succTCHSeizures2\",","       \"attImmediateAssignProcs3\",","       \"succImmediateAssignProcs4\"","    ]","}",",","        \"measValuesList\": [","    {","        \"measObjInstId\": \"ManagedElement=RNC-Gbg-1,ENodeBFunction=1\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"4\"","            },","            {","                \"p\": 2,","                \"sValue\": \"86,87,2,6,77,96,75,33,24\"","            },","            {","                \"p\": 3,","                \"sValue\": \"40\"","            },","            {","                \"p\": 4,","                \"sValue\": \"90\"","            }","        ]","   }","","]","","    },","    {","        \"measInfoId\": {","            \"sMeasInfoId\": \"\"","        },","        \"measTypes\": {","    \"sMeasTypesList\":[","       \"attTCHSeizures5\",","       \"succTCHSeizures6\",","       \"attImmediateAssignProcs7\",","       \"succImmediateAssignProcs8\"","    ]","}",",","        \"measValuesList\": [","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-997\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"238\"","            },","            {","                \"p\": 2,","                \"sValue\": \"344\"","            },","            {","                \"p\": 3,","                \"sValue\": \"563\"","            },","            {","                \"p\": 4,","                \"sValue\": \"787\"","            }","        ]","   }",",","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-998\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"898\"","            },","            {","                \"p\": 2,","                \"sValue\": \"905\"","            },","            {","                \"p\": 3,","                \"sValue\": \"127\"","            },","            {","                \"p\": 4,","                \"sValue\": \"238\"","            }","        ]","   }",",","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-999\",","        \"suspectFlag\": \"true\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"454\"","            },","            {","                \"p\": 2,","                \"sValue\": \"569\"","            },","            {","                \"p\": 3,","                \"sValue\": \"672\"","            },","            {","                \"p\": 4,","                \"sValue\": \"785\"","            }","        ]","   }","","]","","    }","]","","}","","}","","    }","}","",""]




Conclusion (Pass /Fail)PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/
Testing LabEricsson Lab / CSIT


Test Case ID

PM_Mapper_08

Test Case NameVerify 3GPP PM Mapper maps Type-A file based on counter filtering and publish 3gpp perf VES evnets to message router
DescriptionVerifies that PM Mapper maps Type-A xml files correctly and publishes 3gpp perf VES events to message router
ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service and PM Mapper subscribe to Data Router feed.
Testing Steps


StepsExpected Result
  • Send valid Type-A pm files to Data Router with proper meta data. 





No Format
curl -v -X PUT https://${DMAAP_DR_IP}:8443/publish/1/A20181002.0000-1000-0015-1000_5G.xml --data-binary @tests/dcaegen2-pmmapper/pmmapper/assets/A20181002.0000-1000-0015-1000_5G.xml -H "Content-Type:application/octet-stream" -H 'X-DMAAP-DR-META:{"productName": "gnb","vendorName": "Ericsson","lastEpochMicrosec": "1538478000000","sourceName": "csit","startEpochMicrosec": "1538478900000","timeZoneOffset": "UTC+05:00","location": "pm.xml","compression": "gzip","fileFormatType": "org.3GPP.32.435#measCollec","fileFormatVersion": "V9"}' -H "Authorization: Basic cG1tYXBwZXI6cG1tYXBwZXI=" -H "X-DMAAP-DR-ON-BEHALF-OF: pmmapper" --location-trusted -k

/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:



No Format
2019-04-11T11:20:16.504Z	-1	INFO	org.onap.dcaegen2.services.pmmapper.messagerouter.VESPublisher	InstanceUUID=108fa1dc-04d8-441d-b0fc-817b8a5119b0, RequestID=4b712abe-8bb3-4f35-bffd-91fd9e839eec, ServiceName=/delivery/A20181002.0000-1000-0015-1000_5G.xml, InvocationID=c5e82574-ff24-4c6d-865c-5526bb1c6e0c, InvokeTimestamp=2019-04-11T11:20:16.436Z, PartnerName=, ClientIPAddress=/172.18.0.8, ServerFQDN=dcae-pm-mapper	Publishing VES events to messagerouter.



  • Verify that PM Mapper correctly published.



No Format
curl http://${DMAAP_MR_IP}:3904/events/PM_MAPPER/CG1/C1?timeout=1000 > /tmp/mr.log

/tmp/mr.log:

No Format
["{","    \"event\": {","        \"commonEventHeader\": {","    \"domain\": \"perf3gpp\",","    \"eventId\": \"9a6b0ce9-17c1-4fb5-92bc-de64b307168e\",","    \"sequence\": 0,","    \"eventName\": \"perf3gpp_gnb-Ericsson_pmMeasResult\",","    \"sourceName\": \"oteNB5309\",","    \"reportingEntityName\": \"\",","    \"priority\": \"Normal\",","    \"startEpochMicrosec\": 951912000000,","    \"lastEpochMicrosec\": 951912900000,","    \"version\": \"4.0\",","    \"vesEventListenerVersion\": \"7.1\",","    \"timeZoneOffset\": \"UTC+05.00\"","}","","    ,","        \"perf3gppFields\": {","    \"perf3gppFieldsVersion\": \"1.0\",","    \"measDataCollection\": {","    \"granularityPeriod\": 951912870000,","    \"measuredEntityUserName\": \"RNC Telecomville\",","    \"measuredEntityDn\": \"SubNetwork=CountryNN,MeContext=MEC-Gbg-1,ManagedElement=RNC-Gbg-1\",","    \"measuredEntitySoftwareVersion\": \"\",","    \"measInfoList\": [","    {","        \"measInfoId\": {","            \"sMeasInfoId\": \"\"","        },","        \"measTypes\": {","    \"sMeasTypesList\":[","       \"attTCHSeizures\"","    ]","}",",","        \"measValuesList\": [","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-997\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"234\"","            }","        ]","   }",",","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-998\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"890\"","            }","        ]","   }",",","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-999\",","        \"suspectFlag\": \"true\",","        \"measResults\": [","            {","                \"p\": 1,","                \"sValue\": \"456\"","            }","        ]","   }","","]","","    },","    {","        \"measInfoId\": {","            \"sMeasInfoId\": \"ENodeBFunction\"","        },","        \"measTypes\": {","    \"sMeasTypesList\":[","       \"succTCHSeizures2\"","    ]","}",",","        \"measValuesList\": [","    {","        \"measObjInstId\": \"ManagedElement=RNC-Gbg-1,ENodeBFunction=1\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 2,","                \"sValue\": \"86,87,2,6,77,96,75,33,24\"","            }","        ]","   }","","]","","    },","    {","        \"measInfoId\": {","            \"sMeasInfoId\": \"\"","        },","        \"measTypes\": {","    \"sMeasTypesList\":[","       \"succImmediateAssignProcs8\"","    ]","}",",","        \"measValuesList\": [","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-997\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 4,","                \"sValue\": \"787\"","            }","        ]","   }",",","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-998\",","        \"suspectFlag\": \"false\",","        \"measResults\": [","            {","                \"p\": 4,","                \"sValue\": \"238\"","            }","        ]","   }",",","    {","        \"measObjInstId\": \"RncFunction=RF-1,UtranCell=Gbg-999\",","        \"suspectFlag\": \"true\",","        \"measResults\": [","            {","                \"p\": 4,","                \"sValue\": \"785\"","            }","        ]","   }","","]","","    }","]","","}","","}","","    }","}","",""]




Conclusion (Pass /Fail)PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/
Testing LabEricsson Lab


Test Case ID

PM_Mapper_09

Test Case NameVerify that PM Mapper correctly identifies a file that should not be mapped based on metadata filtering.
DescriptionVerify that PM Mapper correctly determines whether a file should be mapped based on the metadata against the instantiated PM Mapper filter information.
ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.
Testing Steps


StepsExpected Result
  1. Send a request to pm-mapper where the metadata vendor name does not match the filter vendor name defined for the pm-mapper


No Format
curl -v -X PUT localhost:8081/delivery/pm  -H "Content-Type:application/xml"  -H 'X-DMAAP-DR-META:{"productName": "gnb","vendorName": "Anon","lastEpochMicrec": "1538478000000","sourceName": "oteNB5309","startEpochMicrosec": "1538478900000","timeZoneOffset": "UTC+05:00","location": "ftpes://192.168.0.101:22/ftp/rop/A20161224.1045-1100.bin.gz","compression": "gzip","fileFormatType": "org.3GPP.32.435#measCollec","fileFormatVersion": "V9"}' --data @tests/dcaegen2-pmmapper/pmmapper/assets/meas_result.xml -H 'X-DMAAP-DR-PUBLISH-ID: 2' -H 'X-ONAP-RequestID: 2'


/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:

No Format
2019-03-14T14:03:19.768Z	-8

/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:

No Format2019-02-20T14:11:25.879Z XNIO-1 I/O-10 INFO org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber InstanceUUID=02bc37e3-4959-4ce5-b1fd-d93b21c7751d, RequestID=09012095-be25-4990-9e51-32701c6e3f1b, ServiceName=/delivery, InvocationID=430ede44-7fe5-4476-873a-e101ae65af73, InvokeTimestamp=2019-02-20T14:11:25.878Z, PartnerName=, ClientIPAddress=/127.0.0.1, ServerFQDN=localhost ENTRY 2019-02-20T14:11:25.881Z XNIO-1 I/O-10 INFO org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber InstanceUUID=02bc37e3-4959-4ce5-b1fd-d93b21c7751d, RequestID=09012095-be25-4990-9e51-32701c6e3f1b, ServiceName=/delivery, InvocationID=430ede44-7fe5-4476-873a-e101ae65af73, InvokeTimestamp=2019-02-20T14:11:25.878Z, PartnerName=, ClientIPAddress=/127.0.0.1, ServerFQDN=localhost Bad Request: no metadata found under 'X-ATT-DR-META' header. org.onap.dcaegen2.services.pmmapper.exceptions.NoMetadataException: Metadata Not found. 2019-02-20T14:11:25.889Z XNIO-1 I/O-10
	INFO	org.onap.dcaegen2.services.pmmapper.
datarouter
filtering.
DataRouterSubscriber
MetadataFilter
ResponseCode=, 
InstanceUUID=
02bc37e3
0e53e6f1-
4959
e411-
4ce5
4132-
b1fd
9d6e-
d93b21c7751d
840ce0eca178, RequestID=
09012095-be25-4990-9e51-32701c6e3f1b
2, ServiceName=/delivery/pm,
ResponseDescription=, 
InvocationID=
430ede44
1ded3e0f-
7fe5
6863-
4476
462f-
873a-e101ae65af73, Severity=
8f35-8106c4d1e1fd, InvokeTimestamp=2019-
02
03-
20T14
14T14:
11
03:
25
19.
878Z
764Z, PartnerName=, ClientIPAddress=/
127
172.
0
18.0.1, ServerFQDN=localhost
, StatusCode= EXIT 
	Metadata does not match any filters,



Conclusion (Pass /Fail)

PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/

Conclusion (Pass /Fail)

Testing LabEricsson Lab
/CSIT



Test Case ID

PM_Mapper_

11

10

Test Case NameVerify
3GPP PM Mapper responds appropriately when invalid metadata is provided
that PM Mapper correctly identifies a non-xml file.
DescriptionVerify
3GPP
that PM Mapper
responds 400 with the message "Malformed Metadata." when invalid metadata is provided
correctly identifies a non-xml file by correctly outputting the expected message
ReleaseDublin
Pre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.
Testing Steps


StepsExpected Result
    • Send a request to the pm-mapper
with invalid metadata header
    • that contains non-xml file.



No Format
curl -v -X PUT
<PM Mapper IP>:8081/delivery
 localhost:8081/delivery/pm  -H "Content-Type:application/xml"  -H 'X-
ATT
DMAAP-DR-META
: not metadata' Malformed Metadata.
:{"productName": "gnb","vendorName": "Ericsson","lastEpochMicrosec": "1538478000000","sourceName": "oteNB5309","startEpochMicrosec": "1538478900000","timeZoneOffset": "UTC+05:00","location": "ftpes://192.168.0.101:22/ftp/rop/A20161224.1045-1100.bin.gz","compression": "gzip","fileFormatType": "org.3GPP.32.435#measCollec","fileFormatVersion": "V9"}' --data @tests/dcaegen2-pmmapper/pmmapper/assets/diff_vendor_metadata.json -H 'X-DMAAP-DR-PUBLISH-ID: 2' -H 'X-ONAP-RequestID: 2'


/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:

No Format
2019-04-09T14:00:08.780Z	-8

/var/log/ONAP/dcaegen2/services/pm-mapper/pm-mapper_output.log:

No Format2019-02-21T08:41:33.422Z XNIO-1 I/O-10 INFO org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber InstanceUUID=ea927d94-a91c-42f5-a145-138ee56259fe, RequestID=05def218-0d62-4e04-9b84-93424b410af4, ServiceName=/delivery, InvocationID=5e0015e9-87f4-46a4-975f-a82a2e308926, InvokeTimestamp=2019-02-21T08:41:33.421Z, PartnerName=, ClientIPAddress=/127.0.0.1, ServerFQDN=localhost ENTRY 2019-02-21T08:41:33.425Z XNIO-1 I/O-10
	INFO	org.onap.dcaegen2.services.pmmapper.
datarouter
filtering.
DataRouterSubscriber
MeasFilterHandler	InstanceUUID=
ea927d94
63d0106e-
a91c
5ba1-
42f5
45b1-
a145
b0f0-
138ee56259fe
9debe9eb2be7, RequestID=
05def218-0d62-4e04-9b84-93424b410af4
2, ServiceName=/delivery/pm, InvocationID=
5e0015e9
5598c331-
87f4
9d9d-
46a4
4679-
975f
8cb2-
a82a2e308926
c30231f25495, InvokeTimestamp=2019-
02
04-
21T08
09T14:
41
00:
33
08.
421Z
775Z, PartnerName=, ClientIPAddress=/
127
172.
0
18.0.1, ServerFQDN=localhost
Bad
PM
Request:
measurement
Failure
file
to
type
parse
not
metadata 2019-02-21T08:41:33.432Z XNIO-1 I/O-10 INFO org.onap.dcaegen2.services.pmmapper.datarouter.DataRouterSubscriber ResponseCode=, InstanceUUID=ea927d94-a91c-42f5-a145-138ee56259fe, RequestID=05def218-0d62-4e04-9b84-93424b410af4, ServiceName=/delivery, ResponseDescription=, InvocationID=5e0015e9-87f4-46a4-975f-a82a2e308926, Severity=, InvokeTimestamp=2019-02-21T08:41:33.421Z, PartnerName=, ClientIPAddress=/127.0.0.1, ServerFQDN=localhost, StatusCode= EXIT Conclusion (Pass /Fail)Testing LabEricsson Lab/CSITTest Case ID

PM_Mapper_12

Test Case NameDescriptionReleaseDublinPre-conditionsFrom the above section "Deployment" a test environment with all the required components - Config Binding Service, Consul and PM Mapper service.Testing StepsStepsExpected ResultConclusion (Pass /Fail)Testing LabEricsson Lab
supported




Conclusion (Pass /Fail)PASS - https://jenkins.onap.org/job/dcaegen2-pmmapper-master-csit-pmmapper/
Testing LabEricsson Lab



PM Mapper Component Performance Stats

Performance (Dublin recommendation 2 - cannot be committed due to Resource constraint)

    • Level 0: no performance testing done
    • Level 1: baseline performance criteria identified and measured  (such as response time, transaction/message rate, latency, footprint, etc. to be defined on per component)
    • Level 2: performance improvement plan created 
    • Level 3: performance improvement plan implemented for 1 release (improvement measured for equivalent functionality & equivalent hardware)


Baseline Stats:

Performance CriteriaMeasurementComments
Time to process 700 XML ( 1.3 MB ) files79 minutes

This time need to be improved .

PM Mapper component can process concurrent request with 1.3 MB XML size successfully.

Test Bed:

1 Concurrent user.

700 XML file.

Standard dublin Full ONAP installation :  vCPU: 16, RAM: 60GB, Disk Size:120 GB

Avg response time0.034100% success.


Performance Improvement Plan:

  • Time to process 700 XML ( 1.3 MB avg ) : ~10 min
  • Adapt parallelism in PM Mapper.