You are viewing an old version of this page. View the current version.
Compare with Current
View Page History
« Previous
Version 39
Next »
The Bulk PM feature consists of two main parts:
- Event-driven bulk transfer of monitoring data from an xNF to ONAP/DCAE. A micro-service will listen for 'FileReady' VES events sent from an xNF via the VES collector. Once files become available the collector micro-service will fetch them using protocol such as FTPES (committed) or SFTP. The collected data files are published internally on a DMaaP Data Router (DR) feed. (committed goal for Casablanca release)
- For 3GPP formatted measurement data and for consumers that prefer such data in VES format, an optional 3GPP PM Mapper micro-service is planned that can extract selected measurements from a 3GPP XML file and publish them as VES events on a DMaaP Message Router topic. The mapper receives the files by subscribing to a Data Router feed (stretch goal for Dublin release)
JIRA:
INT-649
-
Getting issue details...
STATUS
Deployment:
Test environment requirements for above test cases:
- xNF simulator for test cases: FTPes capable server.
- with VES 7.0.1 support for 'fileReady' event.
- E.g. xNF able to produce data files and send VES fileReady events,
- E.g. xNF emulator able to produce 'fileReady' notification events including updated events, or a series or predefined VES events at periodic intervals.
- sample data files for collection. E.g. 3gpp PM file(s)
- DMaaP R3, at minimum need DR running and configured for Bulk PM support
- DCAE R3, MR with support for VES 7.0.1 spec
- DCAE R3, Data File Collector installed and configured
Use Case preconditions:
E2E Sunny Day Scenario Sequence Diagram
High Level End-to-End feature integration Testcases :
| # | Test Case | Status |
|---|
| 1 | Ensure that the 'FileReady' VES event is sent from the simulated xNF via the VES collector. | |
| 2 | Ensure that the unauthenticated.VES_NOTIFICATION_OUTPUT topic is present once it received "File Ready" VES notification from VES Collector. | |
| 3 | Ensure that the Data File Collector starts to download the xml PM file(s) from the simulated xNF once it receives the 'FileReady' VES event via the VES collector. | |
| 4 | Ensure that the PM xml file(s) are published to the Data Router. | |
| 5 | Ensure that a simulated File Consumer is able to subscribe and consume the PM file(s) from the Data Router. | |
Detailed Description End-to-End Feature Integration Testcases :
| Test Case ID | Bulk_PM_E2E_01 |
|---|
| Test Case Name | Send FileReadyEvent to VES Collector |
| Description | Ensure that the 'FileReady' VES event is sent from the simulated xNF via the VES collector. |
| Release | Casablanca |
| Pre-conditions | From the above section "Deployment" a test environment with all the required components - xNF (simulated with sftp or sftpe ), VES Collector. |
| Testing Steps | | Steps | Expected Result |
|---|
Send FileExist VES event to VES collector. Example File Ready VES Notification: curl -i -X POST -H "Content-Type:application/json" -d '{
"event": {
"commonEventHeader": {
"version": "4.0.1",
"vesEventListenerVersion": "7.0.1",
"domain": "notification",
"eventName": "Noti_RnNode-Ericsson_FileReady",
"eventId": "FileReady_1797490e-10ae-4d48-9ea7-3d7d790b25e1",
"lastEpochMicrosec": 8745745764578,
"priority": "Normal",
"reportingEntityName": "otenb5309",
"sequence": 0,
"sourceName": "oteNB5309",
"startEpochMicrosec": 8745745764578,
"timeZoneOffset": "UTC+05.30"
},
"notificationFields": {
"changeIdentifier": "PM_MEAS_FILES",
"changeType": "FileReady",
"notificationFieldsVersion": "2.0",
"arrayOfNamedHashMap": [
{ "name": "pm.xml.gz",
"hashMap":{
"location": "sftp://admin:admin@172.18.0.2:22/pm.xml.gz",
"compression": "gzip",
"fileFormatType": "org.3GPP.32.435#measCollec",
"fileFormatVersion": "V10"
}
}
]
}
}
}' 'http://172.17.0.2:8080/eventListener/v7'
| VES Collector accepted the "File Ready" Notification send by xNF. We should get 202 response by VES Collector. HTTP/1.1 202 Content-Type: application/json Content-Length: 8 Date: Sat, 22 Sep 2018 21:16:07 GMT
|
|
|
|
| Conclusion (Pass /Fail) | PASS |
| Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
| Test Case ID | Bulk_PM_E2E_02 |
|---|
| Test Case Name | Dmaap topic for unauthenticated.VES_NOTIFICATION_OUTPUT |
| Description | Ensure that the unauthenticated.VES_NOTIFICATION_OUTPUT topic is present once it received "File Ready" VES notification from VES Collector.
|
| Release | Casablanca |
| Pre-conditions | 1 . Dmaap Message Router is up and running. 2. The Previous Test case has passed. |
Testing Steps
| | Steps | Expected Result |
|---|
- Check the Dmaap topic, it should contain unauthenticated.VES_NOTIFICATION_OUTPUT
| curl -i http://172.18.0.6:3904/topics
HTTP/1.1 200 OK
Date: Sun, 23 Sep 2018 10:10:26 GMT
Content-Type: application/json
Accept: */*
breadcrumbId: ID-de84f90a4556-45507-1537643129080-0-21587
User-Agent: curl/7.47.0
X-CSI-Internal-WriteableRequest: true
Content-Length: 87
Server: Jetty(9.3.z-SNAPSHOT)
{"topics": [
"__consumer_offsets",
"unauthenticated.VES_NOTIFICATION_OUTPUT"
]}
| | 2. Check the messages under unauthenticated.VES_NOTIFICATION_OUTPUT topic in Dmaap. | root@excl-lego-bulkpm-raj:~#
root@excl-lego-bulkpm-raj:~# curl http://172.18.0.6:3904/events/unauthenticated.VES_NOTIFICATION_OUTPUT/OpenDcae-c12/C12
[]root@excl-lego-bulkpm-raj:~# curl http://172.18.0.6:3904/events/unauthenticated.VES_NOTIFICATION_OUTPUT/OpenDcae-c12/C12
["{\"event\":{\"commonEventHeader\":{\"startEpochMicrosec\":8745745764578,\"eventId\":\"FileReady_1797490e-10ae-4d48-9ea7-3d7d790b25e1\",\"timeZoneOffset\":\"UTC+05.30\",\"internalHeaderFields\":{\"collectorTimeStamp\":\"Sat, 09 22 2018 07:09:15 UTC\"},\"priority\":\"Normal\",\"version\":\"4.0.1\",\"reportingEntityName\":\"otenb5309\",\"sequence\":0,\"domain\":\"notification\",\"lastEpochMicrosec\":8745745764578,\"eventName\":\"Noti_RnNode-Ericsson_FileReady\",\"vesEventListenerVersion\":\"7.0.1\",\"sourceName\":\"oteNB5309\"},\"notificationFields\":{\"notificationFieldsVersion\":\"2.0\",\"changeType\":\"FileReady\",\"changeIdentifier\":\"PM_MEAS_FILES\",\"arrayOfNamedHashMap\":[{\"name\":\"pm.xml.gz\",\"hashMap\":{\"location\":\"sftp://admin:admin@172.18.0.2:22/pm.xml.gz\",\"fileFormatType\":\"org.3GPP.32.435#measCollec\",\"fileFormatVersion\":\"V10\",\"compression\":\"gzip\"}}]}}}"]root@excl-lego-bulkpm-raj:~#
root@excl-lego-bulkpm-raj:~#
root@excl-lego-bulkpm-raj:~#
|
|
| Conclusion (Pass /Fail) | PASS |
| Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
| Test Case ID | Bulk_PM_E2E_03 |
|---|
| Test Case Name | Download of xml PM file(s) from xNF when 'FileReady' VES event is received. |
| Description | Ensure that the Data File Collector starts to download the xml PM file(s) from the simulated xNF once it receives the 'FileReady' VES event via the VES collector. |
| Release | Casablanca |
| Pre-conditions | The Previous Test case has passed. |
| Testing Steps | | Steps | Expected Result |
|---|
- File Collector get xNF info ( sftp address, PM file location etc ) from
Dmaap topic
unauthenticated.VES_NOTIFICATION_OUTPUT
| Data File Collector fetches messages from Dmaap Topic. #less /opt/log/application.log 2018-09-22 21:16:07.815 INFO 1 --- [elastic-2] o.o.d.c.d.s.DmaapReactiveWebClient : Request: GET http://172.18.0.6:3904/events/unauthenticated.VES_NOTIFICATION_OUTPUT/OpenDcae-c12/C12
2018-09-22 21:16:07.815 INFO 1 --- [elastic-2] o.o.d.c.d.s.DmaapReactiveWebClient : Content-Type=application/json
2018-09-22 21:16:07.816 INFO 1 --- [elastic-2] o.o.d.c.d.s.DmaapReactiveWebClient : HTTP request headers: {Content-Type=[application/json]}
2018-09-22 21:16:08.062 INFO 1 --- [reactor-http-client-epoll-15] o.o.d.c.d.s.DmaapReactiveWebClient : Response Status 200
2018-09-22 21:16:08.064 INFO 1 --- [reactor-http-client-epoll-15] o.o.d.c.d.s.DmaapConsumerJsonParser : raw message from message router: ["{"event":{"commonEventHeader":{"startEpochMicrosec":8745745764578,"eventId":"FileReady_1797490e-10ae-4d48-9ea7-3d7d790b25e1","timeZoneOffset":"UTC+05.30","internalHeaderFields":{"collectorTimeStamp":"Sat, 09 22 2018 09:16:07 UTC"},"priority":"Normal","version":"4.0.1","reportingEntityName":"otenb5309","sequence":0,"domain":"notification","lastEpochMicrosec":8745745764578,"eventName":"Noti_RnNode-Ericsson_FileReady","vesEventListenerVersion":"7.0.1","sourceName":"oteNB5309"},"notificationFields":{"notificationFieldsVersion":"2.0","changeType":"FileReady","changeIdentifier":"PM_MEAS_FILES","arrayOfNamedHashMap":[{"name":"pm.xml.gz","hashMap":{"location":"sftp://admin:admin@172.18.0.2:22/pm.xml.gz","fileFormatType":"org.3GPP.32.435#measCollec","fileFormatVersion":"V10","compression":"gzip"}}]}}}"]
| | 2. File Collector start downloading PM files from xNF. | /opt/log/application.log 2018-09-22 21:16:08.811 DEBUG 1 --- [reactor-http-client-epoll-15] o.o.d.c.datafile.ftp.SftpClient : File pm.xml.gz Download Successfull from xNF | | 3. File Collector store downloaded files to /target directory inside container. | root@excl-lego-bulkpm-raj:~# docker exec dfc /bin/sh -c "ls /target | grep .gz" pm.xml.gz root@excl-lego-bulkpm-raj:~# |
|
| Conclusion (Pass /Fail) | PASS |
| Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
| Test Case ID | Bulk_PM_E2E_04 |
|---|
| Test Case Name | File Collector informs Data Router of xml PM file(s) |
| Description | Ensure that the PM xml file(s) are published to the Data Router. |
| Release | Casablanca |
| Pre-conditions | The Previous Test case has passed. |
| Testing Steps | - File Collector subscribes to the Data Router.
- File Collector informs Data Router of new xml PM files(s)
|
| Expected Result | - File Collector is successfully subscribed to the Data Router.
- The xml PM file(s) is published on the Data Router.
|
| Conclusion (Pass /Fail) |
|
| Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
| Test Case ID | Bulk_PM_E2E_05 |
|---|
| Test Case Name | Simulated File Consumer receives the xml PM file(s) |
| Description | Ensure that a simulated File Consumer is able to subscribe and consume the PM file(s) from the Data Router. |
| Release | Casablanca |
| Pre-conditions | The Previous Test case has passed. |
| Testing Steps | - A simulated File Consumer subscribes to the Data Router.
- A simulated File consumer receives notification of a xml PM file(s)
|
| Expected Result | - The simulated File Consumer is successfully subscribed to the Data Router.
- The simulated File Consumer is successfully able to consume the xml PM file(s) from the Data Router
|
| Conclusion (Pass /Fail) |
|
| Testing Lab | https://jenkins.onap.org/view/CSIT/ Ubuntu Docker Machine |
Information:
For more information on the DMaaP API's see this link DMaaP API
Next Step(s):
Write Tests cases to verify BulkPM on an ONAP environment.
