...
Performance test was triggered injecting vCPE, vFirewall, vDNS, VOLTE onset & abatement (where applicable) messages through REST interface of Drools PDP installed in windriver lab (PFPP). This was running on a kubernetes host, using the m2.xlarge spec, having the following configuration:
- 32GB RAM
- 8 VCPU
- 160GB Disk
The test environment was set-up using simulated components i.e. A&AI, VFC and SO using "features enable controlloop-utils". However the performance test subscribes to the POLICY-CL-MGT topic, which is not simulated, to determine when the PDP has completed various steps.
...
Average processing time was calculated using the last 10000 records from audit.log for each use case, as well as the matching transaction time extracted from the network.log, using the below script:
https://gerrit.onap.org/r/gitweb?p=policy/drools-applications.git;a=blob;f=testsuites/performance/src/main/resources/amsterdam/generate_mt_performace_report.sh;h=846628543b5a127c49f57a1fa1f4a254dfff64da;hb=refs/heads/mastergenerate-mt-performance-report
Result
Time taken by Drools PDP
| Code Block |
|---|
Elapsed time for vCPE : matched 8870 samples, average 1918 ms unmatched 1130 samples, average 339 ms Elapsed time for vFirewall : matched 8871 samples, average 5655 ms unmatched 1129 samples, average 177 ms Elapsed time for vDNS : matched 8869 samples, average 129 ms unmatched 1131 samples, average 16 ms Elapsed time for VOLTE : matched 88668868 samples, average 109 ms unmatched 11341132 samples, average 15 ms |
Note: the “unmatched samples” are requests for which no corresponding network time could be identified by the reporting tool. Hence those numbers represent the total elapsed time, with nothing subtracted out.
CPU Utilization
Total CPU used by the PDP was measured before and after the test, using "ps -l".
...
No. | Metric | Description | Result | Comments |
|---|---|---|---|---|
| 4 | Maximum Simultaneous Executions | Measure the maximum number of simultaneous policy executions that can be achieved whilst maintaining system stability and resource utilization | 10 | DMaaP connection limitations prevented the test from running more than 10 simultaneous threads/ONSETs |
| 5 | Multi-Threaded Response Time | Measure the execution time for onset and abatement in each use case when multiple threads are injecting ONSET events simultaneously | vCPE - 19 18 ms vFirewall - 56 55 ms vDNS - 12 9 ms VOLTE - 10 9 ms | |
| 6 | Multi Threaded CPU Usage | CPU Usage for each use case when multiple threads are injecting ONSET events simultaneously | 9.8 ms | |
| 7 | Multi Threaded Memory Usage | Memory Usage for each use case when multiple threads are injecting ONSET events simultaneously |