Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...


For Performance Level 1, we have to define and measure our performance metrics:
Level 1: baseline performance criteria identified and measured  (such as response time, transaction/message rate, latency, footprint, etc. to be defined on per component

I don't think we have to state what the metrics should be, it looks like we just define the metrics and measure them. For Level 2, an improvement plan must be created and implemented.

Although there should be measurements for design time and deployment time performance, here we focus on the run time performance metrics for policy execution in the PDPs, the most critical run time metrics for Policy. We propose to measure these metrics in a simulated environment and in a full ONAP deployment.

No.MetricDescription
1Single Threaded Response TimeMeasure the execution time for onset and abatement in each use case with only a single policy executing
2Multi-Threaded Response TimeMeasure the execution time for onset and abatement in each use case when the maximum number of threads are executing
3Single Threaded CPU UsageCPU Usage for each use case when executing alone
4Multi Threaded CPU UsageCPU Usage for each use case when executing in multiple threads
5Single Threaded Memory UsageMemory Usage for each use case when executing alone
6Multi Threaded Memory UsageMemory Usage for each use case when executing in multiple threads
7Maximum Simultaneous ExecutionsMeasure the maximum number of simultaneous policy executions that can be achieved whilst maintaining system stability and resource utilization
8Installation FootprintThe requirements of the ONAP Policy Framework installation in terms of VM resources including the amount of disk space required for the database and for logs.