| Manageability | Not Measured | 1, partial of 2 |
| - 1 – single logging system across components; instantiation in < 1 hour
- 2 – ability to upgrade a single component; tracing across components; externalized configuration management
|
| Performance | Not Measured | Not Measured |
| - 0 -- none
- 1 – baseline performance criteria identified and measured
- 2 & 3 – performance improvement plans created & implemented
|
| Resiliency | 2 | 3 | Will cover geo-redundancy if lab env supports it. All Integration team will perform platform-level testing similar to: Beijing Release Resiliency Testing Status | - 0 – none
- 1 – manual failure and recovery (< 30 minutes)
- 2 – automated detection and recovery (single site)
- 3 – automated detection and recovery (geo redundancy)
|
| Scalability | Not Measured | Note Measured |
| - 0 – no ability to scale
- 1 – single site horizontal scaling
- 2 – geographic scaling
- 3 – scaling across multiple ONAP instances
|
| Security | Not Measured | Not Measured |
| - 0 – none
- 1 – CII Passing badge + 50% Test Coverage
- 2 – CII Silver badge; internal communication encrypted; role-based access control and authorization for all calls
- 3 – CII Gold
|
| Stability | 2 | 2 | Integration team will perform platform-level testing similar to: Beijing Release Stability Testing Status (w/ OOM) Beijing Release Stability Testing Status (w/ HEAT) | - 0 – none
- 1 – 72 hours component level soak w/random transactions
- 2 – 72 hours platform level soak w/random transactions
- 3 – 6 months track record of reduced defect rate
|
| Usability | Not Measured | Not Measured |
| - 1 – user guide; deployment documentation; API documentation
- 2 – UI consistency; usability testing; tutorial documentation
|
