Beijing Release Platform Maturity
| S3P/Maturity Area | Committed Beijing Level | Test | Result |
|---|---|---|---|
| Performance | Level 1 | baseline performance criteria identified and measured | Perf Test is executed and measured the response time for random beijing CLIs. Here is the reports NOTE: Both Perf and stability tests are conducted simultaneously. |
| Stability | Level 1 - | 72 hour component level soak w/random transactions | For 72 hours, ONAP CLI is soaked with random beijing CLI with different kind of samples. OCLIP is stable and does not break in between. Here is the report: NOTE: Both Perf and stability tests are conducted simultaneously. |
| Resiliency | Level 1 | manual failure and recovery (< 30 minutes) | As part of testing, OCLIP was crashing due to some jline jar issues and is fixed now. No crash occurred during the test It can be started with in a minute manually. |
| Security | Level 1 | CII Passing badge + 50% test coverage | |
| Scalability | Level 1 | single site horizontal scaling | CLI is tested in a ONAP OOM and Heat based deployment on a given site. NOTE: stand-alone deployment would help to install multiple instances of CLI. And currently it scales across multiple versions of the product, ONAP amsterdam and beijing. 250+ CLIs from single installation. |
| Manageability | Level 1 | single logging system across components; instantiation in < 1 hour | Installation by docker/zip (takes less than a minute) Logging for troubleshooting in place |
| Usability | Level 2 | user guide; deployment documentation; API documentation; adherence to coding guidelines | http://onap.readthedocs.io/en/latest/submodules/cli.git/docs/ |