...
Platform Maturity Integration Testing
Actual Level | Targeted Level for current Release | How, Evidences | Comments | Result |
---|
Performance |
0 Jira |
---|
server | ONAP JIRA |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-171 |
---|
|
Are developing server simulation to receive requests from VF-C to SVNFM Baseline performance criteria are being defined |
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-211 |
---|
Jira |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
server | ONAP JIRA | serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | VFC-663 |
---|
|
|
PORTAL-268CSIT tests showsthe stability of the component - https://jenkins.onap.org/view/CSIT/job/portal-master-csit-testsuite/
VF-C R2 Beijing - S3P - discusses the tests and concerns raised. The memory issue is fixed - | - 0 -- none
- 1 – baseline performance criteria identified and measured
- 2 & 3 – performance improvement plans created & implemented
| Pass VF-C Maturity Test Report |
Stability | 1 |
1 | 72 hours components level random transactions are being tested in cmcc lab Depend on the previous simulator |
Jira |
---|
server | ONAP JIRA |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key |
---|
|
|
PORTAL211Heat and OOM deployments have the instances running for more than 72 hours - https://jenkins.onap.org/view/External%20Labs/ | - 0 – none
- 1 – 72 hours component level soak w/random transactions
- 2 – 72 hours platform level soak w/random transactions
- 3 – 6 months track record of reduced defect rate
|
Resiliency | 1 | 2 | Integrated with MUSIC which is one step towards improving the resiliency and scalability
Jira |
---|
server | ONAP JIRA |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-210 |
---|
|
Jira |
---|
server | ONAP JIRA |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
pass Test 72 hours pass in cmcc lab VF-C Maturity Test Report |
Resiliency | 2 | VF-C have integrated with OOM and can implement automated failure detection and recovery by leveraging the k8s capabilities |
key | PORTAL-5 Jira |
---|
server | ONAP JIRA |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-265 |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key |
---|
|
|
PORTAL277 | - 0 – none
- 1 – manual failure and recovery (< 30 minutes)
- 2 – automated detection and recovery (single site)
- 3 – automated detection and recovery (geo redundancy)
|
Security | 0 | 1 |
Image Removed
>50% Test Coverage:
- portal line coverage is greater than 50% - sonar link
- portal-sdk line coverage is greater than 50% - sonar link
Portal Platform Security/Vulnerability Threatspass have been tested in intel lab, core component can be recovered relying on OOM |
Security | 1 | CII Passing is 97% ; code coverage is already above 50%; there are still unresolved critial issues |
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-145 |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
Jira |
---|
server | ONAP JIRA | serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key |
---|
|
|
PORTAL-155 | Jira |
---|
server | ONAP JIRA |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-136 |
---|
|
Jira |
---|
server | ONAP JIRA |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-269 |
---|
|
Jira |
---|
server | ONAP JIRA |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-266 |
---|
|
| - 0 – none
- 1 – CII Passing badge + 50% Test Coverage
- 2 – CII Silver badge; internal communication encrypted; role-based access control and authorization for all calls
- 3 – CII Gold
|
Scalability | 0 | 1 | Integrated with MUSIC which is one step towards improving the resiliency and scalability
Jira |
---|
server | ONAP JIRA |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-210 |
---|
|
Jira |
---|
server | ONAP JIRA |
---|
pass have passed when M4 CII Passing is 97% ; code coverage is above 50%; |
Scalability | 1(*) | Part of stateless components can scale via k8s For stateful VF-C components need more work to support scalability, we plan to support all components scalability in Casablanca release. |
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key | PORTAL-5 |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
|
|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key |
---|
|
|
PORTAL265 | - 0 – no ability to scale
- 1 – single site horizontal scaling
- 2 – geographic scaling
- 3 – scaling across multiple ONAP instances
| pass Note: Currenty,only ztevnfmdriver gvnfmdriver can be scaled via OOM, we plan to support all components scalability in Casablanca release.
|
Manageability | 1 |
1VF-C updated log configuration and added filebeat container to VF-C, So VF-C logs will be transferred to ELK stack Jira |
---|
server | ONAP JIRA |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key |
---|
|
|
PORTAL170 | - 1 – single logging system across components; instantiation in < 1 hour
- 2
|
–abilityto - – ability to upgrade a single component; tracing across components; externalized configuration management
| pass VF-C logs can be written into /var/log/onap/vfc component directory and transferred to ELK stack |
Usability | 1 |
2documentation is already in onap.readthedocs.io Jira |
---|
server | ONAP JIRA |
---|
columns | key,summary,type,created,updated,due,assignee,reporter,priority,status,resolution |
---|
serverId | 425b2b0a-557c-3c0c-b515-579789cceedb |
---|
key |
---|
|
|
PORTAL147 | - 1 – user guide; deployment documentation; API documentation
- 2 – UI consistency; usability testing; tutorial documentation
| pass |