This page will track our test plans for S3P functionality (if applicable). When successful, we will update the Release Planning wiki on our status: Beijing Release Platform Maturity


Platform Maturity Integration Testing

AreaActual LevelTargeted Level for current ReleaseHow, EvidencesComments
Performance01

AAI has not done performance testing in OOM environment, yet, plans to implement in TLAB.

AAI-1145 - Getting issue details... STATUS

HEAT based test results


  • 0 -- none
  • 1 – baseline performance criteria identified and measured
  • 2 & 3 – performance improvement plans created & implemented
Stability11

CSIT tests showsthe stability of the components - https://jenkins.onap.org/view/CSIT/job/aai-master-verify-csit-resources/

https://jenkins.onap.org/view/CSIT/job/aai-master-verify-csit-traversal/

Heat and OOM deployments have the instances running for more than 72 hours - https://jenkins.onap.org/view/External%20Labs/

  • 0 – none
  • 1 – 72 hours component level soak w/random transactions
  • 2 – 72 hours platform level soak w/random transactions
  • 3 – 6 months track record of reduced defect rate
Resiliency12

Integrated with OOM which allows for automated detection and recovery in a single site.

root@rancher:~# kubectl -n onap get pods | grep aai

dev-aai-7c4898f44f-qf4xh                                          1/1       Running            6          2h

dev-aai-babel-789f9d97bd-77d7r                                    2/2       Running            0          2h

dev-aai-cassandra-0                                               1/1       Running            0          2h

dev-aai-cassandra-1                                               1/1       Running            0          2h

dev-aai-cassandra-2                                               1/1       Running            0          2h

dev-aai-champ-58bfcdc445-p9nph                                    1/1       Running            0          2h

dev-aai-data-router-6f9ff67d68-plf4m                              1/1       Running            0          2h

dev-aai-elasticsearch-548b68c46f-j9b9g                            1/1       Running            0          2h

dev-aai-gizmo-796b95f5c5-gct2m                                    2/2       Running            0          2h

dev-aai-hbase-868f949597-s8l7p                                    1/1       Running            0          2h

dev-aai-modelloader-84b77ffb54-pxzss                              2/2       Running            0          2h

dev-aai-resources-894667dd8-rkprw                                 2/2       Running            0          2h

dev-aai-search-data-6cbc65f459-mphxf                              2/2       Running            0          2h

dev-aai-sparky-be-576bbb99fd-j972w                                2/2       Running            0          2h

dev-aai-traversal-9bffcd7b6-fdr7t                                 2/2       Running            0          2h
  • 0 – none
  • 1 – manual failure and recovery (< 30 minutes)
  • 2 – automated detection and recovery (single site)
  • 3 – automated detection and recovery (geo redundancy)
Security01

CII Badging:

AAI Core:

CII Best Practices

AAI ESR:

CII Best Practices

Sparky-fe:

CII Best Practices

AAI UI:

CII Best Practices

Model loader:

CII Best Practices

>50% Test Coverage:


  • 0 – none
  • 1 – CII Passing badge + 50% Test Coverage
  • 2 – CII Silver badge; internal communication encrypted; role-based access control and authorization for all calls
  • 3 – CII Gold
Scalability01

Integrated with OOM:

AAI-539 - Getting issue details... STATUS

AAI-15 - Getting issue details... STATUS

  • 0 – no ability to scale
  • 1 – single site horizontal scaling
  • 2 – geographic scaling
  • 3 – scaling across multiple ONAP instances
Manageability11

Logging with EELF and filebeat in OOM, AAI can be instantiated in < 1 hr

root@rancher:~# kubectl -n onap get pods | grep aai

dev-aai-7c4898f44f-qf4xh                                          1/1       Running            6          2h

dev-aai-babel-789f9d97bd-77d7r                                    2/2       Running            0          2h

dev-aai-cassandra-0                                               1/1       Running            0          2h

dev-aai-cassandra-1                                               1/1       Running            0          2h

dev-aai-cassandra-2                                               1/1       Running            0          2h

dev-aai-champ-58bfcdc445-p9nph                                    1/1       Running            0          2h

dev-aai-data-router-6f9ff67d68-plf4m                              1/1       Running            0          2h

dev-aai-elasticsearch-548b68c46f-j9b9g                            1/1       Running            0          2h

dev-aai-gizmo-796b95f5c5-gct2m                                    2/2       Running            0          2h

dev-aai-hbase-868f949597-s8l7p                                    1/1       Running            0          2h

dev-aai-modelloader-84b77ffb54-pxzss                              2/2       Running            0          2h

dev-aai-resources-894667dd8-rkprw                                 2/2       Running            0          2h

dev-aai-search-data-6cbc65f459-mphxf                              2/2       Running            0          2h

dev-aai-sparky-be-576bbb99fd-j972w                                2/2       Running            0          2h

dev-aai-traversal-9bffcd7b6-fdr7t                                 2/2       Running            0          2h
  • 1 – single logging system across components; instantiation in < 1 hour
  • 2 –abilityto upgrade a single component; tracing across components; externalized configuration management
Usability11

AAI Docs at readthedocs

Active and Available Inventory Project


  • 1 – user guide; deployment documentation; API documentation
  • 2 – UI consistency; usability testing; tutorial documentation
  • No labels