Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

AreaActual levelTargeted level for current releaseHow, EvidencesComments
Performance0

0

(given CLAMP is design time there is no point to adhere to L2 requirement) 

Run performance basic test, depends on performance criteria availability for level 1 - not able to commit to more than what was done on Beijing
  • Level 0: no performance testing done
  • Level 1: baseline performance criteria identified and measured  (such as response time, transaction/message rate, latency, footprint, etc. to be defined on per component)
  • Level 2: performance improvement plan created 
  • Level 3: performance improvement plan implemented for 1 release (improvement measured for equivalent functionality & equivalent hardware)

minimum level for Dublin is 0 except for Control Loop projects. 


see Performance levels

Stability12

Participate to Stability runs Level 1

Jira
serverONAP JIRA
columnskey,summary,type,created,updated,due,assignee,reporter,priority,status,resolution
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyCLAMP-100276


Integration Team is responsible to run the platform test to prove level 2.

  • Level 0: none beyond release requirements
  • Level 1: 72 hour component-level soak test (random test transactions with 80% code coverage; steady load)
  • Level 2: 72 hour platform-level soak test (random test transactions with 80% code coverage; steady load)
  • Level 3: track record over 6 months of reduced defect rate

minimum level for Dublin:2 

see Stability levels

Resiliency1

1

(given CLAMP is design time there is no point to adhere to L2 requirement) 

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyCLAMP-83

  • Level 0: no redundancy
  • Level 1: support manual failure detection & rerouting or recovery within a single site; tested to complete in 30 minutes
  • Level 2: support automated failure detection & rerouting 
    • within a single geographic site
    • stateless components: establish baseline measure of failed requests for a component failure within a site 
    • stateful components: establish baseline of data loss for a component failure within a site
  • Level 3: support automated failover detection & rerouting 

    • across multiple sites 

    • stateless components 

      • improve on # of failed requests for component failure within a site 

      • establish baseline for failed requests for site failure 

    • stateful components 

      • improve on data loss metrics for component failure within a site 

      • establish baseline for data loss for site failure


Minimum Levels (Dublin)

  • Runtime Projects: Level 2 (stretch goal Level 3)
    • NOTE: For Dublin, the building blocks will be put in place for Level 3 geo-redundancy, and a few projects will pilot it
  • All other Projects: Level 1 (stretch goal Level 2)

see Resiliency Levels 

 

Security11

same as in Casablanca, not enough resource to allocate to this effort.



see Security Levels

Scalability11

Level 1 single site horizontal scaling

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyCLAMP-102

  • Level 0: no ability to scale
  • Level 1: supports single site horizontal scale out and scale in, independent of other components
  • Level 2: supports geographic scaling, independent of other components
  • Level 3: support scaling (interoperability) across multiple ONAP instances

Minimum Levels (Dublin)

  • Runtime Projects: Level 1 
    • NOTE: For Dublin, the building blocks will be put in place for Level 2 geographic scaling, and a few projects will pilot it
  • All other Projects: Level 0 

see Scalability levels 

Manageability1

1

(2, if CLAMP can get more resource from the community)


  • Level 1:
    • All ONAP components will use a single logging system.
    • Instantiation of a simple ONAP system should be accomplished in <1 hour with a minimal footprint
  • Level 2:
    • A component can be independently upgraded without impacting operation interacting components
    • Component configuration to be externalized in a common fashion across ONAP projects
    • All application logging to adhere to ONAP Application Logging Specification v1.2
    • Implement guidelines for a minimal container footprint
  • Level 3
    • Transaction tracing across components

Minimum Levels (Dublin)

  • All Projects: Level 2
    • New projects should adhere to v1.2
    • Existing projects have stretch goal for v1.2
  • Stretch Goal: Level 3 
  • Note: some work will be done in Dublin to test/prep for a release upgrade strategy

see Manageability Levels 

Usability1

1

(2, if CLAMP can get more resource from the community)

CLAMP is not anticipating new API at this point, so we are technically compliant with API CVS at this point

  • Level 1:

      • User guide created
      • Deployment documentation
      • API documentation
      • Adherence to coding guidelines
  • Level 2:
  • Level 3
      • Consistent UI across ONAP projects
      • Usability testing conducted
      • API Documentation
  • Level 4

    Minimum Levels (Dublin)

    • All Projects: Level 2
    • Stretch Goal: External APIs also follow the Versioning Strategy


  • see Usability Levels

...