Versions Compared

Old Version 37

changes.mady.by.user Vijay Venkatesh Kumar

Saved on

compared with

New Version Current

changes.mady.by.user Vijay Venkatesh Kumar

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: vescollector

Table of Contents

Common Task


Note: Any HIGHEST and HIGH task from below will be mandated in Frankfurt release if not covered during El-Alto.

  Items

...

striked out are marked out of scope of El-Alto (will be tracked for Frankfurt)


  1. Security Secure communication  (HIGHEST)CBS 
    1. CBS HTTPS support (DCAEGEN2-1515)
  2. Need AAF cert and deployment to be secure
    1. Status
      colourGreen
      titleCommitted
    Consul interface will remain unsecure (dependent on OOM)
      1. CBS expose both secure/insecure
    to allow ServiceComponent transition
      1. + AAF cert (DCAEGEN2-1549)
      2. Deployment update (DCAEGEN2-1550)
      3. SDK impact (
    client
      1. java- DCAEGEN2-
    java
      1. 1552 / python - DCAEGEN2-1551)
    2. InventoryAPI (enable HTTPS) - DCAEGEN2-913
      Status
      colourGreen
      titleCommitted
      1. DeploymentHandler→InventoryAPI (DCAEGEN2-905
    ,
      1. )
      2. Dashboard (DCAEGEN2-1591)
      3. ServiceChangeHandler (DCAEGEN2-
    913
      1. 1597)
      2. Clamp
    2. Cloudify Interfaces
    (question) (Jack to assess impact) -
    1. DCAEGEN2-1516,  DCAEGEN2-909  
      Status
      colourGreen
      titleCommitted
      1. Bootstrap pod update (DCAEGEN2-1586)
        1. Service components RTD/doc updates for deployment using cfy/dashboard required
      2. DeploymentHandler interface (DCAEGEN2-908)
      3. Dashboard interface (DCAEGEN2-1590)
    1. Non-root container  (DCAEGEN2-1220) - Best Practices 
      Status
      colourGreen
      titleCommitted
      1. Cloudify
    - (question) To
      1. (To be handled part of Cloudify 5.0 equivalent community version update)
        1. Platform
          1. CBS (DCAEGEN2-1553)
          2. Inventory (DCAEGEN2-1554)
          3. ServiceChangehandler (DCAEGEN2-1555)
          4. Dashboard (DCAEGEN2-1556)
          5. PolicyHandler, Deployment-
    Handler, CBS, Inventory, ServiceChangehandler, Dashboard
          1. Handler (complaint)
        2. Services
          1. HV-VES
    , PRH, TCA, VES, RESTConf
          1. (DCAEGEN2-1557)
          2. PRH (DCAEGEN2-1558)
          3. TCA (DCAEGEN2-1559)
          4. VES (DCAEGEN2-1560)
          5. RESTConf (DCAEGEN2-1561)
    2. Security Vulnerability (review Dublin exception list and close)
      Status
      colourYellow
      titlePartial Commit
      1. Need to be assessed for all Service components (question) 
    3. Component defaults must be TLS enabled
    4. Dmaap flows  (covered under DCAEGEN2-1517)
  3. OJSI JIRA's (HIGH)
    Status
    colourYellow
    titlePartial Commit
     
    1. CBS - OJSI-195
    2. TCA - OJSI-161
    3. DataFile (OJSI-28, OJSI-109, OJSI-131)
    4. VES Collector (OSJI-116, OJSI-30)
    5. REDIS DB - OJSI-187
    6. Dashboard - OJSI-159
  4. CIA (MEDIUM) - Container Image Minimization Guidelines  (DCAEGEN2-1562)
    Status
    colourYellow
    titlePartial Commit
    1. Cloudify - CentOS (post E release)exempted as dependent on 3rd party s/w)
    2. Platform components
      1. Deployment-handler
      , CBS, Inventory, SCH, Policy-Handler
      1. (DCAEGEN2-1563)
      2. CBS (DCAEGEN2-1564)
        Status
        colourGreen
        titleCommitted
      3. Inventory (DCAEGEN2-1565)
      4. SCH (DCAEGEN2-1566)
      5. Policy-Handler (DCAEGEN2-1567)
      6. Dashboard - DCAEGEN2-1638
    3. Service components
      1. VESCollector (DCAEGEN2-1568)
      2. VESMapper (DCAEGEN2-1569)
        Status
        colourGreen
        titleCommitted
      Service components
      1. VESCollector, VESMapper, HV-VES (docker.io/openjdk:11-jre-slim) - OKAY, as no corresponding alpine available
      2. TCA (exempted as dependent on 3rd party s/w) 
      3. Heartbeat (DCAEGEN2-1571)
      4. SNMPTRAP (DCAEGEN2-1570)
      5. SON-handler (DCAEGEN2-1572), TCA  (question)  (PRH - okay)
        Status
        colourGreen
        titleCommitted
      6. BBS-Eventprocesor, - OKAY  
      7. PM-Mapper - OK
      8. RESTConf (DCAEGEN2-1573)
        Status
        colourGreen
        titleCommitted
      9. PRH - OK,
      10. DFC- OK.
  5.  S3PS3P
    1. Documentation (Usability)
      1. user-guide for DCAE Platform/services
    2. Performance test/bench-marking (such as response time, transaction/message rate, latency, footprint, etc. to be defined on per component) (HIGHESTHIGH) (DCAEGEN2-1574) VEScollector,
      Status
      colourGreen
      titleCommitted
      1. VEScollector (DCAEGEN2-608)
      2. HV-VES
      , DFC,
      1. (DCAGEN2-1576)
      2. DFC (DCAEGEN2-1575)
      3. PM-Mapper (DCAEGEN2-1577)
    3. Application logging consistency (Manageability)
      1. Platform - InventoryAPI, ServiceChangeHandler , rest may be complaint (to be verified)  
    4. API Standardization (Usability)
  6. Jenkins job alignment (moving to common template)  (HIGHEST) - DCAEGEN2-1578
    Status
    colourGreen
    titleCommitted
    1. Moving toward global-jjb for all platform components
    2. Moving toward global-jjb for all service components
  7. CSIT alignment (MEDIUM)
    1. Platform CSIT (add blueprint into inventory, kick-off deployment through DH) (DCAEGEN2-596)
  8. Blueprint generator/Dmaap plugin integration (Topic standardization – pre-requisite) - DCAEGEN2-1517 (HIGHEST) 
    Status
    colourGreen
    titleCommitted
    1. Enhance blueprint generator tool from Dublin to use Dmaap plugin and generated blueprint with associated properties by default (DCAEGEN2-1518)
    2. Deploy components (DFC - DCAEGEN2-1580, PM-Mapper
    for
    1. - DCAEGEN2-1581 for E release) using new blueprint and validate dynamic topic/feed provisioning and configuration into services
  9. Depends on role (or identify setup in AAF - will need pre-configuration)AAF integration
    1. Dynamic certificate generation - Dependent on Dublin AAF work; to be checked with Jonathan (question) (DCAEGEN2-917)
  10. SDK library integration (Except PRH/HV-VES) (MEDIUM)
    1. For service components
      1. DFC using new CBS version
  11. Policy Integration for dynamic components (2 or 3 services for E release) (HIGH) - DCAEGEN2-1152
    1. For service components to go through policy model/SDC onboarding (BBS-EventProcessor, VES-mapper, RESTConf)
  12.  (SDC),
    1. Control Loop flow onboarding/integration (DCAEGEN2-1582) – SDC/CLAMP/Policy for service components (SDC-2100)
      Status
      titlePending Confirmation
      1. BBS-EventProcessor - DCAEGEN2-1583
      2. VES-mapper - DCAEGEN2-1585
      3. RESTConf DCAEGEN2-1584)
        Status
        colourGreen
        titleCommitted
      4. PM-Mapper (DCAEGEN2-1605)
        Status
        colourGreen
        titleCommitted
      5. DFC (DCAEGEN2-1606)
        Status
        colourGreen
        titleCommitted
        1. No policy model; blocked by CLAMP-466; will be deferred to Frankfurt
  13. CBS Look up change (remove consul dependency in lookup) (MEDIUM) 
    1. Library update required (python and java)
      1. java SDK -  DCAEGEN2-1521
        Status
        colourGreen
        titleCommitted
      2. Python - DCAEGEN2-1537
        Status
        colourGreen
        titleCommitted
    2. Non SDK utilized components to be updated (VESCollector, RESTConf + )
    3. Platform components to be verified (Deployment Handler (uses consul), PH, Policy/K8s/Postgres/Dmaap Plugins avoid non-discovery) (question) 
  14. Docker build and tagging consistency (HIGH) (DCAEGEN2-1579)
    Status
    colourYellow
    titlePartial Commit
  15. DCAE plugin (k8splugin) compatibility in nexus (DCAEGEN2-1520 (HIGHEST)Helm plugin in CCSDK address fixed this in R4.
    Status
    colourGreen
    titleCommitted
  16. Helm chart migration (Dashboard)  DCAEGEN2-1318 (MEDIUM)
    Status
    colourGreen
    titleCommitted
  17. Python 3.x 7 support (Cloudify, plugins + other dcae platform component; relates to DOC-419)  - DCAEGEN2-1519 (HIGHEST)
    1. Convert our code to be compatible with Python 3.x. (For example, using “import future” and making certain that loops work on iterators instead of lists when the API calls return iterators in 3.x.)
      1. Cloudify confirmed 3.7; need centos version.
    2. Set up our plugin tox tests so that they are executed with both Python 2.7 AND Python 3.x.
      1. Upgrade all plugins (k8splugin/dmaap/policyplugin/relationship/postgres/helm) to support both 2.x and 3.x7
        1. Cloudify - DCAEGEN2-1546 (Deferred to next release due to Cloudify dependency)
        2. Plugins - DCAEGEN2-1547
          Status
          colourYellow
          titlePartial Commit
        3. Policy Lib (Utils)  - DCAEGEN2-1548
      2. Verify all other platform components (CBS, PH, SNMP trap, Heartbeat) - All supports 3.x
  18. Upgrade to new Cloudify version expected in June (compatible to 5.0) (MEDIUM)
    1. Migrate if single base image (question)  if multiple containers - will be assessed later.
  19. DCAE SDK: (MEDIUM)
    1. Finish DMaaP client (stabilize API, add support for DR)
      Jira
      serverONAP JIRA
      serverId425b2b0a-557c-3c0c-b515-579789cceedb
      keyDCAEGEN2-1421

    2. Refactor current AAI client to reflect overall SDK "look&feel"
    3. Extract monitoring API from HV-VES (KPI monitoring in Prometheus format + healthchecks)
    4. Write HV-VES events consumer client (question)
  20. Migrate to Java 11 (or 12?). The main reason is that Java 9+ properly identifies available memory and CPU cores inside Docker. Prior to Java 9 additional JVM options shall be set. Another benefit is that developers would gain few more language features. Also sooner or later we will need to migrate to new Java and having ElAlto a "maintentance" release it may be the perfect time. The main obstacle may be Java modularity, but in the beginning we shall be able to use old classpath instead of modulepath when running our applications.
    1. Java 11 migration (MEDIUM)
    2. **All java apps should be at minimum on java 8
  21. ONAP Release upgrade feature for DCAE (Platform)   (MEDIUM)
  22. Deployment Deployment support for stateful set (Platform + BP-gen) (MEDIUM)
    1. Cloudify blueprint should support the Statefulset deployment for multi replica set (scaling)
  23. Platform support for Kafka topic provisioning/distribution  (HIGH) - DCAEGEN2-1179



PM-Mapper

  1. Control Loop flow onboarding/integration – SDC/CLAMP/Policy  - (MEDIUM)
    Status
    colourGreen
    titleCommitted
     (DCAEGEN2-1605)
  2. VES Onboarding yaml registration binding with PM-Mapper configuration  - (MEDIUM)LOW) SDC/DCAE-DS item
  3. VES o/p from PM-Mapper feeding into analytics services (LOW)
  4. Dmaap Plugin integration - DCAEGEN2-15171581 (HIGHEST)
    Status
    colourGreen
    titleCommitted
     DCAEGEN2-1581 


BBS-EventProcessor

  1. AAI interaction to use new DCAE SDK (1.1.5). Also A&AI calls use v14 of A&AI. Version should be upgraded (and perhaps externalized as a configuration parameter) (LOW)
  2. Control Loop flow onboarding/integration – SDC/CLAMP/Policy  (HIGHEST)
  3. PNF re-registration event handling should not involve BBS-ep (update of AAI service status) to be moved into SO (HIGH)
  4. Move PRH -> BBS-EP notification structure to VES (This will not be required if #3 is accomplished) (LOW)
  5. Switch to AAF based topic  (MEDIUM)
  6. Stress testing with replicas (MEDIUM)
  7. Support event filtering from generic topic (currently using cpe_authentication topic instead of statechange) (HIGH)
  8. ci job change to use version.properties override DONE


VES-Mapper

  1. Tool translate/simplify smooks mapping from SDC model (HIGH)
  2. Control Loop flow onboarding/integration – SDC/CLAMP/Policy (HIGH)
  3. Consul update (via SDK library) to support periodic polling (HIGHEST)
    Status
    colourGreen
    titleCommitted


SON-Handler

  1. Support MS scaling (HIGH)
  2. CBS SDK integration for periodic polling (HIGHEST) DCAEGEN2-1642
    Status
    colourGreen
    titleCommitted
  3. CSIT (DCAEGEN2-1433)(HIGH)
    Status
    colourYellow
    titlePartial Commit


Heartbeat Service

  1. Control Loop flow onboarding/integration – SDC/CLAMP/Policy  (LOW)
  2. Logging Standardization (LOW)
  3. AAF integration (MEDIUM)

RESTConf Collector

  1. Control Loop flow onboarding/integration – SDC/CLAMP/Policy  (HIGH)
    Status
    colourGreen
    titleCommitted
  2. Multiple controller/truststore - AAF integration (HIGH)
  3. Scaling support to be worked (requires single interface to external controller) - k8s plugin enhancement required (HIGH)

VESCollector

  1. Api Standardization (HIGH)
    Status
    colourGreen
    titleCommitted
  2. Backlogs Jira/bugs (
    Jira
    serverONAP JIRA
    serverId425b2b0a-557c-3c0c-b515-579789cceedb
    keyDCAEGEN2-517
    )  (HIGH)
  3. Optmization/bug fixes (HIGHEST)

    1. https://jira.onap.org/browse/DCAEGEN2-1483  - Possible order issue.

      Status
      colourGreen
      titleCommitted

    2. https://jira.onap.org/browse/DCAEGEN2-1484 - Set dynamic partition key

      Status
      titlePending Confirmation

    3. Jira
      serverONAP JIRA
      serverId425b2b0a-557c-3c0c-b515-579789cceedb
      keyDCAEGEN2-1541
       - Basic auth issue
    4. Jira
      serverONAP JIRA
      serverId425b2b0a-557c-3c0c-b515-579789cceedb
      keyDCAEGEN2-1594
       - VESCollector Healtcheck support on certOnly mode
    5. Optimize VES schema load (retain in-memory than loading file each time) (DCAEGEN2-1774)
  4. Performance baseline VEScollector (DCAEGEN2-608Performance optimization and baselining (HIGH)


Dashboard

Improved error handling and support necessary validation (HIGH)

Enable Dashboard for HTTPS (MEDIUM) - DCAEGEN2-1592

Status
colourGreen
titleCommitted
  (OJSI-159 - Dashboard Support https (init container change required))

Dashboard Gui having old license

Jira
serverONAP JIRA
serverId425b2b0a-557c-3c0c-b515-579789cceedb
keyCCSDK-1485

DCAEGEN2-1591  -  InventoryAPI interface;  container config to be updated

DCAEGEN2-1590   - Cloudify Interfaces (blueprint config)

DCAEGEN2-1556  - Docker build changes


Helm Plugin

  • Support Tiller clusterIP/port as option instead of nodeport alone for tiller. (HIGHEST)
  • Support deployment on existing names spaces (HIGHEST)
    Status
    colourGreen
    titleCommitted
     (DCAEGEN2-1639)
  • Logging enhancements (deployment errors if any to be captured also)(HIGH)
    Status
    titlePending Confirmation
     (DCAEGEN2-1640
  • Requires changing nodeport for tiller; since the deployment is done from bootstrap pod, clusterip/port must also be supportable  (HIGHEST)
  • Existing namespace cannot be used currently (HIGHEST)
  • Deployment error not being logged (HIGH)