This page summarizes the projects participating into Dublin Release.





Dublin Milestones Status



Project NameProject Tech. LeadM0 Kick-Off/Intention Submission

M1

Planning

M2

Functionality freeze

M3

API Freeze

M4
Code Freeze

RC0

Release Candidate 0

RC1

Release Candidate 1

RC2

Release Candidate 2

Sign-Off

Release Delivery

1A & AI Dec 3, 2018

AAI R4 M1 Release Planning

AAI R4 M1 Deliverables for Planning Milestone Checklist

AAI R4 M2 Deliverables for Functionality Freeze Milestone Checklist

AAI R4 Deliverables for RC0 Milestone Checklist

AAI R4 Deliverables for RC1 Milestone Checklist

4 Docs jiras - recently updates


AAI R4 Deliverables for RC2 Milestone Checklist


Docs in process

AAI R4 Deliverables for Release Sign-Off Milestone Checklist
2Application Authorization FrameworkDec 3, 2018AAF R4 - M1 Release Plan
AAF R4 - M1 Milestone Checklist
AAF R4 - M2 Functionality Freeze Milestone Checklist
Condition: aaf-authz @55% by M3

AAF R4 -M3 Deliverables for API Freeze Milestone Checklist

Conditions: Obtain coverage goal by M4 - Failing Sonar coverage: aaf-authz

Need to update the checklist including Modeling Checklist item

Inprocess Gerrit: https://gerrit.onap.org/r/#/c/78520/

https://gerrit.onap.org/r/#/c/79224/

AAF R4 - M4 Deliverable for Code Freeze Milestone Checklist

AAF R4 (Dublin) - RC0 Milestone Checklist


TSC waiver for Dublin release sought: Sonar goal miss: aaf-authz


AAF R4 - RC1 Milestone Checklist


TSC waiver for Dublin release sought: Sonar goal miss: aaf-authz


AAF R4 - RC2 Milestone Checklist


TSC Waiver for Sonar granted

AAF R4 Deliverables for Release Sign-Off Milestone Checklist
3APPCYes, per default

APPC Dublin M1 Release Planning

APPC Dublin M1 Checklist

APPC Dublin M1 Security Checklist

APPC Dublin M2 Functionality Freeze Checklist

APPC Dublin M3 Deliverables for API Freeze Milestone Checklist Template


APPC Dubin M4 Code Freeze Milestone Checklist Template


APPC Dublin RC0 Milestone Checklist Template



APPC Dublin RC1 Milestone Checklist Template


2 high/highest - no update in last week

4CLAMPYes, per defaultCLAMP R4 - M1 Release Planning
CLAMP R4 - M1 Deliverables for Planning Milestone Checklist
CLAMP R4 - M2 Functionality Freeze Milestone Checklist

CLAMP R4 - M3 Deliverables for API Freeze Milestone Checklist


Checklist complete - no swagger API doc

CLAMP R4 - RC0 Milestone ChecklistCLAMP R4 - RC1 Milestone Checklist

CLAMP R4 - RC2 Milestone Checklist 


CLAMP R4 - Deliverables for Release Sign-Off Milestone Checklist
5Common Controller SDKYes, per default

CCSDK : Dublin: Release Planning

CCSDK : Dublin M1 : Deliverables for Planning Milestone

CCSDK : Dublin M2 : Functionality Freeze Milestone Checklist

Condition: All repos unit test coverage > 55% by M3

CCSDK : Dublin M3 : API Freeze Milestone Checklist

Conditions: Unmet Sonar goal: passes as of 2019-04-09


CCSDK : Dublin RC1 : Deliverables for RC1 Milestone Checklist



6DCAEDec 5, 2018

DCAE R4 M1 Release Planning

DCAE R4 M1 Milestone Checklist

DCAE R4 M2 Functionality Freeze Milestone Checklist

DCAE R4 M3 Deliverables for API Freeze Milestone Checklist

Waiver requested, defer coverage goal (55%) for several items until M4:

dcaegen2-collectors-restconf

dcaegen2-collectors-snmptrap

dcaegen2-platform-inventory-api

DCAE R4 RC0 Milestone Checklist



DCAE R4 RC1 Milestone Checklist

1 Doc Jira Ticket

7DMaaPMandar SawantYes, per defaultDMaaP R4 - M1 Release Planning
DMaaP R4 - M1 Milestone Checklist
DMaaP R4 - M2 Functionality Freeze Milestone Checklist Condition: All repos unit test coverage > 55% by M3, non-root post Dublin

DMaaP R4 - M3 API Freeze Milestone Checklist

Gerrit- Review

https://gerrit.onap.org/r/#/c/79574/

Modeling request for data model: "waiting on modeling team."

DMaap R4 - M4 Code Freeze Milestone Checklist

Swagger docs by RC2

DMaaP R4 - RC0 Milestone Checklist



DMaaP R4 - RC1 Milestone Checklist

DMaaP R4 - RC2 Milestone Checklist


DMaaP R4 - Release Sign-Off Milestone Checklist Template
8DocumentationYes, per default

Planning worksheet

M1 Documentation Dublin Release

MS2 Deliverables for Functionality Freeze Milestone Checklist Template

Condition: Followup to document the doc deliverables overtime so that rel_mgmt can support the deliverables

Moving to weekly documentation report... no checklist







9External API FrameworkDec 5, 2018Planning worksheet
M1 Checklist

[ExtAPI] Dublin M3 API Freeze Milestone Checklist


ExtAPI Dublin M4 Code Freeze Milestone Checklist

Project needs help getting signed certificates

ExtAPI Dublin RC0 Checklist



[ExtAPI] Dublin RC1 Checklist

2x Doc Jira Tickets

[ExtAPI] Dublin RC2 Checklist


External API Deliverables for Dublin R4 Release Sign-Off Milestone Checklist
10HolmesDec 3, 2018

Holmes Release Planning for Dublin

Holmes Deliverables for Planning Milestone Checklist for Dublin

Holmes Deliverables for Functionality Freeze Milestone Checklist for Dublin
Condition: holmes-common @55% by M3 (TBC) Non-root by 2019-02-28

Holmes Deliverables for API Freeze Milestone Checklist for Dublin


Holmes Deliverables for Code Freeze Milestone Checklist Template for Dublin


Moving some stories to next release due to lack of resource. No impact existing func.

Holmes Deliverables for RC0 Milestone for Dublin


Holmes Deliverables for RC1 Milestone for DublinHolmes Deliverables for RC2 Milestone for DublinHolmes Deliverables for Release Sign-Off Milestone Checklist for Dublin
11Integration ProjectYes, per default

Integration Dublin M1 Deliverables for Planning Milestone Checklist

Integration Dublin M2 Deliverables for Functionality Freeze Milestone Checklist
Provide status on the plan to close the blocker(s).

Integration Dublin M3 Deliverables for API Freeze Milestone Checklist

Need to understand if Integration has sufficient lab capacity for Dublin and a quick to follow maintenance release.

Integration Dublin M4 Deliverable for Code Freeze Milestone Checklist

Integration Dublin RC0 Milestone Checklist


Integration Dublin RC1 Milestone ChecklistIntegration Dublin RC2 Milestone Checklist

Integration R4 Deliverables for Release Sign-Off Milestone Checklist



12

Logging Enhancements Project

Including POMBA

Nov 16, 2018Logging Dublin M1 Release Planning
Logging Dublin Deliverables for Planning Milestone Checklist
Logging Dublin M2 Deliverables for Functionality Freeze Milestone Checklist

Logging Dublin M3 Deliverables for API Freeze Milestone Checklist Template

Checklist complete. No swagger API data

Logging Dublin M4 Deliverable for Code Freeze Milestone Checklist Template

Logging Dublin RC0 Deliverables for RC0 Milestone Checklist



Logging Dublin RC1 Deliverables for RC1 Milestone Checklist



Logging Dublin RC2 Deliverables for RC2 Milestone Checklist

POMBA docs 

Logging Dublin Deliverables for Release Sign-Off Milestone Checklist Template


13Microservices BusNov 30, 2018

MSB Release Planning for Dublin

MSB Deliverables for Planning Milestone Checklist for Dublin

MSB Dubin Deliverables for Functionality Freeze Milestone Checklist-M2

MSB Deliverables for API Freeze Milestone Checklist for Dublin


MSB Deliverables for RC0 Milestone for Dublin

MSB Deliverables for RC1 Milestone for DublinMSB Deliverables for RC2 Milestone for DublinMSB Deliverables for Release Sign-Off Milestone Checklist for Dublin
14ModelingDec 3, 2018Modeling Dublin Planning
Modeling Dublin Deliverables for Planning Milestone Checklist

Modeling Dublin Deliverables for Functionality Freeze Milestone Checklist

Condition: unit test coverage > 55% by M3

Modeling Dublin Deliverables for API Freeze Milestone Checklist

Condition: meet 55% coverage goal by M4

Sonar reporting warning: modeling-toscaparsers-javatoscachecker

Modeling Dublin Deliverables for RC0 Milestone Checklist




Modeling Dublin Deliverables for RC1 Milestone ChecklistModeling Dublin Deliverables for RC2 Milestone ChecklistModeling Dublin Deliverables for Release Sign-Off Milestone Checklist Template
15Multi VIM/CloudDec 3, 2018

MultiCloud Dublin Release Planning

Deliverables for Planning Milestone Checklist

Deliverables for Functionality Freeze Milestone Checklist

  1. Conditions: Get all remaining unit test code coverage > 55% by M3
  2. Plan to design container(s) as non-root: M3 Dublin

MultiCloud R4 Deliverables for API Freeze Milestone Checklist

Conditional:

Need to add Modeling checklist item

Review gerrit (stale merges)

https://gerrit.onap.org/r/#/c/76324/

https://gerrit.onap.org/r/#/c/75851/

MultiCloud R4 Deliverable for Code Freeze Milestone Checklist

MultiCloud Deliverables for RC0 Milestone Checklist



TSC waiver for Dublin release sought: Sonar multicloud-azure below target

MultiCloud R4 Deliverables for RC1 Milestone Checklist

TSC waiver for Dublin release sought: Sonar multicloud-azure below target

16MUSICYes, per default

MUSIC Dublin Release Planning

MUSIC Dublin M1 Deliverables for Planning Milestone Checklist

MUSIC Dublin M2 Deliverables for Functionality Freeze Milestone Checklist Template Condition: unit test coverage > 55% by M3.

MUSIC Dublin M3 Deliverables for API Freeze Milestone Checklist




MUSIC Dublin M4 Code Freeze Milestone Checklist

MUSIC Dublin RC0 Milestone Checklist







https://wiki.onap.org/display/DW/MUSIC+Dublin+RC1+Milestone+Checklist

MUSIC Dublin RC2 Milestone Checklist


MUSIC Dublin Deliverables for Release Sign-Off Milestone Checklist
17ONAP CLIDec 3, 2018

Dublin-M1-CLI Deliverable

Dublin-M1-CLI Release planning

Dublin-M2-Checklist

Dublin-M3 checklist

Need to update the checklist including Modeling and additional Integration Checklist item

Dublin M4 Code Freeze Milestone Checklist

Dublin-RC0 Milestone Checklist


Dublin-RC1 Milestone Checklist

Old version in Dublin -  CLI-168 - Getting issue details... STATUS

Dublin-RC2 Milestone ChecklistDublin-Release Sign-Off
18ONAP Operations ManagerDec 3, 2018OOM - Deliverables for Planning Milestone Checklist
OOM Dublin Release Planning Template

OOM Dublin - M2 Functionality Freeze Milestone Checklist


OOM Dublin - M3 API Freeze Milestone Checklist


OOM Dublin - RC0 Milestone Deliverables Checklist


OOM Dublin - RC1 Milestone Deliverables Checklist



19ONAP Optimization FrameworkDec 3, 2018OOF Dublin M1 Deliverables for Planning Milestone Checklist
OOF Dublin M1 Release Planning
OOF Dublin M2 Functionality Freeze Milestone Checklist Condition: unit test coverage > 55% by M3

OOF Dublin M3 Deliverables for API Freeze Milestone Checklist

Checklist complete.

Conditional: Complete unit test coverage goal by M4 for HAS and CMSO

OOM-CSIT BY M4

OOF Dublin RC0 Milestone Checklist

OOF Dublin RC2 Milestone Checklist


Doc completion risk - focus on release notes & install docs

20ONAP Usecase UIYes, per default

Usecase-UI Beijing Release Planning

Dublin Release M1 Deliverables for Planning Milestone Checklist

UUI Dublin M2 Functionality Freeze Milestone Checklist

Dublin Release M3 Deliverables for API Freeze Milestone Checklist


UUI Dublin M4 Code Freeze Milestone Checklist



Dublin Release Deliverables for RC0 Milestone Checklist


Dublin Release Deliverables for RC1 Milestone Checklist

2x Doc Jira Tickets

21Policy FrameworkDec 3, 2018

Policy R4 Dublin M1 Release Planning

Policy R4 Dublin M1 Deliverables for Planning Milestone Checklist Template

Policy R4 Dublin M2 Deliverables for Functionality Freeze Milestone Checklist Template

Policy R4 Dublin M3 Deliverables for API Freeze Milestone Checklist Template


Policy R4 Dublin M4 Deliverable for Code Freeze Milestone Checklist Template


Policy R4 Dublin RC0 Deliverables for RC0 Milestone Checklist Template


P-W testing

Policy R4 Dublin RC1 Deliverables for RC1 Milestone Checklist Template

1xDoc Jira Ticket


22Portal PlatformNov 30, 2018Portal R4 M1 Release Planning (Dublin Release)
Portal R4 M1 Deliverables for Planning Milestone Checklist (Dublin Release)
Portal R4 M2 Deliverables for Functionality Freeze Milestone Checklist Dependency on OOM for non-root testing; other dependencies articulated in the risks

Portal R4 M3 Deliverables for API Freeze Milestone Checklist

Need to update the checklist including Integration & Modeling Checklist items



Portal R4 M4 for Code Freeze Milestone Checklist



Portal R4 RC0 Milestone Checklist



23SDN-CYes, per default

SDNC : Dublin: Release Planning

SDNC : Dublin M1 : Deliverables for Planning Milestone

SDNC : Dublin M2 : Functionality Freeze Milestone Checklist

SDNC : Dublin RC0 : Deliverables for RC0 Milestone Checklist


Update certificate in RC1

SDNC : Dublin RC1 : Deliverables for RC1 Milestone Checklist

2 high in Submitted state

Certificate is updated

24Service Design & CreationDec 4, 2018

SDC R4 Release Planning

SDC R4 Deliverables for Planning Milestone Checklist

SDC R4 Deliverables for Functionality Freeze Milestone Checklist

Condition: unit test coverage > 55% by M3

SDC R4 Deliverable for Code Freeze Milestone Checklist



SDC R4 Deliverables for RC0 Milestone Checklist


Sonar below goal: sdc master

SDC R4 Deliverables for RC1 Milestone Checklist

Waiver requested: Sonar below goal: sdc master


25Service OrchestratorDec 2, 2018

SO Dublin M1 Release Planning

SO Dublin M1 Checklist

Service Orchsttrator M2 Checklist

SO Dublin RC0: Deliverables for RC0 Milestone Checklist Template


SO Dublin RC1 Milestone Checklist Template

26VF-C: Virtual Function ControllerDec 2, 2018

VF-C Dublin M1 Release Planning

VF-C Dublin: Deliverables for Planning Milestone Checklist

VF-C Dublin: Deliverables for Functionality Freeze Milestone Checklist Template

VF-C Dublin: Deliverables for RC0 Milestone Checklist Template


DEPRECATED: Sonar warning (46%) on vfc-nfvo-driver-vnfm-svnfm-nokia-vnfmdriver

VF-C Dublin: Deliverables for RC1 Milestone Checklist Template

VF-C Dublin: Deliverables for RC2 Milestone Checklist Template


VF-C Dublin: Deliverables for Release Sign-Off Milestone Checklist Template
27VID projectDec 4, 2018

VID R4 M1 Release Planning

VID R4 M1 Deliverables for Planning Milestone Checklist

VID R4 M2 Deliverables for Functionality Freeze Milestone Checklist

VID R4 M3 Deliverables for API Freeze Milestone Checklist

Missing swagger API info

In -process Integration blockers:

VID-429 - Getting issue details... STATUS

VID-443 - Getting issue details... STATUS


VID R4 M4 Deliverable for Code Freeze Milestone Checklist


VID R4 RC0 Milestone Checklist

VID R4 RC1 Milestone Checklist




VID R4 RC2 Milestone Checklist

28VNF SDKDec 2, 2018

VNF SDK Dublin Release Planning (M1)

VNF SDK Deliverables for Planning Milestone Checklist Template(M1)

VNFSDK Dublin M2 Deliverables for Functionality Freeze Checklist

Conditional:

Unit test coverage by M3

VNF SDK Dublin API Freeze(M3)

Unit test coverage low: VNFSDK refrepo: 52.3% now is 55.3%




VNF SDK Dublin Code Freeze (M4)


Dublin VNFSDK RC0 Checklist - Release Candidate 0 MilestoneDublin VNFSDK RC1 Checklist - Release Candidate 1 MilestoneDublin VNFSDK RC2 Checklist - Release Candidate 2 Milestone
29VNF RequirementsNov 16, 2018

Dublin Release Plan for VNFRQTS

M1 Deliverables for Planning Milestone Checklist Template

M2 Deliverables for Functionality Freeze Milestone Checklist VNFRQTSM3 Deliverables for API Freeze Milestone ChecklistM4 Deliverable for Code Freeze Milestone Checklist VNFRQTS

RC0 Milestone Checklist Template - VNFRQTS



RC1 Milestone - Checklist VNFRQTSRC2 Milestone checklist VNFRQTSsignoff checklist
30VNF Validation (VVP)Nov 16, 2018

Dublin Release Plan for VVP

M1 Deliverables for Planning Milestone Checklist Template 

M2 Deliverables for Functionality Freeze Milestone Checklist Template


M3 Deliverables for API Freeze Milestone Checklist TemplateM4 Code Freeze Milestone Checklist Template for VVP

RC0 Milestone Checklist - VVP


RC1 Milestone Checklist -VVPRC2 Milestone checklist VVPSignoff





  • No labels

1 Comment

  1. 20190325 Dublin status - by request of integration team

    https://lists.onap.org/g/onap-discuss/topic/cpu_high_on_rancher_and_k8s/30782861?p=,,,20,0,0,0::recentpostdate%2Fsticky,,,20,2,0,30782861

    INT-993 - Getting issue details... STATUS

    Single 256G VM on azure - no overrides except dev.yaml

    sequenced/managed deploy over 5 hours via 

    https://git.onap.org/logging-analytics/tree/deploy/cd.sh#n222

              DEPLOY_ORDER_POD_NAME_ARRAY=('consul msb dmaap dcaegen2 aaf robot aai esr multicloud oof so sdc sdnc vid policy portal log vfc uui vnfsdk appc clamp cli pomba contrib sniro-emulator')
              # don't count completed pods
              DEPLOY_NUMBER_PODS_DESIRED_ARRAY=(4 5 11 11 13 1 15 2 6 17 10 12 11 2 8 6 3 18 2 5 5 5 1 11 3 1)
              # account for podd that have varying deploy times or replicaset sizes
              # don't count the 0/1 completed pods - and skip most of the ResultSet instances except 1
              # dcae boostrap is problematic
              DEPLOY_NUMBER_PODS_PARTIAL_ARRAY=(2 5 11 9 11 1 11 2 6 16 10 12 11 2 8 6 3 18 2 5 5 5 1 9 3 1)


    Cloud Native Deployment#Scriptedundercloud(Helm/Kubernetes/Docker)andONAPinstall-SingleVM

    ubuntu@a-rke0-master:~$ kubectl get pods --all-namespaces
    NAMESPACE     NAME                                                           READY     STATUS             RESTARTS   AGE
    kube-system   heapster-7b48b696fc-tjz7w                                      1/1       Running            0          14h
    kube-system   kube-dns-6655f78c68-cvhcw                                      3/3       Running            0          14h
    kube-system   kubernetes-dashboard-6f54f7c4b-sb9jw                           1/1       Running            0          14h
    kube-system   monitoring-grafana-7877679464-77z9n                            1/1       Running            0          14h
    kube-system   monitoring-influxdb-64664c6cf5-lskrv                           1/1       Running            0          14h
    kube-system   tiller-deploy-78db58d887-gjsxg                                 1/1       Running            0          14h
    onap          onap-aaf-aaf-cm-5999cf85df-lwvw8                               1/1       Running            0          10h
    onap          onap-aaf-aaf-cs-659bcc4b74-m522x                               1/1       Running            0          10h
    onap          onap-aaf-aaf-fs-67dc4f5fd4-lz7wx                               1/1       Running            0          10h
    onap          onap-aaf-aaf-gui-79765d856-47n8k                               1/1       Running            0          10h
    onap          onap-aaf-aaf-hello-5fdc4c766f-rl2nj                            1/1       Running            0          10h
    onap          onap-aaf-aaf-locate-654c764588-v9ftn                           1/1       Running            0          10h
    onap          onap-aaf-aaf-oauth-745f87647d-fskzq                            1/1       Running            0          10h
    onap          onap-aaf-aaf-service-54b96965c8-fbfz8                          1/1       Running            0          10h
    onap          onap-aaf-aaf-sms-748d79576f-mcn4c                              1/1       Running            0          10h
    onap          onap-aaf-aaf-sms-preload-4qwx2                                 0/1       Completed          0          10h
    onap          onap-aaf-aaf-sms-quorumclient-0                                1/1       Running            0          10h
    onap          onap-aaf-aaf-sms-quorumclient-1                                1/1       Running            0          10h
    onap          onap-aaf-aaf-sms-quorumclient-2                                1/1       Running            0          10h
    onap          onap-aaf-aaf-sms-vault-0                                       2/2       Running            1          10h
    onap          onap-aaf-aaf-sshsm-distcenter-jw2tr                            0/1       Completed          0          10h
    onap          onap-aaf-aaf-sshsm-testca-ncfzv                                0/1       Completed          0          10h
    onap          onap-aai-aai-babel-7b9bdcf9c6-m9snj                            2/2       Running            0          10h
    onap          onap-aai-aai-bb74c9586-j4nn6                                   0/1       Init:0/1           33         6h
    onap          onap-aai-aai-cassandra-0                                       1/1       Running            2          10h
    onap          onap-aai-aai-champ-5cddfb8cc4-7zdzl                            1/2       Running            0          10h
    onap          onap-aai-aai-data-router-7f6d895dc4-288lk                      2/2       Running            0          10h
    onap          onap-aai-aai-elasticsearch-75d65dff94-s6vzf                    1/1       Running            0          10h
    onap          onap-aai-aai-gizmo-7cf876476-47rrk                             2/2       Running            0          10h
    onap          onap-aai-aai-graphadmin-bc7fb6c59-6ck8l                        0/2       Init:Error         58         10h
    onap          onap-aai-aai-graphadmin-create-db-schema-2jnqw                 0/1       Error              0          9h
    onap          onap-aai-aai-graphadmin-create-db-schema-5klwx                 0/1       Error              0          10h
    onap          onap-aai-aai-graphadmin-create-db-schema-8v26t                 0/1       Error              0          10h
    onap          onap-aai-aai-graphadmin-create-db-schema-bt85r                 0/1       Error              0          10h
    onap          onap-aai-aai-graphadmin-create-db-schema-dn7lq                 0/1       Error              0          9h
    onap          onap-aai-aai-graphadmin-create-db-schema-gj5lh                 0/1       Error              0          10h
    onap          onap-aai-aai-graphadmin-create-db-schema-jqxvt                 0/1       Error              0          9h
    onap          onap-aai-aai-graphadmin-create-db-schema-kwr6d                 0/1       Error              0          9h
    onap          onap-aai-aai-graphadmin-create-db-schema-lfhcd                 0/1       Error              0          10h
    onap          onap-aai-aai-graphadmin-create-db-schema-ppb49                 0/1       Error              0          9h
    onap          onap-aai-aai-graphadmin-create-db-schema-svvb9                 0/1       Error              0          9h
    onap          onap-aai-aai-graphadmin-create-db-schema-txv7j                 0/1       Error              0          9h
    onap          onap-aai-aai-graphadmin-create-db-schema-wb9pw                 0/1       Error              0          10h
    onap          onap-aai-aai-graphadmin-create-db-schema-wznh7                 0/1       Error              0          9h
    onap          onap-aai-aai-graphadmin-create-db-schema-xpq55                 0/1       Error              0          10h
    onap          onap-aai-aai-modelloader-8b659f647-4cbcd                       2/2       Running            0          10h
    onap          onap-aai-aai-resources-f6b6c8df8-bqmpg                         0/2       Init:0/1           58         10h
    onap          onap-aai-aai-schema-service-64585fdcbf-qdgtw                   2/2       Running            0          10h
    onap          onap-aai-aai-search-data-7dbb99df5f-cchgx                      2/2       Running            0          10h
    onap          onap-aai-aai-sparky-be-75fbccb9b-s6fdd                         0/2       Init:0/1           0          10h
    onap          onap-aai-aai-spike-5d94584978-ljglp                            2/2       Running            0          10h
    onap          onap-aai-aai-traversal-f78f855b6-bq464                         0/2       Init:0/1           59         10h
    onap          onap-aai-aai-traversal-update-query-data-nrt2k                 0/1       Init:0/1           59         10h
    # note that this one will oscillate between 2/2 and 1/2
    onap          onap-appc-appc-0                                               2/2       Running            0          7h
    onap          onap-appc-appc-ansible-server-9784b879f-l4k7c                  1/1       Running            0          7h
    onap          onap-appc-appc-cdt-84d65c7b7c-dhfwx                            1/1       Running            0          7h
    onap          onap-appc-appc-db-0                                            1/1       Running            0          7h
    onap          onap-appc-appc-db-1                                            1/1       Running            0          6h
    onap          onap-appc-appc-db-2                                            1/1       Running            0          6h
    onap          onap-appc-appc-dgbuilder-64d76c6c4f-26br5                      1/1       Running            0          7h
    onap          onap-clamp-clamp-766f56bd4d-pz5fp                              2/2       Running            0          6h
    onap          onap-clamp-clamp-dash-es-6d8b4c65cc-rcppx                      1/1       Running            0          6h
    onap          onap-clamp-clamp-dash-kibana-67978bc768-fzcdk                  1/1       Running            0          6h
    onap          onap-clamp-clamp-dash-logstash-756485d766-ztlh7                1/1       Running            0          6h
    onap          onap-clamp-clampdb-56cbd6f996-hnwpp                            1/1       Running            0          6h
    onap          onap-cli-cli-8f5dc65d5-v4vtg                                   1/1       Running            0          6h
    onap          onap-consul-consul-849447d678-ktc97                            1/1       Running            0          10h
    onap          onap-consul-consul-server-0                                    1/1       Running            0          10h
    onap          onap-consul-consul-server-1                                    1/1       Running            0          10h
    onap          onap-consul-consul-server-2                                    1/1       Running            0          10h
    onap          onap-contrib-netbox-app-7b7798fd9f-7k6qd                       1/1       Running            0          6h
    onap          onap-contrib-netbox-app-provisioning-9pmjf                     0/1       Completed          0          6h
    onap          onap-contrib-netbox-app-provisioning-g2tj2                     0/1       Error              0          6h
    onap          onap-contrib-netbox-nginx-7555fb7f5-jkkmd                      1/1       Running            0          6h
    onap          onap-contrib-netbox-postgres-79568cf77-68fvx                   1/1       Running            0          6h
    onap          onap-dcaegen2-dcae-bootstrap-59b48579f7-bpxbp                  0/1       Init:0/1           41         10h
    onap          onap-dcaegen2-dcae-cloudify-manager-77b58b8dcc-rc9tr           0/1       ErrImagePull       0          10h
    onap          onap-dcaegen2-dcae-config-binding-service-6cbd7bbb8-ggz7s      2/2       Running            0          10h
    onap          onap-dcaegen2-dcae-db-0                                        1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-db-1                                        1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-deployment-handler-6dd58f447b-5bm8b         0/2       Init:0/3           14         10h
    onap          onap-dcaegen2-dcae-healthcheck-6bf85ffffb-b4ghz                0/1       ImagePullBackOff   0          10h
    onap          onap-dcaegen2-dcae-inv-pg-0                                    1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-inv-pg-1                                    1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-inv-pgpool-5cbd6467b4-ntqjf                 1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-inv-pgpool-5cbd6467b4-qxxgs                 1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-inventory-api-57595cfc9b-4w8xt              1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-pgpool-696c95c8b-r4nh6                      1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-pgpool-696c95c8b-wnhg8                      1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-policy-handler-6b84f86cf-djvq4              0/2       Init:0/3           14         10h
    onap          onap-dcaegen2-dcae-redis-0                                     1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-redis-1                                     1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-redis-2                                     1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-redis-3                                     1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-redis-4                                     1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-redis-5                                     1/1       Running            0          10h
    onap          onap-dcaegen2-dcae-servicechange-handler-64749c57c7-knmf5      1/1       Running            0          10h
    onap          onap-dmaap-dbc-pg-0                                            1/1       Running            0          10h
    onap          onap-dmaap-dbc-pg-1                                            1/1       Running            0          10h
    onap          onap-dmaap-dbc-pgpool-d865b8fdd-4nsmp                          1/1       Running            0          10h
    onap          onap-dmaap-dbc-pgpool-d865b8fdd-nfnm2                          1/1       Running            0          10h
    onap          onap-dmaap-dmaap-bc-5fb6cc9c87-h5rrz                           0/1       ImagePullBackOff   0          10h
    onap          onap-dmaap-dmaap-bc-post-install-2qfc4                         1/1       Running            0          10h
    onap          onap-dmaap-dmaap-dr-db-0                                       1/1       Running            0          10h
    onap          onap-dmaap-dmaap-dr-db-1                                       1/1       Running            0          10h
    onap          onap-dmaap-dmaap-dr-node-0                                     2/2       Running            0          10h
    onap          onap-dmaap-dmaap-dr-prov-68b5cfffc9-6qb78                      2/2       Running            0          10h
    onap          onap-dmaap-message-router-0                                    1/1       Running            0          10h
    onap          onap-dmaap-message-router-kafka-0                              1/1       Running            2          10h
    onap          onap-dmaap-message-router-kafka-1                              1/1       Running            2          10h
    onap          onap-dmaap-message-router-kafka-2                              1/1       Running            2          10h
    onap          onap-dmaap-message-router-zookeeper-0                          1/1       Running            0          10h
    onap          onap-dmaap-message-router-zookeeper-1                          1/1       Running            0          10h
    onap          onap-dmaap-message-router-zookeeper-2                          1/1       Running            0          10h
    onap          onap-esr-esr-gui-7946c6b68d-94rrf                              1/1       Running            0          9h
    onap          onap-esr-esr-server-d96fcc7d7-sbxbh                            2/2       Running            0          9h
    onap          onap-log-log-elasticsearch-9798b655f-hp7tv                     1/1       Running            0          8h
    onap          onap-log-log-kibana-6b89fd4858-42gkd                           1/1       Running            0          8h
    onap          onap-log-log-logstash-8676887cd4-kql6r                         1/1       Running            0          8h
    onap          onap-msb-kube2msb-7c55d474ff-7tm6q                             1/1       Running            0          10h
    onap          onap-msb-msb-consul-7547dd6464-lg7cz                           1/1       Running            0          10h
    onap          onap-msb-msb-discovery-6797d4f545-2sk4c                        2/2       Running            0          10h
    onap          onap-msb-msb-eag-56954754d6-l4d7l                              2/2       Running            0          10h
    onap          onap-msb-msb-iag-c57959dc9-pr5fw                               2/2       Running            0          10h
    onap          onap-multicloud-multicloud-57b5566dd4-zb64r                    2/2       Running            0          9h
    onap          onap-multicloud-multicloud-azure-5678854877-8ngbw              2/2       Running            0          9h
    onap          onap-multicloud-multicloud-ocata-55d8cc6767-b26sd              2/2       Running            0          9h
    onap          onap-multicloud-multicloud-pike-54cd59b448-6w6gk               2/2       Running            0          9h
    onap          onap-multicloud-multicloud-starlingx-79bf6df8b8-hrm9m          2/2       Running            0          9h
    onap          onap-multicloud-multicloud-vio-7bf4544fc-zzwst                 2/2       Running            0          9h
    onap          onap-multicloud-multicloud-windriver-6b8bb465f5-bcck8          2/2       Running            0          9h
    onap          onap-oof-cmso-db-0                                             1/1       Running            0          9h
    onap          onap-oof-music-cassandra-0                                     1/1       Running            2          9h
    onap          onap-oof-music-cassandra-1                                     1/1       Running            0          9h
    onap          onap-oof-music-cassandra-2                                     1/1       Running            0          9h
    onap          onap-oof-music-cassandra-job-config-l4s8h                      0/1       Completed          0          9h
    onap          onap-oof-music-tomcat-c7b8f6488-67jgq                          1/1       Running            0          9h
    onap          onap-oof-music-tomcat-c7b8f6488-6vswh                          1/1       Running            0          9h
    onap          onap-oof-music-tomcat-c7b8f6488-pv6r8                          1/1       Running            0          9h
    onap          onap-oof-oof-5b8c698f4d-9pj9w                                  1/1       Running            0          9h
    onap          onap-oof-oof-cmso-service-54755bb6b8-lrlbr                     1/1       Running            0          9h
    onap          onap-oof-oof-has-api-79d8bff9b7-v4nx4                          1/1       Running            0          9h
    onap          onap-oof-oof-has-controller-8599f4f464-8vd9q                   1/1       Running            0          9h
    onap          onap-oof-oof-has-data-77c5d5fccb-954vl                         1/1       Running            0          9h
    onap          onap-oof-oof-has-healthcheck-znfsl                             0/1       Completed          0          9h
    onap          onap-oof-oof-has-onboard-z4s62                                 0/1       Completed          0          9h
    onap          onap-oof-oof-has-reservation-6b4448bd64-qttj7                  1/1       Running            0          9h
    onap          onap-oof-oof-has-solver-7d6cdb957f-6tdgd                       1/1       Running            0          9h
    onap          onap-oof-zookeeper-0                                           1/1       Running            0          9h
    onap          onap-oof-zookeeper-1                                           1/1       Running            0          9h
    onap          onap-oof-zookeeper-2                                           1/1       Running            0          9h
    onap          onap-policy-brmsgw-6c9d4dd45b-shqjp                            1/1       Running            0          8h
    onap          onap-policy-drools-0                                           1/1       Running            0          8h
    onap          onap-policy-nexus-6fcddd6c6b-bcsm4                             1/1       Running            0          8h
    onap          onap-policy-pap-6745b8b7b9-mnxlt                               2/2       Running            0          8h
    onap          onap-policy-pdp-0                                              2/2       Running            0          8h
    onap          onap-policy-policy-apex-pdp-0                                  1/1       Running            0          8h
    onap          onap-policy-policy-api-5dcc6d68df-9z8t7                        1/1       Running            0          8h
    onap          onap-policy-policy-distribution-9f7b4f44b-9d4fg                1/1       Running            0          8h
    onap          onap-policy-policy-pap-6478b59c6f-pvlqt                        1/1       Running            0          8h
    onap          onap-policy-policydb-f5c7d8f55-lmvmt                           1/1       Running            0          8h
    onap          onap-pomba-pomba-aaictxbuilder-847c54df6d-znrpm                2/2       Running            0          6h
    onap          onap-pomba-pomba-contextaggregator-78c496cdfc-qdzvr            2/2       Running            0          6h
    onap          onap-pomba-pomba-data-router-697c7ccfc7-h6xgl                  2/2       Running            0          6h
    onap          onap-pomba-pomba-elasticsearch-5c4f8c6b5b-pl6sx                1/1       Running            0          6h
    onap          onap-pomba-pomba-kibana-849747b6c5-76phc                       1/1       Running            0          6h
    onap          onap-pomba-pomba-networkdiscovery-dcfd46dfc-td49q              2/2       Running            0          6h
    onap          onap-pomba-pomba-networkdiscoveryctxbuilder-7b666d5698-pbxv7   2/2       Running            0          6h
    onap          onap-pomba-pomba-sdcctxbuilder-7b785fc7b7-2lq65                2/2       Running            0          6h
    onap          onap-pomba-pomba-sdncctxbuilder-5847bc48cc-fzm59               2/2       Running            0          6h
    onap          onap-pomba-pomba-search-data-5955bf46f8-h2gft                  2/2       Running            0          6h
    onap          onap-pomba-pomba-servicedecomposition-fb6d87dd4-m7n2p          2/2       Running            0          6h
    onap          onap-pomba-pomba-validation-service-86bcb7f689-88ckq           2/2       Running            0          6h
    onap          onap-portal-portal-app-567dfc49bf-8khqx                        2/2       Running            0          8h
    onap          onap-portal-portal-cassandra-6f997cd8fd-twhzh                  1/1       Running            0          8h
    onap          onap-portal-portal-db-85458665d6-7gt44                         1/1       Running            0          8h
    onap          onap-portal-portal-db-config-h7dtj                             0/2       Completed          0          8h
    onap          onap-portal-portal-sdk-7c49c97955-rbj22                        2/2       Running            0          8h
    onap          onap-portal-portal-widget-ccf464b7c-8gsdp                      1/1       Running            0          8h
    onap          onap-portal-portal-zookeeper-5969678cb7-vnktc                  1/1       Running            0          8h
    onap          onap-robot-robot-548bb494dc-ml5qt                              1/1       Running            0          10h
    onap          onap-sdc-sdc-be-76fdcd58fd-6s8dq                               2/2       Running            0          9h
    onap          onap-sdc-sdc-be-config-backend-wbs9z                           0/1       Completed          0          9h
    onap          onap-sdc-sdc-cs-75b46b7ff5-4qdpk                               1/1       Running            0          9h
    onap          onap-sdc-sdc-cs-config-cassandra-c7nbm                         0/1       Completed          0          9h
    onap          onap-sdc-sdc-dcae-be-5b55b7dc9c-4tcgz                          2/2       Running            0          9h
    onap          onap-sdc-sdc-dcae-be-tools-m85cz                               0/1       Init:Error         0          9h
    onap          onap-sdc-sdc-dcae-be-tools-twh2z                               0/1       Completed          0          9h
    onap          onap-sdc-sdc-dcae-dt-5cd48f7598-cj8qf                          2/2       Running            0          9h
    onap          onap-sdc-sdc-dcae-fe-6c6f66664b-577z6                          2/2       Running            0          9h
    onap          onap-sdc-sdc-dcae-tosca-lab-7576c79d74-h4pb5                   2/2       Running            0          9h
    onap          onap-sdc-sdc-es-7b6f8c7f46-9qjk9                               1/1       Running            0          9h
    onap          onap-sdc-sdc-es-config-elasticsearch-s2nc6                     0/1       Completed          0          9h
    onap          onap-sdc-sdc-fe-96df6b5f8-94tck                                2/2       Running            0          9h
    onap          onap-sdc-sdc-kb-7fbcb895fb-cs27m                               1/1       Running            0          9h
    onap          onap-sdc-sdc-onboarding-be-7b548998c-zgw8m                     2/2       Running            0          9h
    onap          onap-sdc-sdc-onboarding-be-cassandra-init-d4jpt                0/1       Completed          0          9h
    onap          onap-sdc-sdc-wfd-be-677487c747-kl4hd                           1/1       Running            0          9h
    onap          onap-sdc-sdc-wfd-be-workflow-init-5kcpg                        0/1       Completed          0          9h
    onap          onap-sdc-sdc-wfd-fe-7877f596c8-fxrtp                           2/2       Running            0          9h
    onap          onap-sdnc-blueprints-processor-6458595d4b-q7bkf                0/1       Running            125        8h
    onap          onap-sdnc-cds-7767b798bb-7qfwl                                 1/1       Running            0          8h
    onap          onap-sdnc-cds-db-0                                             1/1       Running            0          8h
    onap          onap-sdnc-controller-blueprints-795dfcb8b8-mpmfn               1/1       Running            0          8h
    onap          onap-sdnc-nengdb-0                                             1/1       Running            0          8h
    onap          onap-sdnc-network-name-gen-7f95f5bfc8-whvm4                    1/1       Running            0          8h
    onap          onap-sdnc-sdnc-0                                               2/2       Running            0          8h
    onap          onap-sdnc-sdnc-ansible-server-5d566d47bd-58h7r                 1/1       Running            0          8h
    onap          onap-sdnc-sdnc-db-0                                            2/2       Running            0          8h
    onap          onap-sdnc-sdnc-dgbuilder-7c8fcbff77-fhpx7                      1/1       Running            0          8h
    onap          onap-sdnc-sdnc-dmaap-listener-5f4b765b49-6666b                 1/1       Running            0          8h
    onap          onap-sdnc-sdnc-portal-68ccd98986-5vxbt                         1/1       Running            0          8h
    onap          onap-sdnc-sdnc-ueb-listener-8459b78759-s47lm                   1/1       Running            0          8h
    onap          onap-sniro-emulator-sniro-emulator-59d5c5796b-pzvq6            1/1       Running            0          6h
    onap          onap-so-so-75bb4b68bb-7cqxt                                    1/1       Running            0          9h
    onap          onap-so-so-bpmn-infra-56f99599b6-m9gw8                         1/1       Running            0          9h
    onap          onap-so-so-catalog-db-adapter-7994778fd9-qmzdb                 1/1       Running            0          9h
    onap          onap-so-so-mariadb-86765ff569-crbjl                            1/1       Running            0          9h
    onap          onap-so-so-monitoring-b75b95f76-49pct                          1/1       Running            0          9h
    onap          onap-so-so-openstack-adapter-78dc84b88f-2nqv9                  1/1       Running            0          9h
    onap          onap-so-so-request-db-adapter-64ff55cb79-9lnkt                 1/1       Running            0          9h
    onap          onap-so-so-sdc-controller-d89d44595-rqk62                      1/1       Running            0          9h
    onap          onap-so-so-sdnc-adapter-8db65dfb8-lwljs                        1/1       Running            0          9h
    onap          onap-so-so-vfc-adapter-6c4d54b6fd-69xgd                        1/1       Running            0          9h
    onap          onap-so-so-vnfm-adapter-5b4d7496d7-n4wrf                       1/1       Running            0          9h
    onap          onap-uui-uui-f4c65b785-9bxbw                                   1/1       Running            0          7h
    onap          onap-uui-uui-server-85c74899bf-d6svt                           1/1       Running            0          7h
    onap          onap-vfc-vfc-catalog-788576f56b-hvtnj                          2/2       Running            0          8h
    onap          onap-vfc-vfc-db-9c7c86b6b-5wfhz                                1/1       Running            0          8h
    onap          onap-vfc-vfc-ems-driver-65b694c46f-8bxkh                       1/1       Running            0          8h
    onap          onap-vfc-vfc-generic-vnfm-driver-78d5fd5cb4-zv2fl              2/2       Running            0          8h
    onap          onap-vfc-vfc-huawei-vnfm-driver-66bc9b66f-lzcn8                2/2       Running            0          8h
    onap          onap-vfc-vfc-juju-vnfm-driver-78668dcd98-8wphg                 2/2       Running            0          8h
    onap          onap-vfc-vfc-multivim-proxy-6bf6d7f6b5-5hr2f                   1/1       Running            0          8h
    onap          onap-vfc-vfc-nokia-v2vnfm-driver-588f84fdf6-g6st7              1/1       Running            0          8h
    onap          onap-vfc-vfc-nokia-vnfm-driver-64c95cfcdc-dsx9d                2/2       Running            0          8h
    onap          onap-vfc-vfc-nslcm-674f55b69-b6bc5                             2/2       Running            0          8h
    onap          onap-vfc-vfc-resmgr-5b56b67df9-dsv9q                           2/2       Running            0          8h
    onap          onap-vfc-vfc-vnflcm-667848b644-9bldx                           2/2       Running            0          8h
    onap          onap-vfc-vfc-vnfmgr-7bb858f946-vdt5z                           2/2       Running            0          8h
    onap          onap-vfc-vfc-vnfres-575fcdf569-wjspc                           2/2       Running            0          8h
    onap          onap-vfc-vfc-workflow-788bb4d86f-wfqr6                         1/1       Running            0          8h
    onap          onap-vfc-vfc-workflow-engine-57c466bbb6-84mq4                  1/1       Running            0          8h
    onap          onap-vfc-vfc-zte-sdnc-driver-5956f546f-4x7m9                   1/1       Running            0          8h
    onap          onap-vfc-vfc-zte-vnfm-driver-5878b7447c-k4vcm                  2/2       Running            0          8h
    onap          onap-vid-vid-5c86b775b7-fhb6n                                  2/2       Running            0          8h
    onap          onap-vid-vid-galera-config-hrdfn                               0/1       Completed          0          8h
    onap          onap-vid-vid-mariadb-galera-0                                  1/1       Running            0          8h
    
    
    Pods with issues - with completed and jobs that eventually passed removed
    ubuntu@a-rke0-master:~$ kubectl get pods --all-namespaces | grep -E '0/|1/2'
    onap          onap-aai-aai-bb74c9586-j4nn6                                   0/1       Init:0/1           33         6h
    onap          onap-aai-aai-champ-5cddfb8cc4-7zdzl                            1/2       Running            0          10h
    onap          onap-aai-aai-graphadmin-bc7fb6c59-6ck8l                        0/2       Init:0/1           59         10h
    ...
    onap          onap-aai-aai-graphadmin-create-db-schema-xpq55                 0/1       Error              0          10h
    onap          onap-aai-aai-resources-f6b6c8df8-bqmpg                         0/2       Init:0/1           58         10h
    onap          onap-aai-aai-sparky-be-75fbccb9b-s6fdd                         0/2       Init:0/1           0          10h
    onap          onap-aai-aai-traversal-f78f855b6-bq464                         0/2       Init:0/1           59         10h
    onap          onap-aai-aai-traversal-update-query-data-nrt2k                 0/1       Init:0/1           59         10h
    # note that this one will oscillate between 2/2 and 1/2
    onap          onap-appc-appc-0                                               1/2       Running            0          7h
    onap          onap-dcaegen2-dcae-bootstrap-59b48579f7-bpxbp                  0/1       Init:0/1           41         10h
    onap          onap-dcaegen2-dcae-cloudify-manager-77b58b8dcc-rc9tr           0/1       ErrImagePull       0          10h
    onap          onap-dcaegen2-dcae-deployment-handler-6dd58f447b-5bm8b         0/2       Init:0/3           14         10h
    onap          onap-dcaegen2-dcae-healthcheck-6bf85ffffb-b4ghz                0/1       ImagePullBackOff   0          10h
    onap          onap-dcaegen2-dcae-policy-handler-6b84f86cf-djvq4              0/2       Init:0/3           14         10h
    onap          onap-dmaap-dmaap-bc-5fb6cc9c87-h5rrz                           0/1       ErrImagePull       0          10h
    onap          onap-sdnc-blueprints-processor-6458595d4b-q7bkf                0/1       Running            125        8h
    
    ubuntu@a-rke0-master:~$ kubectl top nodes
    NAME            CPU(cores)   CPU%      MEMORY(bytes)   MEMORY%   
    a-rke0-master   15073m       23%       140840Mi        54%  
    
    
    # order of deployment - the deploy with the most #'s was earlier
    ubuntu@a-rke0-master:~$ sudo helm list
    NAME               	REVISION	UPDATED                 	STATUS  	CHART               	NAMESPACE
    onap               	27      	Tue Mar 26 04:50:16 2019	DEPLOYED	onap-4.0.0          	onap     
    onap-aaf           	22      	Tue Mar 26 04:50:19 2019	DEPLOYED	aaf-4.0.0           	onap     
    onap-aai           	20      	Tue Mar 26 04:50:25 2019	DEPLOYED	aai-4.0.0           	onap     
    onap-appc          	6       	Tue Mar 26 04:50:37 2019	DEPLOYED	appc-4.0.0          	onap     
    onap-clamp         	5       	Tue Mar 26 04:50:44 2019	DEPLOYED	clamp-4.0.0         	onap     
    onap-cli           	4       	Tue Mar 26 04:50:48 2019	DEPLOYED	cli-4.0.0           	onap     
    onap-consul        	26      	Tue Mar 26 04:50:50 2019	DEPLOYED	consul-4.0.0        	onap     
    onap-contrib       	2       	Tue Mar 26 04:50:53 2019	DEPLOYED	contrib-4.0.0       	onap     
    onap-dcaegen2      	23      	Tue Mar 26 04:50:57 2019	DEPLOYED	dcaegen2-4.0.0      	onap     
    onap-dmaap         	1       	Tue Mar 26 00:10:20 2019	FAILED  	dmaap-4.0.1         	onap     
    onap-esr           	19      	Tue Mar 26 04:51:03 2019	DEPLOYED	esr-4.0.0           	onap     
    onap-log           	10      	Tue Mar 26 04:51:06 2019	DEPLOYED	log-4.0.0           	onap     
    onap-msb           	25      	Tue Mar 26 04:51:12 2019	DEPLOYED	msb-4.0.0           	onap     
    onap-multicloud    	18      	Tue Mar 26 04:51:15 2019	DEPLOYED	multicloud-4.0.0    	onap     
    onap-oof           	17      	Tue Mar 26 04:51:21 2019	DEPLOYED	oof-4.0.0           	onap     
    onap-policy        	12      	Tue Mar 26 04:51:29 2019	DEPLOYED	policy-4.0.0        	onap     
    onap-pomba         	3       	Tue Mar 26 04:51:34 2019	DEPLOYED	pomba-4.0.0         	onap     
    onap-portal        	11      	Tue Mar 26 04:51:39 2019	DEPLOYED	portal-4.0.0        	onap     
    onap-robot         	21      	Tue Mar 26 04:51:43 2019	DEPLOYED	robot-4.0.0         	onap     
    onap-sdc           	15      	Tue Mar 26 04:51:46 2019	DEPLOYED	sdc-4.0.0           	onap     
    onap-sdnc          	14      	Tue Mar 26 04:51:51 2019	DEPLOYED	sdnc-4.0.0          	onap     
    onap-sniro-emulator	1       	Tue Mar 26 04:51:56 2019	DEPLOYED	sniro-emulator-4.0.0	onap     
    onap-so            	16      	Tue Mar 26 04:51:59 2019	DEPLOYED	so-4.0.0            	onap     
    onap-uui           	8       	Tue Mar 26 04:52:06 2019	DEPLOYED	uui-4.0.0           	onap     
    onap-vfc           	9       	Tue Mar 26 04:52:08 2019	DEPLOYED	vfc-4.0.0           	onap     
    onap-vid           	13      	Tue Mar 26 04:52:14 2019	DEPLOYED	vid-4.0.0           	onap     
    onap-vnfsdk        	1       	Tue Mar 26 03:19:22 2019	FAILED  	vnfsdk-4.0.0        	onap  
    
    ubuntu@a-rke0-master:~$ df
    Filesystem     1K-blocks      Used Available Use% Mounted on
    udev           132059840         0 132059840   0% /dev
    tmpfs           26413892     62364  26351528   1% /run
    /dev/sda1      490906412 134304332 356585696  28% /
    tmpfs          132069444     66868 132002576   1% /dev/shm
    tmpfs               5120         0      5120   0% /run/lock
    tmpfs          132069444         0 132069444   0% /sys/fs/cgroup
    /dev/sdb1      528315000     71452 501383676   1% /mnt
    tmpfs           26413892         0  26413892   0% /run/user/1000
    ubuntu@a-rke0-master:~$ free
                  total        used        free      shared  buff/cache   available
    Mem:      264138892   143441428    11624120      237844   109073344   111423124
    
    ubuntu@a-rke0-master:~/oom/kubernetes/robot$ sudo ./ete-k8s.sh onap health
    Testsuites.Health-Check :: Testing ecomp components are available via calls.  
    ==============================================================================
    Basic A&AI Health Check                                               | FAIL |
    Test timeout 10 seconds exceeded.
    ------------------------------------------------------------------------------
    Basic AAF Health Check                                                | PASS |
    ------------------------------------------------------------------------------
    Basic AAF SMS Health Check                                            | PASS |
    ------------------------------------------------------------------------------
    Basic APPC Health Check                                               | PASS |
    ------------------------------------------------------------------------------
    Basic CLI Health Check                                                | PASS |
    ------------------------------------------------------------------------------
    Basic CLAMP Health Check                                              | PASS |
    ------------------------------------------------------------------------------
    Basic DCAE Health Check                                               | FAIL |
    Test timeout 10 seconds exceeded.
    ------------------------------------------------------------------------------
    Basic DMAAP Data Router Health Check                                  | PASS |
    ------------------------------------------------------------------------------
    Basic DMAAP Message Router Health Check                               | PASS |
    ------------------------------------------------------------------------------
    Basic External API NBI Health Check                                   [ WARN ] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f47475784d0>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v3/status
    [ WARN ] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4747543ed0>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v3/status
    [ WARN ] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f474751f950>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /nbi/api/v3/status
    | FAIL |
    ConnectionError: HTTPConnectionPool(host='nbi.onap', port=8080): Max retries exceeded with url: /nbi/api/v3/status (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4747534550>: Failed to establish a new connection: [Errno -2] Name or service not known',))
    ------------------------------------------------------------------------------
    Basic Log Elasticsearch Health Check                                  | PASS |
    ------------------------------------------------------------------------------
    Basic Log Kibana Health Check                                         | PASS |
    ------------------------------------------------------------------------------
    Basic Log Logstash Health Check                                       | PASS |
    ------------------------------------------------------------------------------
    Basic Microservice Bus Health Check                                   | PASS |
    ------------------------------------------------------------------------------
    Basic Multicloud API Health Check                                     | PASS |
    ------------------------------------------------------------------------------
    Basic Multicloud-ocata API Health Check                               | PASS |
    ------------------------------------------------------------------------------
    Basic Multicloud-pike API Health Check                                | PASS |
    ------------------------------------------------------------------------------
    Basic Multicloud-starlingx API Health Check                           | PASS |
    ------------------------------------------------------------------------------
    Basic Multicloud-titanium_cloud API Health Check                      | PASS |
    ------------------------------------------------------------------------------
    Basic Multicloud-vio API Health Check                                 | PASS |
    ------------------------------------------------------------------------------
    Basic OOF-Homing Health Check                                         | PASS |
    ------------------------------------------------------------------------------
    Basic OOF-SNIRO Health Check                                          | PASS |
    ------------------------------------------------------------------------------
    Basic OOF-CMSO Health Check                                           | PASS |
    ------------------------------------------------------------------------------
    Basic Policy Health Check                                             | PASS |
    ------------------------------------------------------------------------------
    Basic Pomba AAI-context-builder Health Check                          | FAIL |
    Variable '${POMBA_AAICONTEXTBUILDER_ENDPOINT}' not found.
    ------------------------------------------------------------------------------
    Basic Pomba SDC-context-builder Health Check                          | FAIL |
    Variable '${POMBA_SDCCONTEXTBUILDER_ENDPOINT}' not found.
    ------------------------------------------------------------------------------
    Basic Pomba Network-discovery-context-builder Health Check            | FAIL |
    Variable '${POMBA_NETWORKDISCCONTEXTBUILDER_ENDPOINT}' not found.
    ------------------------------------------------------------------------------
    Basic Pomba Service-Decomposition Health Check                        | FAIL |
    Variable '${POMBA_SERVICEDECOMPOSITION_ENDPOINT}' not found. Did you mean:
        ${POMBA_SERVICEDECOMPOSITION_PATH}
    ------------------------------------------------------------------------------
    Basic Pomba Network-Discovery-MicroService Health Check               | FAIL |
    Variable '${POMBA_NETWORKDISCOVERY_MICROSERVICE_ENDPOINT}' not found.
    ------------------------------------------------------------------------------
    Basic Pomba Pomba-Kibana Health Check                                 | FAIL |
    Variable '${POMBA_KIBANA_ENDPOINT}' not found.
    ------------------------------------------------------------------------------
    Basic Pomba Elastic-Search Health Check                               | FAIL |
    Variable '${POMBA_ELASTICSEARCH_ENDPOINT}' not found. Did you mean:
        ${LOG_ELASTICSEARCH_ENDPOINT}
    ------------------------------------------------------------------------------
    Basic Portal Health Check                                             | PASS |
    ------------------------------------------------------------------------------
    Basic SDC Health Check                                                (DMaaP:UP)| PASS |
    ------------------------------------------------------------------------------
    Basic SDNC Health Check                                               | PASS |
    ------------------------------------------------------------------------------
    Basic SO Health Check                                                 | PASS |
    ------------------------------------------------------------------------------
    Basic UseCaseUI API Health Check                                      | PASS |
    ------------------------------------------------------------------------------
    Basic VFC catalog API Health Check                                    | PASS |
    ------------------------------------------------------------------------------
    Basic VFC emsdriver API Health Check                                  | PASS |
    ------------------------------------------------------------------------------
    Basic VFC gvnfmdriver API Health Check                                | PASS |
    ------------------------------------------------------------------------------
    Basic VFC huaweivnfmdriver API Health Check                           | PASS |
    ------------------------------------------------------------------------------
    Basic VFC jujuvnfmdriver API Health Check                             | PASS |
    ------------------------------------------------------------------------------
    Basic VFC multivimproxy API Health Check                              | PASS |
    ------------------------------------------------------------------------------
    Basic VFC nokiavnfmdriver API Health Check                            | PASS |
    ------------------------------------------------------------------------------
    Basic VFC nokiav2driver API Health Check                              | PASS |
    ------------------------------------------------------------------------------
    Basic VFC nslcm API Health Check                                      | PASS |
    ------------------------------------------------------------------------------
    Basic VFC resmgr API Health Check                                     | PASS |
    ------------------------------------------------------------------------------
    Basic VFC vnflcm API Health Check                                     | PASS |
    ------------------------------------------------------------------------------
    Basic VFC vnfmgr API Health Check                                     | PASS |
    ------------------------------------------------------------------------------
    Basic VFC vnfres API Health Check                                     | PASS |
    ------------------------------------------------------------------------------
    Basic VFC workflow API Health Check                                   | PASS |
    ------------------------------------------------------------------------------
    Basic VFC ztesdncdriver API Health Check                              | PASS |
    ------------------------------------------------------------------------------
    Basic VFC ztevnfmdriver API Health Check                              | PASS |
    ------------------------------------------------------------------------------
    Basic VID Health Check                                                | PASS |
    ------------------------------------------------------------------------------
    Basic VNFSDK Health Check                                             [ WARN ] Retrying (Retry(total=2, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4746b81b90>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /onapapi/vnfsdk-marketplace/v1/PackageResource/healthcheck
    [ WARN ] Retrying (Retry(total=1, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4746b81d90>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /onapapi/vnfsdk-marketplace/v1/PackageResource/healthcheck
    [ WARN ] Retrying (Retry(total=0, connect=None, read=None, redirect=None, status=None)) after connection broken by 'NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4746b81f90>: Failed to establish a new connection: [Errno -2] Name or service not known',)': /onapapi/vnfsdk-marketplace/v1/PackageResource/healthcheck
    | FAIL |
    ConnectionError: HTTPConnectionPool(host='refrepo.onap', port=8702): Max retries exceeded with url: /onapapi/vnfsdk-marketplace/v1/PackageResource/healthcheck (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f4746b92190>: Failed to establish a new connection: [Errno -2] Name or service not known',))
    ------------------------------------------------------------------------------
    Basic Holmes Rule Management API Health Check                         | FAIL |
    502 != 200
    ------------------------------------------------------------------------------
    Basic Holmes Engine Management API Health Check                       | FAIL |
    502 != 200
    ------------------------------------------------------------------------------
    Testsuites.Health-Check :: Testing ecomp components are available ... | FAIL |
    56 critical tests, 43 passed, 13 failed
    56 tests total, 43 passed, 13 failed
    ==============================================================================
    Testsuites                                                            | FAIL |
    56 critical tests, 43 passed, 13 failed
    56 tests total, 43 passed, 13 failed
    ==============================================================================
    Output:  /share/logs/0003_ete_health/output.xml
    Log:     /share/logs/0003_ete_health/log.html
    Report:  /share/logs/0003_ete_health/report.html
    command terminated with exit code 13