This is an overview of the state of readiness for moving to project-specific CSIT per project at the end of Honolulu release
TBD: The aspects to be considered:
- produced docker images and method of production
- cross-project dependencies
- execution time (including artifact and docker builds)
- use of Nexus in various phases
Active projects
| Project | Status | Produced docker images | CSIT jobs | CSIT job triggers | Tested docker images and repositories | Docker build jobs that create the tested images | CSIT Dependencies | Comments |
|---|---|---|---|---|---|---|---|---|
ccsdk | Project-specific CSIT in use under ccsdk/distribution | Produced by docker-maven-plugin ccsdk-odlsli-alpine-image:latest ccsdk-dgbuilder-image:latest (+ many others that are not separately tested) | ccsdk-distribution-review-verification-maven-master ccsdk-distribution-merge-verification-maven-master | Review and merge triggers | ccsdk-odlsli-alpine-image:latest ccsdk-dgbuilder-image:latest Technically the source repository for the above images is ccsdk/distribution, but in reality their contents are collected from various other ccsdk repositories via repository zip maven dependencies | Built locally within the verification jobs | mysql/mysql-server:5.6 | The tested images have some tricky build-time dependencies to other docker images that are also built on the fly - their tagging and references should be improved (TODO: create Jira) |
| ccsdk-oran | Project-specific CSIT in use under ccsdk/oran | onap/ccsdk-oran-a1policymanagementservice (1.2.0-SNAPSHOT for master, 1.1.3-SNAPSHOT for Honolulu, 1.0.3-SNAPSHOT for Guilin) | ccsdk-oran-review-verification-maven-master ccsdk-oran-merge-verification-maven-master ccsdk-oran-review-verification-maven-honolulu ccsdk-oran-merge-verification-maven-honolulu | review and merge triggers | onap/ccsdk-oran-a1policymanagementservice (1.2.0-SNAPSHOT for master, 1.1.3-SNAPSHOT for Honolulu, 1.0.3-SNAPSHOT for Guilin) The source repository is ccsdk/oran | Built locally within the verification jobs | nexus3.onap.org:10003/onap/sdnc-image (2.1.0-STAGING-latest for master, nexus3.onap.org:10003/onap/sdnc-image:2.0.1-STAGING-latest for Guilin) nexus3.o-ran-sc.org:10004/o-ran-sc/nonrtric-controlpanel:2.0.0 | These tests are currently cloned from ORAN repository and they are essentially plain shell scripts that are just wrapped into Robot Note that the Robot wrapper could be removed if more flexible project-specific CSIT JJB template was created for that (TODO: create Jira if needed) |
| cps | Project-specific CSIT in use under cps repository | cps-and-nf-proxy:latest (+various other images on which this is dependent) | master branch: honolulu branch: | review and merge triggers | cps-and-nf-proxy:latest The source repository is cps | Built locally within the verification jobs | CPS is the first project to adopt project-specific CSIT design from the beginning instead of porting their tests from integration/csit | |
| dcaegen2 | integration/csit in use, no current plans to move the tests to dcaegen2 repositories | Produced by docker-maven-plugin: org.onap.dcaegen2.services.son-handler:latest ____________________ Produced by docker-build.sh from ci-management: onap/org.onap.dcaegen2.services.pmsh:latest ____________________ Produced by dockerfile-maven-plugin: onap/org.onap.dcaegen2.services.components.bbs-event-processor:latest ____________________ Produced by docker-maven-plugin: org.onap.dcaegen2.services.pm-mapper:latest ____________________ Produced by docker-maven-plugin: org.onap.dcaegen2.collectors.ves.vescollector:latest ____________________ Produced by docker-maven-plugin: org.onap.dcaegen2.services.prh.prh-app-server:latest ___________________ org.onap.dcaegen2.collectors.restconfcollector:latest ___________________ org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:latest (and few other ones that are not being tested nor used in CSIT?) ____________________ org.onap.dcaegen2.collectors.datafile.datafile-app-server:latest | dcaegen2-services-son-handler-master-csit-testsuites _____________________ dcaegen2-services-pmsh-master-csit-testsuite ______________________ dcaegen2-services-bbs-event-processor-master-csit-bbs-testsuites ______________________ dcaegen2-pmmapper-master-csit-pmmapper ______________________ dcaegen2-master-csit-testsuites ______________________ dcaegen2-master-csit-prh-testsuites ______________________ dcaegen2-collectors-restconf-master-csit-testsuites _____________________ dcaegen2-collectors-hv-ves-master-csit-testsuites _____________________ dcaegen2-collectors-datafile-master-csit-ManagementInterface-suite | dcaegen2-services-son-handler-master-merge-java (does neither produce nor push docker image! Instead, it's produced by dcaegen2-services-son-handler-maven-docker-stage-master - ticket raised: DCAEGEN2-2741 - Getting issue details... STATUS ) ________________________ dcaegen2-services-pmsh-docker-merge-master _________________________ dcaegen2-services-master-bbs-event-processor-merge-java _________________________ pmmapper and files-processing-config-pmmapper have no trigger jobs _________________________ dcaegen2-collectors-ves-master-merge-java (does neither produce nor push docker image! Instead, it's produced by dcaegen2-collectors-ves-maven-docker-stage-master - ticket raised: DCAEGEN2-2742 - Getting issue details... STATUS ) _________________________ dcaegen2-services-prh-master-merge-java (does neither produce nor push docker image! Instead, it's produced by dcaegen2-services-prh-maven-docker-stage-master - ticket raised: DCAEGEN2-2743 - Getting issue details... STATUS ) _________________________ dcaegen2-collectors-restconf-master-merge-java (does neither produce nor push docker image! Instead, it's produced by dcaegen2-collectors-restconf-maven-docker-stage-master - ticket raised: DCAEGEN2-2744 - Getting issue details... STATUS ) _________________________ dcaegen2-collectors-hv-ves-master-merge-java (produces the docker image, but apparently does not push it? Instead, it - along with a few other images - is produced by dcaegen2-collectors-hv-ves-maven-docker-stage-master - ticket raised: DCAEGEN2-2745 - Getting issue details... STATUS ) _________________________ Datafile CSITs have no trigger jobs _________________________ | nexus3.onap.org:10003/onap/org.onap.dcaegen2.services.son-handler:latest from dcaegen2/services/son-handler ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.services.pmsh:latest from dcaegen2/services ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.services.components.bbs-event-processor:latest from dcaegen2/services ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.services.pm-mapper:latest ______________________________________ nexus3.onap.org:10003/onap/org.onap.dcaegen2.collectors.ves.vescollector:latest ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.services.prh.prh-app-server:latest ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.restconfcollector:latest ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:latest ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:latest ______________________________________ (all hardcoded in various places in the tests) | dcaegen2-services-son-handler-maven-docker-stage-master (but so do dcaegen2-services-son-handler-maven-docker-stage-honolulu and dcaegen2-services-son-handler-maven-docker-stage-guilin ) ___________________ dcaegen2-services-pmsh-docker-merge-master (but so do dcaegen2-services-pmsh-docker-merge-honolulu and dcaegen2-services-pmsh-docker-merge-guilin ) ____________________ dcaegen2-services-master-bbs-event-processor-merge-java (but then there's also dcaegen2-services-bbs-event-processor-maven-docker-stage-master and dcaegen2-services-master-bbs-event-processor-verify-java also doing this, as well as some of their previous branches) ____________________ dcaegen2-services-pm-mapper-maven-docker-stage-master ____________________ dcaegen2-collectors-ves-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ dcaegen2-services-prh-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ dcaegen2-collectors-restconf-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ dcaegen2-collectors-hv-ves-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ dcaegen2-collectors-datafile-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ Common ticket for all the DCAEGEN2 jobs regarding the use of "latest" raised: DCAEGEN2-2746 - Getting issue details... STATUS | A lot of simulators and other direct ambiguously referenced dependencies - TODO: raise a few tickets (this already caused an issue in pm-mapper that is using "latest" datarouter image) | |
| dmaap | Transition to project CSIT in progress - buscontroller tests are already running under dmaap/buscontroller repository and the rest planned | onap/dmaap/buscontroller:latest ______________________ nexus3.onap.org:10001/onap/dmaap/datarouter-proxv:latest nexus3.onap.org:10001/onap/dmaap/datarouter-node:latest nexus3.onap.org:10001/onap/dmaap/datarouter-subscriber:latest _______________________ dmaap/messagerouter/messageservice dmaap-mr:latest | dmaap-buscontroller-review-verification-maven-master dmaap-buscontroller-merge-verification-maven-master dmaap-buscontroller-review-verification-maven-honolulu dmaap-buscontroller-merge-verification-maven-honolulu _____________________ dmaap-datarouter-master-csit-ssl-dr-suite _____________________ | review and merge triggers ___________________ dmaap-datarouter-maven-docker-stage-master ___________________ mrpubsub CSIT has no triggers | onap/dmaap/buscontroller ________________________ nexus3.onap.org:10001/onap/dmaap/datarouter-proxv nexus3.onap.org:10001/onap/dmaap/datarouter-node nexus3.onap.org:10001/onap/dmaap/datarouter-subscriber _________________________ dmaap/messagerouter/messageservice dmaap-mr (all hardcoded, version not given so latest by default) | Built locally within the verification jobs _________________________________________ dmaap-datarouter-maven-docker-stage-master (same as job trigger) _________________________________________ Latest version of dmaap-mr comes from dmaap-messagerouter-messageservice-java-11-maven-docker-stage-master | kafka111, zookeeper, mariadb - some of these referred to just as "latest" - TODO: raise a ticket | |
| modeling | integration/csit in use, no current plans to move the tests to modeling/etsicatalog | onap/modeling/etsicatalog | modeling-etsicatalog-master-csit-sanity-check | modeling-etsicatalog-master-docker-java-version-shell-daily | nexus3.onap.org:10001/onap/modeling/etsicatalog (latest by default, ticket raised: MODELING-518 - Getting issue details... STATUS ) | consul:0.9.3 nexus3.onap.org:10001/onap/msb/msb_discovery nexus3.onap.org:10001/onap/msb/msb_apigateway nexus3.onap.org:10001/library/mariadb (all latest by default -TODO: raise a ticket) | ||
| multicloud | integration/csit in use, no current plans to move the tests to multicloud repositories | onap/multicloud/openstack-fcaps:1.5.6 onap/multicloud/openstack-starlingx:1.5.6 onap/multicloud/vio:1.4.2 onap/multicloud/framework:1.6.0 All produced by maven-resources-plugin and maven-antrun-plugin | multicloud-fcaps-master-csit-functionality1 ___________________ multicloud-master-csit-functionality1 ___________________ multicloud-starlingx-master-csit-functionality1 ___________________ | No triggers for any CSITs | nexus3.onap.org:10001/onap/multicloud/openstack-fcaps:1.4.1 Ticket raised for obsolete image: MULTICLOUD-1337 - Getting issue details... STATUS ___________________________________________________ nexus3.onap.org:10001/onap/multicloud/vio:1.4.2 nexus3.onap.org:10001/onap/multicloud/framework:1.6.0 ____________________________________________________ nexus3.onap.org:10001/onap/multicloud/openstack-starlingx ____________________________________________________ nexus3.onap.org:10001/onap/multicloud/vio (all hardcoded, default latest for those that do not define version explicitly - TODO: raise a ticket) | Latest in Nexus3: onap/multicloud/openstack-fcaps:1.4.1 is from Sep 04 2019 https://jenkins.onap.org/view/multicloud/job/multicloud-openstack-maven-docker-stage-elalto produces version 1.4.3 of onap/multicloud/openstack-fcaps nexus3.onap.org:10001/onap/multicloud/openstack-fcaps:1.5.6 generated by multicloud-openstack-maven-docker-stage-master __________________________ Latest in Nexus: https://jenkins.onap.org/view/multicloud/job/multicloud-framework-maven-docker-stage-master produces version 1.6.0 (and also latest) of onap/multicloud/framework multicloud-openstack-maven-docker-stage-master produces version 1.5.6 (and also latest) ofonap/multicloud/openstack-fcaps and onap/multicloud/openstack-starlingx multicloud-openstack-vmware-maven-docker-stage-master produces version 1.4.2 (and also latest) of onap/multicloud/vio Why are there jobs only for el-Alto and master? Worth a ticket? | - | |
| oom-platform-cert-service | onap/org.onap.oom.platform.cert-service.oom-certservice-api:latest onap/org.onap.oom.platform.cert-service.oom-certservice-post-processor:latest generated by docker-maven-plugin | oom-platform-cert-service-master-csit-certservice ____________________ | No triggers for CSITs | nexus3.onap.org:10001/onap/org.onap.oom.platform.cert-service.oom-certservice-api:latest __________________________ nexus3.onap.org:10001/onap/org.onap.oom.platform.cert-service.oom-certservice-post-processor:latest (but started in Robot test and defined in Robot variable so it would be theoretically overridable) | oom-platform-cert-service-maven-docker-stage-master (for both) | primekey/ejbca-ce:6.15.2.5 |
| |
| optf | Transition to project-specific CSIT in progress: OPTFRA-930 - Getting issue details... STATUS | OPTFRA-858 - Getting issue details... STATUS | nexus3.onap.org:10001/onap/optf-cmso-service:latest nexus3.onap.org:10001/onap/optf-cmso-dbinit:latest nexus3.onap.org:10001/onap/optf-cmso-topology:latest nexus3.onap.org:10001/onap/optf-cmso-ticketmgt:latest nexus3.onap.org:10001/onap/optf-cmso-optimizer:latest nexus3.onap.org:10001/onap/optf-cmso-robot:latest (!! The actual Robot tests run here in setup phase instead of as separate Robot tests from CSIT repo) nexus3.onap.org:10001/onap/optf-osdf:2.0.3-SNAPSHOT-latest nexus3.onap.org:10001/onap/optf-has:2.1.2-SNAPSHOT-latest Repositories: | optf-cmso-maven-docker-stage-master (word of warning: the frankfurt versions of the above jobs are also pushing the same images with "latest"! Probably worth a ticket) | ||||
| policy | policy-master-csit-distribution policy-master-csit-drools-applications (+frankfurt branches for each) | policy-apex-pdp-master-merge-java policy-distribution-master-merge-java policy-drools-applications-master-merge-java policy-drools-pdp-master-merge-java policy-xacml-pdp-master-merge-java (+frankfurt branches for each - note that these also produce the same images with latest tag; this is not critical though since CSITs do not refer to those) | Dynamic image version resolution based on GERRIT_BRANCH and pom.xmls in the referred branches of the related repositories amended with "SNAPSHOT-latest"
| Same as triggers | Policy components have a lot of dependencies between each other and distinction between what's under test and what's just required is not clear | Policy CSITs and their triggers and image references are currently almost as valid as they can be under current circumstances (the only uncertainty is related to the distinction between images under test and dependency images) | ||
| sdc | SDC has its legacy TestNG tests under sdc repo, incorporated into maven jobs | SDC-3302 - Getting issue details... STATUS | ||||||
| sdnc | sdnc-master-csit-sdnc_netconf_tls_post_deploy | SDNC-1381 - Getting issue details... STATUS | nexus3.onap.org:10001/onap/sdnc-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/sdnc-ansible-server-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/admportal-sdnc-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/sdnc-ueb-listener-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/sdnc-dmaap-listener-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/ccsdk-dgbuilder-image/0.7-STAGING-latest --- nexus3.onap.org:10001/onap/sdnc-image/1.8.3-STAGING-latest The source repo is sdnc/oam | SDNC images are going at version 2.1 in master )sdnc-oam-maven-docker-stage-master) and at 2.0 in Guilin (https://jenkins.onap.org/view/sdnc/job/sdnc-oam-maven-docker-stage-guilin) Latest 1.8-STAGING-latest images are from Aug 31 2020 and 1.8.3-STAGING-latest from Jun 07 2020. These images are from Frankfurt and have no longer any jobs to generate them. Ticket created: CCSDK-2915 - Getting issue details... STATUS | primekey/ejbca-ce:6.15.2.5 nexus3.onap.org:10001/onap/org.onap.aaf.certservice.aaf-certservice-api:latest --- nexus3.onap.org:10001/mariadb:10.1.11 | |||
| so | TODO: macroflow (The jobs below - as well as their previous branches - has been disabled under SO-3632 - Getting issue details... STATUS | TBD - is distinction between images under test and image dependencies clear? | ||||||
| vfc | vfc-gvnfm-vnflcm-master-csit-sanity-check vfc-gvnfm-vnfres-master-csit-sanity-check vfc-nfvo-driver-vnfm-gvnfm-master-csit-sanity-check vfc-nfvo-lcm-master-csit-sanity-check | vfc-gvnfm-vnflcm-master-docker-java-version-shell-daily vfc-gvnfm-vnfres-master-docker-java-version-shell-daily vfc-nfvo-driver-vnfm-gvnfm-master-docker-java-version-shell-daily | nexus3.onap.org:10001/onap/vfc/vnflcm nexus3.onap.org:10001/onap/vfc/vnfres nexus3.onap.org:10001/onap/vfc/gvnfmdriver nexus3.onap.org:10001/onap/vfc/nslcm (all latest by default) Source repositories: | Same as triggers | consul:0.9.3 nexus3.onap.org:10001/onap/msb/msb_discovery nexus3.onap.org:10001/onap/msb/msb_a nexus3.onap.org:10001/library/mariadb redis (!?) It's not clear in all cases which VFC images are under test and which are just necessary dependencies | |||
| vid | VID-906 - Getting issue details... STATUS | nexus3.onap.org:10001/onap/vid:6.0-STAGING-latest Source repo is vid | vid-maven-docker-stage-frankfurt vid-maven-docker-stage-master produces 7.0.0 versions except for STAGING-latest, which is somehow still 6.0 - however, this is problematic as Frankfurt also produces 6.0-STAGING-latest images. Ticket raised: VID-907 - Getting issue details... STATUS | nexus3.onap.org:10001/library/mariadb:10 so-simulator (specific to this suite) aai-simulator (specific to this suite) | ||||
| vfsdk | vnfsdk-refrepo-master-merge-java (for both CSITs; however, this job does not produce or trigger any docker image? Ticket raised: VNFSDK-701 - Getting issue details... STATUS ) | nexus3.onap.org:10001/onap/vnfsdk/refrepo/postgres:latest nexus3.onap.org:10001/onap/vnfsdk/refrepo:latest Source repo is vnfsdk/refrepo | vnfsdk-refrepo-maven-docker-stage-master Where is onap/vnfsdk/refrepo/postgres coming from? It hasn't been produced since Jul 09 2019? | What's the relevance of the marketplace CSIT now (given that it's testing postgres image that hasn't been built for over a year)? |
Disabled projects
| Projects with CSIT | Docker images | CSIT jobs | CSIT job triggers | Tested docker images and repositories | Docker build jobs that create the tested images | Dependencies | Comments |
|---|---|---|---|---|---|---|---|
| aaf (disabled) | aaf-frankfurt-csit-certservice Frankfurt branch only? The tests triggered from here do not even exist in master (on the other hand, there are no Jenkins jobs for still remaining aafapi and sms-test-plan?) | aaf-certservice-frankfurt-merge-java - this job neither builds a docker image nor triggers another job that does it, so why trigger CSIT? | nexus3.onap.org:10001/onap/ org.onap.aaf.certservice.aaf-certservice-api:frankfurt-latest (hardcoded) The source repository is aaf/certservice | aaf-certservice-maven-docker-stage-frankfurt (note that aaf-certservice-release-verify and aaf-certservice-release-merge also build aaf-certservice-api image, but not with frankfurt-latest tag) | primekey/ejbca-ce:6.15.2.5 (hardcoded, real image used) | Project unmaintained, CSIT disabled: AAF-1208 - Getting issue details... STATUS | |
| appc (disabled) | appc-master-csit-healthcheck | - | nexus3.onap.org:10001/onap/appc-image:1.7.2-SNAPSHOT-latest nexus3.onap.org:10001/onap/appc-cdt-image:1.7.2-SNAPSHOT-latest (hardcoded) docker-compose.yml as well as appc-image and appc-cdt-image come from appc/deployment | No job is producing these images at the moment! appc-deployment-master-docker-java-daily produces 1.8.0-SNAPSHOT-latest and appc-deployment-frankfurt-docker-java-daily is producing 1.7.3-SNAPSHOT-latest 1.7.2-SNAPSHOT-latest images have not been created since May 27 | mariadb:10.4.3 nexus3.onap.org:10001/onap/ccsdk-dgbuilder-image:0.6.0 (no longer produced, last update to Nexus on Aug 30 2019) nexus3.onap.org:10001/onap/ccsdk-ansible-server-image:0.4.4 (no longer produced, last update to Nexus on Jun 06 2019) (hardcoded, real images used) | Project unmaintained, CSIT disabled: APPC-1910 - Getting issue details... STATUS | |
clamp (disabled) | nexus3.onap.org:10001/onap/clamp-backend:4.1-STAGING-latest (hardcoded) The docker-compose.yml and source of the images is clamp | mariadb:10.5.4 python:2-slim | Project unmaintained, CSIT disabled: CLAMP-952 - Getting issue details... STATUS | ||||
| music (disabled) | music-master-verify-csit-music-distributed-kv-store-test-plan | music-distributed-kv-store-master-docker-golang-shell-daily | nexus3.onap.org:10001/onap/music/distributed-kv-store (hardcoded, latest by default) | music-distributed-kv-store-master-docker-golang-shell-daily | - | Project unmaintained, CSIT disabled: MUSIC-613 - Getting issue details... STATUS | |
| usecases (disabled? but how?) |