This is an overview of the state of readiness for moving to project-specific CSIT per project at the end of Honolulu release
TBD: The aspects to be considered:
- produced docker images and method of production
- cross-project dependencies
- execution time (including artifact and docker builds)
- use of Nexus in various phases
Active projects
Project | Status | Produced docker images | CSIT jobs | CSIT job triggers | Tested docker images and repositories | Docker build jobs that create the tested images | CSIT Dependencies | Comments |
---|---|---|---|---|---|---|---|---|
ccsdk | Project-specific CSIT in use under ccsdk/distribution | Produced by docker-maven-plugin ccsdk-odlsli-alpine-image:latest ccsdk-dgbuilder-image:latest (+ many others that are not separately tested) | ccsdk-distribution-review-verification-maven-master ccsdk-distribution-merge-verification-maven-master | Review and merge triggers | ccsdk-odlsli-alpine-image:latest ccsdk-dgbuilder-image:latest Technically the source repository for the above images is ccsdk/distribution, but in reality their contents are collected from various other ccsdk repositories via repository zip maven dependencies | Built locally within the verification jobs | mysql/mysql-server:5.6 | The tested images have some tricky build-time dependencies to other docker images that are also built on the fly - their tagging and references should be improved (TODO: create Jira) |
ccsdk-oran | Project-specific CSIT in use under ccsdk/oran | onap/ccsdk-oran-a1policymanagementservice (1.2.0-SNAPSHOT for master, 1.1.3-SNAPSHOT for Honolulu, 1.0.3-SNAPSHOT for Guilin) | ccsdk-oran-review-verification-maven-master ccsdk-oran-merge-verification-maven-master ccsdk-oran-review-verification-maven-honolulu ccsdk-oran-merge-verification-maven-honolulu | Review and merge triggers | onap/ccsdk-oran-a1policymanagementservice (1.2.0-SNAPSHOT for master, 1.1.3-SNAPSHOT for Honolulu, 1.0.3-SNAPSHOT for Guilin) The source repository is ccsdk/oran | Built locally within the verification jobs | nexus3.onap.org:10003/onap/sdnc-image (2.1.0-STAGING-latest for master, nexus3.onap.org:10003/onap/sdnc-image:2.0.1-STAGING-latest for Guilin) nexus3.o-ran-sc.org:10004/o-ran-sc/nonrtric-controlpanel:2.0.0 | These tests are currently cloned from ORAN repository and they are essentially plain shell scripts that are just wrapped into Robot Note that the Robot wrapper could be removed if more flexible project-specific CSIT JJB template was created for that (TODO: create Jira if needed) |
cps | Project-specific CSIT in use under cps repository | cps-and-nf-proxy:latest (+various other images on which this is dependent) | master branch: honolulu branch: | Review and merge triggers | cps-and-nf-proxy:latest The source repository is cps | Built locally within the verification jobs | CPS is the first project to adopt project-specific CSIT design from the beginning instead of porting their tests from integration/csit | |
dcaegen2 | integration/csit in use, no current plans to move the tests to dcaegen2 repositories | Produced by docker-maven-plugin: org.onap.dcaegen2.services.son-handler:latest ____________________ Produced by docker-build.sh from ci-management: onap/org.onap.dcaegen2.services.pmsh:latest ____________________ Produced by dockerfile-maven-plugin: onap/org.onap.dcaegen2.services.components.bbs-event-processor:latest ____________________ Produced by docker-maven-plugin: org.onap.dcaegen2.services.pm-mapper:latest ____________________ Produced by docker-maven-plugin: org.onap.dcaegen2.collectors.ves.vescollector:latest ____________________ Produced by docker-maven-plugin: org.onap.dcaegen2.services.prh.prh-app-server:latest ___________________ org.onap.dcaegen2.collectors.restconfcollector:latest ___________________ org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:latest (and few other ones that are not being tested nor used in CSIT?) ____________________ org.onap.dcaegen2.collectors.datafile.datafile-app-server:latest | dcaegen2-services-son-handler-master-csit-testsuites _____________________ dcaegen2-services-pmsh-master-csit-testsuite ______________________ dcaegen2-services-bbs-event-processor-master-csit-bbs-testsuites ______________________ dcaegen2-pmmapper-master-csit-pmmapper ______________________ dcaegen2-master-csit-testsuites ______________________ dcaegen2-master-csit-prh-testsuites ______________________ dcaegen2-collectors-restconf-master-csit-testsuites _____________________ dcaegen2-collectors-hv-ves-master-csit-testsuites _____________________ dcaegen2-collectors-datafile-master-csit-ManagementInterface-suite | dcaegen2-services-son-handler-master-merge-java (does neither produce nor push docker image! Instead, it's produced by dcaegen2-services-son-handler-maven-docker-stage-master - ticket raised: - DCAEGEN2-2741Getting issue details... STATUS ) ________________________ dcaegen2-services-pmsh-docker-merge-master _________________________ dcaegen2-services-master-bbs-event-processor-merge-java _________________________ pmmapper and files-processing-config-pmmapper have no trigger jobs _________________________ dcaegen2-collectors-ves-master-merge-java (does neither produce nor push docker image! Instead, it's produced by dcaegen2-collectors-ves-maven-docker-stage-master - ticket raised: - DCAEGEN2-2742Getting issue details... STATUS ) _________________________ dcaegen2-services-prh-master-merge-java (does neither produce nor push docker image! Instead, it's produced by dcaegen2-services-prh-maven-docker-stage-master - ticket raised: - DCAEGEN2-2743Getting issue details... STATUS ) _________________________ dcaegen2-collectors-restconf-master-merge-java (does neither produce nor push docker image! Instead, it's produced by dcaegen2-collectors-restconf-maven-docker-stage-master - ticket raised: - DCAEGEN2-2744Getting issue details... STATUS ) _________________________ dcaegen2-collectors-hv-ves-master-merge-java (produces the docker image, but apparently does not push it? Instead, it - along with a few other images - is produced by dcaegen2-collectors-hv-ves-maven-docker-stage-master - ticket raised: - DCAEGEN2-2745Getting issue details... STATUS ) _________________________ Datafile CSITs have no trigger jobs _________________________ | nexus3.onap.org:10003/onap/org.onap.dcaegen2.services.son-handler:latest from dcaegen2/services/son-handler ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.services.pmsh:latest from dcaegen2/services ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.services.components.bbs-event-processor:latest from dcaegen2/services ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.services.pm-mapper:latest ______________________________________ nexus3.onap.org:10003/onap/org.onap.dcaegen2.collectors.ves.vescollector:latest ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.services.prh.prh-app-server:latest ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.restconfcollector:latest ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.hv-ves.hv-collector-main:latest ______________________________________ nexus3.onap.org:10001/onap/org.onap.dcaegen2.collectors.datafile.datafile-app-server:latest ______________________________________ (all hardcoded in various places in the tests) | dcaegen2-services-son-handler-maven-docker-stage-master (but so do dcaegen2-services-son-handler-maven-docker-stage-honolulu and dcaegen2-services-son-handler-maven-docker-stage-guilin ) ___________________ dcaegen2-services-pmsh-docker-merge-master (but so do dcaegen2-services-pmsh-docker-merge-honolulu and dcaegen2-services-pmsh-docker-merge-guilin ) ____________________ dcaegen2-services-master-bbs-event-processor-merge-java (but then there's also dcaegen2-services-bbs-event-processor-maven-docker-stage-master and dcaegen2-services-master-bbs-event-processor-verify-java also doing this, as well as some of their previous branches) ____________________ dcaegen2-services-pm-mapper-maven-docker-stage-master ____________________ dcaegen2-collectors-ves-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ dcaegen2-services-prh-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ dcaegen2-collectors-restconf-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ dcaegen2-collectors-hv-ves-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ dcaegen2-collectors-datafile-maven-docker-stage-master (but :latest is also produced by two previous branch jobs) ____________________ Common ticket for all the DCAEGEN2 jobs regarding the use of "latest" raised: - DCAEGEN2-2746Getting issue details... STATUS | A lot of simulators and other direct ambiguously referenced dependencies - TODO: raise a few tickets (this already caused an issue in pm-mapper that is using "latest" datarouter image) | |
dmaap | Transition to project CSIT in progress - buscontroller tests are already running under dmaap/buscontroller repository and the rest planned | onap/dmaap/buscontroller:latest ______________________ nexus3.onap.org:10001/onap/dmaap/datarouter-proxv:latest nexus3.onap.org:10001/onap/dmaap/datarouter-node:latest nexus3.onap.org:10001/onap/dmaap/datarouter-subscriber:latest _______________________ dmaap/messagerouter/messageservice dmaap-mr:latest | dmaap-buscontroller-review-verification-maven-master dmaap-buscontroller-merge-verification-maven-master dmaap-buscontroller-review-verification-maven-honolulu dmaap-buscontroller-merge-verification-maven-honolulu _____________________ dmaap-datarouter-master-csit-ssl-dr-suite _____________________ | Review and merge triggers ___________________ dmaap-datarouter-maven-docker-stage-master ___________________ mrpubsub CSIT has no triggers | onap/dmaap/buscontroller ________________________ nexus3.onap.org:10001/onap/dmaap/datarouter-proxv nexus3.onap.org:10001/onap/dmaap/datarouter-node nexus3.onap.org:10001/onap/dmaap/datarouter-subscriber _________________________ dmaap/messagerouter/messageservice dmaap-mr (all hardcoded, version not given so latest by default) | Built locally within the verification jobs _________________________________________ dmaap-datarouter-maven-docker-stage-master (same as job trigger) _________________________________________ Latest version of dmaap-mr comes from dmaap-messagerouter-messageservice-java-11-maven-docker-stage-master | kafka111, zookeeper, mariadb - some of these referred to just as "latest" - TODO: raise a ticket | |
modeling | integration/csit in use, no current plans to move the tests to modeling/etsicatalog | onap/modeling/etsicatalog | modeling-etsicatalog-master-csit-sanity-check | modeling-etsicatalog-master-docker-java-version-shell-daily | nexus3.onap.org:10001/onap/modeling/etsicatalog (latest by default, ticket raised: - MODELING-518Getting issue details... STATUS ) | consul:0.9.3 nexus3.onap.org:10001/onap/msb/msb_discovery nexus3.onap.org:10001/onap/msb/msb_apigateway nexus3.onap.org:10001/library/mariadb (all latest by default -TODO: raise a ticket) | ||
multicloud | integration/csit in use, no current plans to move the tests to multicloud repositories | onap/multicloud/openstack-fcaps:1.5.6 onap/multicloud/openstack-starlingx:1.5.6 onap/multicloud/vio:1.4.2 onap/multicloud/framework:1.6.0 All produced by maven-resources-plugin and maven-antrun-plugin | multicloud-fcaps-master-csit-functionality1 ___________________ multicloud-master-csit-functionality1 ___________________ multicloud-starlingx-master-csit-functionality1 ___________________ | No trigger jobs | nexus3.onap.org:10001/onap/multicloud/openstack-fcaps:1.4.1 Ticket raised for obsolete image: - MULTICLOUD-1337Getting issue details... STATUS ___________________________________________________ nexus3.onap.org:10001/onap/multicloud/vio:1.4.2 nexus3.onap.org:10001/onap/multicloud/framework:1.6.0 ____________________________________________________ nexus3.onap.org:10001/onap/multicloud/openstack-starlingx ____________________________________________________ nexus3.onap.org:10001/onap/multicloud/vio (all hardcoded, default latest for those that do not define version explicitly - TODO: raise a ticket) | Latest in Nexus3: onap/multicloud/openstack-fcaps:1.4.1 is from Sep 04 2019 https://jenkins.onap.org/view/multicloud/job/multicloud-openstack-maven-docker-stage-elalto produces version 1.4.3 of onap/multicloud/openstack-fcaps nexus3.onap.org:10001/onap/multicloud/openstack-fcaps:1.5.6 generated by multicloud-openstack-maven-docker-stage-master __________________________ Latest in Nexus: https://jenkins.onap.org/view/multicloud/job/multicloud-framework-maven-docker-stage-master produces version 1.6.0 (and also latest) of onap/multicloud/framework multicloud-openstack-maven-docker-stage-master produces version 1.5.6 (and also latest) ofonap/multicloud/openstack-fcaps and onap/multicloud/openstack-starlingx multicloud-openstack-vmware-maven-docker-stage-master produces version 1.4.2 (and also latest) of onap/multicloud/vio Why are there jobs only for el-Alto and master? Worth a ticket? | - | |
oom-platform-cert-service | integration/csit in use, no current plans to move the tests to oom/platform/cert-service repository | onap/org.onap.oom.platform.cert-service.oom-certservice-api:latest onap/org.onap.oom.platform.cert-service.oom-certservice-post-processor:latest generated by docker-maven-plugin | oom-platform-cert-service-master-csit-certservice ____________________ | No trigger jobs | nexus3.onap.org:10001/onap/org.onap.oom.platform.cert-service.oom-certservice-api:latest __________________________ nexus3.onap.org:10001/onap/org.onap.oom.platform.cert-service.oom-certservice-post-processor:latest (but started in Robot test and defined in Robot variable so it would be theoretically overridable) | oom-platform-cert-service-maven-docker-stage-master (for both) | primekey/ejbca-ce:6.15.2.5 |
|
optf | nexus3.onap.org:10003/onap/optf-osdf:latest __________________________ nexus3.onap.org:10003/onap/optf-has:latest _________________________ nexus3.onap.org:10001/onap/optf-cmso-service:latest nexus3.onap.org:10001/onap/optf-cmso-dbinit:latest nexus3.onap.org:10001/onap/optf-cmso-topology:latest nexus3.onap.org:10001/onap/optf-cmso-ticketmgt:latest nexus3.onap.org:10001/onap/optf-cmso-optimizer:latest nexus3.onap.org:10001/onap/optf-cmso-robot:latest All generated by docker-maven-plugin | optf-osdf-review-verification-maven-master optf-osdf-merge-verification-maven-master optf-osdf-review-verification-maven-honolulu optf-osdf-merge-verification-maven-honolulu ________________ optf-has-review-verification-maven-master optf-has-merge-verification-maven-master optf-has-review-verification-maven-honolulu optf-has-merge-verification-maven-honolulu __________________ | No trigger jobs | nexus3.onap.org:10003/onap/optf-osdf:latest __________________________ nexus3.onap.org:10003/onap/optf-has:latest _________________________ nexus3.onap.org:10001/onap/optf-cmso-service:latest nexus3.onap.org:10001/onap/optf-cmso-dbinit:latest nexus3.onap.org:10001/onap/optf-cmso-topology:latest nexus3.onap.org:10001/onap/optf-cmso-ticketmgt:latest nexus3.onap.org:10001/onap/optf-cmso-optimizer:latest nexus3.onap.org:10001/onap/optf-cmso-robot:latest (!! The actual Robot tests run here in setup phase instead of as separate Robot tests from CSIT repo) | optf-osdf and optf-has images built locally within the verification jobs __________________________ optf-cmso-maven-docker-stage-master (the frankfurt versions of the above jobs are also pushing the same images with "latest" - waiving a ticket for now since the cmso is to be moved under project) | nexus3.onap.org:10001/onap/aaf/sms (this was produced by some aaf-sms job that no longer even exists - is this safe?) | ||
policy | Policy projects have somewhat of a hybrid model; all the policy CSITs have been moved to project repositories, but they are using custom templates for separate CSIT jobs that are still executed after reviews and merges Also, guilin and frankfurt branches are still running maintenance CSITs from integration/csit | policy-apex-pdp-master-project-csit-apex-pdp policy-api-master-project-csit-api policy-distribution-master-project-csit-distribution policy-drools-applications-master-project-csit-drools-applications policy-drools-pdp-master-project-csit-drools-pdp policy-pap-master-project-csit-pap policy-xacml-pdp-master-project-csit-xacml-pdp policy-apex-pdp-honolulu-project-csit-apex-pdp policy-api-honolulu-project-csit-api policy-distribution-honolulu-project-csit-distribution policy-drools-applications-honolulu-project-csit-drools-applications policy-drools-pdp-honolulu-project-csit-drools-pdp policy-pap-honolulu-project-csit-pap policy-xacml-pdp-honolulu-project-csit-xacml-pdp | policy-apex-pdp-master-merge-java policy-distribution-master-merge-java policy-drools-applications-master-merge-java policy-drools-pdp-master-merge-java policy-xacml-pdp-master-merge-java | Dynamic image version resolution based on GERRIT_BRANCH and pom.xmls in the referred branches of the related repositories amended with "SNAPSHOT-latest" | Same as triggers | Policy components have a lot of dependencies between each other and the CSITs are currently working more like integration tests rather than proper project-specific functional tests | Policy CSITs and their triggers and image references are currently almost as valid as they can be under current circumstances (the only uncertainty is related to the distinction between images under test and dependency images) | |
sdc | SDC has its legacy TestNG tests under sdc repo, incorporated into maven jobs | |||||||
sdnc | integration/csit in use, no current plans to move the tests to sdnc/oam repository | sdnc-master-csit-sdnc_netconf_tls_post_deploy | No trigger jobs | nexus3.onap.org:10001/onap/sdnc-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/sdnc-ansible-server-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/admportal-sdnc-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/sdnc-ueb-listener-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/sdnc-dmaap-listener-image/1.8-STAGING-latest nexus3.onap.org:10001/onap/ccsdk-dgbuilder-image/0.7-STAGING-latest --- nexus3.onap.org:10001/onap/sdnc-image/1.8.3-STAGING-latest The source repo is sdnc/oam | SDNC images are going at version 2.1 in master )sdnc-oam-maven-docker-stage-master) and at 2.0 in Guilin (https://jenkins.onap.org/view/sdnc/job/sdnc-oam-maven-docker-stage-guilin) Latest 1.8-STAGING-latest images are from Aug 31 2020 and 1.8.3-STAGING-latest from Jun 07 2020. These images are from Frankfurt and have no longer any jobs to generate them. | primekey/ejbca-ce:6.15.2.5 nexus3.onap.org:10001/onap/org.onap.aaf.certservice.aaf-certservice-api:latest --- nexus3.onap.org:10001/mariadb:10.1.11 | ||
so | TODO: macroflow (The jobs below - as well as their previous branches - has been disabled under - SO-3632Getting issue details... STATUS | TBD - is distinction between images under test and image dependencies clear? | ||||||
vfc | vfc-gvnfm-vnflcm-master-csit-sanity-check vfc-gvnfm-vnfres-master-csit-sanity-check vfc-nfvo-driver-vnfm-gvnfm-master-csit-sanity-check vfc-nfvo-lcm-master-csit-sanity-check | vfc-gvnfm-vnflcm-master-docker-java-version-shell-daily vfc-gvnfm-vnfres-master-docker-java-version-shell-daily vfc-nfvo-driver-vnfm-gvnfm-master-docker-java-version-shell-daily | nexus3.onap.org:10001/onap/vfc/vnflcm nexus3.onap.org:10001/onap/vfc/vnfres nexus3.onap.org:10001/onap/vfc/gvnfmdriver nexus3.onap.org:10001/onap/vfc/nslcm (all latest by default) Source repositories: | Same as triggers | consul:0.9.3 nexus3.onap.org:10001/onap/msb/msb_discovery nexus3.onap.org:10001/onap/msb/msb_a nexus3.onap.org:10001/library/mariadb redis (!?) It's not clear in all cases which VFC images are under test and which are just necessary dependencies | |||
vid | nexus3.onap.org:10001/onap/vid:6.0-STAGING-latest Source repo is vid | vid-maven-docker-stage-frankfurt vid-maven-docker-stage-master produces 7.0.0 versions except for STAGING-latest, which is somehow still 6.0 - however, this is problematic as Frankfurt also produces 6.0-STAGING-latest images. Ticket raised: - VID-907Getting issue details... STATUS | nexus3.onap.org:10001/library/mariadb:10 so-simulator (specific to this suite) aai-simulator (specific to this suite) | |||||
vfsdk | vnfsdk-refrepo-master-merge-java (for both CSITs; however, this job does not produce or trigger any docker image? Ticket raised: - VNFSDK-701Getting issue details... STATUS ) | nexus3.onap.org:10001/onap/vnfsdk/refrepo/postgres:latest nexus3.onap.org:10001/onap/vnfsdk/refrepo:latest Source repo is vnfsdk/refrepo | vnfsdk-refrepo-maven-docker-stage-master Where is onap/vnfsdk/refrepo/postgres coming from? It hasn't been produced since Jul 09 2019? | What's the relevance of the marketplace CSIT now (given that it's testing postgres image that hasn't been built for over a year)? |
Disabled projects
Projects with CSIT | Docker images | CSIT jobs | CSIT job triggers | Tested docker images and repositories | Docker build jobs that create the tested images | Dependencies | Comments |
---|---|---|---|---|---|---|---|
aaf (disabled) | aaf-frankfurt-csit-certservice Frankfurt branch only? The tests triggered from here do not even exist in master (on the other hand, there are no Jenkins jobs for still remaining aafapi and sms-test-plan?) | aaf-certservice-frankfurt-merge-java - this job neither builds a docker image nor triggers another job that does it, so why trigger CSIT? | nexus3.onap.org:10001/onap/ org.onap.aaf.certservice.aaf-certservice-api:frankfurt-latest (hardcoded) The source repository is aaf/certservice | aaf-certservice-maven-docker-stage-frankfurt (note that aaf-certservice-release-verify and aaf-certservice-release-merge also build aaf-certservice-api image, but not with frankfurt-latest tag) | primekey/ejbca-ce:6.15.2.5 (hardcoded, real image used) | ||
appc (disabled) | appc-master-csit-healthcheck | - | nexus3.onap.org:10001/onap/appc-image:1.7.2-SNAPSHOT-latest nexus3.onap.org:10001/onap/appc-cdt-image:1.7.2-SNAPSHOT-latest (hardcoded) docker-compose.yml as well as appc-image and appc-cdt-image come from appc/deployment | No job is producing these images at the moment! appc-deployment-master-docker-java-daily produces 1.8.0-SNAPSHOT-latest and appc-deployment-frankfurt-docker-java-daily is producing 1.7.3-SNAPSHOT-latest 1.7.2-SNAPSHOT-latest images have not been created since May 27 | mariadb:10.4.3 nexus3.onap.org:10001/onap/ccsdk-dgbuilder-image:0.6.0 (no longer produced, last update to Nexus on Aug 30 2019) nexus3.onap.org:10001/onap/ccsdk-ansible-server-image:0.4.4 (no longer produced, last update to Nexus on Jun 06 2019) (hardcoded, real images used) | ||
clamp (disabled) | nexus3.onap.org:10001/onap/clamp-backend:4.1-STAGING-latest (hardcoded) The docker-compose.yml and source of the images is clamp | mariadb:10.5.4 python:2-slim | |||||
music (disabled) | music-master-verify-csit-music-distributed-kv-store-test-plan | music-distributed-kv-store-master-docker-golang-shell-daily | nexus3.onap.org:10001/onap/music/distributed-kv-store (hardcoded, latest by default) | music-distributed-kv-store-master-docker-golang-shell-daily | - | ||
usecases (disabled? but how?) |