- Action point follow-up
- AP1: Andreas Geissler check if doc of the official use cases are excplictely referencing the robot pod
- not done yet
- AP2: Morgan Richomme include Nokia pod in onap-integration web site
- AP3: all help reviewing the OOM patches to give Integration feedback
- in progress see next section
- AP1: Andreas Geissler check if doc of the official use cases are excplictely referencing the robot pod
- Admin
- Honolulu
- pythonsdk
- smoke test issues (basic_vnf, basic_cnf) 10'
last master daily results
01/03/21 03/03/21 04/03/21 05/03/21 06/03/21 08/03/21 basic_onboard OK KO OK KO OK OK basic_cds OK OK OK OK OK OK basic_vm KO KO KO KO KO KO basic_cnf OK KO KO KO KO KO basic_network OK KO KO KO KO OK Pnf-registrate OK KO OK OK KO OK 5gbulkpm OK OK OK OK OK OK Issues
- VID: VID-960 - VID exception on E2E tests In Progress
- 500 on SDC (multi retry on SDC component get versions)
- gitlab.com issues (runner problems)
- today the daily guilin and the daily master are very different, daily guiling is 100% OK from E2E perspective, daily master is still bad
- however it is exactly teh same code xtesting-smoke-usecases:master and the same launch xtesting-onap:master
- the only difference is due to master changes
- review of the OOM Master patches from the 17/2 (all gates look pretty good). Daily master of th 18 and 19 were also good (not the daily from the 1st of March was not that bad as well..)
Merge Date Date of the last patchset (or rebase) used for gating ID Patch Status
At least 2 of the 3 basic_ E2E tests OK)links Comments 17/02/21 00:12:00 12/02/21 08:48:00 117758 [AAF] Give `identities.dat` to working deployments OK https://logs.onap.org/onap-integration/gating//117758-3/index.html basic_cnf and basic_network OK pb of SDC with basic_vm 17/02/21 12:13:00 16/02/21 13:34:00 114505 [MSB] Use certInitializer for MSB OK https://logs.onap.org/onap-integration/experimental-gating//114505-24/index.html 17/02/21 12:18:00 16/02/21 08:07:00 117909 [AAI] Add multi.tenancy.enabled flag to keycloak properties file OK https://logs.onap.org/onap-integration/gating//117909-2/index.html 18/02/21 16:27:00 18/02/21 08:15:00 117881 [APPC][CDT] Automatically retrieve certificates OK https://logs.onap.org/onap-integration/gating//117881-4/index.html 18/02/21 16:35:00 17/02/21 15:22:00 117807 [AAI][SPARKY] Updating the sparky config OK https://logs.onap.org/onap-integration/gating//117807-4/index.html 19/02/21 22:17:00 11/02/21 23:28:00 117743 [GENERAL] Fix failed chart list reporting in deploy plugin KO https://logs.onap.org/onap-integration/gating//117743-1/index.html 20/02/21 01:06:00 17/02/21 10:13:00 117936 [DCAEGEN2] Update inventory Api to 3.5. KO https://logs.onap.org/onap-integration/gating//117936-1/index.html 19/02/21 17:41:00 19/02/21 20:33:00 117753 [SDNC] Fix issue with certs from CMPv2 by Netconf (TLS) KO https://logs.onap.org/onap-integration/gating//117753-6/index.html note patchet 5 executed on the 15/02 os OK https://logs.onap.org/onap-integration/experimental-gating//117753-5/index.html 20/02/21 20:23:00 18/02/21 15:48:00 118049 [NBI] Fix image name OK https://logs.onap.org/onap-integration/gating//118049-1/index.html 22/02/21 15:17:00 18/02/21 23:50:00 118076 [GENERAL] Fix setting of HELM_VER variable KO https://logs.onap.org/onap-integration/experimental-gating//118076-1/index.html 22/02/21 15:22:00 20/02/21 16:54:00 117921 [AAI] Move schema service to use v23 OK https://logs.onap.org/onap-integration/gating//117921-2/index.html 22/02/21 15:31:00 18/02/21 09:07:00 117991 [DCAEGEN2] Use generic makefiles KO https://logs.onap.org/onap-integration/gating//117991-3/index.html 22/02/21 15:47:00 19/02/21 15:19:00 117889 [CLI] Retrieve certificates automatically KO https://logs.onap.org/onap-integration/gating//117889-6/index.html test from the 16/02 (patchset 2) OK (https://logs.onap.org/onap-integration/gating//117889-2/index.html)
test from the 17/02 OK (https://logs.onap.org/onap-integration/experimental-gating//117889-2/index.html)test from the 18/2 (1:29) KO (https://logs.onap.org/onap-integration/gating//117889-3/index.html)But installation is failing
19/2 KO (https://logs.onap.org/onap-integration/gating//117889-6/index.html) (lots of HC KO)22/02/21 15:40:00 18/02/21 19:11:00 117858 [GENERAL] Print helm binary used OK https://logs.onap.org/onap-integration/gating//117921-2/index.html 23/02/21 12:05:00 22/02/21 16:26:00 118171 [GENERIC][CASSANDRA] Loosen probe check time KO https://logs.onap.org/onap-integration/gating//118171-1/index.html 23/02/21 12:15:00 22/02/21 15:53:00 116836 [AAI][RESOURCES] Remove Hardcoded certificates KO https://logs.onap.org/onap-integration/gating//116386-22/index.html 12/2 (patchset 19) OK (https://logs.onap.org/onap-integration/gating//116386-19/index.html)
17/2 (patchset 20) KO – VID issue
18/2 18:00(patchset 21) basic_cnf OK
19/2 (patchset 21 oom _redeploy) OK (https://logs.onap.org/onap-integration/gating//116386-21/index.html)
22/2 (patchset 22) basic_network ok bit other basic failed23/02/21 10:09:00 22/02/21 15:51:00 117828 [AAI][TRAVERSAL] Remove Hardcoded certificates KO https://logs.onap.org/onap-integration/gating//117828-6/index.html Patchset 4 (18/02 21:00) is fully OK (https://logs.onap.org/onap-integration/gating//117828-4/index.html) something seems broken since the 19/2...only 3 patches have been merged around this date: 117743, 117936, 117753
the subsequent OK correspond to patch whose tests have been executed earlier but merge after the 20/2, revert in progress to see if one of the 3 patches coudl be a root cause of the regression on the gating chain
- smoke test issues (basic_vnf, basic_cnf) 10'
- pythonsdk
- sequential versus parallel
- tests planned to move to E2E sequential to avoid side effect due to parallelization. Parallel tests could be done on weekly...need to fist master and gating chains first.
- sequential versus parallel
- tests update (Michal Jagiello 15' )
- pnf (macro flow)
- ready to be tested (logger fixed)
- #action morgan test basic-pnf on daily
- exceptions not caught
- patch provided
- basic_clamp
- almost there: last issue due to DCAE TCA, seems tehre is a regression on dcae due to python2.7 / Python3 =>
. Wait for fix before retrying.Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key INT-1822
- almost there: last issue due to DCAE TCA, seems tehre is a regression on dcae due to python2.7 / Python3 =>
- wrapper
- OK, question on where to host the helm charts for the simulator (pnf and future one)
- #action contact OOM team => similar question than the for CDS mock objects
- it is possible to remove the submodule - just be carefull, once removed => possible to deploy onapsdk as a "standard module" no more as developer module => impact on xtesting-onap as the paces will be different
- pnf (macro flow)
- Backup/restore Morgan Richomme 15' Backup_and_restore_discussion.pdf
- discussion on a realistic use case...
- backup and restore seems too optimistic
- consensus to work on the resiliency of the core component
- #action Andreas Geissler warning shall be added in the documentation, as aarna network is not really usable for a real backup/restore (more some examples to use velero)
- Companies that tried velero has issues due to teh fact that ONAP is not really cloud native
- discussion on a realistic use case...
- AoB
- cmpv2 about to be moved from healthcheck to smoke
- Krzysztof Kuzmicki indicates that 5Gbulkpm will be updated ..may have some turbulences during the update
Actions
- AP1 Illia Halych : ask OOM for the rright place to host helm chart
- AP2 Andreas Geissler add warning in doc for backup and restore
- AP3 Morgan Richomme contact TSC regarding B&R task force and possible scenario for Honolulu
- AP4 Morgan Richomme test basic-pnf (macro) on daily master before integrating thsi use case in CI
- Action point follow-up
- no action point from last week (several docs)
- action point from the 17/02
- AP1: Morgan Richomme : contact vcpe tosca team to get their position in Honolulu (
)Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key TEST-239 - done no feedback on the JIra
- AP2: user-98b79 : get the list of projects using the baseline images
- done
- AP3: Illia Halych amend https://gerrit.onap.org/r/c/testsuite/pythonsdk-tests/+/117192 for helm3 support
- done
- AP4: Morgan Richomme test basic_pnf on Orange daily master with onaptests:master
- not done PTO..but I can reaction myself;.
- AP5: Michał Jagiełło Morgan Richomme test carefully before submitting until we got a gate to do it...
- not really an action point but the advise is wise...be carefull after removing the submodules + change the xtesting installation (using standard python module not developer way...xtesting-onap shall follow)
- AP6: Krzysztof Kuzmicki prepare a 10 minutes demo on pnf-simu to nf-simu (explaning the graph shared by mail)
- done
- AP7: Marcin Przybysz plan a demo of VID new UI, how to launch it, how it is used in PNF macromode + see with VID how we can manage tests that are using legacy VID..
- done
- AP8: Morgan Richomme contact Kenny Paul for the status of the slack chan
- done it is a free chan, no idea how LF decides to pay for a non free chan..if community thinks that we shall be able to keep the history and then take a non free chan, it is possible to report it to the TSC
- AP1: Morgan Richomme : contact vcpe tosca team to get their position in Honolulu (
- Admin
- A1 policy enforcement created
- nf repo created (Krzysztof Kuzmicki )
- M3 is over..JIRA review needed to know what is possible (support/test cases/) what shall be postponed...
- release cadence is new, some projects were surprised. No new code will be accepted in OOM gate. Lots of patches submitted...gating system under pressure..wait for merge to reach the RC0
- Honolulu (M3 is over..)
- CSIT issue with python2.7/Python3 (Lasse Kaihlavirta Morgan Richomme )
- fix submitted by user-98b79
- list of jenkins images known in CSIT repo but not sure it is documented. Some issues due to python 2.7/3.5/3.6/3.7/3.8/3.9...lib dependency issues NB the seccom recommended version is the 3.9
- Refactoring of testsuite
- python2.7/micro service/root
- cert
- helm chart
- Lukasz Rajewski and Andreas Geissler suggest to put the effort on migrating to pythonsdk rather than maintaining the pod
- Morgan Richomme reminds that robot tests are run through pythonsdk, the question is linked to the robot pod not the ability to run robotframework test cases, which is always possible. Who is using the e2e scripts that trigger processing on the robot pod. Lasse Kaihlavirta indicates that some usecases (under upstreaming (A1)) are in this case. For Honolulu we may ask for a waiver and remove the pod in Istambul (is nobody is using it). Morgan Richomme sent a mail to the community but no feedback so far. Scaleout and vFWCL still probably requires the pod, other usercases requires also the init offered by the bash scripts #action Andreas Geissler look in the doc which use cases explicitely make reference to the scripts in the official documentation
- status on CI/CD (delta guilin) (Morgan Richomme )
- New Nokia dualstack lab added in the pool of lab reporting results http://testresults.opnfv.org/onap/api/v1/results?last=5&case_name=full&pod=ci-dualstack-master-daily
- IPv4/IPv6 server, ONAP Master daily => results shared with the community in LF backend + Test DB
- shall we update http://testresults.opnfv.org/onap-integration/ ?
- Daniel Milaszkiewicz OK #action morgan add Nokia in http://testresults.opnfv.org/onap-integration/
- Master is currently not that bad: https://logs.onap.org/onap-integration/daily/onap_daily_pod4_master/03-01-2021_06-03/
- error due to internal cert executed in onap ns (shall be moved to an external ns)
- 1 error on enhanced policy => policy anticipated the OOM merge and already adapted the test, it shall be back OK once the new policy dockers woudl be merged
- 1 error in E2E due to SDC (exception not caught)
- lots of patch in OOM gate..if lots of errors it is not normal as the master is reasonably stable...
- #action all help reviewing the OOM patches to give Integration feedback
- Guilin is not good
- same CI errors in DT and Orange
- runnign the tests directly is usually good => issue in the way to launch the test in guilin
- "old" ansible version in the xtesting-onap branch
- tests in progress to use xtesting-onap master (assuming that the test version is provided by a env variable already) => no need of specific branch
- delta guilin/current master shared with the community
- https://docs.google.com/spreadsheets/d/1t3GNRtabdkVxG4ZAxqBJ-X7OO-Zv6xRwd8KrR52V9zU
- as usual some projects anticipate and provided features continuously (Policy, DCAE, NBI, OOF, OOM), some did not...which explains the gating bottlneck due to the M3
- New Nokia dualstack lab added in the pool of lab reporting results http://testresults.opnfv.org/onap/api/v1/results?last=5&case_name=full&pod=ci-dualstack-master-daily
- security test update
- tern (Alexander Mazuruk user-98b79 )
- last results: https://logs.onap.org/onap-integration/daily/onap_weekly_pod4_master/02-25-2021_02-02/security/tern/
- patch submitted to fix some projects ..but they have no gating so manual test needed
- first patch submitted
- advantage, it will be easier to chase CVE if we can rely on baseline images
- issues with Python (and lib dependencies) but few components dealing with python
- next steps work on teh integration as a weekly job in xtesting-onap to run automatically tern everyweek
- versions still some issue in weekly chain + reporting to be integrated
- patch merged for the bug
- results of last week shared => https://logs.onap.org/onap-integration/daily/onap_weekly_pod4_master/02-25-2021_02-02/security/versions/versions/index.html
- core/internal nodeports tests can be long ..any idea how to parallelize
- wait for Paweł Wieczorek come back as same issue than for versions
- tern (Alexander Mazuruk user-98b79 )
- Backup & restore
- postponed to next week
- simu question on the availability of the E// pnf simu availability in nexus AJAY SINGH
- answer sent by mai, changes done broke the built chain => after 40 days the snampshot images are removed, as the image was not released and not rebuilt, expiration date was reached => need to fix the build or to release an old version (pretty sure that jenkins history is also cleaned..so probably not possible)
- CSIT issue with python2.7/Python3 (Lasse Kaihlavirta Morgan Richomme )
- AoB
- Action points for next meeting
...