- Action point follow-up
- AP1 Illia Halych : ask OOM for the right place to host helm chart
- unformal exchange. For CDS helm charts are stored intestsuite/cds/mock-* until we coudl move the helm charts to a helm registry
- AP2 Andreas Geissler add warning in doc for backup and restore
- patch done
- AP3 Morgan Richomme contact TSC regarding B&R task force and possible scenario for Honolulu
- done, mail sent, Catherine Lefevre answered and agreed on shortmid term plans
- AP4 Morgan Richomme test basic-pnf (macro) on daily master before integrating thsi use case in CI
- done, test issues reported to Michał Jagiełło and added in
Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key INT-1822
- done, test issues reported to Michał Jagiełło and added in
- AP1 Illia Halych : ask OOM for the right place to host helm chart
- Admin
- congratulation to the team for the S3P..now it will be cool to fix the issues in Master/Gating
- windriver re-installation: to be planned after honolulu => answer sent to Intel team
- Azure Staging lab reinstalled
- #acrion Morgan Richomme send a mail to the community to indicate that staging azure is back (guilin maintenance release as master is broken)
- congratulation to the team for the S3P..now it will be cool to fix the issues in Master/Gating
- Honolulu
- Troubleshooting campaign status: INT-1883 - Reccurent various errors in smoke tests In Progress
- several issues found
- SDC races => including offset to move to pseudo sequential seems to reduces the number of SDC issues. Still one where ceritification seems to take to much time => possibility to add a workaround in the test to retry and/or delay the creation/certification
- #action Morgan Richomme amend pythonsdk_tests to include the workaround
- VID 500 due to the presence of a "U" char in random password (which explains why we did not have always the error...à - deobuscated by VID even if not obfuscated using jetty library interprating U as unicode char breaking everything. Problem found and fixed by Krzysztof Opasiak => last gating seems reasonably better
- SO error (so-bpmn stuck) was alsready observed time to time in guilin, so it is not a new problem...it explains why sometimes an instantiation takes 3 minutes sometimes 20, a jIRA had been created on this aspect
Jira server ONAP JIRA serverId 425b2b0a-557c-3c0c-b515-579789cceedb key SO-3419 - rebase/remerge in gate in progress...gates will burn over the next days...but it means that master chains should be back and usable
- SDC races => including offset to move to pseudo sequential seems to reduces the number of SDC issues. Still one where ceritification seems to take to much time => possibility to add a workaround in the test to retry and/or delay the creation/certification
- several issues found
- Automated tests
- demo Apex pdp Policy Santosh bayas Prudence Au
- test done on Bell labs, adaptation needed to be intgrated in CI (config in a dedicated file not leveraging CM information)..
- #Action Santosh bayas identify inputs to see if parameters are missing + publish robot code in testsuite for review
- test done on Bell labs, adaptation needed to be intgrated in CI (config in a dedicated file not leveraging CM information)..
- CDS regression test (session with Jozsef Csongvai planned on thursday to give a try on Orange lab and see how we can integrate in CI - helm chart finally with docker file in mock repositories)
- mock in gates
- troubleshooting planned on thursday
- DCAEmod, 5Gbulkpm evolution (Krzysztof Kuzmicki ) → Morgan Richomme
- Could we move this point to next week when bulkpm over HTTPS server will be finished and DCAEMOD in daily CI ?
- #action Morgan Richomme Krzysztof Kuzmicki check why we have a path difference between execution in the robot pod and in the xtesting docker
- pythonsdk (pnf, clamp, .., removal of the submodule, patch to allow test replay)
- tern integration in CI Alexander Mazuruk Morgan Richomme - how to test/troubleshoot ansible par
- user-98b79 provides follow up in the MR https://gitlab.com/Orange-OpenSource/lfn/onap/xtesting-onap/-/merge_requests/37
- #action Morgan Richomme reriew MR for the integration of tern in ci-weekly
- #agreed moved weekly reinstallation on Friday next week
- user-98b79 provides follow up in the MR https://gitlab.com/Orange-OpenSource/lfn/onap/xtesting-onap/-/merge_requests/37
- demo Apex pdp Policy Santosh bayas Prudence Au
- S3P tests
- back on B&R mail to the community => only resilience tests to be planned for Honolulu
- stability => target?
- wait for master stabilization
- Figures to be decided: 5 // onboarding during 48, 20 // instantiation during 48?
- feed back on first test executed with litmus
- k8s chaos monkey framework
- it was possible to anote onap component and generate chaos..coudl be used for resiliency testing to check that components are recovering
- use cases
- who knows the list of Honolulu use cases?..
- Lukasz Rajewski shared the link with the Honolulu Release Requirements
- no requests received so far
- no documentation changes seen
- #action Morgan Richomme contact use case owner to collect the possible needs and remind the need to update teh doc
- who knows the list of Honolulu use cases?..
- Troubleshooting campaign status: INT-1883 - Reccurent various errors in smoke tests In Progress
- Istambul => for information to be discussed next week
- Move Robot pod out of ONAP cluster (including robot)
- certificate and robot pod to be executed in onap-testing cluster
- CI dashboard: improved dashboard to identify regression over time (see xls graphs) - muti platforms?
- PythonSDK
- which tests? what is poorly covered?
- vFWCL? scaleout?
- NBI
- basic loop (basic_clamp extended)
- which tests? what is poorly covered?
- Add a retry capability in CI? other rules (if onap-helm or onap-k8s Fail "too much" => do not execute E2E tests to save CI time?)
- Robot refactoring: target (slot planned after the meeting if we are short in time)
- #action Morgan Richomme Krzysztof Kuzmicki create Epic and tasks to detail expectations on robot pod refactoring (alpine, split web/robot, python3, execution from outside the cluster, use python baseline image,....)
- Move Robot pod out of ONAP cluster (including robot)
- AoB
- AP1: Morgan Richomme amend pythonsdk_tests to include the workaround
- AP2: Santosh bayas identify inputs to see if parameters are missing + publish robot code in testsuite for review
- AP3: Morgan Richomme Krzysztof Kuzmicki check why we have a path difference between execution in the robot pod and in the xtesting docker
- AP4: Morgan Richomme review MR from user-98b79 for the integration of tern in ci-weekly
- AP5: Morgan Richomme contact use case owner to collect the possible needs and remind the need to update the doc
- AP6: Morgan Richomme Krzysztof Kuzmicki create Epic and tasks to detail expectations on robot pod refactoring (alpine, split web/robot, python3, execution from outside the cluster, use python baseline image,....)
- Action point follow-up
- AP1: Andreas Geissler check if doc of the official use cases are excplictely referencing the robot pod
- not done yet
- AP2: Morgan Richomme include Nokia pod in onap-integration web site
- AP3: all help reviewing the OOM patches to give Integration feedback
- in progress see next section
- AP1: Andreas Geissler check if doc of the official use cases are excplictely referencing the robot pod
- Admin
- Honolulu
- pythonsdk
- smoke test issues (basic_vnf, basic_cnf) 10'
last master daily results
01/03/21 03/03/21 04/03/21 05/03/21 06/03/21 08/03/21 basic_onboard OK KO OK KO OK OK basic_cds OK OK OK OK OK OK basic_vm KO KO KO KO KO KO basic_cnf OK KO KO KO KO KO basic_network OK KO KO KO KO OK Pnf-registrate OK KO OK OK KO OK 5gbulkpm OK OK OK OK OK OK Issues
- VID: - VID-960VID exception on E2E tests In Progress
- 500 on SDC (multi retry on SDC component get versions)
- gitlab.com issues (runner problems)
- today the daily guilin and the daily master are very different, daily guiling is 100% OK from E2E perspective, daily master is still bad
- however it is exactly teh same code xtesting-smoke-usecases:master and the same launch xtesting-onap:master
- the only difference is due to master changes
- review of the OOM Master patches from the 17/2 (all gates look pretty good). Daily master of th 18 and 19 were also good (not the daily from the 1st of March was not that bad as well..)
Merge Date Date of the last patchset (or rebase) used for gating ID Patch Status
At least 2 of the 3 basic_ E2E tests OK)links Comments 17/02/21 00:12:00 12/02/21 08:48:00 117758 [AAF] Give `identities.dat` to working deployments OK https://logs.onap.org/onap-integration/gating//117758-3/index.html basic_cnf and basic_network OK pb of SDC with basic_vm 17/02/21 12:13:00 16/02/21 13:34:00 114505 [MSB] Use certInitializer for MSB OK https://logs.onap.org/onap-integration/experimental-gating//114505-24/index.html 17/02/21 12:18:00 16/02/21 08:07:00 117909 [AAI] Add multi.tenancy.enabled flag to keycloak properties file OK https://logs.onap.org/onap-integration/gating//117909-2/index.html 18/02/21 16:27:00 18/02/21 08:15:00 117881 [APPC][CDT] Automatically retrieve certificates OK https://logs.onap.org/onap-integration/gating//117881-4/index.html 18/02/21 16:35:00 17/02/21 15:22:00 117807 [AAI][SPARKY] Updating the sparky config OK https://logs.onap.org/onap-integration/gating//117807-4/index.html 19/02/21 22:17:00 11/02/21 23:28:00 117743 [GENERAL] Fix failed chart list reporting in deploy plugin KO https://logs.onap.org/onap-integration/gating//117743-1/index.html 20/02/21 01:06:00 17/02/21 10:13:00 117936 [DCAEGEN2] Update inventory Api to 3.5. KO https://logs.onap.org/onap-integration/gating//117936-1/index.html 19/02/21 17:41:00 19/02/21 20:33:00 117753 [SDNC] Fix issue with certs from CMPv2 by Netconf (TLS) KO https://logs.onap.org/onap-integration/gating//117753-6/index.html note patchet 5 executed on the 15/02 os OK https://logs.onap.org/onap-integration/experimental-gating//117753-5/index.html 20/02/21 20:23:00 18/02/21 15:48:00 118049 [NBI] Fix image name OK https://logs.onap.org/onap-integration/gating//118049-1/index.html 22/02/21 15:17:00 18/02/21 23:50:00 118076 [GENERAL] Fix setting of HELM_VER variable KO https://logs.onap.org/onap-integration/experimental-gating//118076-1/index.html 22/02/21 15:22:00 20/02/21 16:54:00 117921 [AAI] Move schema service to use v23 OK https://logs.onap.org/onap-integration/gating//117921-2/index.html 22/02/21 15:31:00 18/02/21 09:07:00 117991 [DCAEGEN2] Use generic makefiles KO https://logs.onap.org/onap-integration/gating//117991-3/index.html 22/02/21 15:47:00 19/02/21 15:19:00 117889 [CLI] Retrieve certificates automatically KO https://logs.onap.org/onap-integration/gating//117889-6/index.html test from the 16/02 (patchset 2) OK (https://logs.onap.org/onap-integration/gating//117889-2/index.html)
test from the 17/02 OK (https://logs.onap.org/onap-integration/experimental-gating//117889-2/index.html)test from the 18/2 (1:29) KO (https://logs.onap.org/onap-integration/gating//117889-3/index.html)But installation is failing
19/2 KO (https://logs.onap.org/onap-integration/gating//117889-6/index.html) (lots of HC KO)22/02/21 15:40:00 18/02/21 19:11:00 117858 [GENERAL] Print helm binary used OK https://logs.onap.org/onap-integration/gating//117921-2/index.html 23/02/21 12:05:00 22/02/21 16:26:00 118171 [GENERIC][CASSANDRA] Loosen probe check time KO https://logs.onap.org/onap-integration/gating//118171-1/index.html 23/02/21 12:15:00 22/02/21 15:53:00 116836 [AAI][RESOURCES] Remove Hardcoded certificates KO https://logs.onap.org/onap-integration/gating//116386-22/index.html 12/2 (patchset 19) OK (https://logs.onap.org/onap-integration/gating//116386-19/index.html)
17/2 (patchset 20) KO – VID issue
18/2 18:00(patchset 21) basic_cnf OK
19/2 (patchset 21 oom _redeploy) OK (https://logs.onap.org/onap-integration/gating//116386-21/index.html)
22/2 (patchset 22) basic_network ok bit other basic failed23/02/21 10:09:00 22/02/21 15:51:00 117828 [AAI][TRAVERSAL] Remove Hardcoded certificates KO https://logs.onap.org/onap-integration/gating//117828-6/index.html Patchset 4 (18/02 21:00) is fully OK (https://logs.onap.org/onap-integration/gating//117828-4/index.html) something seems broken since the 19/2...only 3 patches have been merged around this date: 117743, 117936, 117753
the subsequent OK correspond to patch whose tests have been executed earlier but merge after the 20/2, revert in progress to see if one of the 3 patches coudl be a root cause of the regression on the gating chain
- smoke test issues (basic_vnf, basic_cnf) 10'
- pythonsdk
...