Info |
---|
SONARQUBE SUPPORT WILL END FEB-20Please make sure there are no components left in SonarQube Please implement SonarCloud coverage drop fix explained below |
Timeline of events
To prevent dependency issues, this migration is planned to happen in 2 stages.
Stage 1 will use hardcoded sonar goals to the needed plugin version to avoid waiting on dependencies from where this can be inherited.
Stage 2 will be a cleanup stage and work towards fixing the plugin in the dependencies like oparent and slowly migrate teams to it while removing hardcoded sonar goals.
STAGE 1
- RELENG → Will add the needed changes in ci-management for each project and run a test in the sandbox
- RELENG → will post the restults of the sandbox test in the 3rd column below.
- This is not reflecting if the Sonar report actually pass or failed a quality gate. Instead, this result is the outcome of running the Sandbox job using the changes in ci-management.
- TECHTEAM → Review the results and comments posted by Releng in column 4. PTLs will be mentioned explicitly to notify them that the next action is on their team.
- TECHTEAM&RELENG → Will work on any additional comments/questions/issues from column 4 and 5.
Info |
---|
SONAR COVERAGE DROP TO 0%Sonar Cloud made an update on the jacoco plugin where they dropped support for .exec file format. We need to use .xml instead. Please look for more information in https://community.sonarsource.com/t/sonar-coverage-dropping-to-0-for-some-projects/18521/2 Some teams like APPC have upgraded their reports and coverage was restored for them. Please follow their examples: https://gerrit.onap.org/r/#/c/appc/parent/+/100156/, https://gerrit.onap.org/r/#/c/appc/+/100155/
Also, OPARENT has been updated with the fix too https://gerrit.onap.org/r/#/c/oparent/+/100168/ included in 3.0.0-SNAPSHOT |
Tableenhancer |
---|
numberOfFixedRows | 3 |
---|
decimalMark | . (point) |
---|
|
(org.sonarsource.scanner.maven)Task | Add SonarCloud variables in project's yaml files |
---|
Remove SonarQube plugin if RelEng test fails Sandbox test of my change (DO NOT CONFUSE WITH SONAR REPORT RESULT) | Review results | Comment on progress |
---|
Responsible | RelEng |
---|
PTLReleng | PTL |
|
---|
Estimated Duration |
---|
15 10 min per project including reviewsper project (including sandbox test and reviews)CCSDK parent needs to migrate first | CCSDK | Working with Dan to migrate ccsdk-parent | CLAMP | Tested and working for JDK13 but having issues with JavaScript (Contacted Sonar team) | CLI | DCAE | Demo | DMAAP | ExtAPI | Holmes | Integration | Logging | Modeling | MSB | MultiCloud | Music | OOF | OOM | O-parent | Policy | Portal | SDC | SDNC | SO | UUI | VFC | VID | VNFSDK | | https://gerrit.onap.org/r/c/ci-management/+/98545 | PASS | Takamune Cho This is marked as "PASS" becuase the build actually produced the same result as what we had in SonarQube, but I know we still are facing coverage issues. Shall we merge this change to move to SonarCloud and continue our investigation there? Jessica Wagantall I +1 already. we still have to work with the issue. I have posted my last comment on IT-17899. Please take a look. thx | Coverage drop still low, we are taking our investigation to SonarCloud but the migration is completed
Issue has been fixed. back to 80% | CCSDK | https://gerrit.onap.org/r/c/ci-management/+/98546 | PASS | Dan Timoney Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed Dan Timoney CCSDK repos now all show coverage >= 55%. | CLAMP | https://gerrit.onap.org/r/#/c/ci-management/+/98543/ | PASS | all looks ok. | Tested and working with JDK11 | CLI | https://gerrit.onap.org/r/c/ci-management/+/98547 | PASS | user-67d6f Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | completed with coverage 61 % (25 Feb 2020) https://sonarcloud.io/organizations/onap/projects/?search=cli
| DCAE | https://gerrit.onap.org/r/c/ci-management/+/98548 | PASS |
| 2/13 - All component migration completed and 0% coverage issue resolved | Demo | https://gerrit.onap.org/r/#/c/ci-management/+/98549/ | PASS | Morgan Richomme Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok |
| DMAAP | https://gerrit.onap.org/r/#/c/ci-management/+/98550/ | PASS | Mandar Sawant Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Need to fix 0% coverage (Almost done)
3/18 - Done | ExtAPI | https://gerrit.onap.org/r/#/c/ci-management/+/98551/ | fail | Adrian OSullivan , the Sonar jobs have been failing since before the migration. Can we please address them? --> | Completed | Holmes | https://gerrit.onap.org/r/#/c/ci-management/+/98552/ | PASS | Guangrong Fu Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Need to fix 0% coverage: https://sonarcloud.io/dashboard?id=onap_holmes-common https://sonarcloud.io/dashboard?id=onap_holmes-engine-management https://sonarcloud.io/dashboard?id=onap_holmes-rule-management | Integration |
|
|
| No Sonar jobs to migrate | Logging | https://gerrit.onap.org/r/#/c/ci-management/+/98554/ | PASS | Prudence Au Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Need to fix 0% coverage: https://sonarcloud.io/dashboard?id=onap_logging-analytics | Modeling | https://gerrit.onap.org/r/#/c/ci-management/+/98553/ | PASS | Hui Deng Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok Completed | Completed
| MSB | https://gerrit.onap.org/r/#/c/ci-management/+/98555/ | PASS | Huabing Zhao Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok Completed | Completed | MultiCloud | https://gerrit.onap.org/r/#/c/ci-management/+/98556/ | PASS | | Done
| Music | https://gerrit.onap.org/r/#/c/ci-management/+/98557/ | Pass | Bharath Balasubramanian Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok Completed |
| OOF | https://gerrit.onap.org/r/#/c/optf/cmso/+/104333/ | 1 fail, seems like a sandbox npm environment | Completed | Need to fix 0% coverage:
https://sonarcloud.io/dashboard?id=onap_optf-fgps https://sonarcloud.io/dashboard?id=onap_optf-cmso https://sonarcloud.io/dashboard?id=onap_optf-has | OOM |
|
|
| No Sonar jobs to migrate | O-parent |
|
|
| No Sonar jobs to migrate | Policy | https://gerrit.onap.org/r/#/c/ci-management/+/98559/ | PASS | DONE | COMPLETED | Portal | https://gerrit.onap.org/r/#/c/ci-management/+/98560/ | PASS | Manoop Talasila Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | COMPLETED | Portal SDK | https://gerrit.onap.org/r/#/c/ci-management/+/98568/ | PASS | Manoop Talasila Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | 'npm install' failed which also fails in SonarQube job. Not a migration issue. | SDC | https://gerrit.onap.org/r/#/c/ci-management/+/98561/ | PASS | Ofir Sonsino Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed
| SDNC | https://gerrit.onap.org/r/#/c/ci-management/+/98562/ | PASS | Dan Timoney Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed | SO | https://gerrit.onap.org/r/#/c/ci-management/+/98563/ | PASS | Seshu Kumar Mudiganti Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok https://sonarcloud.io/dashboard?id=onap_so
| Completed | UUI | https://gerrit.onap.org/r/#/c/ci-management/+/98564/ | PASS | xu ran Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed | VFC | https://gerrit.onap.org/r/#/c/ci-management/+/98565/ | PASS | Yan Yang Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok Completed | Completed | VID | https://gerrit.onap.org/r/#/c/ci-management/+/98566/ | PASS | Tech team to compare reports: SonarQube: https://sonar.onap.org/dashboard?id=org.onap.vid%3Avid-parent SonarCloud: https://sonarcloud.io/dashboard?id=onap_vid | Completed | VNFSDK | https://gerrit.onap.org/r/#/c/ci-management/+/98567/ | PASS | Weitao Gao Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | COMPLETED https://sonarcloud.io/organizations/onap/projects?search=vnfsdk | VVP | https://gerrit.onap.org/r/#/c/ci-management/+/98569/ | PASS | Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed Need to fix 0% coverage
Fixed https://sonarcloud.io/dashboard?id=onap_vvp-validation-scripts For python projects, see https://gerrit.onap.org/r/c/vvp/validation-scripts/+/101356 for an example. |
|
STAGE 2
- Update oparent to upgrade the sonar plugin and Jacoco configuration to the latest plugin required by SonarCloud: https://sonarcloud.io/documentation/analysis/scan/sonarscanner-for-maven/
- Make an oparent release wit this change
- Migrate teams to the new oparent while also removing the hardcoded goals in their sonar ci-management changes from the above table
SonarCloud SonarCloud migration notes
Ready to migrate? Things to consider and challenges faced with the currently migrated teams
...
- Teams will still be using the same Jenkins jobs
- SonarCloud is based on SonarQube 8.0 with +- some feature and plugin differences
- SonarQube will stay around for some time, but eventually will be deprecated (mid next year)
- Warnings in Quality Gates are no longer applicable in SonarCloud
- Teams using the "org.sonarsource.scanner.maven" plugin, might face issues during the migration since this plugin calls SonarQube directly .in older versions.
Changes needed to be done and stakeholders
RELENG: Modify project's yaml files to run Sonar on SonarCloud
RELENG: Test new runs in Sandbox and report failures
TECHTEAM: If failures are reported from the test, techteams help will be needed (Most likely related to dependencies and SonarQube specific plugins in the source)
TECHTEAM: Once test passes, review the final report and +1 Releng ci-management change
Testing the migration
The reports will now be posted under: https://sonarcloud.io/organizations/onap/projects
...