SONARQUBE SUPPORT WILL END FEB-20
Please make sure there are no components left in SonarQube
Please implement SonarCloud coverage drop fix explained below
Timeline of events
To prevent dependency issues, this migration is planned to happen in 2 stages.
Stage 1 will use hardcoded sonar goals to the needed plugin version to avoid waiting on dependencies from where this can be inherited.
Stage 2 will be a cleanup stage and work towards fixing the plugin in the dependencies like oparent and slowly migrate teams to it while removing hardcoded sonar goals.
STAGE 1
- RELENG → Will add the needed changes in ci-management for each project and run a test in the sandbox
- RELENG → will post the restults of the sandbox test in the 3rd column below.
- This is not reflecting if the Sonar report actually pass or failed a quality gate. Instead, this result is the outcome of running the Sandbox job using the changes in ci-management.
- TECHTEAM → Review the results and comments posted by Releng in column 4. PTLs will be mentioned explicitly to notify them that the next action is on their team.
- TECHTEAM&RELENG → Will work on any additional comments/questions/issues from column 4 and 5.
SONAR COVERAGE DROP TO 0%
Sonar Cloud made an update on the jacoco plugin where they dropped support for .exec file format. We need to use .xml instead.
Please look for more information in https://community.sonarsource.com/t/sonar-coverage-dropping-to-0-for-some-projects/18521/2
Some teams like APPC have upgraded their reports and coverage was restored for them. Please follow their examples: https://gerrit.onap.org/r/#/c/appc/parent/+/100156/, https://gerrit.onap.org/r/#/c/appc/+/100155/
Also, OPARENT has been updated with the fix too https://gerrit.onap.org/r/#/c/oparent/+/100168/ included in 3.0.0-SNAPSHOT
Task | Add SonarCloud variables in project's yaml files | Sandbox test of my change (DO NOT CONFUSE WITH SONAR REPORT RESULT) | Review results | Comment on progress |
---|---|---|---|---|
Responsible | RelEng | Releng | PTL | |
Estimated Duration | 5 min | 15 min to 1 hr depending | 10 min per report | |
AAF | https://gerrit.onap.org/r/#/c/ci-management/+/98542/ | PASS | Jonathan Gathman Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed Need to fix 0% coverage |
AAI | https://gerrit.onap.org/r/c/ci-management/+/98544 | PASS | James Forsyth Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed
Update 19 Feb 2020: Issues have been fixed. AAI repos all passing in sonarcloud |
APPC | https://gerrit.onap.org/r/c/ci-management/+/98545 | PASS | Takamune Cho This is marked as "PASS" becuase the build actually produced the same result as what we had in SonarQube, but I know we still are facing coverage issues. Shall we merge this change to move to SonarCloud and continue our investigation there? Jessica Wagantall I +1 already. we still have to work with the issue. I have posted my last comment on IT-17899. Please take a look. thx |
Issue has been fixed. back to 80% |
CCSDK | https://gerrit.onap.org/r/c/ci-management/+/98546 | PASS | Dan Timoney Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed Need to fix 0% coverage |
CLAMP | https://gerrit.onap.org/r/#/c/ci-management/+/98543/ | 1/2 pass | Tested and working for JDK13 but having issues with JavaScript (Contacted Sonar team) | |
CLI | https://gerrit.onap.org/r/c/ci-management/+/98547 | PASS | user-67d6f Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | completed with coverage 61 % (25 Feb 2020) https://sonarcloud.io/organizations/onap/projects/?search=cli |
DCAE | https://gerrit.onap.org/r/c/ci-management/+/98548 | PASS | 2/13 - All component migration completed and 0% coverage issue resolved | |
Demo | https://gerrit.onap.org/r/#/c/ci-management/+/98549/ | PASS | Morgan Richomme Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | |
DMAAP | https://gerrit.onap.org/r/#/c/ci-management/+/98550/ | PASS | Mandar Sawant Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Need to fix 0% coverage (Almost done) |
ExtAPI | https://gerrit.onap.org/r/#/c/ci-management/+/98551/ | fail | Adrian OSullivan , the Sonar jobs have been failing since before the migration. Can we please address them? --> | Caused by: java.lang.IllegalArgumentException: invalid flag: --release |
Holmes | https://gerrit.onap.org/r/#/c/ci-management/+/98552/ | PASS | Guangrong Fu Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed Need to fix 0% coverage |
Integration | No Sonar jobs to migrate | |||
Logging | https://gerrit.onap.org/r/#/c/ci-management/+/98554/ | PASS | Prudence Au Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed Need to fix 0% coverage |
Modeling | https://gerrit.onap.org/r/#/c/ci-management/+/98553/ | PASS | Hui Deng Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed
0% coverage issue has been fixed. |
MSB | https://gerrit.onap.org/r/#/c/ci-management/+/98555/ | PASS | Huabing Zhao Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Need to fix 0% coverage |
MultiCloud | https://gerrit.onap.org/r/#/c/ci-management/+/98556/ | PASS | Completed | Need to fix 0% coverage: in progress. |
Music | https://gerrit.onap.org/r/#/c/ci-management/+/98557/ | Pass | Bharath Balasubramanian Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok Completed | |
OOF | https://gerrit.onap.org/r/#/c/ci-management/+/98558/ | 1 fail, seems like a sandbox npm environment | Completed | Need to fix 0% coverage |
OOM | No Sonar jobs to migrate | |||
O-parent | No Sonar jobs to migrate | |||
Policy | https://gerrit.onap.org/r/#/c/ci-management/+/98559/ | PASS | DONE | COMPLETED |
Portal | https://gerrit.onap.org/r/#/c/ci-management/+/98560/ | PASS | Manoop Talasila Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | COMPLETED |
Portal SDK | https://gerrit.onap.org/r/#/c/ci-management/+/98568/ | PASS | Manoop Talasila Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | 'npm install' failed which also fails |
SDC | https://gerrit.onap.org/r/#/c/ci-management/+/98561/ | PASS | Ofir Sonsino Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed Need to fix 0% coverage |
SDNC | https://gerrit.onap.org/r/#/c/ci-management/+/98562/ | PASS | Dan Timoney Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed |
SO | https://gerrit.onap.org/r/#/c/ci-management/+/98563/ | PASS | Seshu Kumar Mudiganti Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok https://sonarcloud.io/dashboard?id=onap_so | Completed |
UUI | https://gerrit.onap.org/r/#/c/ci-management/+/98564/ | PASS | Tao Shen Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | |
VFC | https://gerrit.onap.org/r/#/c/ci-management/+/98565/ | two fail | Yan Yang Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok Completed | Completed |
VID | https://gerrit.onap.org/r/#/c/ci-management/+/98566/ | PASS | Tech team to compare reports: SonarQube: https://sonar.onap.org/dashboard?id=org.onap.vid%3Avid-parent SonarCloud: https://sonarcloud.io/dashboard?id=onap_vid | Waiting on Tech team to review reports. |
VNFSDK | https://gerrit.onap.org/r/#/c/ci-management/+/98567/ | PASS | Weitao Gao Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | COMPLETED https://sonarcloud.io/organizations/onap/projects?search=vnfsdk |
VVP | https://gerrit.onap.org/r/#/c/ci-management/+/98569/ | PASS | Gerrit ready, SonarCloud results pushed and waiting on committers to +1 my change if all looks ok | Completed
Fixed https://sonarcloud.io/dashboard?id=onap_vvp-validation-scripts For python projects, see https://gerrit.onap.org/r/c/vvp/validation-scripts/+/101356 for an example. |
STAGE 2
- Update oparent to upgrade the sonar plugin and Jacoco configuration to the latest plugin required by SonarCloud: https://sonarcloud.io/documentation/analysis/scan/sonarscanner-for-maven/
- Make an oparent release wit this change
- Migrate teams to the new oparent while also removing the hardcoded goals in their sonar ci-management changes from the above table
SonarCloud migration notes
Ready to migrate? Things to consider and challenges faced with the currently migrated teams
- Teams will still be using the same Jenkins jobs
- SonarCloud is based on SonarQube 8.0 with +- some feature and plugin differences
- SonarQube will stay around for some time, but eventually will be deprecated (mid next year)
- Warnings in Quality Gates are no longer applicable in SonarCloud
- Teams using the "org.sonarsource.scanner.maven" plugin, might face issues during the migration since this plugin calls SonarQube directly in older versions.
Testing the migration
The reports will now be posted under: https://sonarcloud.io/organizations/onap/projects
Jenkins jobs do not change.