References

Assumptions

<optional, assumptions are like decision made up front ie. everyone agrees on the answer but they are important to mention>

#AssumptionNotes
1Decisions will be agreed with stakeholders

Issues & Decisions


IssueNotesĀ Decision
1Acceptance criteria for bug ticketsWhat should we do if a bug not reproducible? > RejectCPS team will decide whether to accept bug ticket based on whether enough information has been provided to be able to reproduce/resolve the issue.
2Standard Bug Reporting TemplateMinimal information useful for all bug tickets

Create a wiki page containing bug report template, as a guideline for writing bug report. Fields are optional, depending on context. Daniel Hanrahan will create this page.

3Handling of sensitive information such as logs and heap dumpsNeed to protect IPR of commercial contributorsWill provide guidelines for what info can/cannot be shared in open source. Client-specific internal Jira ticket can be used to share artifacts, where applicable.
4Bug reporting guidelinesA wiki page showing how to write a good bug report. Note there are many existing ones such as:
https://bugzilla.mozilla.org/page.cgi?id=bug-writing.html
Can be done as part of #2 (bug report template)

<Note. use green for closed issues, yellow for important ones if needed>

Background

It has been observed that some bugs (particularly performance-related ones) can take weeks to resolve, and often cannot be reproduced by the CPS dev team.

This proposal is to improve ways of working around bugs to reduce time spent.

Bug Reporting Template

Many bug tickets lack basic information such as what version was tested.

It is proposed that in addition to CPS FSA Template, a Bug Reporting Template be created. At a minimum, the following information should be provided:

There has been much confusion about the number of CM-handles the bug reporters are testing with. In many tickets, phrases such as "80k deployment" is used, but in some cases this was 6k CM-handles, and 20k for others!

Performance Bugs

Performance issues are significantly more difficult to reproduce, being very sensitive the user's deployment/environment.

Client-reported bugs

Links to internal Jira tickets, Jenkins pipelines, should be provided where applicable. Logs etc. could be shared securely there.

Acceptance Criteria for Bugs

We need to agree on reasonable criteria, e.g.

Sharing artifacts such as Logs in the Open Source

Some bugs being reported often require sharing information such as logs, heap dumps, etc. This needs to be done in a way that IPR is protected, since CPS is developed in the open source.