Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Assumptions

<optional, assumptions are like decision made up front ie. everyone agrees on the answer but they are important to mention>

...


IssueNotes Decision
1Acceptance criteria for bug ticketsWhat should we do if a bug not reproducible? > RejectCPS team will decide whether to accept bug ticket based on whether enough information has been provided to be able to reproduce/resolve the issue.
2Standard Bug Reporting TemplateThe minimal Minimal information needed useful for all bug tickets3NCMP Bug ReportsThere is specific information needed for reproducing NCMP bugs, e.g. number of CM-handles4Performance Bug ReportsPerformance issues are much more difficult to reproduce than functional issues, so may need additional info like heap dumps

Create a wiki page containing bug report template, as a guideline for writing bug report. Fields are optional, depending on context. Daniel Hanrahan will create this page.

35Handling of sensitive information such as logs and heap dumpsNeed to protect IPR of commercial contributorsWill provide guidelines for what info can/cannot be shared in open source. Client-specific internal Jira ticket can be used to share artifacts, where applicable.
46Bug reporting guidelinesA wiki page showing how to write a good bug report. Note there are many existing ones such as:
https://bugzilla.mozilla.org/page.cgi?id=bug-writing.html
Can be done as part of #2 (bug report template)

<Note. use green for closed issues, yellow for important ones if needed>

...

  • Full description of the issue
  • Affected version(s)
  • Expected behaviour (what is the requirement?)
  • Actual behaviour
  • Impact - this is important for setting priority
  • Steps to reproduce - ideally a Minimal reproducible example
  • (Optional) Attached artifacts: Screenshots, Logs, Test data, etc.

...

  • Environment
  • Attached the corresponding IDUN Jira

There has been much confusion about the number of CM-handles the bug reporters are testing with. In many tickets, phrases such as "80k deployment" is used, but in some cases this was 6k CM-handles, and 20k for others!

...

Performance issues are significantly more difficult to reproduce, being very sensitive the user's deployment/environment.

  • Available Environment, including available resources in the deployment (memory and CPU cores, number of application instances)
  • What is the load on the system (how many concurrent operations, etc.)?
  • Measured CPU and memory consumption
  • For Out Of Memory Errors (OOMEs): Attached heap dump - I think this should be a requirement moving forward

...

Client-reported bugs

Links to internal Jira tickets, Jenkins pipelines, should be provided where applicable. Logs etc. could be shared securely herethere.

Acceptance Criteria for Bugs

We need to agree on reasonable criteria, e.g.

  • All information in the Bug Reporting Template is provided, especially steps to reproduce
  • Bug reporter tests with the latest released version?
  • But what do we do when a bug is not reproducible by us?That CPS team has enough information to reproduce the bug

Sharing artifacts such as Logs in the Open Source

...