Bugs:Triage guide

m (add "CC yourself to the report")
m (convert some external links pointing to wiki.maemo.org to internal ones and swap freenode references to Libera instead)
 
(11 intermediate revisions not shown)
Line 6: Line 6:
# [https://bugs.maemo.org/createaccount.cgi Create an account.]
# [https://bugs.maemo.org/createaccount.cgi Create an account.]
-
# Read the [https://wiki.maemo.org/index.php?title=Bugs:Stock_answers Stock answers]. These stock responses are general examples of the kinds of comments that triagers should add to bug reports. There are even a surprising number of bug reports for which you can simply use these responses. Please always add a comment when changing the bug status to RESOLVED or adding the "moreinfo" keyword, so the user can comprehend your decision.
+
# Read the [[Bugs:Stock answers|Stock answers]]. These stock responses are general examples of the kinds of comments that triagers should add to bug reports. There are even a surprising number of bug reports for which you can simply use these responses. Please always add a comment when changing the bug status to RESOLVED or adding the "moreinfo" keyword, so the user can comprehend your decision.
-
# Find what should be changed. Read the [https://wiki.maemo.org/Bugs:Triage_guide#Steps_of_Triaging Steps of Triaging] to determine what should be changed (if anything) and how.
+
# Find what should be changed. Read the [[Bugs:Triage guide#Steps of Triaging|Steps of Triaging]] to determine what should be changed (if anything) and how.
# Add yourself to the CC list of the reports you triage so you will receive updates and notifications on changes.
# Add yourself to the CC list of the reports you triage so you will receive updates and notifications on changes.
-
# Ask someone to verify your changes. In #maemo on irc.freenode.net mention the bug number you are looking at and the changes that you think should be made. (If no one is around, it is perfectly okay to leave a comment in the relevant bug with information that could be useful to others, e.g. "I think this bug report is a duplicate of bug 1234").  
+
# Ask someone to verify your changes. In #maemo-bugs on irc.libera.chat mention the bug number you are looking at and the changes that you think should be made. (If no one is around, it is perfectly okay to leave a comment in the relevant bug with information that could be useful to others, e.g. "I think this bug report is a duplicate of bug 1234").  
-
As time goes by and you become more familiar with Bugzilla, please ask the [https://wiki.maemo.org/index.php?title=Bugsquad#Members Bugsquad members] to provide [http://www.bugzilla.org/docs/2.22/html/useradmin.html#modifyusers editbugs permissions] to you so you have gain much more power to change things and work efficiently in the bug database.
+
As time goes by and you become more familiar with Bugzilla, please ask the [[Bugsquad#Members|Bugsquad members]] to provide [http://www.bugzilla.org/docs/2.22/html/useradmin.html#modifyusers editbugs permissions] to you so you have gain much more power to change things and work efficiently in the bug database.
=== Potential tasks ===
=== Potential tasks ===
-
There are a number of ways, but one way is to pick a couple of components that interest you, or which you know about, or are willing to learn, or happen to use and set up user watching. Once you've done that, look through the bugs in each of those components.
+
Please take a look at [[Bugs:Tasks|some ideas here]].
-
You could also take a look at the latest [https://bugs.maemo.org/buglist.cgi?bug_file_loc=&bug_file_loc_type=allwordssubstr&bug_id=&bugidtype=include&chfield=%5BBug%20creation%5D&chfieldfrom=-14d&chfieldto=Now&chfieldvalue=&email1=&email2=&emailassigned_to1=1&emailassigned_to2=1&emailcc2=1&emailqa_contact2=1&emailreporter2=1&emailtype1=substring&emailtype2=substring&field0-0-0=noop&keywords=&keywords_type=allwords&long_desc=&long_desc_type=substring&query_format=advanced&remaction=&short_desc=&short_desc_type=allwordssubstr&status_whiteboard=&status_whiteboard_type=allwordssubstr&type0-0-0=noop&value0-0-0=&votes=&order=bugs.bug_id&query_based_on= incoming reports of the last two weeks].
+
== Steps of Triaging ==
-
Or you could take a look at old bug reports and try to reproduce them with the latest software release (currently Diablo version 4.2008.30-2) to find out whether the reports are still valid.
+
This guide should make triaging a bug as easy and simple as possible. Remember, if in doubt, ask! Also, remember that you may not be able to find anything to change for some bugs since not all bugs are filed incorrectly or incompletely.
-
Another option is to clean up [https://bugs.maemo.org/buglist.cgi?keywords_type=allwords&keywords=moreinfo&bug_status=UNCONFIRMED&bug_status=NEW&bug_status=ASSIGNED&bug_status=REOPENED&chfieldfrom=-6m&chfieldto=Now bugs with moreinfo keyword that have not been changed for 6 months]. This means that more information had been requested from the reporter but has not been provided. These bugs should be closed as WORKSFORME if you are not able to reproduce. If there is simply not enough information to be a useful report, then close the bug as INVALID (You need [http://www.bugzilla.org/docs/2.22/html/useradmin.html#modifyusers editbugs permissions] for such changes). Please always explain your decision by adding a nice comment and in the latter case, ask the reporter to provide the information asked for, if he can, and reopen the bug.
+
=== Is there already something like "int-123456" in the Alias field? ===
-
== Steps of Triaging ==
+
If so, the report already has been triaged and imported into Nokia's internal bug tracking system. Nothing to do here anymore...
-
 
+
(Note that many reporters set an Alias like "mybug" as they think that it is required when writing a report. The planned update of Bugzilla to a newer version will fix this behaviour.)
-
This guide should make triaging a bug as easy and simple as possible. Remember, if in doubt, ask! Also, remember that you may not be able to find anything to change for some bugs since not all bugs are filed incorrectly or incompletely.
+
=== Is it part of Maemo Bugzilla? ===
=== Is it part of Maemo Bugzilla? ===
Line 33: Line 32:
==== Hardware problems and Hardware enhancement requests ====
==== Hardware problems and Hardware enhancement requests ====
-
Maemo.org is a software platform, and while its sponsor thinks about hardware, we don't. Close the bug as invalid and ask the reporter to either
+
Maemo is a software platform, hence bug reports about hardware bugs are invalid in bugs.maemo.org. Please ask the reporter to either contact Nokia Care services via www.nokia.com or to contact the company who sold the product to them.
-
  1. Contact Nokia Care services
+
If the report is about an enhancement idea for the hardware, please close the report as invalid and kindly ask the reporter to file a ticket in the [http://maemo.org/community/brainstorm/ Maemo Brainstorm] at http://maemo.org/community/brainstorm/ instead as hardware is out of scope for maemo.org Bugzilla. Also there is http://conversations.nokia.com/design-by-community/.
-
        1. visit www.nokia.com
+
 
-
        2. browse to Nokia 770, Nokia N800 or Nokia N810
+
==== Is it a valid, but wide and non-specific feature request? ====
-
        3. Support and Software
+
 
-
        4. Under Nokia Care services, select Repair and recycling
+
Some reporters have great ideas and visions. They want to improve the User Experience in general or change behaviour of several applications at once.
-
        5. Select your Nokia Care point
+
These ideas are very hard to handle in Bugzilla as they require extensive brainstorming, discussing and involvement of several people/teams. Such reports should be closed as INVALID and reporters should be kindly asked to file a report in [http://maemo.org/community/brainstorm/ maemo.org Brainstorm] instead.
-
        6. Select Repair or Warranty
+
-
  2. Contact the company who sold you the product
+
=== Does it make sense? ===
=== Does it make sense? ===
Does it have enough information? Common sense rules here - "this sucks" or "this crashed" should get the "moreinfo" keyword with a polite message, as should other things that are too ambiguous to be useful.
Does it have enough information? Common sense rules here - "this sucks" or "this crashed" should get the "moreinfo" keyword with a polite message, as should other things that are too ambiguous to be useful.
-
In many cases asking for a URL or attachment will help. If you need help making changes to bug fields ([http://www.bugzilla.org/docs/2.22/html/useradmin.html#modifyusers "editbugs"]), just comment describing what changes you want made or ask for help from #maemo (especially the bugmasters, andre and guenther, are a good contact).
+
In many cases asking for a URL or attachment will help. If you need help making changes to bug fields ([http://www.bugzilla.org/docs/2.22/html/useradmin.html#modifyusers "editbugs"]), just comment describing what changes you want made, or ask for help from the #maemo-bugs channel on Libera IRC (especially the bugmaster andre is good contact), or send an email to bugzilla@maemo.org.
=== Is the bug a duplicate? ===
=== Is the bug a duplicate? ===
Line 73: Line 70:
* '''Crasher bugs'''
* '''Crasher bugs'''
Should have Severity=Critical, Priority=High.
Should have Severity=Critical, Priority=High.
-
Add the "moreinfo" keyword if they don't have a stack trace, and ask the reporter to get a decent stack trace (see https://wiki.maemo.org/index.php?title=Bugs:Stock_answers for more information). If there is no information about how it is triggered you should ask the original reporter how to reproduce the bug.
+
Add the "moreinfo" keyword if they don't have a stack trace, and ask the reporter to get a decent stack trace (see [[Bugs:Stock answers]] for more information). If there is no information about how it is triggered you should ask the original reporter how to reproduce the bug.
* '''Something not working as expected'''
* '''Something not working as expected'''
Severity=Low or Medium depending on how much it breaks the application.
Severity=Low or Medium depending on how much it breaks the application.
Line 95: Line 92:
Kudos to [http://browser.garage.maemo.org/news/8/ timeless], the [http://wiki.mozilla.org/MozillaQualityAssurance:Triage Mozilla Triage Team] and the [http://live.gnome.org/Bugsquad/TriageGuide GNOME Bugsquad]. I shamelessly copied huge parts from them.
Kudos to [http://browser.garage.maemo.org/news/8/ timeless], the [http://wiki.mozilla.org/MozillaQualityAssurance:Triage Mozilla Triage Team] and the [http://live.gnome.org/Bugsquad/TriageGuide GNOME Bugsquad]. I shamelessly copied huge parts from them.
-
 
[[Category:Community]]
[[Category:Community]]
[[Category:maemo.org]]
[[Category:maemo.org]]
[[Category:Bugzilla]]
[[Category:Bugzilla]]
 +
[[Category:Quality Assurance]]

Latest revision as of 09:33, 9 November 2021

This article is for anyone who wants to help triaging the incoming and existing bug reports in Maemo Bugzilla. This article is not for bug reporters, but those people taking a look at the reports after they have been submitted.

Following the techniques listed and explained here will help important bugs get fixed, as well as optimize precious developer time.

Contents

[edit] How can I help?

  1. Create an account.
  2. Read the Stock answers. These stock responses are general examples of the kinds of comments that triagers should add to bug reports. There are even a surprising number of bug reports for which you can simply use these responses. Please always add a comment when changing the bug status to RESOLVED or adding the "moreinfo" keyword, so the user can comprehend your decision.
  3. Find what should be changed. Read the Steps of Triaging to determine what should be changed (if anything) and how.
  4. Add yourself to the CC list of the reports you triage so you will receive updates and notifications on changes.
  5. Ask someone to verify your changes. In #maemo-bugs on irc.libera.chat mention the bug number you are looking at and the changes that you think should be made. (If no one is around, it is perfectly okay to leave a comment in the relevant bug with information that could be useful to others, e.g. "I think this bug report is a duplicate of bug 1234").

As time goes by and you become more familiar with Bugzilla, please ask the Bugsquad members to provide editbugs permissions to you so you have gain much more power to change things and work efficiently in the bug database.

[edit] Potential tasks

Please take a look at some ideas here.

[edit] Steps of Triaging

This guide should make triaging a bug as easy and simple as possible. Remember, if in doubt, ask! Also, remember that you may not be able to find anything to change for some bugs since not all bugs are filed incorrectly or incompletely.

[edit] Is there already something like "int-123456" in the Alias field?

If so, the report already has been triaged and imported into Nokia's internal bug tracking system. Nothing to do here anymore... (Note that many reporters set an Alias like "mybug" as they think that it is required when writing a report. The planned update of Bugzilla to a newer version will fix this behaviour.)

[edit] Is it part of Maemo Bugzilla?

Some pieces of software that users think of as part of Maemo are 3rd party software and have their bug tracking systems elsewhere. If the bug relates to one of these components, please close the bug as INVALID and ask the reporter to report it to the correct tracking system.

[edit] Hardware problems and Hardware enhancement requests

Maemo is a software platform, hence bug reports about hardware bugs are invalid in bugs.maemo.org. Please ask the reporter to either contact Nokia Care services via www.nokia.com or to contact the company who sold the product to them. If the report is about an enhancement idea for the hardware, please close the report as invalid and kindly ask the reporter to file a ticket in the Maemo Brainstorm at http://maemo.org/community/brainstorm/ instead as hardware is out of scope for maemo.org Bugzilla. Also there is http://conversations.nokia.com/design-by-community/.

[edit] Is it a valid, but wide and non-specific feature request?

Some reporters have great ideas and visions. They want to improve the User Experience in general or change behaviour of several applications at once. These ideas are very hard to handle in Bugzilla as they require extensive brainstorming, discussing and involvement of several people/teams. Such reports should be closed as INVALID and reporters should be kindly asked to file a report in maemo.org Brainstorm instead.

[edit] Does it make sense?

Does it have enough information? Common sense rules here - "this sucks" or "this crashed" should get the "moreinfo" keyword with a polite message, as should other things that are too ambiguous to be useful. In many cases asking for a URL or attachment will help. If you need help making changes to bug fields ("editbugs"), just comment describing what changes you want made, or ask for help from the #maemo-bugs channel on Libera IRC (especially the bugmaster andre is good contact), or send an email to bugzilla@maemo.org.

[edit] Is the bug a duplicate?

Some bugs in Bugzilla have been reported before. Finding them is more of an art than a science :-) This is an important step, but don't spend too long over it; if a bug is filed twice, someone else will mark the duplicate later. Be creative, e.g. searching for "delet" will bring up all bugs that have "delete" or "deleting" in the report. If the bug is a duplicate, mark it as a duplicate in the resolution box at the bottom of bugzilla and add a polite comment explaining that this bug/request has been filed before. You don't need to carry on triaging it if it's a duplicate; press the Save Changes button and go onto your next bug!

[edit] Can you reproduce it?

If you can, please try to reproduce the problem. If you think the problem is not reproducable, write a comment indicating the version you tested, the steps you took, the results you got, and why you think the bug WORKSFORME. If you can reproduce the bug running the latest publically available software version and if it is well-reported, change the status from UNCONFIRMED to NEW (You need canconfirm permissions for this).

[edit] Is the version set correctly?

See http://en.wikipedia.org/wiki/Internet_Tablet_OS for a mapping between the SDK version information used in Maemo Bugzilla and the name of the software images. In general we always ask people to run the latest available software release, because nobody works on fixing ancient and obsolete releases anymore.

[edit] Is it in the right place?

If you think the bug was filed against the wrong product, look for a better alternative in the drop-down list box. Make sure to mark the "Reassign bug to default assignee and QA contact of selected component" radio button (forgetting to do this is a common mistake that results in the new owner not getting email about the bug).

[edit] What severity/priority should be set?

Finding the correct severity and priority takes some experience, and you will get a feel for it after triaging several bugs. Here are some guidelines for the most commonly reported bugs. You should read the severity and priority guidelines at least once.

Please note that only changing severity and/or priority slightly may do more fuss than good. It causes an extra email to the maintainers and consumes their precious time and attention. If other changes are done as well then there is only little additional impact when changing severity and/or priority.

  • Crasher bugs

Should have Severity=Critical, Priority=High. Add the "moreinfo" keyword if they don't have a stack trace, and ask the reporter to get a decent stack trace (see Bugs:Stock answers for more information). If there is no information about how it is triggered you should ask the original reporter how to reproduce the bug.

  • Something not working as expected

Severity=Low or Medium depending on how much it breaks the application.

  • Incorrect strings, typos, etc.

Severity=Low, Priority=Normal or High depending on how user-visible it is.

  • Feature requests

If it really is a new feature, and not an improvement to something already in the product, set Severity=Enhancement, Priority=Low. If you're unsure about your Severity/Priority triage, add a comment in the bug explaining why you triaged it as you did. You can also add yourself to the Cc field, so if someone retriages it differently you can find out why.

[edit] What keywords should be set?

The available few keywords are listed here. Get familiar with them. For example, if the bug is most probably trivial to fix, add the "easyfix" keyword. If a patch has been added that fixes the issue, add the "patch" keyword.

[edit] Specific areas

[edit] Documentation bugs

Specific API documentation bugs must be filed against the corresponding product. Also please add the "docs" keyword.

Generic documentation bugs and HIG issues must be filed against the "Documentation" component in the "Development Platform" product. This does not require the docs keyword.

[edit] Acknowledgment

Kudos to timeless, the Mozilla Triage Team and the GNOME Bugsquad. I shamelessly copied huge parts from them.