I’ve been doing some data mining on b.m.o. recently, and have got some interesting results. I’ve been particularly looking at UNCONFIRMED bugs (of which we have a very large number) and what happens to them.
Any bug which ends up FIXED is a great thing. Almost any other bug is a net drain on resources – we’d have been better off if it had never existed. So, in an ideal world, all filed bugs would end up FIXED (and get filed with a crystal-clear description, a reduced testcase, and a pointer into the code…).
So I looked at all bugs filed as UNCO in the week of 2004-04-22 to 2004-04-28 (6 months ago) which eventually ended up FIXED. There were 38 of them. This is a chart of how long it took them to get confirmed. It was made by hand, checking the Bug Activity of each one.
< 1 day 18 < 1 week 13 < 1 month 3 < 2 months > 2 months
Some bugs went straight from UNCO to FIXED; they were fixed after:
< 1 day < 1 week 2 < 1 month < 2 months 2 (but both of these should have been WORKSFORME) > 2 months
So, based on this sample, any bug which hasn’t been confirmed after two months is very unlikely to become FIXED – no examples were found of this. (Please point out any flaws in this logic in the comments.)
So what are we going to do with this fact? More on that tomorrow.