近来之前,我帮助在硅谷的加州大学Santa Cruz延伸的加州大学软件工程计划中开始了软件质量证书。我在顾问委员会。在将课程放在一起,一些人建议了测量和指标课程。自从我在计划中教一些课程以来,他们让我撰写并领导课程。当他们这样做时,我没有意识到迅速 - 或者有多大声 - 我回答说“不!”
The whole room froze and looked at me. I laughed. I told them that there was no way I would go near that class––not even with a 10-foot pole.
测量的问题是每个组织都是独一无二的,每个产品都处于不同的成熟程度并具有其自身的有意义的测量需求,团队成员对其决定的个人偏好,不同的工具已经预测了他们的想法或仪表板的预测报告或仪表板you may want to know… what I’m getting at here is that it’s all context-driven. Reporting from QA and Test Teams serves many purposes, but reporting must also support the business goals. Thus, measurements and metrics must be relevant to these goals. The reporting needs to be actionable, meaning that the data informs decision-makers and arms them with what they need for:
- 评估产品准备走, no-go, not yet, etc.),
- Ascertaining process efficiency (that testing and development are getting done as efficiently as needed), and
- 精确范围的项目大小,人员配置,资源,工具需求,设备等
测量和度量标准报告具有岩石历史,因为测量很容易生成,所以有些人过度报告,使其成为读者的工作,以了解所有数据。消除浪费,瘦,切割开销是更好的管理。“只是事实”和“更少的是更多”是今天报告的更好的咒语。
Better than inventing some acronym, from my experience, the reporting you do must be:
- Correct.This may go without saying, but I could tell you horror stories of the incorrect or missing information or measurement leading to problems.
- Easy to generate or capture.Once you have defined the measurements to report to the team, they need to be easy to capture. If you regularly have to manually grab a piece of data from one tool and manually grab another piece of data from another tool, then put them into an Excel spreadsheet and calculate something to send the decision-makers or team members… think again. Capturing and calculating reporting needs to be automated.
- 了解。您正在报告此信息的团队成员需要了解它所做的,并不意味着 - 也许甚至可能是多少良好的数字,并且错误的数字可能是什么样的。它超级常见的是,这些测量或指标被报告并被团队的各种成员误解,因为他们从未完全解释过,也没有得到关于实际测量的协议以及为什么的协议。
- Used!The reporting is used for action. The right people do things, make decisions, make changes, get staff, get time, bless a release, or hold a release based on the numbers we are giving them. If it turns out that people are not making decisions based on these numbers…
- Reevaluate.改变它们。如果人们没有采取行动,如果有太多的误解,或者你没有得到你打算的结果,可以获得一个易于理解的不同措施,并且团队将能够用于决策。请记住,没有“最佳实践”,只有持续改进。

Reporting is complex because it is always context-driven and often political. My biggest advice for reporting is to be Lean and be careful.
This issue is packed full of content aimed at helping QA leaders ensure their team’s efforts are actively (and accurately) communicated to business decision makers. Our cover story,如何停止“飞行盲人”核算时was written by LogiGear’s SVP of Sales Clayton Simmons and offers actionable insight for QA leaders who may be struggling to find the “perfect mix” of metrics when reporting to decision-makers.中点危机:自动化如何能够做出更多手动测试工作由Michael Larsen编写,并探讨如何防止在我们的自动化程序成熟时手动执行任务。怎么看was written by Kristin Jackvony and is aimed at entry-level QA professionals who are trying to find ways to make their work known and climb the corporate ladder. This issue’s Blogger of the Month, Wes Silverstein, explores the important role that QA has when it comes to planning Automation sprints inThe Role of QA in Sprint Planning.Our infographic,5 Incredibly Useful KPIs for Test Automation,探索我们在您的QA报告中使用的最高推荐的测试指标,包括公式和原因,为什么他们有关。最后,查看TestArchitt 9.0版的新功能和功能TestArchitect Corner.
We hope you enjoy this issue––happy testing!