Talk about the metrics of automated testing

This is the fourth article in the automated testing series , In this article, I want to talk about some ideas about automated test measurement .

In the internal sharing of the knowledge planet community last weekend , Some students also asked this question ： What are the metrics for automated testing ？ What is the value of each ？ It's a little weak to talk about value without data support , But let's talk about measurement indicators without the original intention and background of Automation , It's the opposite .

The purpose of automated testing

Before talking about automated test metrics , It is necessary to return to the original intention of Automation , That's why we need to do automated testing , What problem to solve . In different companies , For different teams and technical students , The purpose of automation is different . Common purposes are as follows ：

• Test data preparation takes a long time , Do automated testing to improve the efficiency of data generation ;

• The core business link before the project goes online returns , In order to improve the efficiency of regression testing , This is also a pre launch check methods ;

• Before the test, in order to quickly verify the test quality , As a smoke test method, improve efficiency , At the same time, this is also a practice of testing the left shift ;

• Large team and many business lines , Improve the efficiency of test team collaboration by unifying the framework and collaboration specifications , Cut down on making wheels , Avoid wasting resources ;

Of course, there are other purposes , To sum up , do

The main purpose of automated testing is to reduce costs and increase efficiency . That is, through technical means , Improve the efficiency of testing process and teamwork , New test regression verification means , Reduce the input cost of repetitive work

.

Develop metrics based on purpose

As mentioned above , Metrics for automated testing , My personal view is to develop measurement indicators based on practical purposes . give an example ：

Pay attention to when formulating metrics

When developing metrics , It is suggested to follow and consider the following points ：

• Never be oriented towards indicators / oriented KPI Measure ;

• Considering the cost of redundancy , Not too many indicators ;

• The purpose of setting indicators is to improve quality , Instead of making data ;

• Develop metrics based on the purpose of automated testing ;

• The comparison of measurement indicators should be based on whether the pain points have been solved ;

• Measurement indicators are the basis of auxiliary evaluation , Is not the only correct result ;

• Which indicators should be considered to be more practical and effective in formulating indicators , From the perspective of solving problems ;

• Don't evaluate the measurement indicators alone , Quality measurement should be comprehensively evaluated and carried out in combination with multiple dimensions ;