How to conduct TPC-C test on tidb

This article introduces how to TiDB Conduct  TPC-C  test .

TPC-C It's a right OLTP（ Online transaction processing ） Specification for system testing , Use a commodity sales model to OLTP The system is tested , There are five types of transactions ：

• NewOrder – Generation of new orders
• Payment – Order payment
• OrderStatus – Recent order query
• Delivery – Delivery
• StockLevel – Inventory shortage status analysis

Before the test begins ,TPC-C Benchmark Specifies the initial state of the database , That is, the rules of data generation in the database , among ITEM The table contains 10 Ten thousand kinds of goods , The number of warehouses can be adjusted , hypothesis WAREHOUSE Table has W Bar record , that ：

• STOCK There should be... In the table W * 10 Ten thousand records （ Each warehouse corresponds to 10 Inventory data of 10000 Commodities ）
• DISTRICT There should be... In the table W * 10 Bar record （ Each warehouse is 10 Provide services in three regions ）
• CUSTOMER There should be... In the table W * 10 * 3000 Bar record （ Each region has 3000 A customer ）
• HISTORY There should be... In the table W * 10 * 3000 Bar record （ Each customer has a transaction history ）
• ORDER There should be... In the table W * 10 * 3000 Bar record （ Every region 3000 Order per order ）, And finally generated 900 Orders were added to NEW-ORDER In the table , Each order is randomly generated 5 ~ 15 strip ORDER-LINE Record .

We're going to 1000 WAREHOUSE Test for an example .

TPC-C Use tpmC value (Transactions per Minute) To measure the maximum effective throughput of the system (MQTh, Max Qualified Throughput), among Transactions With NewOrder Transaction Subject to , That is, the final measurement unit is the number of new orders processed per minute .

This article USES the  go-tpc  As TPC-C Test implementation , Can pass  TiUP  Command to download the test program ：

tiup install bench

About TiUP Bench For detailed usage of components, please refer to  TiUP Bench.

Import data

Importing data is usually the whole TPC-C The most time-consuming test , It is also the most problematic stage .

stay shell Run in TiUP command ：

tiup bench tpcc -H 172.16.5.140 -P 4000 -D tpcc --warehouses 1000 prepare

Based on different machine configurations , This process may last for several hours . If it is a small cluster , You can use smaller WAREHOUSE Value to test .

When the data import is complete , By command  tiup bench tpcc -H 172.16.5.140 -P 4000 -D tpcc --warehouses 4 check  Verify data correctness .

Run the test

The command to run the test is ：

tiup bench tpcc -H 172.16.5.140 -P 4000 -D tpcc --warehouses 1000 run

Test results will be continuously printed on the console during operation ：

[Current] NEW_ORDER - Takes(s): 4.6, Count: 5, TPM: 65.5, Sum(ms): 4604, Avg(ms): 920, 90th(ms): 1500, 99th(ms): 1500, 99.9th(ms): 1500 [Current] ORDER_STATUS - Takes(s): 1.4, Count: 1, TPM: 42.2, Sum(ms): 256, Avg(ms): 256, 90th(ms): 256, 99th(ms): 256, 99.9th(ms): 256 [Current] PAYMENT - Takes(s): 6.9, Count: 5, TPM: 43.7, Sum(ms): 2208, Avg(ms): 441, 90th(ms): 512, 99th(ms): 512, 99.9th(ms): 512 [Current] STOCK_LEVEL - Takes(s): 4.4, Count: 1, TPM: 13.8, Sum(ms): 224, Avg(ms): 224, 90th(ms): 256, 99th(ms): 256, 99.9th(ms): 256 ...

At the end of the run , Will print test statistical results ：

[Summary] DELIVERY - Takes(s): 455.2, Count: 32, TPM: 4.2, Sum(ms): 44376, Avg(ms): 1386, 90th(ms): 2000, 99th(ms): 4000, 99.9th(ms): 4000 [Summary] DELIVERY_ERR - Takes(s): 455.2, Count: 1, TPM: 0.1, Sum(ms): 953, Avg(ms): 953, 90th(ms): 1000, 99th(ms): 1000, 99.9th(ms): 1000 [Summary] NEW_ORDER - Takes(s): 487.8, Count: 314, TPM: 38.6, Sum(ms): 282377, Avg(ms): 899, 90th(ms): 1500, 99th(ms): 1500, 99.9th(ms): 1500 [Summary] ORDER_STATUS - Takes(s): 484.6, Count: 29, TPM: 3.6, Sum(ms): 8423, Avg(ms): 290, 90th(ms): 512, 99th(ms): 1500, 99.9th(ms): 1500 [Summary] PAYMENT - Takes(s): 490.1, Count: 321, TPM: 39.3, Sum(ms): 144708, Avg(ms): 450, 90th(ms): 512, 99th(ms): 1000, 99.9th(ms): 1500 [Summary] STOCK_LEVEL - Takes(s): 487.6, Count: 41, TPM: 5.0, Sum(ms): 9318, Avg(ms): 227, 90th(ms): 512, 99th(ms): 1000, 99.9th(ms): 1000

Once the test is complete , It can also run  tiup bench tpcc -H 172.16.5.140 -P 4000 -D tpcc --warehouses 4 check  Verify the correctness of data .

Clean up the test data

tiup bench tpcc -H 172.16.5.140 -P 4000 -D tpcc --warehouses 4 cleanup