benchmarksql 在5.0版本去除了對MySQL的TPC-C測試支持，本文通過修改部分源碼，讓benchmarksql 5.0支持MySQL。
1. 環境:
CentOS 7.2
benchmarksql 5.0
Percona MySQL Server 5.7.19
2. 下載編譯benchmarksql源碼
2.1 首先安裝java開發環境，具體步驟略過，本文涉及到的操作在 java 1.8.0 環境下測試通過。
2.2 安裝ant工具。
yum install ant
2.3 下載benchmarksql 5.0 源碼，解壓。
https://sourceforge.net/projects/benchmarksql/
cd benchmarksql-5.0
2.4 編譯
ant
此時會編譯出一個版本 benchmarksql-5.0/dist/BenchmarkSQL-5.0.jar，但是該版本並不支持MySQL的TPC-C測試，需要做如下的修改。
3 修改benchmarksql源碼
3.1 修改benchmarksql-5.0/src/client/jTPCC.java，增加mysql相關部分，如下所示：
if (iDB.equals("firebird"))
dbType = DB_FIREBIRD;
else if (iDB.equals("oracle"))
dbType = DB_ORACLE;
else if (iDB.equals("postgres"))
dbType = DB_POSTGRES;
else if (iDB.equals("mysql"))
dbType = DB_UNKNOWN;
else
{
log.error("unknown database type '" + iDB + "'");
return;
}
3.2 修改benchmarksql-5.0/src/client/jTPCCConnection.java， SQL子查詢增加"AS L"別名，如下所示：
default:
stmtStockLevelSelectLow = dbConn.prepareStatement(
"SELECT count(*) AS low_stock FROM (" +
" SELECT s_w_id, s_i_id, s_quantity " +
" FROM bmsql_stock " +
" WHERE s_w_id = ? AND s_quantity < ? AND s_i_id IN (" +
" SELECT ol_i_id " +
" FROM bmsql_district " +
" JOIN bmsql_order_line ON ol_w_id = d_w_id " +
" AND ol_d_id = d_id " +
" AND ol_o_id >= d_next_o_id - 20 " +
" AND ol_o_id < d_next_o_id " +
" WHERE d_w_id = ? AND d_id = ? " +
" ) " +
" ) AS L");
break;
3.3 編譯修改后的源碼，此時得到的benchmarksql版本 benchmarksql-5.0/dist/BenchmarkSQL-5.0.jar 已經支持MySQL的TPC-C測試。
cd benchmarksql-5.0
ant
4 修改相關腳本，支持MySQL
4.1. 在benchmarksql-5.0/run目錄下，創建文件props.mysql，內容如下：
db=mysql
driver=com.mysql.jdbc.Driver
conn=jdbc:mysql://127.0.0.1:3306/db_admin
user=root
password=123456
warehouses=1
loadWorkers=4
terminals=1
//To run specified transactions per terminal- runMins must equal zero
runTxnsPerTerminal=10
//To run for specified minutes- runTxnsPerTerminal must equal zero
runMins=0
//Number of total transactions per minute
limitTxnsPerMin=300
//Set to true to run in 4.x compatible mode. Set to false to use the
//entire configured database evenly.
terminalWarehouseFixed=true
//The following five values must add up to 100
//The default percentages of 45, 43, 4, 4 & 4 match the TPC-C spec
newOrderWeight=45
paymentWeight=43
orderStatusWeight=4
deliveryWeight=4
stockLevelWeight=4
// Directory name to create for collecting detailed result data.
// Comment this out to suppress.
resultDirectory=my_result_%tY-%tm-%td_%tH%tM%tS
osCollectorScript=./misc/os_collector_linux.py
osCollectorInterval=1
//osCollectorSSHAddr=user@dbhost
osCollectorDevices=net_eth0 blk_sda
4.2. 修改 文件：benchmarksql-5.0/run/funcs.sh，添加mysql 數據庫類型。
function setCP()
{
case "$(getProp db)" in
firebird)
cp="../lib/firebird/*:../lib/*"
;;
oracle)
cp="../lib/oracle/*"
if [ ! -z "${ORACLE_HOME}" -a -d ${ORACLE_HOME}/lib ] ; then
cp="${cp}:${ORACLE_HOME}/lib/*"
fi
cp="${cp}:../lib/*"
;;
postgres)
cp="../lib/postgres/*:../lib/*"
;;
mysql)
cp="../lib/mysql/*:../lib/*"
;;
esac
myCP=".:${cp}:../dist/*"
export myCP
}
...省略
case "$(getProp db)" in
firebird|oracle|postgres|mysql)
;;
"") echo "ERROR: missing db= config option in ${PROPS}" >&2
exit 1
;;
*) echo "ERROR: unsupported database type 'db=$(getProp db)' in ${PROPS}" >&2
exit 1
;;
esac
4.3 添加mysql java connector驅動，mysql-connector-java-5.1.45.jar 需自行下載。
mkdir -p benchmarksql-5.0/lib/mysql
cp mysql-connector-java-5.1.45.jar benchmarksql-5.0/lib/mysql/
4.4 修改benchmarksql-5.0/run/runDatabaseBuild.sh，去掉extraHistID
AFTER_LOAD="indexCreates foreignKeys extraHistID buildFinish"
修改為：
AFTER_LOAD="indexCreates foreignKeys buildFinish"
5 測試MySQL TPC-C
cd benchmarksql-5.0/run
./runDatabaseBuild.sh props.mysql
./runBenchmark.sh props.mysql
修改后的benchmarksql對MySQL進行TPC-C測試，結果如下所示：
02:58:47,071 [Thread-1] INFO jTPCC : Term-00,
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Measured tpmC (NewOrders) = 136.71
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Measured tpmTOTAL = 298.81
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Session Start = 2018-12-27 02:53:46
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Session End = 2018-12-27 02:58:47
02:58:47,071 [Thread-1] INFO jTPCC : Term-00, Transaction Count = 1494
修改props.mysql參數后重新執行,比如調整如下兩個參數:
runTxnsPerTerminal=0
//To run for specified minutes- runTxnsPerTerminal must equal zero
runMins=20
重新執行:
./runDatabaseDestroy.sh my_postgres.properties
./runDatabaseBuild.sh my_postgres.properties
./runBenchmark.sh my_postgres.properties
6.輸出報表
安裝R
yum -y install R
執行完成后runBenchmark.sh后會在run目錄下生成一個結果目錄，執行如下的命令可以生成報表
./generateReport.sh my_result_2019-12-25_101117
將如下html文件下載到本地即可查看
流量指標(Throughput，簡稱tpmC)
按照TPC的定義，流量指標描述了系統在執行Payment、Order-status、Delivery、Stock-Level這四種交易的同時，每分鍾可以處理多少個New-Order交易。所有交易的響應時間必須滿足TPC-C測試規范的要求。
流量指標值越大越好！
性價比(Price/Performance，簡稱Price/tpmC)
即測試系統價格（指在美國的報價）與流量指標的比值。
性價比越小越好！