1. 程式人生 > >sysbench對MySQL的壓測,使用sysbench壓測磁盤io

sysbench對MySQL的壓測,使用sysbench壓測磁盤io

onf possible inf bubuko 最新版本 number 現在 nbsp tis

QPS - query per second
TPS - transaction per second 不是特別關註,每個業務場景中事務標準是不一樣的

Ⅰ、sysbench測試框架

技術分享圖片

Ⅱ、常用測試腳本

[root@VM_42_63_centos lua]# pwd
/usr/local/src/sysbench-master/src/lua
[root@VM_42_63_centos lua]# ll *.lua
-rwxr-xr-x 1 root root  1446 Jun 27 02:35 bulk_insert.lua
-rw-r--r-- 1 root root  1307 Jun 27 02:35 empty-test.lua
-rw-r--r-- 1 root root 14468 Jun 27 02:35 oltp_common.lua
-rwxr-xr-x 1 root root  1290 Jun 27 02:35 oltp_delete.lua
-rwxr-xr-x 1 root root  2415 Jun 27 02:35 oltp_insert.lua
-rwxr-xr-x 1 root root  1265 Jun 27 02:35 oltp_point_select.lua
-rwxr-xr-x 1 root root  1649 Jun 27 02:35 oltp_read_only.lua
-rwxr-xr-x 1 root root  1824 Jun 27 02:35 oltp_read_write.lua
-rwxr-xr-x 1 root root  1118 Jun 27 02:35 oltp_update_index.lua
-rwxr-xr-x 1 root root  1127 Jun 27 02:35 oltp_update_non_index.lua
-rwxr-xr-x 1 root root  1440 Jun 27 02:35 oltp_write_only.lua
-rw-r--r-- 1 root root  1631 Jun 27 02:35 prime-test.lua
-rwxr-xr-x 1 root root  1933 Jun 27 02:35 select_random_points.lua
-rwxr-xr-x 1 root root  2132 Jun 27 02:35 select_random_ranges.lua

Ⅲ、開搞

這個老版本好像有參數設置熱數據的量什麽的,現在最新版本不知道咋搞,就先將就直接弄吧,不管了

準備數據
[root@VM_42_63_centos lua]# sysbench --mysql-host=127.0.0.1 --mysql-port=3307 --mysql-db=sbtest --tables=10 --table-size=10000 --mysql-user=root --mysql-password=123 oltp_update_index.lua prepare
sysbench 1.1.0 (using bundled LuaJIT 2.1.0-beta3)

Creating table ‘sbtest1‘...
Inserting 10000 records into ‘sbtest1‘
Creating a secondary index on ‘sbtest1‘...
Creating table ‘sbtest2‘...
Inserting 10000 records into ‘sbtest2‘
Creating a secondary index on ‘sbtest2‘...
Creating table ‘sbtest3‘...
Inserting 10000 records into ‘sbtest3‘
Creating a secondary index on ‘sbtest3‘...
...

開始測試
[root@VM_42_63_centos lua]# sysbench oltp_update_index.lua --mysql-host=127.0.0.1 --mysql-port=3307 --mysql-user=root --mysql-password=123 --threads=10 --time=120 --report-interval=10 run
sysbench 1.1.0 (using bundled LuaJIT 2.1.0-beta3)

Running the test with following options:
Number of threads: 10
Report intermediate results every 10 second(s)
Initializing random number generator from current time


Initializing worker threads...

Threads started!

[ 10s ] thds: 10 tps: 804.14 qps: 804.14 (r/w/o: 0.00/804.14/0.00) lat (ms,95%): 36.89 err/s: 0.00 reconn/s: 0.00
[ 20s ] thds: 10 tps: 647.70 qps: 647.70 (r/w/o: 0.00/647.70/0.00) lat (ms,95%): 35.59 err/s: 0.00 reconn/s: 0.00
[ 30s ] thds: 10 tps: 2220.50 qps: 2220.50 (r/w/o: 0.00/2220.50/0.00) lat (ms,95%): 18.28 err/s: 0.00 reconn/s: 0.00
[ 40s ] thds: 10 tps: 4566.59 qps: 4566.59 (r/w/o: 0.00/4566.59/0.00) lat (ms,95%): 2.71 err/s: 0.00 reconn/s: 0.00
[ 50s ] thds: 10 tps: 4194.30 qps: 4194.30 (r/w/o: 0.00/4194.30/0.00) lat (ms,95%): 7.30 err/s: 0.00 reconn/s: 0.00
[ 60s ] thds: 10 tps: 4717.91 qps: 4717.91 (r/w/o: 0.00/4717.91/0.00) lat (ms,95%): 2.76 err/s: 0.00 reconn/s: 0.00
...

看結果,這裏就不解釋了,比較簡單,隨便看看就好
SQL statistics:
    queries performed:
        read:                            0
        write:                           665574
        other:                           0
        total:                           665574
    transactions:                        665574 (5546.21 per sec.)
    queries:                             665574 (5546.21 per sec.)
    ignored errors:                      0      (0.00 per sec.)
    reconnects:                          0      (0.00 per sec.)

Throughput:
    events/s (eps):                      5546.2076
    time elapsed:                        120.0052s
    total number of events:              665574

Latency (ms):
         min:                                    0.27
         avg:                                    1.80
         max:                                  123.45
         95th percentile:                        2.43
         sum:                              1199263.13

Threads fairness:
    events (avg/stddev):           66557.4000/209.28
    execution time (avg/stddev):   119.9263/0.00




Ⅰ、sysbench安裝

cd /usr/local/src
yum -y install make automake libtool pkgconfig libaio-devel
git clone https://github.com/akopytov/sysbench.git
cd sysbench
./autogen.sh
./configure
make -j 4
make install
ldconfig /usr/local/mysql/lib

[root@VM_42_63_centos sysbench]# sysbench --version;
sysbench 1.1.0-50966c8

Ⅱ、file io測試

2,1 生成測試文件

sysbench fileio --file-num=4 --file-block-size=16384 --file-total-size=110G prepare

2.2 看下參數

[root@VM_42_63_centos data]# sysbench fileio help
sysbench 1.1.0-50966c8 (using bundled LuaJIT 2.1.0-beta3)

fileio options:
  --file-num=N                  number of files to create [128]
  --file-block-size=N           block size to use in all IO operations [16384]
  --file-total-size=SIZE        total size of files to create [2G]
  --file-test-mode=STRING       test mode {seqwr, seqrewr, seqrd, rndrd, rndwr, rndrw}
  --file-io-mode=STRING         file operations mode {sync,async,mmap} [sync]
  --file-extra-flags=[LIST,...] list of additional flags to use to open files {sync,dsync,direct} []
  --file-fsync-freq=N           do fsync() after this number of requests (0 - don‘t use fsync()) [100]
  --file-fsync-all[=on|off]     do fsync() after each write operation [off]
  --file-fsync-end[=on|off]     do fsync() at the end of test [on]
  --file-fsync-mode=STRING      which method to use for synchronization {fsync, fdatasync} [fsync]
  --file-merged-requests=N      merge at most this number of IO requests if possible (0 - don‘t merge) [0]
  --file-rw-ratio=N             reads/writes ratio for combined test [1.5]

2.3 測兩把看看

  • 先看隨機讀
[root@VM_42_63_centos sysdata]# sysbench fileio > --time=180 > --threads=24 > --file-total-size=110G > --file-test-mode=rndrd > --file-num=4 > --file-extra-flags=direct > --file-fsync-freq=0 > --file-block-size=16384 > run
sysbench 1.1.0-50966c8 (using bundled LuaJIT 2.1.0-beta3)

Running the test with following options:
Number of threads: 24
Initializing random number generator from current time


Extra file open flags: directio
4 files, 2.5GiB each
10GiB total file size
Block size 16KiB
Number of IO requests: 0
Read/Write ratio for combined random IO test: 1.50
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing random read test
Initializing worker threads...

Threads started!


Throughput:
         read:  IOPS=1752.15 27.38 MiB/s (28.71 MB/s)
         write: IOPS=0.00 0.00 MiB/s (0.00 MB/s)
         fsync: IOPS=0.00

Latency (ms):
         min:                                  0.07
         avg:                                 13.70
         max:                                687.59
         95th percentile:                     36.89
         sum:                            4319633.88
  • 再看隨機寫
[root@VM_42_63_centos sysdata]# sysbench fileio > --time=180 > --threads=24 > --file-total-size=110G > --file-test-mode=rndwr > --file-num=4 > --file-extra-flags=direct > --file-fsync-freq=0 > --file-block-size=16384 > run
sysbench 1.1.0-50966c8 (using bundled LuaJIT 2.1.0-beta3)

Running the test with following options:
Number of threads: 24
Initializing random number generator from current time


Extra file open flags: directio
4 files, 2.5GiB each
10GiB total file size
Block size 16KiB
Number of IO requests: 0
Read/Write ratio for combined random IO test: 1.50
Calling fsync() at the end of test, Enabled.
Using synchronous I/O mode
Doing random write test
Initializing worker threads...

Threads started!


Throughput:
         read:  IOPS=0.00 0.00 MiB/s (0.00 MB/s)
         write: IOPS=1094.75 17.11 MiB/s (17.94 MB/s)
         fsync: IOPS=0.53

Latency (ms):
         min:                                  0.09
         avg:                                 21.92
         max:                               3376.77
         95th percentile:                     94.10
         sum:                            4319984.68

隨機讀的iops為1752,隨機寫的iops為1094,讀寫非對稱

清理測試文件用cleanup選項即可

我們主要看隨機寫的性能哦

sysbench對MySQL的壓測,使用sysbench壓測磁盤io