Mysqlslap: tutorial stress test: Difference between revisions

From OnnoCenterWiki
Jump to navigationJump to search
← Older editNewer edit →
Onnowpurbo (talk | contribs)
69,477 edits
Onnowpurbo (talk | contribs)
69,477 edits
No edit summary
Onnowpurbo (talk | contribs)
69,477 edits
No edit summary
Line 1: Line 1:
The mysqlslap utility makes it possible to benchmark and compare MySQL performance on different hardware, as well as accurately quantify the effect of a change in database design. This tutorial shows how you can use mysqlslap to run tests involving multiple clients, custom queries, different table engines, and much more.


One of the interesting new tools in MySQL 5.1.4 is mysqlslap, a load emulator that lets you see how well a particular query set or table engine performs under high-load conditions.
==Penggunaan Dasar==


A query that consumes too many database resources may be the result of designing tables incorrectly, choosing the wrong table type, or creating an inefficient query. When a query eats up a lot of database resources, it can negatively affect other application components. By using mysqlslap to stress test a server in a non-public environment, you will discover these errors sooner, allowing you to you avoid a database meltdown once your application goes live.


This tutorial shows how you can use mysqlslap to run stress tests involving multiple clients, custom queries, different table engines, and much more.
mysqlslap --user=root --password=123456 --auto-generate-sql


Basic usage
Output:


This simple (and unrealistic) example uses mysqlslap to test server performance assuming only one client connection:
Benchmark
Average number of seconds to run all queries: 0.008 seconds
Minimum number of seconds to run all queries: 0.008 seconds
Maximum number of seconds to run all queries: 0.008 seconds
Number of clients running queries: 1
Average number of queries per client: 0


shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql
Untuk melihat apa yang terjadi dengan --auto-generate-sql lakukan


Benchmark
mysqlslap --user=root --password=123456 --auto-generate-sql -vvv


                                               
Output:


           
Building Create Statements for Auto
 
Building Query Statements for Auto
Average number of seconds to run all queries: 0.006 seconds
Parsing engines to use.
 
  Starting Concurrency Test
Minimum number of seconds to run all queries: 0.006 seconds
 
Maximum number of seconds to run all queries: 0.006 seconds
 
Number of clients running queries: 1
 
 
Average number of queries per client: 0
 
The --auto-generate-sql switch tells mysqlslap to automatically generate and execute SQL statements, monitor how fast MySQL performs this task, and display the result. The results indicate that MySQL took 0.006 seconds to execute the SQL statements.
 
The --auto-generate-sql switch creates a table, executes an INSERT query and saves dummy data to it, executes a SELECT query to retrieve the dummy data, and then drops the table. You can see behind-the-scenes action by adding the -v switch to the mysqlslap command line (adding extra 'v's increases the verbosity level):
 
  shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql -vv
  DROP SCHEMA IF EXISTS `mysqlslap`;
  DROP SCHEMA IF EXISTS `mysqlslap`;
Loading Pre-data
  CREATE SCHEMA `mysqlslap`;
  CREATE SCHEMA `mysqlslap`;
  CREATE SCHEMA `mysqlslap`;
  CREATE SCHEMA `mysqlslap`;
  CREATE TABLE `t1` (intcol1 INT(32),charcol1 VARCHAR(128));
  CREATE TABLE `t1` (intcol1 INT(32) ,charcol1 VARCHAR(128));
  INSERT INTO t1 VALUES (1804289383,'mxvtvmC9127qJNm06sGB8R92q2j7vTiiITRDGXM9ZLzkdekbWtmXKwZ2qG1llkRw5m9DHOFilEREk3q7oce8O3BEJC0woJsm6uzFAEynLH2xCsw1KQ1lT4zg9rdxBL');
  INSERT INTO t1 VALUES (1804289383,'mxvtvmC9127qJNm06sGB8R92q2j7vTiiITRDGXM9ZLzkdekbWtmXKwZ2qG1llkRw5m9DHOFilEREk3q7oce8O3BEJC0woJsm6uzFAEynLH2xCsw1KQ1lT4zg9rdxBL');
  SELECT intcol1,charcol1 FROM t1;
  ..
 
..
Benchmark
INSERT INTO t1 VALUES (364531492,'qMa5SuKo4M5OM7ldvisSc6WK9rsG9E8sSixocHdgfa5uiiNTGFxkDJ4EAwWC2e4NL1BpAgWiFRcp1zIH6F1BayPdmwphatwnmzdwgzWnQ6SRxmcvtd6JRYwEKdvuWr');
 
Generating stats
Average number of seconds to run all queries: 0.007 seconds
Benchmark
 
Average number of seconds to run all queries: 0.011 seconds
Minimum number of seconds to run all queries: 0.007 seconds
Minimum number of seconds to run all queries: 0.011 seconds
 
Maximum number of seconds to run all queries: 0.011 seconds
Maximum number of seconds to run all queries: 0.007 seconds
Number of clients running queries: 1
 
Average number of queries per client: 0
Number of clients running queries: 1
 
Average number of queries per client: 0
 
  DROP SCHEMA IF EXISTS `mysqlslap`;
  DROP SCHEMA IF EXISTS `mysqlslap`;


It's unlikely that you'll have only a single client connecting to the MySQL server at any given time, so you'll typically also need the --concurrency switch, which lets you simulate multiple simultaneous client connections, like this:
shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100
Benchmark
Average number of seconds to run all queries: 0.698 seconds
Minimum number of seconds to run all queries: 0.698 seconds
Maximum number of seconds to run all queries: 0.698 seconds
Number of clients running queries: 100
Average number of queries per client: 0
MySQL performance drops pretty significantly (from 0.007 seconds to 0.698 seconds) when it has to deal with 100 clients instead of just one.
See what happens if you increase the number of concurrent connections even more:
shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=300
Benchmark
Average number of seconds to run all queries: 47.515 seconds
Minimum number of seconds to run all queries: 47.515 seconds
Maximum number of seconds to run all queries: 47.515 seconds
Number of clients running queries: 300
Average number of queries per client: 0
Note: As you increase the number of concurrent connections, you might encounter a "Too many connections" error. You need to adjust MySQL's 'max_connections' variable, which controls the maximum number of concurrent connections allowed by the server.
Running tests more than once
You can force mysqlslap to run a particular test more than once by adding the --iterations switch to the command line. This example runs the same test five times and prints a composite result:
shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100 --iterations=5
Benchmark
Average number of seconds to run all queries: 0.714 seconds
Minimum number of seconds to run all queries: 0.682 seconds
Maximum number of seconds to run all queries: 0.753 seconds
Number of clients running queries: 100
Average number of queries per client: 0
Specifying the total number of queries
It's possible to force each "client" to run a specific number of queries by adding the --number-of-queries switch to the mysqlslap command line. When mysqlslap encounters this switch, it divides the corresponding value by the number of concurrent connections and uses the result to decide how many queries each client should run.
For example, with settings of 500 total queries and five concurrent clients, mysqlslap will run 500/5 = 100 queries per client. Take a look at an example:


shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100 --number-of-queries=10000
Untuk mensimulasi banyak & simultan client connections


Benchmark


Average number of seconds to run all queries: 0.694 seconds
mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100


Minimum number of seconds to run all queries: 0.694 seconds
Output:


Maximum number of seconds to run all queries: 0.694 seconds
Benchmark
Average number of seconds to run all queries: 0.320 seconds
Minimum number of seconds to run all queries: 0.320 seconds
Maximum number of seconds to run all queries: 0.320 seconds
Number of clients running queries: 100
Average number of queries per client: 0


Number of clients running queries: 100
Coba naikan lagi


Average number of queries per client: 100


Using larger tables
mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=300


The default behavior of mysqlslap when using the --auto-generate-sql switch is to create a two-column table with one integer column and one character column. If this isn't representative of the kind of tables you typically use, you can adjust these settings to include more integer and/or character columns, with the --number-char-cols and --number-int-cols switches. Here are examples:
Output:


  shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100 --number-of-queries=1000 --number-char-cols=4 --number-int-cols=7
  Benchmark
Average number of seconds to run all queries: 1.674 seconds
Minimum number of seconds to run all queries: 1.674 seconds
Maximum number of seconds to run all queries: 1.674 seconds
Number of clients running queries: 300
Average number of queries per client: 0


Benchmark


Average number of seconds to run all queries: 1.290 seconds
Catatan: pada suatu saat, kita akan menghadapi error "Too many connections". Kita perlu mengatur variable MySQL 'max_connections' yang mengatur concurrent connections ke server.


Minimum number of seconds to run all queries: 1.290 seconds
==Run test lebih dari satu kali==


Maximum number of seconds to run all queries: 1.290 seconds


Number of clients running queries: 100
mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --iterations=5


Average number of queries per client: 10
Output:


  shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100 --number-char-cols=4
  Benchmark
Benchmark
Average number of seconds to run all queries: 0.313 seconds
Minimum number of seconds to run all queries: 0.286 seconds
Maximum number of seconds to run all queries: 0.347 seconds
Number of clients running queries: 100
Average number of queries per client: 0


Average number of seconds to run all queries: 0.968 seconds


Minimum number of seconds to run all queries: 0.968 seconds
==Menentukan total queries==


Maximum number of seconds to run all queries: 0.968 seconds
mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --number-of-queries=10000


Number of clients running queries: 100
Output:


Average number of queries per client: 0
Benchmark
Average number of seconds to run all queries: 9.486 seconds
Minimum number of seconds to run all queries: 9.486 seconds
Maximum number of seconds to run all queries: 9.486 seconds
Number of clients running queries: 100
Average number of queries per client: 100


shell>  /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100 --number-int-cols=5
Benchmark


Average number of seconds to run all queries: 1.076 seconds
==Menggunakan Tables yang besar==


Minimum number of seconds to run all queries: 1.076 seconds


Maximum number of seconds to run all queries: 1.076 seconds
mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --number-of-queries=1000 --number-char-cols=4 --number-int-cols=7


Number of clients running queries: 100
Output:


Average number of queries per client: 0
Benchmark
Average number of seconds to run all queries: 0.575 seconds
Minimum number of seconds to run all queries: 0.575 seconds
Maximum number of seconds to run all queries: 0.575 seconds
Number of clients running queries: 100
Average number of queries per client: 10


Using custom queries


While the --auto-generate-sql option is fine for general load testing, you may want to test the performance of a specific query on a database that already exists. In these situations, you can bypass the --auto-generate-sql switch and instead tell mysqlslap to use your own custom query with the --query switch. Here's the next example:
mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --number-char-cols=4


  shell> /usr/local/mysql/bin/mysqlslap  --user=john --create-schema=world --query="SELECT City.Name, City.District FROM City, Country WHERE City.CountryCode = Country.Code AND Country.Code = 'IND';" --concurrency=100 --iterations=5
  Benchmark
Average number of seconds to run all queries: 0.452 seconds
Minimum number of seconds to run all queries: 0.452 seconds
Maximum number of seconds to run all queries: 0.452 seconds
Number of clients running queries: 100
Average number of queries per client: 0


Benchmark


Average number of seconds to run all queries: 2.886 seconds
mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --number-int-cols=5


Minimum number of seconds to run all queries: 2.137 seconds
Benchmark
Average number of seconds to run all queries: 0.404 seconds
Minimum number of seconds to run all queries: 0.404 seconds
Maximum number of seconds to run all queries: 0.404 seconds
Number of clients running queries: 100
Average number of queries per client: 0


Maximum number of seconds to run all queries: 4.125 seconds


Number of clients running queries: 100
==Menggunakan Custom Query==


Average number of queries per client: 1
Asumsi kita mempunyai


It's helpful to use mysqlslap in this manner when you need to analyze the effect of a change in your database structure or indexing because it allows you to immediately grasp the impact of, say, an additional index on overall performance. To illustrate, look what happens to the time needed to run the previous query when an index is added to the City table:
* database world


mysql> CREATE INDEX idx_ccode ON City(CountryCode);
mysqlslap  --user=root --password=123456 --create-schema=world --query="SELECT City.Name, City.District FROM City, Country WHERE City.CountryCode = Country.Code AND Country.Code = 'IND';" --concurrency=100 --iterations=5


Query OK, 4079 rows affected (1.06 sec)


Records: 4079  Duplicates: 0  Warnings: 0 mysql> exit
Untuk mempercepat ada baiknya dilakukan INDEX pada tabel City
Bye
shell> /usr/local/mysql/bin/mysqlslap  --user=john --create-schema=world --query="SELECT City.Name, City.District FROM City, Country WHERE City.CountryCode = Country.Code AND Country.Code = 'IND';" --concurrency=100 --iterations=5
Benchmark


Average number of seconds to run all queries: 1.682 seconds
mysql -u root -p123456


Minimum number of seconds to run all queries: 1.396 seconds
USE world;
CREATE INDEX idx_ccode ON City(CountryCode);
exit


Maximum number of seconds to run all queries: 2.109 seconds


Number of clients running queries: 100
mysqlslap  --user=john --create-schema=world --query="SELECT City.Name, City.District FROM City, Country WHERE City.CountryCode = Country.Code AND Country.Code = 'IND';" --concurrency=100 --iterations=5


Average number of queries per client: 1


You can tell mysqlslap to create a custom table for your load testing by using the --create command-line switch with a CREATE TABLE command.
Kita dapat You can tell mysqlslap to create a custom table for your load testing by using the --create command-line switch with a CREATE TABLE command.
Comparing table engines
Comparing table engines


Revision as of 02:21, 8 June 2015

Penggunaan Dasar

mysqlslap --user=root --password=123456 --auto-generate-sql

Output: 

Benchmark
	Average number of seconds to run all queries: 0.008 seconds
	Minimum number of seconds to run all queries: 0.008 seconds
	Maximum number of seconds to run all queries: 0.008 seconds
	Number of clients running queries: 1
	Average number of queries per client: 0

Untuk melihat apa yang terjadi dengan --auto-generate-sql lakukan 

mysqlslap --user=root --password=123456 --auto-generate-sql -vvv

Output: 

Building Create Statements for Auto
Building Query Statements for Auto
Parsing engines to use.
Starting Concurrency Test
DROP SCHEMA IF EXISTS `mysqlslap`;
Loading Pre-data
CREATE SCHEMA `mysqlslap`;
CREATE SCHEMA `mysqlslap`;
CREATE TABLE `t1` (intcol1 INT(32) ,charcol1 VARCHAR(128));
INSERT INTO t1 VALUES (1804289383,'mxvtvmC9127qJNm06sGB8R92q2j7vTiiITRDGXM9ZLzkdekbWtmXKwZ2qG1llkRw5m9DHOFilEREk3q7oce8O3BEJC0woJsm6uzFAEynLH2xCsw1KQ1lT4zg9rdxBL');
..
..
INSERT INTO t1 VALUES (364531492,'qMa5SuKo4M5OM7ldvisSc6WK9rsG9E8sSixocHdgfa5uiiNTGFxkDJ4EAwWC2e4NL1BpAgWiFRcp1zIH6F1BayPdmwphatwnmzdwgzWnQ6SRxmcvtd6JRYwEKdvuWr');
Generating stats
Benchmark
	Average number of seconds to run all queries: 0.011 seconds
	Minimum number of seconds to run all queries: 0.011 seconds
	Maximum number of seconds to run all queries: 0.011 seconds
	Number of clients running queries: 1
	Average number of queries per client: 0

DROP SCHEMA IF EXISTS `mysqlslap`;


Untuk mensimulasi banyak & simultan client connections 


mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100

Output: 

Benchmark
	Average number of seconds to run all queries: 0.320 seconds
	Minimum number of seconds to run all queries: 0.320 seconds
	Maximum number of seconds to run all queries: 0.320 seconds
	Number of clients running queries: 100
	Average number of queries per client: 0

Coba naikan lagi 


mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=300

Output: 

Benchmark
	Average number of seconds to run all queries: 1.674 seconds
	Minimum number of seconds to run all queries: 1.674 seconds
	Maximum number of seconds to run all queries: 1.674 seconds
	Number of clients running queries: 300
	Average number of queries per client: 0


Catatan: pada suatu saat, kita akan menghadapi error "Too many connections". Kita perlu mengatur variable MySQL 'max_connections' yang mengatur concurrent connections ke server.

Run test lebih dari satu kali

mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --iterations=5

Output: 

Benchmark
	Average number of seconds to run all queries: 0.313 seconds
	Minimum number of seconds to run all queries: 0.286 seconds
	Maximum number of seconds to run all queries: 0.347 seconds
	Number of clients running queries: 100
	Average number of queries per client: 0


Menentukan total queries

mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --number-of-queries=10000

Output: 

Benchmark
	Average number of seconds to run all queries: 9.486 seconds
	Minimum number of seconds to run all queries: 9.486 seconds
	Maximum number of seconds to run all queries: 9.486 seconds
	Number of clients running queries: 100
	Average number of queries per client: 100


Menggunakan Tables yang besar

mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --number-of-queries=1000 --number-char-cols=4 --number-int-cols=7

Output: 

Benchmark
	Average number of seconds to run all queries: 0.575 seconds
	Minimum number of seconds to run all queries: 0.575 seconds
	Maximum number of seconds to run all queries: 0.575 seconds
	Number of clients running queries: 100
	Average number of queries per client: 10



mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --number-char-cols=4

Benchmark
	Average number of seconds to run all queries: 0.452 seconds
	Minimum number of seconds to run all queries: 0.452 seconds
	Maximum number of seconds to run all queries: 0.452 seconds
	Number of clients running queries: 100
	Average number of queries per client: 0



mysqlslap --user=root --password=123456 --auto-generate-sql --concurrency=100 --number-int-cols=5

Benchmark
	Average number of seconds to run all queries: 0.404 seconds
	Minimum number of seconds to run all queries: 0.404 seconds
	Maximum number of seconds to run all queries: 0.404 seconds
	Number of clients running queries: 100
	Average number of queries per client: 0


Menggunakan Custom Query

Asumsi kita mempunyai

  • database world
mysqlslap  --user=root --password=123456 --create-schema=world --query="SELECT City.Name, City.District FROM City, Country WHERE City.CountryCode = Country.Code AND Country.Code = 'IND';" --concurrency=100 --iterations=5


Untuk mempercepat ada baiknya dilakukan INDEX pada tabel City 

mysql -u root -p123456

USE world;
CREATE INDEX idx_ccode ON City(CountryCode);
exit



mysqlslap  --user=john --create-schema=world --query="SELECT City.Name, City.District FROM City, Country WHERE City.CountryCode = Country.Code AND Country.Code = 'IND';" --concurrency=100 --iterations=5


Kita dapat You can tell mysqlslap to create a custom table for your load testing by using the --create command-line switch with a CREATE TABLE command. Comparing table engines

A cool feature of mysqlslap is the ability to specify the table engine used in the test. This provides database designers with an easy way to compare the performance of different table types under different load conditions. The --engine switch accepts any of MySQL's supported table types and creates test tables using the corresponding storage engine. Here's an example of how it could be used:

shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100 --number-of-queries=700 --engine=innodb

Benchmark

Running for engine innodb

Average number of seconds to run all queries: 1.240 seconds

Minimum number of seconds to run all queries: 1.240 seconds

Maximum number of seconds to run all queries: 1.240 seconds

Number of clients running queries: 100

Average number of queries per client: 7 shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100 --number-of-queries=700 --engine=myisam Benchmark

Running for engine myisam

Average number of seconds to run all queries: 0.676 seconds

Minimum number of seconds to run all queries: 0.676 seconds

Maximum number of seconds to run all queries: 0.676 seconds

Number of clients running queries: 100

Average number of queries per client: 7

shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100 --number-of-queries=700 --engine=memory Benchmark

Running for engine memory

Average number of seconds to run all queries: 0.602 seconds

Minimum number of seconds to run all queries: 0.602 seconds

Maximum number of seconds to run all queries: 0.602 seconds

Number of clients running queries: 100

Average number of queries per client: 7

Saving reports

You might wish to save a mysqlslap report so you can compare it to a previous or future test run; you may also want to use the report as a reference when you're configuring new systems.

The easiest way to save a mysqlslap report is to pipe the output of a mysqlslap run to a file, as below:

shell> /usr/local/mysql/bin/mysqlslap --user=john --auto-generate-sql --concurrency=100 --number-of-queries=1000 --number-char-cols=4 --number-int-cols=7 >> /tmp/output.log

You can force mysqlslap to generate reports in CSV format; this is often useful if you need to import the data into a spreadsheet or database to build graphical reports from it. To do this, add the --csv switch to your mysqlslap command line and specify the output filename as an argument to this switch. Here's an example:

shell> /usr/local/mysql/bin/mysqlslap --csv=/tmp/output.csv --user=john --auto-generate-sql --concurrency=100 --number-of-queries=1000 --number-char-cols=4 --number-int-cols=7

Here's what the CSV file would contain if you peeked inside it:

shell> cat /tmp/output.csv ,query,1.070,1.070,1.070,100,10

Trying mysqlslap

The mysqlslap utility makes it possible to benchmark and compare MySQL performance on different hardware, as well as accurately quantify the effect of a change in database design. Try mysqlslap out for yourself and see how well your database server behaves under pressure from thousands of client connections.


Referensi

Retrieved from "https://lms.onnocenter.or.id/wiki/index.php?title=Mysqlslap:_tutorial_stress_test&oldid=43509"