Distributed database benchmark tester

benchmark consul database database-benchmarking distributed-database distributed-systems etcd go performance-analysis performance-visualization zookeeper

Go to file

Gyu-Ho Lee fdaf741dd7 vendor: update psn, add tablewriter		2017-01-23 20:37:38 -08:00
agent	agent: fix 'ClientNum' setting	2017-01-17 15:14:37 -08:00
analyze	analyze: improve aggregation, tablewriter	2017-01-23 20:37:05 -08:00
bench-configuration	bench-configuration: fix IP	2017-01-23 19:57:26 -08:00
control	control, bench-configuration: update client variables	2017-01-23 16:38:44 -08:00
remotestorage	*: improve upload, error logging	2016-11-15 14:36:12 -08:00
scripts	*: fix tests, go vet	2017-01-19 15:38:30 -08:00
vendor	vendor: update psn, add tablewriter	2017-01-23 20:37:38 -08:00
.gitignore	*: clean up test and other scripts, update travis	2016-10-31 21:04:32 -07:00
.travis.yml	Update .travis.yml	2017-01-20 11:06:43 -08:00
CONTRIBUTING.md	initial commit	2016-03-15 17:06:35 -07:00
DCO	initial commit	2016-03-15 17:06:35 -07:00
LICENSE	initial commit	2016-03-15 17:06:35 -07:00
NOTICE	initial commit	2016-03-15 17:06:35 -07:00
README.md	README: add working in progress results	2017-01-23 20:37:21 -08:00
glide.lock	glide: update psn, tablewriter	2017-01-23 20:34:37 -08:00
glide.yaml	glide: update psn, tablewriter	2017-01-23 20:34:37 -08:00
main.go	*: update README, command desription	2017-01-09 15:19:53 -08:00

README.md

dbtester

Distributed database tester

Database agent and runner are implemented at https://github.com/coreos/dbtester/tree/master/agent
Client is implemented at https://github.com/coreos/dbtester/tree/master/control
System metrics are collected via https://github.com/gyuho/psn
Data analysis is done via https://github.com/coreos/dbtester/tree/master/analyze
- https://github.com/gyuho/dataframe
- https://github.com/gonum/plot

For etcd, we also recommend etcd benchmark tool.

Latest Results

All logs and results can be found at https://console.cloud.google.com/storage/browser/dbtester-results

Google Cloud Compute Engine
4 machines of 16 vCPUs + 30 GB Memory + 150 GB SSD (1 for client)
Ubuntu 16.10
etcd v3.1 (Go 1.7.4)
Zookeeper r3.4.9
- Java 8
- Java(TM) SE Runtime Environment (build 1.8.0_111-b14)
- Java HotSpot(TM) 64-Bit Server VM (build 25.111-b14, mixed mode)
- javac 1.8.0_111
Consul v0.7.2 (Go 1.7.4)
zetcd v3.1 (Go 1.7.4)
cetcd v3.1 (Go 1.7.4)

Write 1M keys, 1000-client, 256-byte key, 1KB value

+------------------------------+-------------------+------------------------+-----------------------+
|                              | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.2-go1.7.4 |
+------------------------------+-------------------+------------------------+-----------------------+
|    READS-COMPLETED-DELTA     |         6         |           6            |          15           |
|   SECTORS-READS-DELTA-SUM    |         0         |           0            |           0           |
|  WRITES-COMPLETED-DELTA-SUM  |       96474       |         77628          |        940695         |
|  SECTORS-WRITTEN-DELTA-SUM   |      542512       |        9387436         |       41272068        |
|      RECEIVE-BYTES-SUM       |      4.9 GB       |         5.1 GB         |        7.7 GB         |
| RECEIVE-BYTES-NUM-DELTA-SUM  |    4879653590     |       5061811231       |      7744263649       |
|      TRANSMIT-BYTES-SUM      |      3.7 GB       |         4.1 GB         |        6.5 GB         |
| TRANSMIT-BYTES-NUM-DELTA-SUM |    3749247743     |       4050548646       |      6518060316       |
|        TOTAL-SECONDS         |     36.2024 s     |       62.0373 s        |      467.9311 s       |
|        AVG-THROUGHPUT        |    27622.4453     |       15951.5555       |       2137.0667       |
|       SLOWEST-LATENCY        |    246.4560 ms    |      6650.0930 ms      |     30388.9318 ms     |
|       FASTEST-LATENCY        |     5.3413 ms     |       1.7698 ms        |      21.5605 ms       |
|         AVG-LATENCY          |    36.1057 ms     |       37.7865 ms       |      467.4253 ms      |
|             p10              |   13.712090 ms    |      11.923543 ms      |     65.910086 ms      |
|             p25              |   16.625779 ms    |      14.581663 ms      |     77.221971 ms      |
|             p50              |   22.306160 ms    |      19.217649 ms      |     120.663354 ms     |
|             p75              |   40.376905 ms    |      23.642903 ms      |     716.373543 ms     |
|             p90              |   65.849751 ms    |      28.756700 ms      |    1068.038406 ms     |
|             p95              |   137.545464 ms   |      59.868096 ms      |    1080.751412 ms     |
|             p99              |   177.127309 ms   |     544.858078 ms      |    2686.919571 ms     |
|            p99.9             |   198.540415 ms   |     2457.827147 ms     |    19041.188919 ms    |
+------------------------------+-------------------+------------------------+-----------------------+

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-LATENCY-MS

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-THROUGHPUT

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-CPU

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-VOLUNTARY-CTXT-SWITCHES

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-NON-VOLUNTARY-CTXT-SWITCHES

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-VMRSS-MB

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-READS-COMPLETED-DELTA

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-SECTORS-READ-DELTA

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-WRITES-COMPLETED-DELTA

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-SECTORS-WRITTEN-DELTA

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-RECEIVE-BYTES-NUM-DELTA

2017Q1-01-etcd-zookeeper-consul/01-write-1M-keys/AVG-TRANSMIT-BYTES-NUM-DELTA