etcd-io
/
dbtester
mirror of https://github.com/etcd-io/dbtester.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
Distributed database benchmark tester
902 Commits 5 Branches 0 Tags 114 MiB
Go 92.8%
Shell 7.2%
Go to file
Gyu-Ho Lee 13c3c275a2
bench-configuration: fix title 		2017-02-04 21:27:28 -08:00
agent agent: use 'TopStream' for process metrics 2017-02-04 02:31:55 -08:00
analyze analyze: fix benchmark interpolation, new results 2017-02-04 21:10:40 -08:00
bench-configuration bench-configuration: fix title 2017-02-04 21:27:28 -08:00
bench-results analyze: fix benchmark interpolation, new results 2017-02-04 21:10:40 -08:00
control control: save MIN,MAX latency 2017-02-04 13:26:20 -08:00
pkg pkg/report: manual vendoring 2017-02-04 13:05:33 -08:00
scripts Update tests.sh 2017-02-02 23:59:29 -08:00
vendor vendor: update 'dataframe' 2017-02-04 20:30:20 -08:00
.gitignore *: clean up test and other scripts, update travis 2016-10-31 21:04:32 -07:00
.travis.yml Update .travis.yml 2017-01-26 15:38:59 -08:00
CONTRIBUTING.md initial commit 2016-03-15 17:06:35 -07:00
DCO initial commit 2016-03-15 17:06:35 -07:00
LICENSE initial commit 2016-03-15 17:06:35 -07:00
NOTICE initial commit 2016-03-15 17:06:35 -07:00
README.md analyze: fix benchmark interpolation, new results 2017-02-04 21:10:40 -08:00
glide.lock vendor: update 'dataframe' 2017-02-04 20:30:20 -08:00
glide.yaml vendor: update 'dataframe' 2017-02-04 20:30:20 -08:00
main.go *: update README, command desription 2017-01-09 15:19:53 -08:00

README.md

dbtester

Build Status Godoc

Distributed database benchmark tester: etcd, Zookeeper, Consul

For etcd, we also recommend etcd benchmark tool.

All logs and results can be found at https://console.cloud.google.com/storage/browser/dbtester-results



Write 1M keys, 256-byte key, 1KB value value, clients 1 to 1,000
  • Google Cloud Compute Engine
  • 4 machines of 16 vCPUs + 30 GB Memory + 150 GB SSD (1 for client)
  • Ubuntu 16.10
  • etcd v3.1 (Go 1.7.4)
  • Zookeeper r3.4.9
    • Java 8
    • javac 1.8.0_121
    • Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
    • Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)
  • Consul v0.7.3 (Go 1.7.4)
+-----------------------------+-------------------+------------------------+-----------------------+
|                             | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 |
+-----------------------------+-------------------+------------------------+-----------------------+
|   READS-COMPLETED-DELTA-SUM |                 2 |                    218 |                   126 |
|     SECTORS-READS-DELTA-SUM |                 0 |                      0 |                     0 |
|  WRITES-COMPLETED-DELTA-SUM |         1,217,752 |                955,419 |             2,183,202 |
|   SECTORS-WRITTEN-DELTA-SUM |           702,780 |             11,846,404 |             3,991,232 |
|       AVG-DATA-SIZE-ON-DISK |            2.5 GB |                 7.4 GB |                3.1 GB |
|    NETWORK-RECEIVE-DATA-SUM |            5.1 GB |                 5.0 GB |                5.5 GB |
|   NETWORK-TRANSMIT-DATA-SUM |            3.9 GB |                 4.0 GB |                4.2 GB |
|               MAX-CPU-USAGE |          451.00 % |               800.00 % |              409.33 % |
|            MAX-MEMORY-USAGE |        1316.36 MB |             3596.23 MB |            4691.18 MB |
|               TOTAL-SECONDS |      324.5626 sec |           335.0999 sec |          667.9389 sec |
|              MAX-THROUGHPUT |    36,479 req/sec |         41,799 req/sec |        15,969 req/sec |
|              AVG-THROUGHPUT |     3,081 req/sec |          2,961 req/sec |         1,497 req/sec |
|              MIN-THROUGHPUT |        79 req/sec |              0 req/sec |            49 req/sec |
|             FASTEST-LATENCY |         1.0313 ms |              1.1256 ms |             2.9151 ms |
|                 AVG-LATENCY |        13.4807 ms |             25.5780 ms |            47.0926 ms |
|             SLOWEST-LATENCY |       261.8235 ms |           4260.5699 ms |         22260.1112 ms |
|                 Latency p10 |       2.201212 ms |            2.528874 ms |           3.926152 ms |
|                 Latency p25 |       5.636563 ms |            3.821957 ms |           7.640734 ms |
|                 Latency p50 |       9.696159 ms |            6.656013 ms |          19.126381 ms |
|                 Latency p75 |      16.202583 ms |           11.576279 ms |          54.750630 ms |
|                 Latency p90 |      28.434395 ms |           14.472618 ms |          77.993718 ms |
|                 Latency p95 |      44.336815 ms |           16.786180 ms |          91.026490 ms |
|                 Latency p99 |      60.008762 ms |          479.797108 ms |         201.844359 ms |
|               Latency p99.9 |      84.831886 ms |         2725.947720 ms |        1502.535463 ms |
|  CLIENT-NETWORK-RECEIVE-SUM |            270 MB |                 353 MB |                200 MB |
| CLIENT-NETWORK-TRANSMIT-SUM |            1.5 GB |                 1.4 GB |                1.5 GB |
|        CLIENT-MAX-CPU-USAGE |          577.00 % |               496.00 % |              210.00 % |
|     CLIENT-MAX-MEMORY-USAGE |            355 MB |                 3.3 GB |                227 MB |
|          CLIENT-ERROR-COUNT |                 0 |                  7,495 |                     0 |
+-----------------------------+-------------------+------------------------+-----------------------+
2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-LATENCY-MS 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-LATENCY-MS-BY-KEY 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-LATENCY-MS-BY-KEY-ERROR-POINTS 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-THROUGHPUT 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-VOLUNTARY-CTXT-SWITCHES 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-NON-VOLUNTARY-CTXT-SWITCHES 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-CPU 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-VMRSS-MB 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-VMRSS-MB-BY-KEY 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-VMRSS-MB-BY-KEY-ERROR-POINTS 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-READS-COMPLETED-DELTA 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-SECTORS-READ-DELTA 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-WRITES-COMPLETED-DELTA 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-SECTORS-WRITTEN-DELTA 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-RECEIVE-BYTES-NUM-DELTA 2017Q1-02-etcd-zookeeper-consul/01-write-1M-keys-client-variable/AVG-TRANSMIT-BYTES-NUM-DELTA