etcd-io
/
dbtester
mirror of https://github.com/etcd-io/dbtester.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #280 from gyuho/aa 

*: save raw data for network bytes sum
This commit is contained in:
Gyu-Ho Lee 2017-02-09 09:45:06 -08:00 committed by GitHub
parent af3e8a3703 bb627b6771
commit 6509e2dc81
3 changed files with 372 additions and 323 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

57
README.md
View File

@ -20,6 +20,7 @@ For etcd, we recommend [etcd benchmark tool](https://github.com/coreos/etcd/tree
All logs and results can be found at https://github.com/coreos/dbtester/tree/master/test-results All logs and results can be found at https://github.com/coreos/dbtester/tree/master/test-results
<br><br><hr> <br><br><hr>
##### Write 1M keys, 256-byte key, 1KB value value, clients 1 to 1,000 ##### Write 1M keys, 256-byte key, 1KB value value, clients 1 to 1,000
@ -36,9 +37,9 @@ All logs and results can be found at https://github.com/coreos/dbtester/tree/mas
``` ```
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 | | | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| TOTAL-SECONDS | 338.7661 sec | 344.3563 sec | 703.7060 sec | | TOTAL-SECONDS | 338.7661 sec | 344.3563 sec | 703.7060 sec |
| TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 | | TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 |
| MAX-THROUGHPUT | 35,147 req/sec | 31,726 req/sec | 15,328 req/sec | | MAX-THROUGHPUT | 35,147 req/sec | 31,726 req/sec | 15,328 req/sec |
@ -55,10 +56,10 @@ All logs and results can be found at https://github.com/coreos/dbtester/tree/mas
| Latency p95 | 44.023164 ms | 44.599685 ms | 165.331967 ms | | Latency p95 | 44.023164 ms | 44.599685 ms | 165.331967 ms |
| Latency p99 | 60.351324 ms | 1063.554863 ms | 430.071868 ms | | Latency p99 | 60.351324 ms | 1063.554863 ms | 430.071868 ms |
| Latency p99.9 | 94.058105 ms | 2336.144865 ms | 12648.734251 ms | | Latency p99.9 | 94.058105 ms | 2336.144865 ms | 12648.734251 ms |
| SERVER-TOTAL-NETWORK-RECEIVE-DATA-SUM | 5.1 GB | 5.4 GB | 7.9 GB | | SERVER-TOTAL-NETWORK-RX-DATA-SUM | 5.1 GB | 5.4 GB | 7.9 GB |
| SERVER-TOTAL-NETWORK-TRANSMIT-DATA-SUM | 3.9 GB | 4.4 GB | 6.6 GB | | SERVER-TOTAL-NETWORK-TX-DATA-SUM | 3.9 GB | 4.4 GB | 6.6 GB |
| CLIENT-TOTAL-NETWORK-RECEIVE-SUM | 270 MB | 357 MB | 202 MB | | CLIENT-TOTAL-NETWORK-RX-SUM | 270 MB | 357 MB | 202 MB |
| CLIENT-TOTAL-NETWORK-TRANSMIT-SUM | 1.5 GB | 1.4 GB | 1.5 GB | | CLIENT-TOTAL-NETWORK-TX-SUM | 1.5 GB | 1.4 GB | 1.5 GB |
| SERVER-MAX-CPU-USAGE | 434.00 % | 600.67 % | 416.00 % | | SERVER-MAX-CPU-USAGE | 434.00 % | 600.67 % | 416.00 % |
| SERVER-MAX-MEMORY-USAGE | 1.3 GB | 4.0 GB | 5.4 GB | | SERVER-MAX-MEMORY-USAGE | 1.3 GB | 4.0 GB | 5.4 GB |
| CLIENT-MAX-CPU-USAGE | 540.00 % | 322.00 % | 204.00 % | | CLIENT-MAX-CPU-USAGE | 540.00 % | 322.00 % | 204.00 % |
@ -69,7 +70,7 @@ All logs and results can be found at https://github.com/coreos/dbtester/tree/mas
| SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 1,217,294 | 953,784 | 2,381,092 | | SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 1,217,294 | 953,784 | 2,381,092 |
| SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 714,152 | 9,304,072 | 10,711,132 | | SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 714,152 | 9,304,072 | 10,711,132 |
| SERVER-AVG-DATA-SIZE-ON-DISK | 3.0 GB | 7.9 GB | 3.0 GB | | SERVER-AVG-DATA-SIZE-ON-DISK | 3.0 GB | 7.9 GB | 3.0 GB |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
zookeeper errors: zookeeper errors:
@ -159,9 +160,9 @@ zookeeper errors:
``` ```
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 | | | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| TOTAL-SECONDS | 37.3284 sec | 75.0700 sec | 304.4858 sec | | TOTAL-SECONDS | 37.3284 sec | 75.0700 sec | 304.4858 sec |
| TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 | | TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 |
| MAX-THROUGHPUT | 33,567 req/sec | 35,499 req/sec | 15,141 req/sec | | MAX-THROUGHPUT | 33,567 req/sec | 35,499 req/sec | 15,141 req/sec |
@ -178,10 +179,10 @@ zookeeper errors:
| Latency p95 | 76.533161 ms | 11.992104 ms | 349.281928 ms | | Latency p95 | 76.533161 ms | 11.992104 ms | 349.281928 ms |
| Latency p99 | 146.318242 ms | 153.580393 ms | 1324.508306 ms | | Latency p99 | 146.318242 ms | 153.580393 ms | 1324.508306 ms |
| Latency p99.9 | 183.924901 ms | 1935.929712 ms | 10622.316021 ms | | Latency p99.9 | 183.924901 ms | 1935.929712 ms | 10622.316021 ms |
| SERVER-TOTAL-NETWORK-RECEIVE-DATA-SUM | 5.0 GB | 6.2 GB | 11 GB | | SERVER-TOTAL-NETWORK-RX-DATA-SUM | 5.0 GB | 6.2 GB | 11 GB |
| SERVER-TOTAL-NETWORK-TRANSMIT-DATA-SUM | 3.8 GB | 5.1 GB | 10 GB | | SERVER-TOTAL-NETWORK-TX-DATA-SUM | 3.8 GB | 5.1 GB | 10 GB |
| CLIENT-TOTAL-NETWORK-RECEIVE-SUM | 274 MB | 350 MB | 216 MB | | CLIENT-TOTAL-NETWORK-RX-SUM | 274 MB | 350 MB | 216 MB |
| CLIENT-TOTAL-NETWORK-TRANSMIT-SUM | 1.4 GB | 1.4 GB | 1.5 GB | | CLIENT-TOTAL-NETWORK-TX-SUM | 1.4 GB | 1.4 GB | 1.5 GB |
| SERVER-MAX-CPU-USAGE | 407.67 % | 704.97 % | 380.00 % | | SERVER-MAX-CPU-USAGE | 407.67 % | 704.97 % | 380.00 % |
| SERVER-MAX-MEMORY-USAGE | 1.1 GB | 5.1 GB | 6.2 GB | | SERVER-MAX-MEMORY-USAGE | 1.1 GB | 5.1 GB | 6.2 GB |
| CLIENT-MAX-CPU-USAGE | 454.00 % | 292.00 % | 202.00 % | | CLIENT-MAX-CPU-USAGE | 454.00 % | 292.00 % | 202.00 % |
@ -192,7 +193,7 @@ zookeeper errors:
| SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 112,190 | 109,945 | 681,774 | | SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 112,190 | 109,945 | 681,774 |
| SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 492,444 | 10,249,020 | 32,988,480 | | SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 492,444 | 10,249,020 | 32,988,480 |
| SERVER-AVG-DATA-SIZE-ON-DISK | 2.8 GB | 7.3 GB | 2.9 GB | | SERVER-AVG-DATA-SIZE-ON-DISK | 2.8 GB | 7.3 GB | 2.9 GB |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
zookeeper errors: zookeeper errors:
@ -283,9 +284,9 @@ zookeeper errors:
``` ```
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 | | | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| TOTAL-SECONDS | 36.3917 sec | 72.1698 sec | 140.9480 sec | | TOTAL-SECONDS | 36.3917 sec | 72.1698 sec | 140.9480 sec |
| TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 | | TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 |
| MAX-THROUGHPUT | 36,861 req/sec | 39,923 req/sec | 14,455 req/sec | | MAX-THROUGHPUT | 36,861 req/sec | 39,923 req/sec | 14,455 req/sec |
@ -302,10 +303,10 @@ zookeeper errors:
| Latency p95 | 133.035887 ms | 58.675701 ms | 210.603403 ms | | Latency p95 | 133.035887 ms | 58.675701 ms | 210.603403 ms |
| Latency p99 | 173.021441 ms | 880.253639 ms | 484.701759 ms | | Latency p99 | 173.021441 ms | 880.253639 ms | 484.701759 ms |
| Latency p99.9 | 188.144407 ms | 3260.921550 ms | 15472.281038 ms | | Latency p99.9 | 188.144407 ms | 3260.921550 ms | 15472.281038 ms |
| SERVER-TOTAL-NETWORK-RECEIVE-DATA-SUM | 5.0 GB | 5.5 GB | 5.6 GB | | SERVER-TOTAL-NETWORK-RX-DATA-SUM | 5.0 GB | 5.5 GB | 5.6 GB |
| SERVER-TOTAL-NETWORK-TRANSMIT-DATA-SUM | 3.9 GB | 4.4 GB | 4.4 GB | | SERVER-TOTAL-NETWORK-TX-DATA-SUM | 3.9 GB | 4.4 GB | 4.4 GB |
| CLIENT-TOTAL-NETWORK-RECEIVE-SUM | 282 MB | 357 MB | 243 MB | | CLIENT-TOTAL-NETWORK-RX-SUM | 282 MB | 357 MB | 243 MB |
| CLIENT-TOTAL-NETWORK-TRANSMIT-SUM | 1.4 GB | 1.4 GB | 1.5 GB | | CLIENT-TOTAL-NETWORK-TX-SUM | 1.4 GB | 1.4 GB | 1.5 GB |
| SERVER-MAX-CPU-USAGE | 443.00 % | 695.00 % | 414.00 % | | SERVER-MAX-CPU-USAGE | 443.00 % | 695.00 % | 414.00 % |
| SERVER-MAX-MEMORY-USAGE | 1.1 GB | 4.8 GB | 4.9 GB | | SERVER-MAX-MEMORY-USAGE | 1.1 GB | 4.8 GB | 4.9 GB |
| CLIENT-MAX-CPU-USAGE | 566.00 % | 324.00 % | 205.00 % | | CLIENT-MAX-CPU-USAGE | 566.00 % | 324.00 % | 205.00 % |
@ -316,7 +317,7 @@ zookeeper errors:
| SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 100,985 | 91,154 | 289,238 | | SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 100,985 | 91,154 | 289,238 |
| SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 552,592 | 9,923,988 | 9,537,168 | | SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 552,592 | 9,923,988 | 9,537,168 |
| SERVER-AVG-DATA-SIZE-ON-DISK | 2.7 GB | 6.7 GB | 3.1 GB | | SERVER-AVG-DATA-SIZE-ON-DISK | 2.7 GB | 6.7 GB | 3.1 GB |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
zookeeper errors: zookeeper errors:
@ -407,9 +408,9 @@ zookeeper errors:
``` ```
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 | | | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| TOTAL-SECONDS | 141.1728 sec | 4134.1565 sec | 2979.6229 sec | | TOTAL-SECONDS | 141.1728 sec | 4134.1565 sec | 2979.6229 sec |
| TOTAL-REQUEST-NUMBER | 3,000,000 | 3,000,000 | 3,000,000 | | TOTAL-REQUEST-NUMBER | 3,000,000 | 3,000,000 | 3,000,000 |
| MAX-THROUGHPUT | 32,215 req/sec | 38,259 req/sec | 15,784 req/sec | | MAX-THROUGHPUT | 32,215 req/sec | 38,259 req/sec | 15,784 req/sec |
@ -426,10 +427,10 @@ zookeeper errors:
| Latency p95 | 123.844111 ms | 14.391699 ms | 1209.603980 ms | | Latency p95 | 123.844111 ms | 14.391699 ms | 1209.603980 ms |
| Latency p99 | 148.837786 ms | 722.847010 ms | 11957.052613 ms | | Latency p99 | 148.837786 ms | 722.847010 ms | 11957.052613 ms |
| Latency p99.9 | 162.994644 ms | 2457.522611 ms | 26068.610794 ms | | Latency p99.9 | 162.994644 ms | 2457.522611 ms | 26068.610794 ms |
| SERVER-TOTAL-NETWORK-RECEIVE-DATA-SUM | 15 GB | 26 GB | 102 GB | | SERVER-TOTAL-NETWORK-RX-DATA-SUM | 15 GB | 26 GB | 102 GB |
| SERVER-TOTAL-NETWORK-TRANSMIT-DATA-SUM | 12 GB | 24 GB | 98 GB | | SERVER-TOTAL-NETWORK-TX-DATA-SUM | 12 GB | 24 GB | 98 GB |
| CLIENT-TOTAL-NETWORK-RECEIVE-SUM | 832 MB | 978 MB | 688 MB | | CLIENT-TOTAL-NETWORK-RX-SUM | 832 MB | 978 MB | 688 MB |
| CLIENT-TOTAL-NETWORK-TRANSMIT-SUM | 4.3 GB | 3.3 GB | 4.4 GB | | CLIENT-TOTAL-NETWORK-TX-SUM | 4.3 GB | 3.3 GB | 4.4 GB |
| SERVER-MAX-CPU-USAGE | 421.00 % | 752.33 % | 410.67 % | | SERVER-MAX-CPU-USAGE | 421.00 % | 752.33 % | 410.67 % |
| SERVER-MAX-MEMORY-USAGE | 2.8 GB | 7.1 GB | 17 GB | | SERVER-MAX-MEMORY-USAGE | 2.8 GB | 7.1 GB | 17 GB |
| CLIENT-MAX-CPU-USAGE | 442.00 % | 376.00 % | 217.00 % | | CLIENT-MAX-CPU-USAGE | 442.00 % | 376.00 % | 217.00 % |
@ -440,7 +441,7 @@ zookeeper errors:
| SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 333,196 | 360,314 | 3,689,221 | | SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 333,196 | 360,314 | 3,689,221 |
| SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 1,604,172 | 67,295,610 | 794,919,246 | | SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 1,604,172 | 67,295,610 | 794,919,246 |
| SERVER-AVG-DATA-SIZE-ON-DISK | 6.5 GB | 27 GB | 8.2 GB | | SERVER-AVG-DATA-SIZE-ON-DISK | 6.5 GB | 27 GB | 8.2 GB |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
zookeeper errors: zookeeper errors:

114
analyze/command.go
View File

@ -119,8 +119,10 @@ func do(configPath string) error {
} }
} }
row19ServerReceiveBytesSum := []string{"SERVER-TOTAL-NETWORK-RECEIVE-DATA-SUM"} row19ServerReceiveBytesSum := []string{"SERVER-TOTAL-NETWORK-RX-DATA-SUM"}
row20ServerTransmitBytesSum := []string{"SERVER-TOTAL-NETWORK-TRANSMIT-DATA-SUM"} row19ServerReceiveBytesSumRaw := []string{"SERVER-TOTAL-NETWORK-RX-DATA-BYTES-SUM-RAW"}
row20ServerTransmitBytesSum := []string{"SERVER-TOTAL-NETWORK-TX-DATA-SUM"}
row20ServerTransmitBytesSumRaw := []string{"SERVER-TOTAL-NETWORK-TX-DATA-BYTES-SUM-RAW"}
row23ServerMaxCPUUsage := []string{"SERVER-MAX-CPU-USAGE"} row23ServerMaxCPUUsage := []string{"SERVER-MAX-CPU-USAGE"}
row24ServerMaxMemoryUsage := []string{"SERVER-MAX-MEMORY-USAGE"} row24ServerMaxMemoryUsage := []string{"SERVER-MAX-MEMORY-USAGE"}
row28ReadsCompletedDeltaSum := []string{"SERVER-AVG-READS-COMPLETED-DELTA-SUM"} row28ReadsCompletedDeltaSum := []string{"SERVER-AVG-READS-COMPLETED-DELTA-SUM"}
@ -228,7 +230,9 @@ func do(configPath string) error {
} }
row19ServerReceiveBytesSum = append(row19ServerReceiveBytesSum, humanize.Bytes(uint64(receiveBytesNumDeltaSum))) row19ServerReceiveBytesSum = append(row19ServerReceiveBytesSum, humanize.Bytes(uint64(receiveBytesNumDeltaSum)))
row19ServerReceiveBytesSumRaw = append(row19ServerReceiveBytesSumRaw, fmt.Sprintf("%.2f", receiveBytesNumDeltaSum))
row20ServerTransmitBytesSum = append(row20ServerTransmitBytesSum, humanize.Bytes(uint64(transmitBytesNumDeltaSum))) row20ServerTransmitBytesSum = append(row20ServerTransmitBytesSum, humanize.Bytes(uint64(transmitBytesNumDeltaSum)))
row20ServerTransmitBytesSumRaw = append(row20ServerTransmitBytesSumRaw, fmt.Sprintf("%.2f", transmitBytesNumDeltaSum))
row23ServerMaxCPUUsage = append(row23ServerMaxCPUUsage, fmt.Sprintf("%.2f %%", maxAvgCPU)) row23ServerMaxCPUUsage = append(row23ServerMaxCPUUsage, fmt.Sprintf("%.2f %%", maxAvgCPU))
row28ReadsCompletedDeltaSum = append(row28ReadsCompletedDeltaSum, humanize.Comma(int64(readsCompletedDeltaSum))) row28ReadsCompletedDeltaSum = append(row28ReadsCompletedDeltaSum, humanize.Comma(int64(readsCompletedDeltaSum)))
row29SectorsReadDeltaSum = append(row29SectorsReadDeltaSum, humanize.Comma(int64(sectorsReadDeltaSum))) row29SectorsReadDeltaSum = append(row29SectorsReadDeltaSum, humanize.Comma(int64(sectorsReadDeltaSum)))
@ -258,8 +262,10 @@ func do(configPath string) error {
row16p95 := []string{"Latency p95"} // p95 row16p95 := []string{"Latency p95"} // p95
row17p99 := []string{"Latency p99"} // p99 row17p99 := []string{"Latency p99"} // p99
row18p999 := []string{"Latency p99.9"} // p99.9 row18p999 := []string{"Latency p99.9"} // p99.9
row21ClientReceiveBytesSum := []string{"CLIENT-TOTAL-NETWORK-RECEIVE-SUM"} // RECEIVE-BYTES-NUM-DELTA row21ClientReceiveBytesSum := []string{"CLIENT-TOTAL-NETWORK-RX-SUM"} // RECEIVE-BYTES-NUM-DELTA
row22lientTransmitBytesSum := []string{"CLIENT-TOTAL-NETWORK-TRANSMIT-SUM"} // TRANSMIT-BYTES-DELTA row21ClientReceiveBytesSumRaw := []string{"CLIENT-TOTAL-NETWORK-RX-BYTES-SUM-RAW"} // RECEIVE-BYTES-NUM-DELTA
row22ClientTransmitBytesSum := []string{"CLIENT-TOTAL-NETWORK-TX-SUM"} // TRANSMIT-BYTES-DELTA
row22ClientTransmitBytesSumRaw := []string{"CLIENT-TOTAL-NETWORK-TX-BYTES-SUM-RAW"} // TRANSMIT-BYTES-DELTA
row25ClientMaxCPU := []string{"CLIENT-MAX-CPU-USAGE"} // CPU-NUM row25ClientMaxCPU := []string{"CLIENT-MAX-CPU-USAGE"} // CPU-NUM
row26ClientMaxMemory := []string{"CLIENT-MAX-MEMORY-USAGE"} // VMRSS-NUM row26ClientMaxMemory := []string{"CLIENT-MAX-MEMORY-USAGE"} // VMRSS-NUM
row27ClientErrorCount := []string{"CLIENT-ERROR-COUNT"} // ERROR: row27ClientErrorCount := []string{"CLIENT-ERROR-COUNT"} // ERROR:
@ -282,7 +288,7 @@ func do(configPath string) error {
return err return err
} }
var receiveBytesNumDeltaSum uint64 var receiveBytesNumDeltaSum float64
col, err := fr.Column("RECEIVE-BYTES-NUM-DELTA") col, err := fr.Column("RECEIVE-BYTES-NUM-DELTA")
if err != nil { if err != nil {
return err return err
@ -292,11 +298,11 @@ func do(configPath string) error {
if err != nil { if err != nil {
return err return err
} }
iv, _ := v.Uint64() fv, _ := v.Float64()
receiveBytesNumDeltaSum += iv receiveBytesNumDeltaSum += fv
} }
var transmitBytesNumDeltaSum uint64 var transmitBytesNumDeltaSum float64
col, err = fr.Column("TRANSMIT-BYTES-NUM-DELTA") col, err = fr.Column("TRANSMIT-BYTES-NUM-DELTA")
if err != nil { if err != nil {
return err return err
@ -306,8 +312,8 @@ func do(configPath string) error {
if err != nil { if err != nil {
return err return err
} }
iv, _ := v.Uint64() fv, _ := v.Float64()
transmitBytesNumDeltaSum += iv transmitBytesNumDeltaSum += fv
} }
var maxAvgCPU float64 var maxAvgCPU float64
@ -342,8 +348,10 @@ func do(configPath string) error {
} }
} }
row21ClientReceiveBytesSum = append(row21ClientReceiveBytesSum, humanize.Bytes(receiveBytesNumDeltaSum)) row21ClientReceiveBytesSum = append(row21ClientReceiveBytesSum, humanize.Bytes(uint64(receiveBytesNumDeltaSum)))
row22lientTransmitBytesSum = append(row22lientTransmitBytesSum, humanize.Bytes(transmitBytesNumDeltaSum)) row21ClientReceiveBytesSumRaw = append(row21ClientReceiveBytesSumRaw, fmt.Sprintf("%.2f", receiveBytesNumDeltaSum))
row22ClientTransmitBytesSum = append(row22ClientTransmitBytesSum, humanize.Bytes(uint64(transmitBytesNumDeltaSum)))
row22ClientTransmitBytesSumRaw = append(row22ClientTransmitBytesSumRaw, fmt.Sprintf("%.2f", transmitBytesNumDeltaSum))
row25ClientMaxCPU = append(row25ClientMaxCPU, fmt.Sprintf("%.2f %%", maxAvgCPU)) row25ClientMaxCPU = append(row25ClientMaxCPU, fmt.Sprintf("%.2f %%", maxAvgCPU))
row26ClientMaxMemory = append(row26ClientMaxMemory, humanize.Bytes(maxVMRSSNum)) row26ClientMaxMemory = append(row26ClientMaxMemory, humanize.Bytes(maxVMRSSNum))
} }
@ -508,7 +516,64 @@ func do(configPath string) error {
} }
} }
aggRows := [][]string{ plog.Printf("saving summary data to %q", cfg.Analyze.AllAggregatedOutputPathCSV)
aggRowsForSummaryCSV := [][]string{
row00Header,
row01TotalSeconds,
row02TotalRequestNumber,
row05MaxThroughput,
row06AverageThroughput,
row07MinThroughput,
row08FastestLatency,
row09AverageLatency,
row10SlowestLatency,
row11p10,
row12p25,
row13p50,
row14p75,
row15p90,
row16p95,
row17p99,
row18p999,
row19ServerReceiveBytesSum,
row19ServerReceiveBytesSumRaw,
row20ServerTransmitBytesSum,
row20ServerTransmitBytesSumRaw,
row21ClientReceiveBytesSum,
row21ClientReceiveBytesSumRaw,
row22ClientTransmitBytesSum,
row22ClientTransmitBytesSumRaw,
row23ServerMaxCPUUsage,
row24ServerMaxMemoryUsage,
row25ClientMaxCPU,
row26ClientMaxMemory,
row27ClientErrorCount,
row28ReadsCompletedDeltaSum,
row29SectorsReadDeltaSum,
row30WritesCompletedDeltaSum,
row31SectorsWrittenDeltaSum,
row32AverageDatasize,
}
file, err := openToOverwrite(cfg.Analyze.AllAggregatedOutputPathCSV)
if err != nil {
return err
}
defer file.Close()
wr := csv.NewWriter(file)
if err := wr.WriteAll(aggRowsForSummaryCSV); err != nil {
return err
}
wr.Flush()
if err := wr.Error(); err != nil {
return err
}
plog.Printf("saving summary data to %q", cfg.Analyze.AllAggregatedOutputPathTXT)
aggRowsForSummaryTXT := [][]string{
row00Header, row00Header,
row01TotalSeconds, row01TotalSeconds,
row02TotalRequestNumber, row02TotalRequestNumber,
@ -530,7 +595,7 @@ func do(configPath string) error {
row19ServerReceiveBytesSum, row19ServerReceiveBytesSum,
row20ServerTransmitBytesSum, row20ServerTransmitBytesSum,
row21ClientReceiveBytesSum, row21ClientReceiveBytesSum,
row22lientTransmitBytesSum, row22ClientTransmitBytesSum,
row23ServerMaxCPUUsage, row23ServerMaxCPUUsage,
row24ServerMaxMemoryUsage, row24ServerMaxMemoryUsage,
@ -545,31 +610,15 @@ func do(configPath string) error {
row31SectorsWrittenDeltaSum, row31SectorsWrittenDeltaSum,
row32AverageDatasize, row32AverageDatasize,
} }
plog.Printf("saving summary data to %q", cfg.Analyze.AllAggregatedOutputPathCSV)
file, err := openToOverwrite(cfg.Analyze.AllAggregatedOutputPathCSV)
if err != nil {
return err
}
defer file.Close()
wr := csv.NewWriter(file)
if err := wr.WriteAll(aggRows); err != nil {
return err
}
wr.Flush()
if err := wr.Error(); err != nil {
return err
}
buf := new(bytes.Buffer) buf := new(bytes.Buffer)
tw := tablewriter.NewWriter(buf) tw := tablewriter.NewWriter(buf)
tw.SetHeader(aggRows[0]) tw.SetHeader(aggRowsForSummaryTXT[0])
for _, row := range aggRows[1:] { for _, row := range aggRowsForSummaryTXT[1:] {
tw.Append(row) tw.Append(row)
} }
tw.SetAutoFormatHeaders(false) tw.SetAutoFormatHeaders(false)
tw.SetAlignment(tablewriter.ALIGN_RIGHT) tw.SetAlignment(tablewriter.ALIGN_RIGHT)
tw.Render() tw.Render()
errs := "" errs := ""
for _, databaseID := range cfg.AllDatabaseIDList { for _, databaseID := range cfg.AllDatabaseIDList {
es, ok := databaseIDToErrs[databaseID] es, ok := databaseIDToErrs[databaseID]
@ -578,7 +627,6 @@ func do(configPath string) error {
} }
errs = databaseID + " " + "errors:\n" + strings.Join(es, "\n") + "\n" errs = databaseID + " " + "errors:\n" + strings.Join(es, "\n") + "\n"
} }
plog.Printf("saving summary data to %q", cfg.Analyze.AllAggregatedOutputPathTXT)
stxt := buf.String() stxt := buf.String()
if errs != "" { if errs != "" {
stxt += "\n" + "\n" + errs stxt += "\n" + "\n" + errs

56
test-results/2017Q1-00-etcd-zookeeper-consul/README.md
View File

@ -16,9 +16,9 @@
``` ```
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 | | | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| TOTAL-SECONDS | 338.7661 sec | 344.3563 sec | 703.7060 sec | | TOTAL-SECONDS | 338.7661 sec | 344.3563 sec | 703.7060 sec |
| TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 | | TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 |
| MAX-THROUGHPUT | 35,147 req/sec | 31,726 req/sec | 15,328 req/sec | | MAX-THROUGHPUT | 35,147 req/sec | 31,726 req/sec | 15,328 req/sec |
@ -35,10 +35,10 @@
| Latency p95 | 44.023164 ms | 44.599685 ms | 165.331967 ms | | Latency p95 | 44.023164 ms | 44.599685 ms | 165.331967 ms |
| Latency p99 | 60.351324 ms | 1063.554863 ms | 430.071868 ms | | Latency p99 | 60.351324 ms | 1063.554863 ms | 430.071868 ms |
| Latency p99.9 | 94.058105 ms | 2336.144865 ms | 12648.734251 ms | | Latency p99.9 | 94.058105 ms | 2336.144865 ms | 12648.734251 ms |
| SERVER-TOTAL-NETWORK-RECEIVE-DATA-SUM | 5.1 GB | 5.4 GB | 7.9 GB | | SERVER-TOTAL-NETWORK-RX-DATA-SUM | 5.1 GB | 5.4 GB | 7.9 GB |
| SERVER-TOTAL-NETWORK-TRANSMIT-DATA-SUM | 3.9 GB | 4.4 GB | 6.6 GB | | SERVER-TOTAL-NETWORK-TX-DATA-SUM | 3.9 GB | 4.4 GB | 6.6 GB |
| CLIENT-TOTAL-NETWORK-RECEIVE-SUM | 270 MB | 357 MB | 202 MB | | CLIENT-TOTAL-NETWORK-RX-SUM | 270 MB | 357 MB | 202 MB |
| CLIENT-TOTAL-NETWORK-TRANSMIT-SUM | 1.5 GB | 1.4 GB | 1.5 GB | | CLIENT-TOTAL-NETWORK-TX-SUM | 1.5 GB | 1.4 GB | 1.5 GB |
| SERVER-MAX-CPU-USAGE | 434.00 % | 600.67 % | 416.00 % | | SERVER-MAX-CPU-USAGE | 434.00 % | 600.67 % | 416.00 % |
| SERVER-MAX-MEMORY-USAGE | 1.3 GB | 4.0 GB | 5.4 GB | | SERVER-MAX-MEMORY-USAGE | 1.3 GB | 4.0 GB | 5.4 GB |
| CLIENT-MAX-CPU-USAGE | 540.00 % | 322.00 % | 204.00 % | | CLIENT-MAX-CPU-USAGE | 540.00 % | 322.00 % | 204.00 % |
@ -49,7 +49,7 @@
| SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 1,217,294 | 953,784 | 2,381,092 | | SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 1,217,294 | 953,784 | 2,381,092 |
| SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 714,152 | 9,304,072 | 10,711,132 | | SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 714,152 | 9,304,072 | 10,711,132 |
| SERVER-AVG-DATA-SIZE-ON-DISK | 3.0 GB | 7.9 GB | 3.0 GB | | SERVER-AVG-DATA-SIZE-ON-DISK | 3.0 GB | 7.9 GB | 3.0 GB |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
zookeeper errors: zookeeper errors:
@ -139,9 +139,9 @@ zookeeper errors:
``` ```
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 | | | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| TOTAL-SECONDS | 37.3284 sec | 75.0700 sec | 304.4858 sec | | TOTAL-SECONDS | 37.3284 sec | 75.0700 sec | 304.4858 sec |
| TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 | | TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 |
| MAX-THROUGHPUT | 33,567 req/sec | 35,499 req/sec | 15,141 req/sec | | MAX-THROUGHPUT | 33,567 req/sec | 35,499 req/sec | 15,141 req/sec |
@ -158,10 +158,10 @@ zookeeper errors:
| Latency p95 | 76.533161 ms | 11.992104 ms | 349.281928 ms | | Latency p95 | 76.533161 ms | 11.992104 ms | 349.281928 ms |
| Latency p99 | 146.318242 ms | 153.580393 ms | 1324.508306 ms | | Latency p99 | 146.318242 ms | 153.580393 ms | 1324.508306 ms |
| Latency p99.9 | 183.924901 ms | 1935.929712 ms | 10622.316021 ms | | Latency p99.9 | 183.924901 ms | 1935.929712 ms | 10622.316021 ms |
| SERVER-TOTAL-NETWORK-RECEIVE-DATA-SUM | 5.0 GB | 6.2 GB | 11 GB | | SERVER-TOTAL-NETWORK-RX-DATA-SUM | 5.0 GB | 6.2 GB | 11 GB |
| SERVER-TOTAL-NETWORK-TRANSMIT-DATA-SUM | 3.8 GB | 5.1 GB | 10 GB | | SERVER-TOTAL-NETWORK-TX-DATA-SUM | 3.8 GB | 5.1 GB | 10 GB |
| CLIENT-TOTAL-NETWORK-RECEIVE-SUM | 274 MB | 350 MB | 216 MB | | CLIENT-TOTAL-NETWORK-RX-SUM | 274 MB | 350 MB | 216 MB |
| CLIENT-TOTAL-NETWORK-TRANSMIT-SUM | 1.4 GB | 1.4 GB | 1.5 GB | | CLIENT-TOTAL-NETWORK-TX-SUM | 1.4 GB | 1.4 GB | 1.5 GB |
| SERVER-MAX-CPU-USAGE | 407.67 % | 704.97 % | 380.00 % | | SERVER-MAX-CPU-USAGE | 407.67 % | 704.97 % | 380.00 % |
| SERVER-MAX-MEMORY-USAGE | 1.1 GB | 5.1 GB | 6.2 GB | | SERVER-MAX-MEMORY-USAGE | 1.1 GB | 5.1 GB | 6.2 GB |
| CLIENT-MAX-CPU-USAGE | 454.00 % | 292.00 % | 202.00 % | | CLIENT-MAX-CPU-USAGE | 454.00 % | 292.00 % | 202.00 % |
@ -172,7 +172,7 @@ zookeeper errors:
| SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 112,190 | 109,945 | 681,774 | | SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 112,190 | 109,945 | 681,774 |
| SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 492,444 | 10,249,020 | 32,988,480 | | SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 492,444 | 10,249,020 | 32,988,480 |
| SERVER-AVG-DATA-SIZE-ON-DISK | 2.8 GB | 7.3 GB | 2.9 GB | | SERVER-AVG-DATA-SIZE-ON-DISK | 2.8 GB | 7.3 GB | 2.9 GB |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
zookeeper errors: zookeeper errors:
@ -263,9 +263,9 @@ zookeeper errors:
``` ```
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 | | | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| TOTAL-SECONDS | 36.3917 sec | 72.1698 sec | 140.9480 sec | | TOTAL-SECONDS | 36.3917 sec | 72.1698 sec | 140.9480 sec |
| TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 | | TOTAL-REQUEST-NUMBER | 1,000,000 | 1,000,000 | 1,000,000 |
| MAX-THROUGHPUT | 36,861 req/sec | 39,923 req/sec | 14,455 req/sec | | MAX-THROUGHPUT | 36,861 req/sec | 39,923 req/sec | 14,455 req/sec |
@ -282,10 +282,10 @@ zookeeper errors:
| Latency p95 | 133.035887 ms | 58.675701 ms | 210.603403 ms | | Latency p95 | 133.035887 ms | 58.675701 ms | 210.603403 ms |
| Latency p99 | 173.021441 ms | 880.253639 ms | 484.701759 ms | | Latency p99 | 173.021441 ms | 880.253639 ms | 484.701759 ms |
| Latency p99.9 | 188.144407 ms | 3260.921550 ms | 15472.281038 ms | | Latency p99.9 | 188.144407 ms | 3260.921550 ms | 15472.281038 ms |
| SERVER-TOTAL-NETWORK-RECEIVE-DATA-SUM | 5.0 GB | 5.5 GB | 5.6 GB | | SERVER-TOTAL-NETWORK-RX-DATA-SUM | 5.0 GB | 5.5 GB | 5.6 GB |
| SERVER-TOTAL-NETWORK-TRANSMIT-DATA-SUM | 3.9 GB | 4.4 GB | 4.4 GB | | SERVER-TOTAL-NETWORK-TX-DATA-SUM | 3.9 GB | 4.4 GB | 4.4 GB |
| CLIENT-TOTAL-NETWORK-RECEIVE-SUM | 282 MB | 357 MB | 243 MB | | CLIENT-TOTAL-NETWORK-RX-SUM | 282 MB | 357 MB | 243 MB |
| CLIENT-TOTAL-NETWORK-TRANSMIT-SUM | 1.4 GB | 1.4 GB | 1.5 GB | | CLIENT-TOTAL-NETWORK-TX-SUM | 1.4 GB | 1.4 GB | 1.5 GB |
| SERVER-MAX-CPU-USAGE | 443.00 % | 695.00 % | 414.00 % | | SERVER-MAX-CPU-USAGE | 443.00 % | 695.00 % | 414.00 % |
| SERVER-MAX-MEMORY-USAGE | 1.1 GB | 4.8 GB | 4.9 GB | | SERVER-MAX-MEMORY-USAGE | 1.1 GB | 4.8 GB | 4.9 GB |
| CLIENT-MAX-CPU-USAGE | 566.00 % | 324.00 % | 205.00 % | | CLIENT-MAX-CPU-USAGE | 566.00 % | 324.00 % | 205.00 % |
@ -296,7 +296,7 @@ zookeeper errors:
| SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 100,985 | 91,154 | 289,238 | | SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 100,985 | 91,154 | 289,238 |
| SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 552,592 | 9,923,988 | 9,537,168 | | SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 552,592 | 9,923,988 | 9,537,168 |
| SERVER-AVG-DATA-SIZE-ON-DISK | 2.7 GB | 6.7 GB | 3.1 GB | | SERVER-AVG-DATA-SIZE-ON-DISK | 2.7 GB | 6.7 GB | 3.1 GB |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
zookeeper errors: zookeeper errors:
@ -387,9 +387,9 @@ zookeeper errors:
``` ```
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 | | | etcd-v3.1-go1.7.4 | zookeeper-r3.4.9-java8 | consul-v0.7.3-go1.7.4 |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
| TOTAL-SECONDS | 141.1728 sec | 4134.1565 sec | 2979.6229 sec | | TOTAL-SECONDS | 141.1728 sec | 4134.1565 sec | 2979.6229 sec |
| TOTAL-REQUEST-NUMBER | 3,000,000 | 3,000,000 | 3,000,000 | | TOTAL-REQUEST-NUMBER | 3,000,000 | 3,000,000 | 3,000,000 |
| MAX-THROUGHPUT | 32,215 req/sec | 38,259 req/sec | 15,784 req/sec | | MAX-THROUGHPUT | 32,215 req/sec | 38,259 req/sec | 15,784 req/sec |
@ -406,10 +406,10 @@ zookeeper errors:
| Latency p95 | 123.844111 ms | 14.391699 ms | 1209.603980 ms | | Latency p95 | 123.844111 ms | 14.391699 ms | 1209.603980 ms |
| Latency p99 | 148.837786 ms | 722.847010 ms | 11957.052613 ms | | Latency p99 | 148.837786 ms | 722.847010 ms | 11957.052613 ms |
| Latency p99.9 | 162.994644 ms | 2457.522611 ms | 26068.610794 ms | | Latency p99.9 | 162.994644 ms | 2457.522611 ms | 26068.610794 ms |
| SERVER-TOTAL-NETWORK-RECEIVE-DATA-SUM | 15 GB | 26 GB | 102 GB | | SERVER-TOTAL-NETWORK-RX-DATA-SUM | 15 GB | 26 GB | 102 GB |
| SERVER-TOTAL-NETWORK-TRANSMIT-DATA-SUM | 12 GB | 24 GB | 98 GB | | SERVER-TOTAL-NETWORK-TX-DATA-SUM | 12 GB | 24 GB | 98 GB |
| CLIENT-TOTAL-NETWORK-RECEIVE-SUM | 832 MB | 978 MB | 688 MB | | CLIENT-TOTAL-NETWORK-RX-SUM | 832 MB | 978 MB | 688 MB |
| CLIENT-TOTAL-NETWORK-TRANSMIT-SUM | 4.3 GB | 3.3 GB | 4.4 GB | | CLIENT-TOTAL-NETWORK-TX-SUM | 4.3 GB | 3.3 GB | 4.4 GB |
| SERVER-MAX-CPU-USAGE | 421.00 % | 752.33 % | 410.67 % | | SERVER-MAX-CPU-USAGE | 421.00 % | 752.33 % | 410.67 % |
| SERVER-MAX-MEMORY-USAGE | 2.8 GB | 7.1 GB | 17 GB | | SERVER-MAX-MEMORY-USAGE | 2.8 GB | 7.1 GB | 17 GB |
| CLIENT-MAX-CPU-USAGE | 442.00 % | 376.00 % | 217.00 % | | CLIENT-MAX-CPU-USAGE | 442.00 % | 376.00 % | 217.00 % |
@ -420,7 +420,7 @@ zookeeper errors:
| SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 333,196 | 360,314 | 3,689,221 | | SERVER-AVG-WRITES-COMPLETED-DELTA-SUM | 333,196 | 360,314 | 3,689,221 |
| SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 1,604,172 | 67,295,610 | 794,919,246 | | SERVER-AVG-SECTORS-WRITTEN-DELTA-SUM | 1,604,172 | 67,295,610 | 794,919,246 |
| SERVER-AVG-DATA-SIZE-ON-DISK | 6.5 GB | 27 GB | 8.2 GB | | SERVER-AVG-DATA-SIZE-ON-DISK | 6.5 GB | 27 GB | 8.2 GB |
+----------------------------------------+-------------------+------------------------+-----------------------+ +---------------------------------------+-------------------+------------------------+-----------------------+
zookeeper errors: zookeeper errors: