mirror of https://github.com/rancher/dartboard.git
1 Commits
| Author | SHA1 | Message | Date |
|---|---|---|---|
Silvio Moioli
|
985ad080b3
|
feat(k6): Add Steve Watch API benchmark test (#102)
* first version from Gemini Prompt used: Take a look at the @k6 directory scripts, particularly @k6/tests/api_benchmark.js targeting Steve. I need a new k6 benchmark script along the same lines that tests the Watch functionality described in https://github.com/moio/apiserver/blob/watch_readme/README.md and https://github.com/moio/steve/blob/readme_watch/README.md. Specifically, I need to start watching the same resource (default: configmaps) in a configurable namespace (default: scalability-tests) from multiple Steve servers backed by the same Kubernetes API. A parallel scenario should change configmaps at a configurable rate, updating one configmaps at random via PUT to one of the configured Steve servers. There will be some delay between resource.changed events coming from the Steve servers, as they might not always have exactly the same speed. I need to measure and report the delta between the fastest and the slowest Steve (with stats: min, max, avg, p(95)), as well as the delay between a change in a configmap and the time the first Steve observes the change via Watch (with stats) and the time the last Steve observes it (with stats). mode should be the default for this test, but make it configurable to use resources.changes optionally. Signed-off-by: Silvio Moioli <silvio@moioli.net> * fix durations and iterations Signed-off-by: Silvio Moioli <silvio@moioli.net> * fix cookie passing in the websocket case - api is different there Signed-off-by: Silvio Moioli <silvio@moioli.net> * fixup! fix durations and iterations Signed-off-by: Silvio Moioli <silvio@moioli.net> * Rework delay computation logic. VUs do not share data, not even global variables, piggyback on the ConfigMap instead Signed-off-by: Silvio Moioli <silvio@moioli.net> * spray logging all over Signed-off-by: Silvio Moioli <silvio@moioli.net> * Use WebSocket async API Gemini prompt: you used the standard k6 websocket api documented here https://grafana.com/docs/k6/latest/using-k6/protocols/websockets/. The problem is that it is blocking, so no more than one websocket is opened at any time. Re-read @k6/tests/steve_watch_benchmark.js considering all manual changes I've made as the good starting point. Migrate it over the new experimental API which is non-blocking, see https://grafana.com/docs/k6/latest/javascript-api/k6-experimental/websockets/ Signed-off-by: Silvio Moioli <silvio@moioli.net> * fix timeout and error handling Signed-off-by: Silvio Moioli <silvio@moioli.net> * add time after creation to not pollute watch measurements Signed-off-by: Silvio Moioli <silvio@moioli.net> * improve logging Signed-off-by: Silvio Moioli <silvio@moioli.net> * bugfix: ensure ints are ints Signed-off-by: Silvio Moioli <silvio@moioli.net> * add settle time for watchers to start watching Signed-off-by: Silvio Moioli <silvio@moioli.net> * hardcode watchers vus to 1. What we are interested in measuring is delay of replicas, not load here Signed-off-by: Silvio Moioli <silvio@moioli.net> * make change vus parametric Signed-off-by: Silvio Moioli <silvio@moioli.net> * add sainty thresholds Signed-off-by: Silvio Moioli <silvio@moioli.net> * tear down before setup, in case an earlier run is half finished Signed-off-by: Silvio Moioli <silvio@moioli.net> * rework logging so that verbose messages are only output with the verbose option Signed-off-by: Silvio Moioli <silvio@moioli.net> * fix id to be truly unique and avoid misassignment of timestamps Signed-off-by: Silvio Moioli <silvio@moioli.net> * hardcode resource type for now Signed-off-by: Silvio Moioli <silvio@moioli.net> * add the ability to target both Steve and Kubernetes APIs Signed-off-by: Silvio Moioli <silvio@moioli.net> * as an additional check, log the time the listener takes to run Signed-off-by: Silvio Moioli <silvio@moioli.net> * add kube api watching Signed-off-by: Silvio Moioli <silvio@moioli.net> * tune settle time Signed-off-by: Silvio Moioli <silvio@moioli.net> * explainer for origin url Signed-off-by: Silvio Moioli <silvio@moioli.net> --------- Signed-off-by: Silvio Moioli <silvio@moioli.net> |