* Update test framework to use 1.6.0-beta.0
* Go back to copies from env var
* Add more test targets, fix mtls test (new PA added)
* Update to use Istio SHA from go.mod (convert to long SHA)
* Try and remove TAG from prow
* Debug TAG not being set
* Fix paralization issue
* Remove some extra output
* Review comments
Reverted the actual mirror test script, because mirror test seems to have some subtle failure when running with what seems to be the exact same commands via snips. Will investigate further in followup PR. Merging this one to get the generator changes.
* Add test for Request Timeouts
* Update test to extract snippets
* Apply suggestions from code review
Co-Authored-By: Frank Budinsky <frankb@ca.ibm.com>
* Fix lint error
* Use code snippets from bookinfo snips
Co-Authored-By: Frank Budinsky <frankb@ca.ibm.com>
* Remove sleep pods
* remove deprecated $snippet and use use verify func
Co-Authored-By: Frank Budinsky <frankb@ca.ibm.com>
* Skip test failure
Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>
* User guide tests for DNS certificate management
- Add user guide tests for DNS certificate management
- Remove user guide's dependency on jq
* Use _verify_contains function
* User guide tests and remove manual steps for plugging in CA cert
- Add user guide tests for plugging in CA cert
- Remove the manual steps in the user guide of plugging in CA cert
to make it easier for an user to try the guide.
* Fix SC2046 lint error and the trafficmanagement test errors
* Update doc test README
* add sh
* tweaks
* formatting
* format
* fix comment
* wording
* convert mtls migration task
* Update tests/README.md
Co-Authored-By: Eric Van Norman <ericvn@us.ibm.com>
* Update tests/README.md
Co-Authored-By: Eric Van Norman <ericvn@us.ibm.com>
Co-authored-by: Eric Van Norman <ericvn@us.ibm.com>
The `TestCircuitBreaker` test is very flaky. It relies on examining
the percentage of requests that succeed or fail to a service with
circuit breaking configured, and ensuring the numbers fall within a
given range. Unfortunately, the percentages tend to vary widely from
run to run, so the test fails as often as it passes.
This simplifies the test by only verifying that both successes and
failures occur instead of checking the percentage of each.
Most of the tasks in the docs assume the installation is using the
demo profile, but the tests install Istio with the default profile.
At least one instance of an issue caused by this can be found in
istio/istio#21556. This changes the example tests to run against an
installation using the demo profile.
Fixes: https://github.com/istio/istio/issues/21634
The mTLS migration task in the docs was updated to use
PeerAuthentication instead of Policy and DestinationRules, but the
tests were never updated. This updates the test script to be inline
with the docs.
The `TestTCPTrafficShifting` test script relies on fetching the port
named "tcp" on the istio-ingressgateway service, but that port is not
present in the default installation profile -- only in the demo
profile. This patches the service to add the port in the setup
script, and also fixes the usage of `nc` in the test script.
* (#6586) move istio.io test for circuit breaking to istio.io repository
* (#6586) add verification for output metrics
* (#6586) widened bounds for both before and after tripping and use ruby for evaluation
* (#6586) fix istioio package import
Eric Van Norman
Frank Budinsky
Justin Pettit
Oliver Liu
lei-tang
Shamsher Ansari
Brad Ison
Brad Ison
Suchith J N
Nathan Mittler
Istio Automation
Daniel Grimm