Commit Graph

73 Commits

Author SHA1 Message Date
Frank Budinsky 412f03105c
Kubernetes Ingress Test + fixes (#7662)
* Kubernetes Ingress Test + fixes

* cleanup

* fix circuit-breaking test

* fix lint

* remove -it
2020-07-06 07:54:35 -07:00
Frank Budinsky 67e181ce34
More test framework doc (#7635)
* More test framework doc

* Update tests/README.md

Co-authored-by: Hongyi Zhang <hongyizhang@google.com>

* Update tests/README.md

Co-authored-by: Hongyi Zhang <hongyizhang@google.com>

* tweak

* tweak

* increase default retry

* increase retries to 8

* fix test failing

* disable istioctl install

* fix lint

Co-authored-by: Hongyi Zhang <hongyizhang@google.com>
2020-06-30 11:06:42 -07:00
Frank Budinsky 01c4cce951
Add proper wait for config calls to tests (#7620)
* Add wait for config calls to tests

* two more
2020-06-24 09:48:29 -07:00
Hongyi Zhang 420a54447b
Migration to a new framework for doc testing (#7465)
* add an example task to test

* main test function: save progress

* a working example: routing request

* improve log info and error handling

* introduce makefile

* run each test as a subtest; remove common setup from test.sh

* add another test.sh: fault-injection

* improve error handling

* check test environment

* add two more test.sh files

* fix make command for istio setup

* update two test.sh files from upstream

* add comments and update README.md

* update test.sh files from upstream

* support multiple test names

* update README

* update README.md for new framework

* remove documentation of migration steps

* undo format changes

* change separation line to '# @cleanup'

* move go code and makefile from content/ to tests/

* change package name

* make for loop more readable

* change the set of auto-sourced scripts

* add docs for all functions

* approach to deal with folders with the same name

* minor fixes to ensure everything still runs

* fix make gen error

* add a TIMEOUT argument

* make sure util/debug.sh works with new framework

* make lint-go happy

* [BIG CHANGE] allow different istio setup configs

* make linters happy

* make linters happier

* changed wording and function orders

* make error return as the 2nd argument

* add TODOs

* Update content/en/docs/tasks/traffic-management/traffic-shifting/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* only test english docs

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* allow test.sh as suffix

* move adding setup configs to tests/setup

* recommend full paths

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* require full test paths

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>
2020-06-09 14:11:53 -07:00
Frank Budinsky b3e79edd95
Rename _run_and_verify_xxx functions to _verify_xxx (#7452)
* Remove _verify_ calls

* Rename _run_and_verify functions to _verify

* Update tests/configuration/scripts/liveness_and_readiness_probes.sh

* error exit

* cleaner errexit
2020-06-03 06:24:29 -07:00
Frank Budinsky 3093ddc581
New verify function: _run_and_verify_lines (#7451)
* New verify function: _run_and_verify_lines

* fix lint
2020-06-02 11:23:43 -07:00
Justin Pettit c709c976da
Move generally useful "sample_" functions to new "helpers.sh". (#7441) 2020-06-01 13:09:30 -07:00
Frank Budinsky f129da0ee7
Verify function improvements (#7440) 2020-06-01 11:16:15 -07:00
Frank Budinsky 55a4416230
Remove temporary login kludge (#7429) 2020-05-29 09:04:07 -07:00
Frank Budinsky 77d3dc6bf1
Fix mirroring test (#7399)
* Fix mirroring test

* fix typo

* fixes

* export vars

* lint
2020-05-26 12:57:19 -07:00
Justin Pettit 5f89f64d49
debug.sh: Add debugging to test runs. (#7370)
When tests are run, shell script debugging is enabled and written to a
file called "<script_name>_debug.txt" in the same directory as the
"<script_name>_output.txt" file.
2020-05-20 20:27:44 -07:00
Justin Pettit 0fb1c50a49
verify.sh: Don't exit on error in _run_and_verify_*() funcs. (#7359)
* verify.sh: Don't exit on error in _run_and_verify_*() funcs.

Most tests include "set -e", which causes the script to exit if a
statement returns a non-true return value.  In some cases, the command
may exit with a non-true return value, but we want to retry the command
later.  We want to temporarily disable that "errexit" behavior.

* verify.sh: Clarify __verify_with_retry() comment and variable name.
2020-05-19 18:06:21 -07:00
Justin Pettit 7782eb1d0a
Authz jwt (#7338)
* snip.py: Replace github file token with release-specific URL.

* verify.sh: Show the expected output as well as the actual output.

* snip.py: Update the githubfile regex to not include email addresses.

When generating snip scripts, pairs of "@" signs indicate a link to
GitHub repo content.  However, JWT attribute values contained pairs of
email addresses such as:

    `testing@secure.istio.io/testing@secure.istio.io`

which would be treated as an email address and mangled.  This commit
rewrites the regex to not match on email addresses.

* Add authz-jwt user guide test.
2020-05-17 13:51:45 -04:00
Frank Budinsky 90103ae557
Cleanup circuit breaking test (#7335)
* Cleanup circuit breaking test

* remove old files

* updated expected
2020-05-15 16:59:58 -07:00
Justin Pettit 8cacec48de
Authz deny (#7315)
* Add authz-tcp user guide test.

* Add run and verify functions for user doc tests.
2020-05-14 16:10:20 -07:00
Frank Budinsky 93b889af63
Cleanup secure ingress test (#7313)
* Cleanup secure ingress test

* fix lint

* remove curl version check
2020-05-14 07:20:37 -07:00
Frank Budinsky 85f4d1d97b
Simplify TCPTrafficShiftingTest (#7308)
* Simplify TCPTrafficShiftingTest

* fix lint

* more lint

* remove --all

* fix function name
2020-05-13 17:00:35 -07:00
Frank Budinsky 4f7622e3aa
More doc testing (#7253)
* Ingress control test

* Ingress control test

* fix lint

* fix package

* fix path

* improve _verify_like

* curl -s

* debug

* fix compare

* remove flaky verify call

* fix path

* regen
2020-05-12 05:58:07 -07:00
Frank Budinsky affe99f97a
More traffic management task tests (#7250)
* More traffic management task tests

* lint errors

* fix kubectl output

* fix arg check

* login to bookinfo

* curl --user

* temporary kludge for login not working

* fault injection test

* rename test

* fix cleanup

* timeouts tests

* regen

* make sure sleep pods are gone
2020-05-10 15:05:22 -07:00
Frank Budinsky f45bc9e1a8
Remove obsolete '# ' uses from all tests (#7233) 2020-05-06 19:17:11 -04:00
Frank Budinsky a7107678f5
Convert TCP traffic shifting test (#7131)
* Convert TCP traffic shifting test

* lint errors

* regen

* test disable spellcheck

* temporary disable gen-check

* disable inappropriate bash lint errors

* disable gen check

* one more regen

* reenable gen check

* remove -it options

* revert commands

* fix app health check outdated
2020-04-22 18:26:27 -07:00
Frank Budinsky a9541a2b42
Convert bookinfo test to new model (#7127)
* Convert bookinfo test to new model

* missing include

* Fix kubectl output

* fix elapsed time regex
2020-04-22 11:36:01 -07:00
Frank Budinsky 1e7a781bdf
Add built-in verify functions to test framework (#7110)
* Add builtin verify functions to test framework

* fix lint

* tweaks

* fix bold
2020-04-20 13:29:46 -07:00