Commit Graph

40 Commits

Author SHA1 Message Date
Faseela K d3f6b3b6e6
add README for multicluster docs tests (#15782)
* add README for multicluster docs tests

Signed-off-by: Faseela K <faseela.k@est.tech>

* fix links

Signed-off-by: Faseela K <faseela.k@est.tech>

---------

Signed-off-by: Faseela K <faseela.k@est.tech>
2024-10-10 15:18:46 -04:00
Ben Leggett 2886593d5a
Fixup Helm CRD docs in light of istio/istio#53318 (#15744)
* (testing CI with latest)

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* also bump gateway ref

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* This is really hard for me, but the teapot must go

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Always use *published* release tags for gateway API.

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Fix snips

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* fix go mod?

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Fixup SE

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Headers come back as JSON now

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Some more header fixes

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* More fixes

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Fixup

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Le sigh

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Another `httpbin` difference

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Another stray header

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* More twiddles

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Indents, other headers

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Fix

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Hmm

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Fixup

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Gen

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Just do this to avoid weird fragility

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Fixup docs in light of https://github.com/istio/istio/pull/53318

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* fixup

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* lints

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* genfix

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* underscores

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Fixup

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Fixup again

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Oh

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Go ahead and do this for now, it's simpler

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* sumfix

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Forgot to use the smarter form

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Do this centrally, to catch leftovers (we don't cleanup CRDs)

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* lint

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Satisfy shellcheck

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Stray ref

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

* Ah geez

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>

---------

Signed-off-by: Benjamin Leggett <benjamin.leggett@solo.io>
2024-10-08 16:55:44 -04:00
Craig Box c6e477a54c
Fix ambient doc tests (#15500)
* snip_annotate_bookinfo_gateway

* disable shellcheck

* Update content/en/docs/ambient/usage/extend-waypoint-wasm/index.md

Co-authored-by: Ben Leggett <854255+bleggett@users.noreply.github.com>

* Update content/en/docs/ambient/usage/extend-waypoint-wasm/index.md

grrr, I remember seeing that

Co-authored-by: Daniel Hawton <daniel@hawton.org>

---------

Co-authored-by: Ben Leggett <854255+bleggett@users.noreply.github.com>
Co-authored-by: Daniel Hawton <daniel@hawton.org>
2024-07-31 18:13:06 -04:00
Eric Van Norman cc3a534e60
Update to use current version (#14909)
* Update to use current version

* Try just replacing APP VERSION with ...

* Add versionregex to verify_like and update to include APP VERSION

* Allow more fields with verify_like

* Move column heading

* Update header and add additional verify comments
2024-04-22 10:56:32 -07:00
Eric Van Norman f317970d3c
Move from trustworthy-jwt yaml to default-yaml (#13152)
* Move from trustworthy-jwt yaml to default-yaml

* Update to K8s 1.27.0

* Minor update

* Remove apiVersion as in istio/istio #44687
2023-05-02 12:45:36 -07:00
SRodi 26a64c0781
fix-test-doc-verify-like (#13049)
* fix env vars according to tests/util/verify.sh
2023-04-14 06:36:36 -07:00
Ingwon Song 3ecc5aeb4a
Moving/Updating the WasmPlugin tutorial and Adding ImagePullPolicy description (#11379)
* Update for Wasm contents

* Fix the wrong cleanup code

* Fix the description of `extensibility` folder's description

* Apply suggestions from code review

Co-authored-by: craigbox <craigbox@google.com>

* Update _index.md

* Regenerate snips

* Add old URL path as an alias

* Update content/en/docs/tasks/extensibility/_index.md

* Add description for the wasm pull policy

Signed-off-by: Ingwon Song <igsong@google.com>

* Apply suggestions from code review

Co-authored-by: Douglas Reid <douglas-reid@users.noreply.github.com>

* Apply suggestions from code review

Co-authored-by: craigbox <craigbox@google.com>

* Applying the comment from @dgn

Co-authored-by: craigbox <craigbox@google.com>
Co-authored-by: Douglas Reid <douglas-reid@users.noreply.github.com>
2022-07-01 12:20:20 -07:00
Ihor Sychevskyi dd7d71475d
update link (#10974) 2022-02-28 07:12:41 -08:00
Yangmin Zhu 84a63d0e33
add test for the dry-run task (#10526)
* add test for the dry-run task

* Update content/en/docs/tasks/security/authorization/authz-dry-run/index.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>
2021-12-08 07:50:27 -08:00
Frank Budinsky a70e78f25e
Test cleanup (#8564)
* Framework inject set +e at start of cleanup test script

* tabs

* fix typo

* add nl

* fix doc
2020-11-24 16:26:19 -05:00
Nathan Mittler 616f45b1d5
Several test framework improvements (#8524)
Overview of the changes:

- Adding ability to verify that expected output occurs a number of times consecutively. This is needed for https://github.com/istio/istio.io/pull/8402.

- Moving snapshot checking logic to Go code so that it can be separated out into separate test steps, which are timed and contain their own output directories/files. This makes the code cleaner and also makes the snapshot logic more transparent.

- Updating debug.sh to use newer bash syntax that allows it to dynamically select a free file descriptor. Without this, I was seeing all commands echoed to my console in goland.
2020-11-23 09:23:54 -05:00
Nathan Mittler 132c2375bc
Add wait for gateway to multicluster tests (#8346)
This required some other changes WRT verification:

- Change __cmp_like to allow for not accepting <pending> for an IP address.

- Change __verify_with_retry to use a timeout rathan than number of retries. This is a more intuitive interface and aligns with the way we do retries in istio/istio. I also got rid of exponential backoff and allow both the timeout and delay between retries to be configured.
2020-10-26 06:45:38 -07:00
Nathan Mittler f9a9f54eba
[Test Framework] Fixes to support multicluster (#8253)
* [Test Framework] Fixes to support multicluster

* use current context from each kubeconfig file.

* addressing comments
2020-10-02 14:05:09 -07:00
Eric Van Norman d06ddf8b6a
Update tests README note for kind cluster failure (#8260) 2020-10-02 13:26:32 -07:00
Frank Budinsky 1f1d762c81
README update (#8161)
* README update

* tweak

* missing paren
2020-09-17 15:13:09 -07:00
Frank Budinsky df5ea809a6
Update test framework readme (#7968) 2020-08-17 10:03:52 -07:00
Frank Budinsky 67e181ce34
More test framework doc (#7635)
* More test framework doc

* Update tests/README.md

Co-authored-by: Hongyi Zhang <hongyizhang@google.com>

* Update tests/README.md

Co-authored-by: Hongyi Zhang <hongyizhang@google.com>

* tweak

* tweak

* increase default retry

* increase retries to 8

* fix test failing

* disable istioctl install

* fix lint

Co-authored-by: Hongyi Zhang <hongyizhang@google.com>
2020-06-30 11:06:42 -07:00
Hongyi Zhang faa2001b9d
Remove obsolete classes in old istioio framework (#7550)
* fix bug where *_test.sh doesn't source snips.sh

* remove 'source snips.sh' from scripts

* remove obsolete classes and env variable
2020-06-15 07:23:26 -07:00
Hongyi Zhang 5fbb14bedc
Convert all old tests to new tests (#7522)
* add an example task to test

* main test function: save progress

* a working example: routing request

* improve log info and error handling

* introduce makefile

* run each test as a subtest; remove common setup from test.sh

* add another test.sh: fault-injection

* improve error handling

* check test environment

* add two more test.sh files

* fix make command for istio setup

* update two test.sh files from upstream

* add comments and update README.md

* update test.sh files from upstream

* support multiple test names

* update README

* update README.md for new framework

* remove documentation of migration steps

* undo format changes

* change separation line to '# @cleanup'

* move go code and makefile from content/ to tests/

* change package name

* make for loop more readable

* change the set of auto-sourced scripts

* add docs for all functions

* approach to deal with folders with the same name

* minor fixes to ensure everything still runs

* fix make gen error

* add a TIMEOUT argument

* make sure util/debug.sh works with new framework

* make lint-go happy

* [BIG CHANGE] allow different istio setup configs

* make linters happy

* make linters happier

* changed wording and function orders

* make error return as the 2nd argument

* add TODOs

* Update content/en/docs/tasks/traffic-management/traffic-shifting/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* only test english docs

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* allow test.sh as suffix

* move adding setup configs to tests/setup

* recommend full paths

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* require full test paths

* converting old tests to new tests: traffic-management and misc

* converting old tests to new tests: security

* remove old tests

* Update content/en/docs/tasks/security/cert-management/dns-cert/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* simplify setup configs

* Update content/en/docs/tasks/security/authentication/authn-policy/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update content/en/docs/tasks/security/authentication/mtls-migration/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update content/en/docs/tasks/security/authorization/authz-http/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* do not let istioctl prompt y/n

* Update content/en/docs/tasks/traffic-management/ingress/ingress-sni-passthrough/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update content/en/docs/tasks/traffic-management/ingress/secure-ingress/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update content/en/docs/tasks/security/cert-management/plugin-ca-cert/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* simplify stuff

* rename dns-cert test.sh to test_broken.sh

* fix dns-cert doc and test

* remove egress=disabled

* fix test

* Update content/en/docs/tasks/observability/logs/access-log/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update content/en/docs/tasks/security/authentication/authn-policy/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>
2020-06-11 11:15:48 -07:00
Hongyi Zhang 420a54447b
Migration to a new framework for doc testing (#7465)
* add an example task to test

* main test function: save progress

* a working example: routing request

* improve log info and error handling

* introduce makefile

* run each test as a subtest; remove common setup from test.sh

* add another test.sh: fault-injection

* improve error handling

* check test environment

* add two more test.sh files

* fix make command for istio setup

* update two test.sh files from upstream

* add comments and update README.md

* update test.sh files from upstream

* support multiple test names

* update README

* update README.md for new framework

* remove documentation of migration steps

* undo format changes

* change separation line to '# @cleanup'

* move go code and makefile from content/ to tests/

* change package name

* make for loop more readable

* change the set of auto-sourced scripts

* add docs for all functions

* approach to deal with folders with the same name

* minor fixes to ensure everything still runs

* fix make gen error

* add a TIMEOUT argument

* make sure util/debug.sh works with new framework

* make lint-go happy

* [BIG CHANGE] allow different istio setup configs

* make linters happy

* make linters happier

* changed wording and function orders

* make error return as the 2nd argument

* add TODOs

* Update content/en/docs/tasks/traffic-management/traffic-shifting/test.sh

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* only test english docs

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* allow test.sh as suffix

* move adding setup configs to tests/setup

* recommend full paths

* Update tests/README.md

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>

* require full test paths

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>
2020-06-09 14:11:53 -07:00
Frank Budinsky b3e79edd95
Rename _run_and_verify_xxx functions to _verify_xxx (#7452)
* Remove _verify_ calls

* Rename _run_and_verify functions to _verify

* Update tests/configuration/scripts/liveness_and_readiness_probes.sh

* error exit

* cleaner errexit
2020-06-03 06:24:29 -07:00
Frank Budinsky c4e7daaa99
Add make test_status command (#7417)
* Add make test_status command

* improvement
2020-05-27 13:34:26 -07:00
Frank Budinsky e11cf24f0d
Add test: attribute to all md files (#7413) 2020-05-27 09:11:26 -07:00
Frank Budinsky 77d3dc6bf1
Fix mirroring test (#7399)
* Fix mirroring test

* fix typo

* fixes

* export vars

* lint
2020-05-26 12:57:19 -07:00
Frank Budinsky b5f5fd897d
Update tests README + small fixes (#7395)
* Update tests README + small fixes

* lint

* wording tweaks
2020-05-25 15:14:39 -07:00
Justin Pettit 8cacec48de
Authz deny (#7315)
* Add authz-tcp user guide test.

* Add run and verify functions for user doc tests.
2020-05-14 16:10:20 -07:00
Frank Budinsky 4f7622e3aa
More doc testing (#7253)
* Ingress control test

* Ingress control test

* fix lint

* fix package

* fix path

* improve _verify_like

* curl -s

* debug

* fix compare

* remove flaky verify call

* fix path

* regen
2020-05-12 05:58:07 -07:00
Frank Budinsky affe99f97a
More traffic management task tests (#7250)
* More traffic management task tests

* lint errors

* fix kubectl output

* fix arg check

* login to bookinfo

* curl --user

* temporary kludge for login not working

* fault injection test

* rename test

* fix cleanup

* timeouts tests

* regen

* make sure sleep pods are gone
2020-05-10 15:05:22 -07:00
Frank Budinsky f45bc9e1a8
Remove obsolete '# ' uses from all tests (#7233) 2020-05-06 19:17:11 -04:00
Eric Van Norman 392a2bee14
Update test framework to use 1.6.0-beta.0 (#7214)
* Update test framework to use 1.6.0-beta.0

* Go back to copies from env var

* Add more test targets, fix mtls test (new PA added)

* Update to use Istio SHA from go.mod (convert to long SHA)

* Try and remove TAG from prow

* Debug TAG not being set

* Fix paralization issue

* Remove some extra output

* Review comments
2020-05-06 10:49:27 -07:00
lei-tang 2dbb4dc02d
Fix for running user guide tests (#7136) 2020-04-23 07:31:31 -07:00
Frank Budinsky 99d4febb16
Convert health check test to new model (#7126)
* Convert health check test to new model

* fix cleanup
2020-04-22 11:18:58 -07:00
Eric Van Norman a8b9bd10ce
Notes on testing (#7115)
* Notes on testing

* Update tests/README.md

Co-Authored-By: Frank Budinsky <frankb@ca.ibm.com>

Co-authored-by: Frank Budinsky <frankb@ca.ibm.com>
2020-04-21 08:20:51 -07:00
Frank Budinsky 1e7a781bdf
Add built-in verify functions to test framework (#7110)
* Add builtin verify functions to test framework

* fix lint

* tweaks

* fix bold
2020-04-20 13:29:46 -07:00
Frank Budinsky ccd4ce6faa
Document check for lint errors in generated snip.sh files (#7100)
* Document source of user confusion

* tweak
2020-04-17 11:17:20 -07:00
Frank Budinsky 82d4851806
Snip regen (#7084)
* Add gen-check rule

* make gen->site

* tweak

* more readme clarification
2020-04-16 08:28:58 -07:00
Frank Budinsky f2cf780bfb
Update doc test README (#7080)
* Update doc test README

* add sh

* tweaks

* formatting

* format

* fix comment

* wording

* convert mtls migration task

* Update tests/README.md

Co-Authored-By: Eric Van Norman <ericvn@us.ibm.com>

* Update tests/README.md

Co-Authored-By: Eric Van Norman <ericvn@us.ibm.com>

Co-authored-by: Eric Van Norman <ericvn@us.ibm.com>
2020-04-15 08:44:18 -07:00
Nathan Mittler 10821e3a17
Fixes and cleanup for running tests (#6598) 2020-02-25 14:28:01 -08:00
Nathan Mittler a7c0724624
Copy istio.io test framework from istio/istio (#6521) 2020-02-20 10:55:35 -08:00
Nathan Mittler 6a4372e36d
Copy istio.io tests to istio.io repo (#6451)
Once this lands, we will work on getting them on CI
2020-02-14 14:20:10 -08:00