Commit Graph

36 Commits

Author SHA1 Message Date
Frank Budinsky e30ab6491d
Add namespace labels to test framework diff snapshots (#14773)
* Add namespace labels to test framework diff snapshots

* fix lint

* failing tests

* more failed tests

* more failures

* more fixes

* one more

* fix fault injection
2024-03-25 09:07:25 -07:00
Eric Van Norman 91afadd482
Main branch has a non release gateway API. Changes to allow that. (#13313)
* Master has a non release gateway API. Changes to allow that.

* Grab a istio test ref from main branch

* <ove from istio.io/pkg to istio/istio/pkg

* revert one change

* update istio/api

* Run make gen

* disable failing test temporarily
2023-06-07 15:42:03 -07:00
Eric Van Norman c80facb92f
Update the istio test reference and fix test code (#12914) 2023-03-19 13:04:43 -07:00
Eric Van Norman d18ce3a976
Update istio reference to latest from main branch (#12847) 2023-03-06 07:38:45 -08:00
Eric Van Norman 0c584239b5
Run go-mod-update (#12440) 2023-01-10 14:23:28 -08:00
Ihor Sychevskyi a7297a1006
update links (#12079) 2022-10-11 15:13:39 -07:00
Frank Budinsky 5e89d73d81
Add gateway-api instructions to getting-started and bookinfo docs (#12021)
* Add gateway-api instructions to getting-started and bookinfo docs

* fix lint

* fix cleanup

* regen

* fix lint

* fix setup

* fix include path

* v1alpha2 -> v1beta1

* regen

* install k8s crds

* fix lint

* fix cleanup

* lint

* workaround duplicate crd problem

* fix cmd

* fixes

* lint

* more fixes

* typo

* regen

* uncomment failing snip

* no choice in getting-started

* lint

* typo

* remove duplicate section title
2022-10-03 12:11:48 -07:00
Eric Van Norman d146b3bfce
Fix lint errors with new build tools (#11679)
* Fix lint errors with new build tools

* Move copyright so it doesn't get marked as a heading

I beleive Istio removed copyrights so we could do a bigger clense
later.
2022-08-03 14:09:23 -07:00
Eric Van Norman e9841ae394
Update to use the master branch of istio.io/istio for test refs (#11414)
* Update to use the master branch of istio.io/istio for test refs

* go.* changes

* Update test and go.*

* Update to use `master` branch for make targets

* One final go mod tidy

* REmove vm test for now.

* Remove istioctl-analyze test

* Also remove using-istio-dashboard
2022-06-14 13:39:44 -07:00
Frank Budinsky a326daa3e0
Add webhooks to test framework snapshot (#11281)
* Add webhooks to test framework snapshot

* missing return

* fix lint

* some fixes

* more fixes

* final fixes

* one more
2022-05-13 10:12:49 -07:00
Eric Van Norman f82e0f14b8
Update istio/istio test reference. Also needs a code change. (#10607) 2021-12-14 01:49:12 -08:00
John Howard a7c63369c4
Remove "file mount" egress gw doc (#10143)
* Remove file mount egress documentation

This is actively leading users down a bad practice. We previously did
the same for Ingress - the results were we got a lot less bugs about
file mount being very hard to use.

As is, users are directed here as the default - only if they happen to
know what "SDS" is (an implementation detail) will they realize the
other doc is better.

* gen snips

* fix test

* Fix inject
2021-08-26 10:16:00 -07:00
Eric Van Norman 061a219fc9
Update make gen to do a format-go and check in updated files (#8960)
* Update make gen to do a format-go and check in updated files

* make gen
2021-02-12 10:17:53 -08:00
John Howard c76b74540b
Add docs test for VM installation (#8853)
* Add docs test for VM installation

* fix kind name
2021-01-27 11:34:18 -08:00
Frank Budinsky a70e78f25e
Test cleanup (#8564)
* Framework inject set +e at start of cleanup test script

* tabs

* fix typo

* add nl

* fix doc
2020-11-24 16:26:19 -05:00
Nathan Mittler c5e8a9adc5
Rework locality LB docs into tasks (#8402)
Removing the old locality docs entirely and replacing with tested tasks.
2020-11-24 09:31:15 -08:00
Nathan Mittler 616f45b1d5
Several test framework improvements (#8524)
Overview of the changes:

- Adding ability to verify that expected output occurs a number of times consecutively. This is needed for https://github.com/istio/istio.io/pull/8402.

- Moving snapshot checking logic to Go code so that it can be separated out into separate test steps, which are timed and contain their own output directories/files. This makes the code cleaner and also makes the snapshot logic more transparent.

- Updating debug.sh to use newer bash syntax that allows it to dynamically select a free file descriptor. Without this, I was seeing all commands echoed to my console in goland.
2020-11-23 09:23:54 -05:00
Nathan Mittler 132c2375bc
Add wait for gateway to multicluster tests (#8346)
This required some other changes WRT verification:

- Change __cmp_like to allow for not accepting <pending> for an IP address.

- Change __verify_with_retry to use a timeout rathan than number of retries. This is a more intuitive interface and aligns with the way we do retries in istio/istio. I also got rid of exponential backoff and allow both the timeout and delay between retries to be configured.
2020-10-26 06:45:38 -07:00
Nathan Mittler 6be79801d1
[Test Framework] General improvements (#8312)
- Adding test output to CI artifacts directory
- Removing a few needless features/structures

Split out from #8309
2020-10-18 18:13:21 -07:00
Nathan Mittler f9a9f54eba
[Test Framework] Fixes to support multicluster (#8253)
* [Test Framework] Fixes to support multicluster

* use current context from each kubeconfig file.

* addressing comments
2020-10-02 14:05:09 -07:00
Nathan Mittler c3a3c5df0b
[Test Framework] Refactor to properly use subtests. (#8255)
This was noticed when investigating why errors are not causing the test to fail. It's not clear if this is related to the problem, but the existing logic was definitely atypical.
2020-10-02 06:05:28 -07:00
Nathan Mittler ae343f4148
Fixing tests for osx (#8194)
The scripts currently hard-code the istioctl binary for linux. This change modifies `init.sh` to use the appropriate binary for the current platform.
2020-09-23 07:45:11 -07:00
Suchith J N 94fe1b5353
Test framework enhancement for multicluster doc test (#8160)
* test framework enhancement for multicluster doc test

* simplify multicluster test framework with setup=multicluster directive

* restore documentation comment
2020-09-21 10:43:36 -07:00
Frank Budinsky 4801cd62fa
Verify test cleanup (#7889)
* Verify test cleanup

* disable istio-system checks

* more tolerant checks

* fix lint

* more lint

* limited check cleanup

* always check

* snapshot tweak
2020-08-11 08:19:21 -07:00
Eric Van Norman e43b465057
Update the istio.io/istio ref - Requires code change (#7745) 2020-07-17 13:46:09 -07:00
Hongyi Zhang 4406c95b2d
More cleanup of the test framework (#7640)
* more cleanup

* make go linter happy
2020-06-28 12:24:19 -07:00
Eric Van Norman ee8927ea74
Update istio version for testing (#7565)
* Update istio version for testing

* Framework changes in base istio required changes

* Work on whitelist

* Remove whitelist and move to a new feature

* Another istio.io/istio update

* Another framework change - remove test suite name
2020-06-19 12:20:35 -07:00
Hongyi Zhang faa2001b9d
Remove obsolete classes in old istioio framework (#7550)
* fix bug where *_test.sh doesn't source snips.sh

* remove 'source snips.sh' from scripts

* remove obsolete classes and env variable
2020-06-15 07:23:26 -07:00
Justin Pettit c709c976da
Move generally useful "sample_" functions to new "helpers.sh". (#7441) 2020-06-01 13:09:30 -07:00
John Howard e9e963a617
Add TLS origination doc test (#7367)
* Add TLS origination doc test

* Fix build

* Add header

* lint
2020-05-21 14:10:26 -07:00
Justin Pettit 5f89f64d49
debug.sh: Add debugging to test runs. (#7370)
When tests are run, shell script debugging is enabled and written to a
file called "<script_name>_debug.txt" in the same directory as the
"<script_name>_output.txt" file.
2020-05-20 20:27:44 -07:00
Frank Budinsky dcfdce05dc
Delete all snippet generating code from istioio test framework (#7239)
* Cleanup and remove all snippet generateing from istioio test framework

* fix lint

* one more lint

* remove dead code
2020-05-08 06:07:34 -07:00
Frank Budinsky 1e7a781bdf
Add built-in verify functions to test framework (#7110)
* Add builtin verify functions to test framework

* fix lint

* tweaks

* fix bold
2020-04-20 13:29:46 -07:00
Frank Budinsky 3b59501872
Generate test snippets from md files POC (#7044)
* Generate test snippets from md POC

* fixes

* fix python lint

* fix snip source

* improvements

* update snip calls

* add copyright header

* lint errors

* lint error in md instructions

* better default snip_id

* run test without snippet gen

* gofmt

* fixes

* fix path

* fixes

* fix verify
2020-04-14 07:13:44 -07:00
Nathan Mittler 404cbd180d
Update to the latest istio/istio (#6881)
There were changes to the test framework that required a few tweaks.
2020-03-16 10:08:02 -04:00
Nathan Mittler a7c0724624
Copy istio.io test framework from istio/istio (#6521) 2020-02-20 10:55:35 -08:00