Commit Graph

282 Commits

Author SHA1 Message Date
Eric Van Norman 806fe9faec
Update test reference to 1.11.0 (#10173) 2021-08-12 11:41:51 -07:00
Eric Van Norman b01db7b1e1
Update test ref to istio-1.11-rc.4 (#10167) 2021-08-10 12:16:29 -07:00
Eric Van Norman 95fc4e0aa4
Update test reference to 1.11.0-rc.3 (#10165) 2021-08-10 10:51:23 -07:00
Eric Van Norman a751a3766b
Upfaste istio test ref to 1.11.0-rc.2 (#10155) 2021-08-06 04:31:26 -07:00
Eric Van Norman e2761afb40
Update reference to 1.11.0-rc.1 (#10149) 2021-08-04 15:56:41 -07:00
Istio Automation 6be1a43274
Automator: update istio@ test reference (#10137) 2021-08-01 12:50:22 -07:00
Istio Automation 031a90d9c0
Automator: update istio@ test reference (#10118) 2021-07-26 10:01:29 -07:00
Istio Automation d5b550a371
Automator: update istio@ test reference (#10089) 2021-07-19 07:46:40 -07:00
Eric Van Norman a3f2c5a0dd
Update for branch cut (#10082)
* prepare for v1.11 as istio source is already branched

* Update test ref to 1.11.0-beta.0

* Remove extraneous added files
2021-07-15 11:58:54 -07:00
Eric Van Norman 60e5f06808
Update istio test reference (#10066) 2021-07-13 07:21:47 -07:00
Istio Automation 582b5e25ed
Automator: update istio@ test reference (#10056) 2021-07-12 06:50:23 -07:00
Istio Automation 982acd0829
Automator: update istio@ test reference (#10033) 2021-07-06 06:57:48 -07:00
Istio Automation 614cb4c26a
Automator: update istio@ test reference (#9997) 2021-06-28 07:17:52 -07:00
Istio Automation accf83079b
Automator: update istio@ test reference (#9948) 2021-06-19 20:04:12 -07:00
Istio Automation 5e8b5a3e6f
Automator: update istio@ test reference (#9924) 2021-06-14 07:09:19 -07:00
Istio Automation 7c23406b73
Automator: update istio@ test reference (#9887) 2021-06-07 07:32:15 -07:00
Istio Automation 43818c3d4b
Automator: update istio@ test reference (#9857) 2021-06-01 07:02:20 -07:00
Eric Van Norman 764c37d65a
Update istio reference for istio.io tests (#9841)
* Update istio reference for istio.io tests

* Update to istio commit - hopefully fixing VM test failures
2021-05-26 14:27:48 -07:00
Eric Van Norman 9308f25ab9
Restore external authorization tests (#9788)
* Restore external authorization tests

* Remove extra echo's
2021-05-19 08:44:15 -07:00
Eric Van Norman ae7939eabe
Update master after 1.10 release (#9779)
* build an archive of v1.9 in master

* update data/versions.yml and archive index page

* advance master to release-1.11

* Update the istio test reference to master

* Remove failing deny test

* Remove another test

* Remove a third test
2021-05-18 15:57:52 -07:00
Istio Automation db2ba10111
Automator: update istio@ test reference (#9763) 2021-05-16 07:59:29 -07:00
Eric Van Norman 365547c980
Update test reference to latest 1.10 build (#9715) 2021-05-11 14:35:46 -07:00
Istio Automation e6bfe041c1
Automator: update istio@ test reference (#9702) 2021-05-09 19:08:55 -07:00
Eric Van Norman 277367087d
Update Istio test ref to latest (#9699) 2021-05-07 13:26:11 -07:00
Eric Van Norman 341db5d855
Update istio test refererence for 1.10 (#9680)
* Update istio test ref

* Change test back to previous instructions as regression was reverted
2021-05-04 14:59:29 -07:00
Istio Automation de8f0b2018
Automator: update istio@ test reference (#9663) 2021-05-02 19:16:17 -07:00
Eric Van Norman 32158a0cea
Update istio test ref to latest (picks up external profile changes) (#9630) 2021-04-28 09:18:19 -07:00
Eric Van Norman 5c26859b7d
Update istio test ref to 1.10.0-rc.0 (#9609) 2021-04-26 13:43:03 -07:00
Istio Automation fdc679ab5f
Automator: update istio@ test reference (#9598) 2021-04-26 06:44:41 -07:00
Eric Van Norman c0bf3bf786
Update testref to include MC sample GWs (#9579)
* Update testref to include MC sample GWs

* Update primary-remote with namespace
2021-04-22 15:58:11 -07:00
Eric Van Norman b8c00998e0
Update istio ref to 1.10-alpha.1 (#9568) 2021-04-20 18:14:37 -07:00
Istio Automation a6d794589e
Automator: update istio@ test reference (#9551) 2021-04-19 06:01:54 -07:00
Eric Van Norman ddd3895dc6
Update the istio/istio reference to latest 1.10 commit (#9508) 2021-04-12 06:42:00 -07:00
Eric Van Norman f127816dc7
Update istio reference, update circuit braker test (#9454) 2021-04-06 08:35:48 -07:00
Istio Automation 0dfde1e993
Automator: update istio@ test reference (#9413) 2021-03-29 07:04:27 -07:00
Eric Van Norman 517c0208e3
Update istio test ref - fix timeout failures? (#9325)
* Update istio test ref - fix timeout failures?

* Go back to figure out why ext cp setup is failing (samples not starting)

* Again including #31560

* After 31561

* Past #31410

* test ref sha=688973e58828ffbcff2ccd9eeab41a12527c217a

* test ref 9d5ba69765 #31401

* Update test ref to latest istio and change 504/408 for egress test

* Update to get around quay.io outage
2021-03-23 06:29:04 -07:00
Istio Automation b7a4c79e84
Automator: update istio@ test reference (#9208) 2021-03-15 06:05:50 -07:00
Istio Automation b6e842fbc8
Automator: update istio@ test reference (#9134) 2021-03-08 08:17:41 -08:00
Istio Automation 216fef2923
Automator: update istio@ test reference (#9078) 2021-03-01 06:53:18 -08:00
Istio Automation bb69a9c951
Automator: update istio@ test reference (#9021) 2021-02-22 06:13:22 -08:00
Istio Automation 99c90b6c08
Automator: update istio@ test reference (#8975) 2021-02-14 20:27:28 -08:00
Eric Van Norman c5966d20f3
Update test reference on main branch to istio.io/istio master (#8950)
* Update test reference on main branch to istio.io/istio master

* Run make gen

* Update istio.io/api

* Fix istioctl-analyze test moving output to 1.10

* Change version string

* Remove overall shellcheck disable of SC2001
2021-02-12 06:50:52 -08:00
Eric Van Norman ebcc7e6de8
Update istio test ref to 1.9.0 (#8919) 2021-02-08 06:05:26 -08:00
Eric Van Norman 0db0744ace
Update istio test ref to 1.9.0-rc.0 (#8852)
* Update istio test ref to 1.9.0-beta.1

* Update test reference to Istio 1.9-rc.0
2021-02-02 11:10:39 -08:00
Eric Van Norman 5d984eb560
Update istio.io/istio ref to 1.9.0-beta.0 (#8562)
* Update istio/istio ref to latest master

* Move to latest before testing.

* Update release in Makefile

* Fix some tests

* Update to latest isti.io/istio again

* Update to latest istio.io/istio

* Update to latest istio.io/istio

* Update ref to latest master

* Fix instioctl-analyze

* Add back @howardjohn commit I inadvertantly deleted

* Fix lint

* Pick up new stio: fix empty iop read from stdin for operator

* go mod tidy without itermediate go gets

* Update to current stats-filter's

* Needed another 'make gen'

* More go.* changes for changes in ref'd istio/istio

* Update istio to 1.9.0-beta.0
2021-01-19 11:57:22 -08:00
Nathan Mittler 616f45b1d5
Several test framework improvements (#8524)
Overview of the changes:

- Adding ability to verify that expected output occurs a number of times consecutively. This is needed for https://github.com/istio/istio.io/pull/8402.

- Moving snapshot checking logic to Go code so that it can be separated out into separate test steps, which are timed and contain their own output directories/files. This makes the code cleaner and also makes the snapshot logic more transparent.

- Updating debug.sh to use newer bash syntax that allows it to dynamically select a free file descriptor. Without this, I was seeing all commands echoed to my console in goland.
2020-11-23 09:23:54 -05:00
Eric Van Norman 26c7cc4d69
Move to an intermediate 1.8 build for testing (#8477) 2020-11-10 06:21:07 -08:00
Eric Van Norman 9f6a0aa9a2
Update test reference to 1.8.0-alpha.2 (#8399)
* Update test reference to 1.8.0-alpha.2

* Fix access-log test for new behavior

* Update to remove deprecated parameter

* More updates for deprecated (already removed) values

* Enable test, disable failing tests (#8405) open for fix.

* Review comment

* Remove extraneous old-td
2020-10-30 09:36:38 -07:00
Eric Van Norman 75980d36d2
Initial setting of istio test ref to 1.8 branch (#8329) 2020-10-21 10:57:33 -07:00
Nathan Mittler b28bb174de
Fixes for multicluster tests (#8309) 2020-10-21 06:46:49 -07:00
Nathan Mittler 1c8f8cbc2f
Update multicluster install docs with latest config. (#8305)
Fixes: #8303
Fixes: #8304
2020-10-14 12:59:13 -07:00
Eric Van Norman daeceef369
Update istio/istio test reference (#8290)
* Update istio/istio test reference

* Update istioctl analyzer test as namespace message is now Info.

* Review comment
2020-10-14 06:23:01 -07:00
Nathan Mittler 5131e65225
[WIP] Update to the latest istio/istio (#8259) 2020-10-02 12:42:41 -07:00
Eric Van Norman 87ce923716
Revert to -o pipefail and fix lint-yaml, revert istio commit (#8254)
* Revert to -o pipefile

* Add +o pipefail around common file lint-yaml

* Update comment

* Simplify call

* Revert to older istio/istio commit which passed tests
2020-10-02 08:02:49 -07:00
Eric Van Norman efd94919a1
Update test reference from latest master commit (#8233) 2020-09-30 07:53:11 -07:00
Nathan Mittler 539cd2aaf7
Update to latest istio/istio (#8199) 2020-09-23 16:06:55 -07:00
Eric Van Norman cc1a34f99c
Update test reference - master (#8103)
* Update test reference

* Test framework changes

* Another required change

* Update Tag to 1.8

* Pick istio/istio commit that actually exists

* Disable ISTIO_META_DNS_CAPTURE

* Add --skip-confirmation to istioctl installl commands

* Increase test timeout. First pass at fixes.

* Update to later istio/istio that fixes DNS and minor fixes

* test fixes

* Pick up go.mod `replace` changes from #8118

* Fix istioctl-analayze and mirror

* Fix mtls-migration test

* Update istio to include commit to fix egress

* Re-enable verify with fix

* Update istio/istio ref for egress fix

* Fix tasks/security/authorization/authz-td-migration - remove ns

* Shorten wait timeout so tests complete in under an hr

* Let tests continue after wait timeout

* Fix --skip-confirmation to -y and use yes | in tests

* revert yes | to echo y |

* Additional echo y fix

* Code review comments

* Change verify from same to contains as k8s 1.19 has extra warning lines.
2020-09-16 11:44:20 -07:00
Eric Van Norman b9f6f79bb5
Update test ref to 1.7.0-rc.4 (#7990) 2020-08-21 10:25:50 -07:00
Eric Van Norman 5799f4ca9b
Update test ref to 1.7.0-rc.3 (#7984) 2020-08-20 06:28:42 -07:00
Eric Van Norman 20c574a1d4
Update test ref to 1.7.0-rc.2 (#7973)
* Update test ref to 1.7.0-rc.2

* Rerun go mod tidy
2020-08-19 07:46:12 -07:00
Eric Van Norman b9a1ba8426
Update test ref to 1.7.0-rc.1 (#7936)
* Update test ref to 1.7.0-rc.1

* Update to actual 1.7.0-rc.1 build
2020-08-14 06:13:20 -07:00
Eric Van Norman af7e232cea
Update test reference to 1.7-beta.2 (#7901) 2020-08-10 11:57:53 -04:00
Eric Van Norman bc5071b44b
Update test reference to 1.7.0-beta.1 (#7868)
* Update test reference to 1.7.0-beta.1

* Fix testcase with new istioctl anaylze changes

* One more change in URL
2020-08-05 14:46:21 -04:00
Eric Van Norman d14ee98564
Update test ref to 1.7.0-alpha.2 (#7806)
* Update test ref to 1.7.0-alpha.1

* Update test reference to 1.7.0-alpha.2
2020-07-29 10:40:39 -07:00
Eric Van Norman e43b465057
Update the istio.io/istio ref - Requires code change (#7745) 2020-07-17 13:46:09 -07:00
Navraj Singh Chhina 9bd857e565
Bump istio/istio dep and enable TLS origination tests (#7714)
* add missing cleanup for vs nginx

* bump istio and re enable tls origination tasks

* update istio to master

* bump to stable istio/istio

* make gen
2020-07-13 14:32:28 -04:00
Eric Van Norman 78088360fe
Update istio/istio ref and reenable tests (#7669)
* Update istio/istio ref and reenable tests

* Update istio/istio reference

* Update istioctl build to have version for images

* Fix lint and pull a newer istio/istio

* Disable egress tests
2020-07-09 13:29:32 -07:00
Eric Van Norman 33383e6532
Update Istio ref (#7604) 2020-06-22 08:35:51 -07:00
Eric Van Norman ee8927ea74
Update istio version for testing (#7565)
* Update istio version for testing

* Framework changes in base istio required changes

* Work on whitelist

* Remove whitelist and move to a new feature

* Another istio.io/istio update

* Another framework change - remove test suite name
2020-06-19 12:20:35 -07:00
Eric Van Norman e8f18494dd
Update istio sha for tests to current `master` from `release-1.6` (#7430)
* Update istio sha for tests to current `master` from `release-1.6`

* Update to latest `master` sha

* Change ISTIO_IMAGE_VERSION to match master

* Increase retries for flakiness

* Pick up istio release with egress fix

* Fix for flakiness
2020-06-05 10:48:49 -07:00
John Howard e9e963a617
Add TLS origination doc test (#7367)
* Add TLS origination doc test

* Fix build

* Add header

* lint
2020-05-21 14:10:26 -07:00
John Howard f83280e618
Bump istio/istio dependency (#7350)
Also run go mod tidy. This made me notice we are installing the junit
reporter every time even when not needed and keeping it in go.mod
unexpectedly, so this is removed as well.
2020-05-19 07:12:55 -07:00
Justin Pettit 7782eb1d0a
Authz jwt (#7338)
* snip.py: Replace github file token with release-specific URL.

* verify.sh: Show the expected output as well as the actual output.

* snip.py: Update the githubfile regex to not include email addresses.

When generating snip scripts, pairs of "@" signs indicate a link to
GitHub repo content.  However, JWT attribute values contained pairs of
email addresses such as:

    `testing@secure.istio.io/testing@secure.istio.io`

which would be treated as an email address and mangled.  This commit
rewrites the regex to not match on email addresses.

* Add authz-jwt user guide test.
2020-05-17 13:51:45 -04:00
Eric Van Norman 8dff1803bf
Update the Istio version for testing (#7259)
* Update the Istio version for testing

* Update to 1.6.0-rc.1

* Update to 1.6.0-rc.1
2020-05-15 12:03:45 -07:00
Eric Van Norman 392a2bee14
Update test framework to use 1.6.0-beta.0 (#7214)
* Update test framework to use 1.6.0-beta.0

* Go back to copies from env var

* Add more test targets, fix mtls test (new PA added)

* Update to use Istio SHA from go.mod (convert to long SHA)

* Try and remove TAG from prow

* Debug TAG not being set

* Fix paralization issue

* Remove some extra output

* Review comments
2020-05-06 10:49:27 -07:00
lei-tang 96073364ea
User guide tests and remove manual steps for plugging in CA cert (#7085)
* User guide tests and remove manual steps for plugging in CA cert

- Add user guide tests for plugging in CA cert
- Remove the manual steps in the user guide of plugging in CA cert
to make it easier for an user to try the guide.

* Fix SC2046 lint error and the trafficmanagement test errors
2020-04-17 09:16:56 -07:00
Nathan Mittler 82f577cc4a
Update to the latest istio/istio (#6999)
Have to copy over a new configuration file for istioctl required by the test framework.
2020-03-30 07:29:35 -07:00
Nathan Mittler 404cbd180d
Update to the latest istio/istio (#6881)
There were changes to the test framework that required a few tweaks.
2020-03-16 10:08:02 -04:00
Istio Automation c71ba46ef4
Updating istio/istio dependency (#6724) 2020-03-05 07:24:16 -08:00
Nathan Mittler 10821e3a17
Fixes and cleanup for running tests (#6598) 2020-02-25 14:28:01 -08:00
Nathan Mittler e97c81b700
Fix istio.io integration tests (#6489) 2020-02-20 09:28:42 -08:00
Nathan Mittler 6a4372e36d
Copy istio.io tests to istio.io repo (#6451)
Once this lands, we will work on getting them on CI
2020-02-14 14:20:10 -08:00