Commit Graph

48 Commits

Author SHA1 Message Date
Chi Zhang 064b156ab7
Update and fixes to the cluster management lib (#1196)
* fix project in e2e cluster manager

* delete async for boskos

* use the right quota in the GKE requests

* update google cloud api

* update

* fix unit tests

* fix unit tests

* fix unit tests

* acquire always creates new

* support resolving GKE version

* go fmt

* delete version.go

* add more unit tests
2020-04-06 14:52:59 -07:00
Chi Zhang 7727cb37e0
Retry cluster creation if there's an error (#1186)
* retry cluster creation if there's an error

* nit renaming

* go fmt

* delete cluster async

* clean up the code a bit

* nits

* address comments

* fix unit tests

* nits

* go fmt

* fix unit tests
2020-04-03 09:23:18 -07:00
Joyce Liu 777b215a64
use boskos to fetch a project if only a project is not specified (#1169) 2020-03-23 12:45:09 -07:00
Matt Moore 1cc7b71529
golang format tools (#1099)
Produced via:
  `gofmt -s -w $(find -path './vendor' -prune -o -path './third_party' -prune -o -type f -name '*.go' -print)`
  `goimports -w $(find -name '*.go' | grep -v vendor | grep -v third_party)`
/assign n3wscott
/cc n3wscott
2020-02-17 09:56:10 -08:00
chaodaiG d8caefc1cd
Default occupy Boskos for long enough time so we don't need to do hea… (#1095)
* Default occupy Boskos for long enough time so we don't need to do heartbeat

* Update testutils/clustermanager/e2e-tests/boskos/boskos.go

Co-Authored-By: Victor Agababov <vagababov@gmail.com>

Co-authored-by: Victor Agababov <vagababov@gmail.com>
2020-02-14 10:07:41 -08:00
Chi Zhang 84c9a84d38
Add extra flags for cluster creation in test (#1033)
* add extra flags for cluster creation

* move flags out of request.go
2020-02-03 07:38:30 -08:00
Adriano Cunha 446f2e9f2c
Use e2 VMs instead of n1 for test clusters (#1024)
* Use n2 VMs instead of n1 for test clusters

* Update unit tests that use default values
2020-01-30 16:20:28 -08:00
Chi Zhang b51ee347cb give cloud-platform scope by default (#1015) 2020-01-27 17:39:25 -08:00
Chi Zhang 8daabb442e do not enable workload identity for perf tests GKE clusters (#1014) 2020-01-27 14:44:26 -08:00
Chi Zhang e0330640f0 perf-tests cluster manager supports creating clusters in other environment (#982)
* perf-tests cluster manager supports creating clusters in other environment

* address codereview comments

* address comments
2020-01-10 11:29:57 -08:00
Joyce Liu 4f9e59084b Return GKECluster info in PCO (#975)
Returns gkeOps in create, get prow-cluster-operation actions to fetch the Cluster info that's just created/fetched without reading the metadata file when running in Go
2020-01-06 14:43:50 -08:00
Joyce Liu 169ef0797c Added GKE release channel support in cluster creation in cluster manager lib (#968)
* Added release channel support in cluster creation in cluster manager lib
* updated k8s beta dependency to pick up release channel API

* added unit test for the missing coverage in request_test.go
2020-01-02 11:27:42 -08:00
Joyce Liu 400dfb9ff9 updated boskos client based on the latest API in k8s (#945)
* updated boskos client based on the latest API in k8s

* Added clarification comments and cleanup dead code

* Apply suggestions from code review

Co-Authored-By: Victor Agababov <vagababov@gmail.com>

* Updated test error messages in boskos_test.go

* clarification on parameters

* removed accidentally modified client/istio changes

* Fixed unit test for AcquireGKEProject

* Apply suggestions from code review

Co-Authored-By: Victor Agababov <vagababov@gmail.com>

* simplified NewClient + annotated NewClient in boskos_test.go

Co-authored-by: Victor Agababov <vagababov@gmail.com>
2019-12-29 20:19:35 -08:00
Chi Zhang 9fda5bd59a For GKE clusters used in performance tests, always enable Workload Identity (#954)
* always enable workload identity for perf test cluster creation

* fix unit tests

* add comments
2019-12-20 19:25:35 -08:00
Chi Zhang 0094d3a892 RecreateClusters function also create new clusters if they do not exist (#950)
* recreate-clusters also create new clusters

* fix unit tests
2019-12-17 18:27:04 -08:00
Joyce Liu 138ab0d10d Propagate the error in prow-cluster-operation actions instead of log.Fatalf (#931)
* Propagate the error in prow-cluster-operation actions instead of log.Fatalf

* log error in the same manner in prow-cluster-operation main
2019-12-09 20:45:46 -08:00
Joyce Liu da3d090aa9 modify boskos in cluster manager to make the boskos resource type customizable (#922) 2019-12-03 16:45:36 -08:00
Joyce Liu c259ed6f2e Moved cluster name check to later so --get can use cluster name in kubeconfig (#918) 2019-12-02 15:50:35 -08:00
Markus Thömmes 56c2594e4f Assorted linting fixes. (#840)
* Remove unused code.

* Remove unneeded loops.

* Remove unneeded Printf calls.

* Use time.Since instead of time.Now().Sub.

* Remove unused values.

* Rename error variable according to conventions.

* Return error last.

* Simplify array allocations.

* Remove leaky ticker.

* Remove Yoda conditions.

* Remove deprecated function to talk to GKE.

* Remove dot import.

* Remove empty critical section and replace with a channel operation.

* Add linter directives to explicitly state wanted weirdness.

* Update deps.

* Fix broken line.
2019-11-01 12:49:12 -07:00
mattmoor-sockpuppet 12ca01312b Format markdown (#792)
Produced via:
  `prettier --write --prose-wrap=always $(find -name '*.md' | grep -v vendor | grep -v .github)`
/assign mattmoor
2019-10-23 13:42:37 -07:00
mattmoor-sockpuppet 2d54fc909d golang format tools (#791)
Produced via:
  `gofmt -s -w $(find -path './vendor' -prune -o -type f -name '*.go' -print))`
  `goimports -w $(find -name '*.go' | grep -v vendor)`
/assign mattmoor
2019-10-23 13:37:29 -07:00
chaodaiG 0b19b4ad91 Add prow-cluster-operation package (#788)
* Add prow-cluster-operation package

* Remove binary committed by accident
2019-10-22 11:19:26 -07:00
Chi Zhang 1331c9178a Add perf test cluster manager (#776)
* name the parameters of functions in interface

* add perf test cluster manager

* fix package path

* fix build error
2019-10-18 23:50:20 -07:00
Chi Zhang 3f11504864 Some refactors of the pkg/test code (#763)
* some refactors of the pkg/test code

* move clustermanager

* fix unit tests

* address comments

* address feedback

* move clustermanager package

* add comments

* address comment
2019-10-15 23:03:15 -07:00
chaodaiG 7a2cadb6ad Modify cluster manager lib to make it work better with Prow (#755)
* Consolidate cluster manager lib

* Adjust unit test

* updates based on feedback

* Fixing unit tests

* Use project as string instead of pointer
2019-10-11 16:11:31 -07:00
Chi Zhang 9353a99265 Move GKE basic operations to a separate package (#737)
* move GKE basic operations to a separate package

* trying to fix unit tests...

* fix unit tests

* also move wait out

* move the clustercreaterequest out

* fix unit tests

* Update testutils/gke/request_test.go

Co-Authored-By: mattmoor-sockpuppet <mattmoor+sockpuppet@google.com>

* add a flag to indicate whether it's blocking

* address comments, unit tests pending

* bump up unit tests

* minor changes

* fix unit tests

* get zonal changes back, and a few minor changes

* clean up

* more clean up

* address codereview comments

* fix unit test

* remove project id from the request

* project name is not required

* fix unit tests
2019-10-03 15:39:06 -07:00
chaodaiG 385ff7299f Clustermanager lib supports zonal cluster (#740)
* Support zonal cluster

* test util.go

* feedback updates

* Fix unit tests

* feedback updates2

* Update testutils/clustermanager/util_test.go

Co-Authored-By: Victor Agababov <vagababov@gmail.com>
2019-10-02 10:27:07 -07:00
chaodaiG 346b0abf16 Clustermanager lib: don't expose initialize, calling it internally only, also allow skip cluster creation and force cleanup options (#734)
* Don't expose initialize, calling it internally only. Also allow skip
creation and force deletion to mimic the current behavior of test-infra

* Update testutils/clustermanager/gke.go

Co-Authored-By: Adriano Cunha <35786489+adrcunha@users.noreply.github.com>
2019-10-01 15:55:05 -07:00
mattmoor-sockpuppet 9c487c053f golang format tools (#729)
Produced via:
  `gofmt -s -w $(find -path './vendor' -prune -o -type f -name '*.go' -print))`
  `goimports -w $(find -name '*.go' | grep -v vendor)`
/assign mattmoor
2019-09-30 07:17:48 -07:00
chaodaiG 1c104e1f43 Explictly set GKE cluster version to 'latest' (#727) 2019-09-27 20:23:42 -07:00
chaodaiG 339da85539 Cluster management lib: allow custom cluster name (#723)
* Cluster management lib: allow custom cluster name

* Apply suggestions from code review

Co-Authored-By: Chi Zhang <chizhg@google.com>

* Apply suggestions from code review

Co-Authored-By: Chi Zhang <chizhg@google.com>

* revert unit64 change

* Apply suggestions from code review

Co-Authored-By: Adriano Cunha <35786489+adrcunha@users.noreply.github.com>
2019-09-27 10:42:42 -07:00
chaodaiG a1b3961a1d Fix cluster creation lib return not up-to-date cluster issue (#718) 2019-09-24 12:12:43 -07:00
Chi Zhang f31c478cbc minor changes (#713) 2019-09-23 09:59:14 -07:00
chaodaiG 27ef42f063 Create cluster with basic auth enabled by default (#705) 2019-09-20 09:12:03 -07:00
mattmoor-sockpuppet 0ec97c7f72 golang format tools (#700)
Produced via:
  `gofmt -s -w $(find -path './vendor' -prune -o -type f -name '*.go' -print))`
  `goimports -w $(find -name '*.go' | grep -v vendor)`
/assign mattmoor
2019-09-19 07:42:15 -07:00
chaodaiG 9d9cb54ed0 Cluster management lib: Add autoscaling to cluster creation (#692)
* Add autoscaling to cluster creation

* Apply suggestions from code review

Co-Authored-By: Adriano Cunha <35786489+adrcunha@users.noreply.github.com>

* fixing a test failure
2019-09-18 10:37:46 -07:00
chaodaiG 53eebd4e81 Cluster management lib: create cluster with addon (#687)
* Create cluster with addon

* Apply suggestions from code review

Co-Authored-By: Victor Agababov <vagababov@gmail.com>
Co-Authored-By: Adriano Cunha <35786489+adrcunha@users.noreply.github.com>
2019-09-16 16:06:46 -07:00
chaodaiG b980bf131b Cluster creation lib uses v1beta1 instead of v1 (#677) 2019-09-16 12:57:49 -07:00
mattmoor-sockpuppet ed1a121c33 golang format tools (#684)
Produced via:
  `gofmt -s -w $(find -path './vendor' -prune -o -type f -name '*.go' -print))`
  `goimports -w $(find -name '*.go' | grep -v vendor)`
/assign mattmoor
2019-09-16 07:21:41 -07:00
chaodaiG 55634011c4 Add cluster deletion funciton (#674)
* Add cluster deletion funciton

* Apply suggestions from code review

Co-Authored-By: Adriano Cunha <35786489+adrcunha@users.noreply.github.com>
2019-09-13 11:05:34 -07:00
chaodaiG 2e2ab7a878 clusterlib: fake boskos client for better test coverage (#649)
* Fake boskos

* feedback updates
2019-09-12 11:36:32 -07:00
chaodaiG 87ad483365 Cluster operations wait for *Operation object directly (#666)
* Cluster operations wait for *Operation object directly

* feedback updates
2019-09-11 17:28:35 -07:00
chaodaiG c92533920c testing setup (#639) 2019-09-06 14:08:07 -07:00
chaodaiG 9f6e5334c2 Add cluster creation logic with using GKE SDK (#579)
* Add cluster creation logic with GKE SDK
`

* fix build/test error + code review updates

* add tests for acquiring cluster
2019-08-21 18:54:33 -07:00
chaodaiG f90999efb7 Add boskos related helpers for cluster management lib (#575)
* Add boskos related helper for cluster management lib

* Add boskos in vendor

* update boskos usage

* add unit test for boskos

* feedback updates
2019-08-17 07:49:29 -07:00
chaodaiG d3c17af1d9 clustermanager: move common helpers and add more helpers (#573)
* clustermanager: move common helpers and add more helpers

* feedback updates
2019-08-14 14:52:07 -07:00
chaodaiG 057c0dfb8f Add cluster creation logic for local users (#569)
* Add cluster creation logic for local users

* Add unit test

* Feedback updates
2019-08-13 23:41:08 -07:00
chaodaiG 1b8b127c99 Test Infra 2.0: Add cluster management lib skeleton (#568)
* Add cluster management lib skeleton

* Add OWNERS file
2019-08-12 17:20:32 -07:00