Commit Graph

817 Commits

Author SHA1 Message Date
Kimonas Sotirchos 46fc423f9b readme: Update the K8s section (#2168)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2022-03-10 19:01:57 +02:00
Kimonas Sotirchos 9522bb26d7 Update kubeflow/kubeflow manifests from v1.5.0 (#2167) 2022-03-10 16:22:26 +02:00
Suraj Kota 5b85865c06 sync single-line install command with individual component install (#2166)
Update individual component instructions to match single line installation
2022-03-10 16:22:21 +02:00
Paul Van Eck 5bb641f138 docs: Update KServe/KFServing section in README (#2162)
Signed-off-by: Paul Van Eck <pvaneck@us.ibm.com>
2022-03-10 14:11:07 +02:00
juliusvonkohout abd63cb39e Create networkpolicy kserve-models-web-app.yaml (#2160)
* Create kserve-models-web-app.yaml

* Update kustomization.yaml
2022-03-10 14:11:02 +02:00
Kimonas Sotirchos 37d56295a6 kserve: Add distinct file for cluster-roles (#2153)
* kserve: Add distinct file for cluster-roles

When we install both KFServing 0.6.1 and KServe 0.7.0 we are using the
standalone version of KServe 0.7.0. But, the standalone KServe
installation does not include the aggregated roles for the KF
kubeflow-{admin,editor,viewer} roles.

This commit adds the needed clusterroles/bingings as a distinct file to
explicitly include them, when installing both KFServing and standalone
KServe.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* kserve: Use kubeflow overlay of MWA

In order to use the KServe MWA by default we will need to use the
kubeflow overlay. This overlay updates the VirtualService to use the
kubeflow/kubeflow-gateway Gateway, alongside the other KF apps.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2022-03-04 21:04:43 +02:00
Kimonas Sotirchos 9c5f015ae3 Update kubeflow/kubeflow manifests from v1.5.0-rc.2 (#2159) 2022-03-04 21:04:37 +02:00
Kimonas Sotirchos b110a205dd kserve: Update the Models web app (#2158)
Update the app's manifests to:
1. Work under the /kserve-endpoints prefix
2. Use the correct gatway in the manifests
3. Use the correct namespace in for the app's ConfigMap

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2022-03-04 21:04:24 +02:00
Kimonas Sotirchos 889d786d08 Sync kubeflow katib manifests v0.13.0 (#2156)
* hack: Update katib script to update the README

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update kubeflow/katib manifests from v0.13.0
2022-03-04 21:04:19 +02:00
Kimonas Sotirchos 74dc2cd3d9 Update the README (#2157)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2022-03-04 21:04:14 +02:00
Kimonas Sotirchos 4022813a9f Update kubeflow/pipelines manifests from 1.8.1 (#2152) 2022-03-04 21:04:09 +02:00
Kimonas Sotirchos 9195ebfb34
Cherry-picks for v1.5-branch before cutting RC1 (#2138)
* tests: Scripts for e2e tests (#2128)

* remove old test files

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* gitignore: Don't track pyc files

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* flake8: Introduce linting file

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* hack: Introduce scripts for cluster manipulation

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* tests: Add e2e test

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* GH action for running e2e test

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Reduce the installed components and system reqs

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* kserve: Add simple kustomization file

To avoid having to use --load_restrictor none we'll need to wrap the
KServe manifests inside a kustomization.yaml file.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* unittests: Fix unit tests

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* gh: Remove action for e2e tests

We should use prow instead to trigger our e2e tests.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Add networkpolicies under /contrib/networkpolicies (#2121)

* Create .gitkeep

* Add files via upload

* Create OWNERS

* Create README.md

* Delete default-deny-not-istio-system.yaml

* Create default-allow-same-namespace.yaml

* Create centraldashboard.yaml

* Create jupyter-web-app.yaml

* Create katib-ui.yaml

* Create kfserving-models-web-app.yaml

* Create ml-pipeline-ui.yaml

* Update ml-pipeline.yaml

* Create volumes-web-app.yaml

* Update kustomization.yaml

* Update OWNERS

* Sync kubeflow pipelines manifests 1.8.0 rc.2 (#2131)

* hack: Update pipelines sync script to change README

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update kubeflow/pipelines manifests from 1.8.0-rc.2

* Sync kubeflow kubeflow manifests v1.5.0 rc.1 (#2134)

* hack: Sync README for kubeflow/kubeflow sync-script

Extend the sync-script for kubeflow/kubeflow to also update the
components versions in the readme.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update kubeflow/kubeflow manifests from v1.5.0-rc.1

* Sync kserve/models-web-app manifests (#2135)

* kserve: Rename from upstream to kserve

We will be including both kserve/kserve and kserve/models-web-app into
the manifests, so the names will need to reflect this.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* kserve: Add manifests for the models-web-app

Include the MWA manifests from the v0.7.0 tag.
https://github.com/kserve/models-web-app/tree/v0.7.0

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* kserve: Include both kserve and mwa manifests

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update kubeflow/kfp-tekton manifests from v1.1.1 (#2141)

* hack: Update tekton script to edit README

The hack script for updating the kfp-tekton manifests should also be
updating the README file as well.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update kubeflow/kfp-tekton manifests from v1.1.1

* Update manifests for Katib v0.13.0-rc.1 release (#2139)

* Update manifests for Katib v0.13.0-rc.1 release

* Change README

* readme: Remove MPI reference and add ingress distributions link (#2143)

* Closes #1963
* Remove unused MPI reference (PR #2119)

* Update kubeflow/pipelines manifests from 1.8.0 (#2144)

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* hack: Don't error if namespace kubeflow exists (#2140)

The helper setup scripts should not error when the namespaces already
exist.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

Co-authored-by: juliusvonkohout <45896133+juliusvonkohout@users.noreply.github.com>
Co-authored-by: Andrey Velichkevich <andrey.velichkevich@gmail.com>
Co-authored-by: a9p <58503488+a9p@users.noreply.github.com>
2022-02-16 15:10:07 +00:00
Kimonas Sotirchos 7bd34debf4
Update README for v1.5.0-rc.0 (#2124)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2022-01-27 17:10:10 +00:00
Kimonas Sotirchos 266bf92cfc
Update kubeflow/kubeflow manifests from v1.5.0-rc.0 (#2123) 2022-01-27 16:37:10 +00:00
Kimonas Sotirchos 5abad1e06b
Update the KServe manifests (#2122)
* Copy kserve manifests

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Include kserve in example

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update the README

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2022-01-27 16:36:10 +00:00
Juana Nakfour 9a5489892c
Updating cert-manager to v1.5.0 to enable KF on Kubernetes 1.22 (#2076)
Co-authored-by: Juana Nakfour <nakfour>
2022-01-27 14:20:10 +00:00
Kimonas Sotirchos 3438166ae8
Sync kubeflow training operator manifests v1.4.0 rc.0 (#2119)
* Update kubeflow/training-operator manifests from v1.4.0-rc.0

* Remove helper sync script for mpi-job

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Remove MPI Operator from README

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Remove mpi-job folder

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2022-01-27 11:57:10 +00:00
Kimonas Sotirchos 75b250954c
Update kubeflow/pipelines manifests from 1.8.0-rc.1 (#2118) 2022-01-26 21:53:09 +00:00
Kimonas Sotirchos bcc0e4f8bd
Update kubeflow/katib manifests from v0.13.0-rc.0 (#2116) 2022-01-26 21:52:10 +00:00
Andy Wu 105846262d
Update to istio 1.11 (#2090)
* Update to Istio 1.11

* Fix envoyfilter indentation and remove subfilter

* update kustomization file in example to deploy istio1.11
2022-01-26 20:45:44 +00:00
Kimonas Sotirchos 77f6cac6a0
Update kubeflow/kfp-tekton manifests from v1.1.0 (#2117) 2022-01-26 17:11:44 +00:00
Kimonas Sotirchos f61daecf0d
Create sync scripts for manifests (#2114)
* remove old hack files

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Sync script for kubeflow/kubeflow

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Sync script for katib

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Sync script for pipelines

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Sync script for kfp-tekton

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Sync script for Training Operators

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Sync scripts for MPI Operator

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2022-01-26 13:31:44 +00:00
Yuan (Bob) Gong 366a3e187b
chore: remove Bobgy from OWNERS (#2113) 2022-01-25 08:15:43 +08:00
Kimonas Sotirchos 5fc5aacbcf
Introduce a basic proposals flow for more advanced features (#2100)
This is hugely influenced by the proccess that Octant is following
https://github.com/vmware-tanzu/octant/blob/master/CONTRIBUTING.md#proposals

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2022-01-05 16:32:54 +00:00
Kimonas Sotirchos b9526c9d93
knative-serving: Workaround Istio race wrt Gateway creation (#2092)
When deploying knative-serving there a race due to an Istio issue
that ends up having cluster-local-gateway misconfigured because of
conflicting ports. In a nutshell Istio creates listeners based on
Gateway ports and the corresponding Services (if any) and in our
case we have two Services (cluster-local-gateway, knative-local-gateway)
with port 80 and different targetPort (8080, 8081). In normal
operation the pod gets the following listeners:

  ADDRESS PORT  MATCH DESTINATION
  0.0.0.0 8080  ALL   Route: http.80
  0.0.0.0 8081  ALL   Route: http.8081

We have seen on fresh deployment to end up with only 8081:8081 and
istio complaining with:

  Error adding/updating listener(s) 0.0.0.0_8081: duplicate listener 0.0.0.0_8081 found

To fix that add a label in knative-local-gateway service so that
it gets ignored by istio when translating gateway ports.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-12-22 13:57:41 +00:00
Andrey Velichkevich 3dad839fb0
Remove Katib label from Kubeflow namespace (#2079) 2021-11-23 13:16:06 +00:00
Kimonas Sotirchos 8a40bb9b38
docs: Remove the release docs (#2078)
The documentation for the release process is now moved under the
kubeflow/community repo.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-11-22 15:56:37 +00:00
Kimonas Sotirchos 8478841cd2
Update components of kubeflow/kubeflow for 1.4 (#2055)
* Sync with the 1.4 kubeflow/kubeflow repo

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update README for 1.4

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-10-08 10:30:24 -07:00
Kimonas Sotirchos e756406b45
Update KFServing to 0.6.1 (#2053)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-10-07 13:20:23 -07:00
Kimonas Sotirchos 8c6b8a61e0
Update the example installation (#2050)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-10-07 13:15:23 -07:00
Kimonas Sotirchos ade83a654c
Knative: Use istio's local gateway (#2048)
By default Knative's local gateway will use the istio-ingressgateway Pod
for configuring traffic and binding VirtualServices. This means that all
in-cluster traffic will need to also pass via the ingress gateway.

We've noticed 302s from Notebooks curl-ing InferenceServices. This was
because the AuthService is authenticating all requests that go through
the ingress gateway. But since we now send in-cluster requests via the
ingress gateway this means that AuthService will also check them.

To avoid the above we provide an overlay for making Knative's local
gateway to use Istio's local gateway and not the ingress one.

See: https://github.com/kubeflow/manifests/issues/1966

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-10-07 06:24:22 -07:00
Kimonas Sotirchos 74e04b1a22
Update README for 1.4 (#2047)
* Update references for 1.4

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Add a table for the common components

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update K8s version

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-10-07 06:23:22 -07:00
Andrey Velichkevich 2e0c7fc33d
Update Katib manifests to v0.12.0 release (#2046) 2021-10-06 01:08:08 -07:00
Jiaxin Shan 0aa9a0c965
Update training operator to v1.3.0 (#2041) 2021-10-04 11:57:17 -07:00
Jiaxin Shan 4e7c6d10a3
Update training operator to v1.3.0-rc.2 (#2032) 2021-09-21 14:41:44 -07:00
Jiaxin Shan fdf25f49e7
Update training operator to v1.3.0-rc.1 (#2024) 2021-09-16 08:08:55 -07:00
mtszkw 9d1c7ce5e7
Fix apps description in example/kustomization.yaml (#2023) 2021-09-15 02:35:32 -07:00
Kimonas Sotirchos c87eecc24a
git: Ignore Vim files (#2020)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-09-14 11:34:32 -07:00
Kimonas Sotirchos 0e77b87b44
Update Notebooks WG manifests from RC1 (#2021)
Use the manifests from https://github.com/kubeflow/kubeflow/tree/v1.4-rc.1

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-09-14 11:33:33 -07:00
Andrey Velichkevich af29173b00
Update manifests for Katib 0.12.0-rc.1 release (#2008)
* Update manifests for Katib 0.12.0-rc.1 release

* Update README
2021-09-13 07:17:01 -07:00
juliusvonkohout e7fe3f8e8d
feat: add seldon permissions to default-editor (#2013)
* Create kubeflow-edit-seldon.yaml

* Update kustomization.yaml
2021-09-13 05:00:01 -07:00
Aldo Culquicondor 2119cc81e8
Use MPI operator tag v0.3.0 (#2012)
Ensure the v1 controller is used.
2021-09-09 02:41:01 -07:00
Kimonas Sotirchos f378b229a2
Update KFP Tekton for version 1.0.0 (#2006)
* Update KFP Tekfont for version 1.0.0

Used tag https://github.com/kubeflow/kfp-tekton/tree/v1.0.0/manifests/kustomize

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update the README

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-09-07 14:58:07 -07:00
Kimonas Sotirchos 999b6185a8
Update README for pipelines 1.7.0 (#1999)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-08-31 03:45:04 -07:00
Kimonas Sotirchos d9a64570c0
Update pipelines to 1.7.0 (#1997)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-08-30 17:45:03 -07:00
Kimonas Sotirchos f4dbef22cb
Allocate 3 weeks for distribution testing (#1996)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-08-30 15:14:25 -07:00
Hao Xin 2e283fece2
docs: fix fmt (#1992) 2021-08-26 07:57:06 -07:00
Anna fe99bd7f21
Add 1.4 release information (#1974)
* Add 1.4 release information

Signed-off-by: Anna Jung (VMware) <antheaj@vmware.com>

* Add 1.4 release wg liaisons, product manager and a shadow

Signed-off-by: Anna Jung (VMware) <antheaj@vmware.com>

* Add a step to reach out to each WG during preparation for WG liaison info

Signed-off-by: Anna Jung (VMware) <antheaj@vmware.com>
2021-08-25 01:44:45 -07:00
Kimonas Sotirchos 18b9bc8d2d
Update the versions of components in README (#1989)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-08-23 17:07:39 -07:00
Kimonas Sotirchos 82c56ed2d5
Update Knative to 0.22.1 (#1965)
* serving: Update to v0.22.1

Fetch the yamls from:
1. https://github.com/knative/serving/releases/download/v0.22.1/serving-core.yaml
2. https://github.com/knative-sandbox/net-istio/releases/download/v0.23.1/net-istio.yaml
3. https://github.com/knative/serving/releases/download/v0.22.1/serving-post-install-jobs.yaml

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* serving: Remove comments with yq

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* serving: Remove anchors and aliases

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* serving: Remove knative-ingress-gateway Gateway

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* serving: Update post-install job

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* eventing: Update to v0.22.1

Use yamls from https://github.com/knative/eventing/releases/tag/v0.22.1

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* eventing: Remove all comments with yq

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* eventing: Remove aliases and anchors

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* eventing: Update post-install job

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* kustomization: Fix namespace and commonLabels

Don't explicitly set the namespace in the kustomization, since there are
resources like the knative-local-gateway Service that need to be applied
in other namespaces.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update the README

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* remove vim .swp file

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: Use string keys to work with kustomize 4.2

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-08-23 11:08:57 -07:00