Commit Graph

321 Commits

Author SHA1 Message Date
DavidSpek 165d7d7241 (JWA): update manifests with latest notebook image tags (kubeflow/kubeflow#5757) 2021-03-23 12:30:44 -07:00
DavidSpek 713f0bc2d3 Add notebook-server-rstudio-tidyverse dockerfile and CI/CD (kubeflow/kubeflow#5711)
* Add notebook-server-rstudio-tidyverse dockerfile and CI/CD

* cleanup rstudio tidyverse notebook image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-23 10:28:44 -07:00
Mathew Wicks 447c63bb03 set TZ in rstudio notebook image (kubeflow/kubeflow#5756) 2021-03-23 09:53:44 -07:00
Kimonas Sotirchos a144fcae46 Update the manifests for the Jupyter web app (kubeflow/kubeflow#5741)
* manifests: Add variable for the app's prefix

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* manifests: Remove Rok variables

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* manifests: Use AWS image

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* manifests: Update the spawner-config.yaml file

* Add the ImagePullPolicy setting
* Don't name the config `jupyter-web-app-jupyter-web-app-config`

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* manifests: Permissions to start/stop nbs

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Add latest jupyter images

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-03-23 08:50:44 -07:00
Kimonas Sotirchos 0fe8bf5463 Tensorboards web app manifests: Don't use specific namespace in base (kubeflow/kubeflow#5753)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-03-23 08:46:44 -07:00
DavidSpek 1d9c808db7 Add notebook-server-rstudio dockerfile and CI/CD (kubeflow/kubeflow#5624)
* Add R-Studio image

* cleanup rstudio notebook server image
2021-03-23 07:37:44 -07:00
DavidSpek 8bff0c78b5 Fix conda activation for JupyterLab in full images + cleanup (kubeflow/kubeflow#5748) 2021-03-22 10:09:17 -07:00
DavidSpek 93b9c01880 Fix conda activation for JupyterLab + cleanup (kubeflow/kubeflow#5743) 2021-03-22 08:45:17 -07:00
DavidSpek 9cb33192f1 Update notebook dependency + cleanup (kubeflow/kubeflow#5744) 2021-03-22 08:10:17 -07:00
DavidSpek c934536e2c Fix conda activation in notebook-server-base for JupyterLab (kubeflow/kubeflow#5742) 2021-03-22 07:48:18 -07:00
DavidSpek 90a8e02fc1 (JWA): Add server type selector for jupterlab, vs-code and r-studio (kubeflow/kubeflow#5646)
* jwa(back): ability to setting annotations on NB resource

* jwa(back): update spanwer yaml, dump logo from yaml if file doesn't exist

* jwa(front): add annotations and VSCode/RStudio image types/config

* jwa(front): add server type toggle to UI

* jwa(front): set annotations in notebook request based on server-type

* jwa(front): add server type column to index page

* review: improve button toggle formatting

* jwa(back): set rstudio-tidyverse image in spawner_ui_config

* review: move rewrite and headers to backend

* review: add logo SVGs and set them in environment*.ts

* review: fix how allowing custom images works

* review: add server type logo to index
2021-03-22 05:09:18 -07:00
DavidSpek 7bde2e7e71 Add notebook-server-codeserver-python dockerfile and CI/CD (kubeflow/kubeflow#5700)
* Add notebook-server-codeserver-python dockerfile and CI/CD

* cleanup codeserver python image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-22 03:58:17 -07:00
DavidSpek ca6323c7d5 Add notebook-server-jupyter-scipy dockerfile and CI/CD (kubeflow/kubeflow#5699)
* Add notebook-server-jupyter-scipy dockerfile and CI/CD

* cleanup jupyter scipy image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-22 00:32:17 -07:00
DavidSpek f0aaa691d3 Add notebook-server-jupyter-tensorflow-full dockerfiles and CI/CD (kubeflow/kubeflow#5632) 2021-03-22 00:16:17 -07:00
Kimonas Sotirchos ca44b1c4ee Manifests for Tensorboard controller (kubeflow/kubeflow#5730)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-03-21 14:28:17 -07:00
DavidSpek 149393118e Add listing nodes to JWA ClusterRole for GPU vendor detection (kubeflow/kubeflow#5732) 2021-03-21 13:48:17 -07:00
DavidSpek 98d9c5b152 Add notebook-server-codeserver dockerfile and CI/CD (kubeflow/kubeflow#5625)
* Add Code-Server (VS-Code) image

* cleanup codeserver notebook image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 12:20:17 -07:00
DavidSpek 85859c8998 Add notebook-server-tensorflow dockerfiles and CI/CD (kubeflow/kubeflow#5627)
* Add TensorFlow CPU base image

* cleanup jupyter tensorflow notebook images

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 11:48:17 -07:00
DavidSpek 321d60d916 Add notebook-server-jupyter-pytorch-full dockerfiles and CI/CD (kubeflow/kubeflow#5631) 2021-03-21 10:48:17 -07:00
DavidSpek 8908bde330 Add notebook-server-jupyter-pytorch dockerfiles and CI/CD (kubeflow/kubeflow#5626)
* Add pytorch base images

* cleanup jupyter pytorch notebook image

* rename jupyter pytorch dockerfiles

* fix typo

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 09:07:17 -07:00
DavidSpek 3a7bd2d716 Add notebook-server-jupyter dockerfile and CI/CD (kubeflow/kubeflow#5623)
* Add base dockerfile for all jupyter based images

* cleanup jupyter notebook image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 08:11:17 -07:00
DavidSpek fe7e662392 Add notebook-server-base dockerfile and CI/CD (kubeflow/kubeflow#5622)
* Add base dockerfile for all Web-IDE images (jupyter, r-studio, vs-code)

remove sudo from image

Add S6-overlay

Change naming and add CD

Add ci build test

change naming in prow config to avoid character limit

Add OWNERS file

rename folder

rename folder (again)

remove labels

Rename to the final folder

* cleanup base notebook image Dockerfile

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 04:50:17 -07:00
Kimonas Sotirchos 8db0c6120d Manifests for the Volumes web app (kubeflow/kubeflow#5728)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-03-19 16:22:17 -07:00
Kimonas Sotirchos 0aeda30689 Manifests for Tensorboards web app (kubeflow/kubeflow#5727)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-03-19 16:21:17 -07:00
Yannis Zarkadas 22e4cecf56 fix notebook controller manifests (kubeflow/kubeflow#5729)
* notebook-controller: Remove manager from gitignore

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* notebook-controller: Add missing manifests

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>
2021-03-19 16:09:17 -07:00
Yannis Zarkadas ae3b53f8d2 Notebook Controller: Consolidate manifests (kubeflow/kubeflow#5723)
* notebook-controller: Modify kubebuilder manifests

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* notebook-controller: Set storageVersion to v1

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* notebook-controller: Fix RBAC

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* notebook-controller: Regenerate manifests

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>

* notebook-controller: Remove unused kubebuilder manifests

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>
2021-03-19 10:22:16 -07:00
Yannis Zarkadas da3c7a6642 jupyter-web-app: Consolidate manifests (kubeflow/kubeflow#5721)
Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>
2021-03-19 10:16:16 -07:00
Kimonas Sotirchos 08433d6394 web-apps: Extend common code for the apps to work in standalone mode (kubeflow/kubeflow#5710)
* web-apps(back): Introduce an APP_NO_AUTHNZ env var

The admin can use the APP_NO_AUTHNZ={True,False} to configure if the
application should perform authnz checks or not.

In case of False, then the app will not be expecting a logged in user, in the
`kubeflow-userid` header, and will not perform authorization checks using
SubjectAccessReviews.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Expose if Dashboard is connected

The NamespaceService will also provide an observable that informs
different parts of the app if the CentralDashboard is present.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: Use enumeration for Dashboard state

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: Move common vars to a settings module

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-03-18 13:16:16 -07:00
Kimonas Sotirchos ebbd123359 Fixes in Tensorboard web app (kubeflow/kubeflow#5693)
* twa(front): Use correct base-href when building

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(backend): Fix regex for parsing prefix

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa: Add git tag while building the image

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa: Fix dockerfile for buster-slim image

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa: Use common date-time component to show date

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa(back): Fetch the name directly from the CR

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: Remove unused npm script

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa: Don't override the app's config

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa: Use correct AWS image in Makefile

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: Use bash in Dockerfile entrypoint

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-03-18 12:26:16 -07:00
Kimonas Sotirchos a63eff43ed Volumes Management UI (kubeflow/kubeflow#5684)
* vwa(back): first commit of volumes web app backend

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa(front): init code for volumes web app frontend

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa: {Make,Docker}files

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa: gitignore

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* vwa: README

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: Rename Jupyter to Volumes in README

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: Rephrase comment in default flavor

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* review: Remove snapshot reference from default flavor

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-03-18 01:07:16 -07:00
DavidSpek a1e52c2b9e (Notebook-controller): Add `http-rewrite-uri` and `http-headers-request-set` annotations (kubeflow/kubeflow#5660)
Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-12 04:14:24 -08:00
Rui Fang 7f9c309586 Tesorboard-Controller: use updateStatus instead of update (kubeflow/kubeflow#5644) 2021-03-10 07:46:24 -08:00
dependabot[bot] d110b9670c Bump lodash from 4.17.15 to 4.17.21 in /components/crud-web-apps/common/frontend/kubeflow-common-lib (kubeflow/kubeflow#5674)
Bumps [lodash](https://github.com/lodash/lodash) from 4.17.15 to 4.17.21.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.15...4.17.21)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-03-10 03:33:23 -08:00
dependabot[bot] 6dbf07487a Bump lodash-es from 4.17.11 to 4.17.14 in /components/crud-web-apps/common/frontend/kubeflow-common-lib (kubeflow/kubeflow#5475)
Bumps [lodash-es](https://github.com/lodash/lodash) from 4.17.11 to 4.17.14.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.11...4.17.14)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2021-03-10 03:32:23 -08:00
Yannis Zarkadas b0f13d6ef4 Jupyter Web App: Move manifests development upstream (kubeflow/kubeflow#5613)
As part of the work of wg-manifests for 1.3
(https://github.com/kubeflow/manifests/issues/1735), we are moving manifests
development in upstream repos. This gives the application developers full
ownership of their manifests, tracked in a single place.

This commit copies the manifests for application `Jupyter Web App`
from path `apps/jupyter/jupyter-web-app/upstream` of kubeflow/manifests to path
`components/crud-web-apps/jupyter/manifests` of the upstream repo (https://github.com/kubeflow/kubeflow).

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>
2021-03-04 14:31:48 -08:00
DavidSpek 738e438c98 Fix entrypoint of crud-jwa (kubeflow/kubeflow#5606)
* Fix entrypoint of crud-jwa

* remove APP_PREIX ENV variable from entrypoint
2021-03-02 04:31:47 -08:00
Yannis Zarkadas 3f94f691c3 Notebook Controller: Move manifests development upstream (kubeflow/kubeflow#5608)
As part of the work of wg-manifests for 1.3
(https://github.com/kubeflow/manifests/issues/1735), we are moving manifests
development in upstream repos. This gives the application developers full
ownership of their manifests, tracked in a single place.

This commit copies the manifests for application `Notebook Controller`
from path `apps/jupyter/notebook-controller/upstream` of kubeflow/manifests to path
`components/notebook-controller/config` of the upstream repo (https://github.com/kubeflow/kubeflow).

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>
2021-02-17 18:24:51 -08:00
Kimonas Sotirchos 89f7784383 web-apps(front): Make the library tests run in CI (kubeflow/kubeflow#5564)
In order for the frontend tests to run in a CI system, which will be
using a container to run them, we will need to make some adjustments.

Namely, we will need to:
* Run a headless version of Chrome
* Run the `ng test` in non-watch mode, in order for the testing process
  to terminate and not watch for changes to the codebase.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-02-01 23:14:27 -08:00
Kimonas Sotirchos c38a706299 web-apps(back): Export package code for wheel (kubeflow/kubeflow#5569)
* web-apps(back): Export package code for wheel

When building the wheel we need to define Python packages

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Don't include init in root dir

We don't want to have an init file in the setup directory

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-01-29 08:25:40 -08:00
Kimonas Sotirchos b965467590 web-apps: Fixes to the common code (kubeflow/kubeflow#5567)
* web-apps(back): Fetch the correct default SC

The backend would only check for the annotation of the default
StorageClass but not if it's value would be true/false.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(back): Fetch Pod logs

Extend the common backend libraries to fetch pod logs

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Add global variables.scss

Since we will need the page padding in multiple places we'll create a
scss file to store these values.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Export the Dialog module

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Rework the Toolbar component

* Add option to make button to be stroked
* Don't emit an event when a button is clicked. Expect a function which
  will be executed from this component.
* Put all the buttons on the right to mimic Pipelines UI

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Make the app's background white

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Export commonly used modules

The mat-divider and mat-icon modules are oftenly used so we could
include them in the exports of the KubeflowModule.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Key-val should be on top in list

In the list that shows key-valu pairs in lines we want the key to remain
on top if the value has a big height. Previously the key-title would be
in the middle height of the value, which looked weird.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Add a Comment component for forms

This is used to explain different sections in the form.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Bar at the bottom for every form

We want our forms to have a bar on the bottom with CREATE CANCEL buttons
and the ability to view the yaml contents of a CR.

This component is only used for visualization. The logic component
should be handling this component via this component's inputs/outputs

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): General purpose css

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Make k8s fields optional

We might need to instantiate a k8s objecti with only some of the
subfields, like only the spec and not metadata.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* remove redundant link class

Co-authored-by: Tasos Alexiou <tasos@arrikto.com>

* support fit-content for firefox as well

Co-authored-by: Tasos Alexiou <tasos@arrikto.com>

* firefox fit-content support

Co-authored-by: Tasos Alexiou <tasos@arrikto.com>

* use button instead of span

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

Co-authored-by: Tasos Alexiou <tasos@arrikto.com>
2021-01-29 07:03:40 -08:00
DavidSpek 4ec593159f Move JWA python images to slim-buster (kubeflow/kubeflow#5555) 2021-01-27 10:37:07 -08:00
DavidSpek b9917b8507 Use node:12 as specified in the docs (kubeflow/kubeflow#5522)
* Use node:12 as specified in the docs

* Move to buster-slim

Move images that build the kubeflow library and frontend to buster-slim to reduce image size. Tested with the Jupyter Web App, assumed to also work for Tensorboards Web App once https://github.com/kubeflow/kubeflow/issues/5529 is solved.
2021-01-25 10:22:54 -08:00
Kimonas Sotirchos 879f3aaba5 web-apps(back): Change the string formatting (kubeflow/kubeflow#5495)
* web-apps(back): Change api routes formatting

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(back): Use % substitution for strings

Remove the f"strings" and use % substitutions.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(back): Add subresource handling

Handle an optional subresource field when performing authorization
checks.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-01-20 06:07:59 -08:00
DavidSpek f804366b19 twa(front): Add missing dependencies for tensorboard web app (kubeflow/kubeflow#5528)
* Add missing dependencies for tensorboard web app

* add date-fns and lodash-es dependencies
2021-01-19 03:01:44 -08:00
Kimonas Sotirchos 5fa8b1e820 twa(front): Fix the type issue with table config (kubeflow/kubeflow#5531)
Fix the type of the variables for the table configuration object.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-01-19 02:43:45 -08:00
Naveen e2555c4797 Upgrading the `go` compiler version. (kubeflow/kubeflow#5394)
Upgrade go version of the notebook-controller to 1.15, across the
Dockerfile, Makefile and README. We used the same Golang version as our Kubernetes
dependency, after @Jeffwan's suggestion.
2021-01-12 04:10:25 -08:00
Kimonas Sotirchos 315e973ea4 twa: Update the build process and instructions for the Tensorboards web app (kubeflow/kubeflow#5498)
* web-apps(back): Helper config functions

Introduce helper function for creating the config object for an app.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa: Update the build process

Update both the frontend and the backend of the Tensorboards web app to
follow the build/run process of the other web apps as well.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* twa: Update the README

Restructure the README to look like the JWA one. Also update the
instructions with the latest process for running the web app.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-01-08 05:04:54 -08:00
gilbeckers 82c04b3be1 Correct ContainerStatus of Notebook CR (kubeflow/kubeflow#5314)
* Correct ContainerStatus of Notebook CR

The Notebook Controller doesn't set the State of the CR correctly. In some cases
the first container is the istio-sidecar which results in an incorrect state being
shown to the Notebook CR. This is fix now by showing the Notebook container
ContainerState to the Notebook CR ContainerState

* Changed log statement and added a comment
Implemented remarks of @yanniszark and @kimwnasptd

* Small reorganization of some if statements
2021-01-04 01:27:55 -08:00
Kimonas Sotirchos 7badb2b424 web-apps(back): Add CSRF protection mechanisms to the backends (kubeflow/kubeflow#5472)
* web-apps(back): Add CSRF protection to the backend

The server of each crud-web-app will be setting an XSRF-TOKEN cookie to
the frontend. On each unsafe method (POST, PATCH etc) the backend will
check to make sure that the request:
* Contains an XSRF-TOKEN cookie
* Contains an X-XSRF-TOKEN header
* The value of the above values are the same

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(back): Document the CSRF_SAMESITE env var

Add a new table in the README of the common code to include the ENV vars
that a user can set in any web app. In the future we should also extend
the README of every app with the supported ENV vars.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2020-12-23 08:24:27 -08:00
Kimonas Sotirchos 5eb884bb3d web-apps(front): Update the README (kubeflow/kubeflow#5481)
* web-apps(front): Update the README

Update the readme with detailed commands on how to consume the library
as well as developer guidelines.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Fix typo in README

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2020-12-23 02:42:28 -08:00
Kimonas Sotirchos 9580c16791 web-apps(front): Update the common frontend library (kubeflow/kubeflow#5463)
* web-apps(front): Udate the common library

Add new components to the library. These components will enhance
* The current common table for visualizing objects
* The components we can use for a details-page for each object

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* web-apps(front): Add unit tests to common lib

Fix and introduce new unit tests for most of the components in the
library. We expect the developers to always run `ng test` before any PR
to ensure that the existing functionality is not broken.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* jwa(front): Add required packages for common lib

The common library will expect extra npm modules to be installed in each
app that consumes it.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2020-12-21 05:06:25 -08:00
Josh Risley fa5d1e7f9c Use valid commit for kubeflow/components/common module. (kubeflow/kubeflow#5309)
We use the local `../common` module to build `notebook-controller`. We
also need to specify a valid pseudo-version for `common` to support
importing the Notebook API in other modules. This is because according
to the `go.mod` docs [1]:

> exclude and replace directives only operate on the current (“main”)
> module. exclude and replace directives in modules other than the main
> module are ignored when building the main module.

If we don't replace the default "zero version" for `common` that is
generated in our require directive, then then builds fail for modules
that require the Notebook API. They will encounter an an "invalid
version" error for `common` at commit hash "000000000000".

[1]: https://github.com/golang/go/wiki/Modules#gomod
2020-12-01 12:24:52 -08:00
Naveen bc8df5407e Implemented functional tests using ginkgo for notebook controller (kubeflow/kubeflow#5378)
* Implemented functional tests using ginkgo

The notebook controller can be tested using sigs.k8s.io/controller-runtime/pkg/envtest which comes as part of kubebuilder. With this we should be able to measurable test coverage.

* Fixed the incorrect test condition and included fix to download the envtest binaries.

Fixed the incorrect test condition and included fix to download the envtest binaries.

* Some tweaks based on review.

* Removed the check-license as it was blocking the test.
Included some of the tweaked yaml's files that were being generated.
2020-11-11 05:57:49 -08:00
Naveen a75404d6d8 Included the instructions to contribute notebook-controller. (kubeflow/kubeflow#5383)
* Instructions to contribute.

* Update based on feedback.
2020-11-09 01:52:25 -08:00
Naveen 396ace7a83 Fixes the default leader election ID (kubeflow/kubeflow#5374)
The default leader election  ID is controller-leader-election-helper which could conflict when multiple controllers run within the same namespace. This is a required field in later versions of controller-runtime.
2020-11-02 23:22:17 -08:00
Mathew Wicks e9bbe43418 Add thesuperzapper to notebook OWNERS (kubeflow/kubeflow#5363) 2020-10-27 08:24:00 -07:00
Kimonas Sotirchos 9593da2cd3 Initialize the Jupyter web app frontend in crud-web-apps (kubeflow/kubeflow#5332)
* Update the backend

For the frontend to work properly we will need to add the following
changes to jupyter web app's backend as well as to the common backend
code:
* rename the references from `flask_rest_backend` to `crud_backend` in
  the web app's backend code
* add a route for exposing GPU info. This way the UI will block users
  from creating Notebooks with a GPU type that is not installed at all
  in the cluster

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update the common frontend library

New functionality added:
* An `Advanced Settings` button that can expand and shrink to
  expose/hide more options in the form
* All validators will have a debounce time to make the input of
  characters smoother
* Extend the Status types to allow start/stopped resources
* Extend the main table config to support a button [ ex CONNECT for
  jupyter web app ]
* The http services should use relative URLs

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Update the frontend to utilize the common code

The bulk of the new frontend code. The folder structure is changed to
make it more clear what pages are used from the page.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* {Make,Docker}files

Add Makefile and Dockerfiles. Note that GCB build process needs to be
updated.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* README.md

Add a readme that explains how to build the app and have a development
environment.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2020-10-27 07:45:59 -07:00
Kimonas Sotirchos 5d84874fc4 Refactor the JWA backend to utilize common code (kubeflow/kubeflow#5316)
* WA: Backend common: update the library

Update the common python wheel wrt:
* How to distinguish between dev and prod mode
* Extra routes for handling Notebooks
* Serving the index.html for every non api route (SPA)
* Add a STOPPED state to the possible Status values

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* JWA: Add the refactored backend

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* JWA: Backend: Add support for Affinity/Tolerations

* Extend the configuration yaml with default form values for the
  affinity/tolerations
* Set them accordingly when the user submits a notebook

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
Reviewed-by: Ilias Katsakioris <elikatsis@arrikto.com>
2020-09-29 02:37:25 -07:00
MartinForReal 97a8be52a4 Add MartinForReal as reviewer (kubeflow/kubeflow#5241)
Add MartinForReal as reviewer
2020-09-06 19:27:41 -07:00
Konstantinos Andriopoulos 531a428eff Add TWA frontend (kubeflow/kubeflow#5267)
* Add frontend for the Tensorboard Web-app

This commit contains the code for the frontend of the Tensorboard
web-app. It completes the GSoC 2020 project for building the
standalone TWA for Kubeflow.

The app is not yet fully integrated to the Kubeflow dashboard, so
the README.md file contains documentation on how to build, run and
use the web-app locally.

Also, a Dockerfile was added in order to build a playground image
of the web-app. The 'deploy' folder contains manifests that will
enable the TWA to properlly run on the cluster in the future.

* Update README.md
2020-08-31 09:32:21 -07:00
Konstantinos Andriopoulos a97b442e5b Add RWO_PVC_SCHEDULING env var to the Tensorboard Controller deployment (kubeflow/kubeflow#5266)
* Add RWO_PVC_SCHEDULING env var to Tensorboard controller deployment

The value of the 'RWO_PVC_SCHEDULING' env var is set to "false" by
default. The user will be able to change the value of the env var
manually by modifying the 'config/manager/manager.yaml' file.

* Update README.md
2020-08-31 08:12:21 -07:00
dependabot[bot] 8be6caebc5 Bump lodash from 4.17.15 to 4.17.20 in /components/crud-web-apps/common/frontend/kubeflow-common-lib (kubeflow/kubeflow#5256)
Bumps [lodash](https://github.com/lodash/lodash) from 4.17.15 to 4.17.20.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.15...4.17.20)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2020-08-31 07:08:20 -07:00
Konstantinos Andriopoulos 254c3f7bfc Add roles for Tensorboard controller pod (kubeflow/kubeflow#5262)
* Add Tensorboard controller permissions for managing resources

The pod running the Tensorboard controller didn't have permissions
to manage the deployments, services, and VirtualServices needed
so that the Tensorboard servers would function properly.

In order for the deployed Tensorboard controller to run properly,
permissions to 'get', 'list', 'watch', 'create' and 'update'
are given to the Tensorboard controller pod so that the necessary
deployments, services and VirtualServices are created and managed
as expected. Also, permissions to 'get', 'list', 'watch' PVCs and
pods were added.

* Add namespace of Tensorboard CR to VirtualService prefix

In order to avoid creating 2 virtual services that have the same
prefix in different namespaces, the namespace of the corresponding
Tensorboard CR was added in the prefix of the generated Virtual
Service.

* Fix directory bug in Makefile

* Add README.md
2020-08-30 06:56:20 -07:00
Konstantinos Andriopoulos e32222032c Tensorboard web-app: Add functionality to inform TWA frontend about the status of Tensorboard servers (kubeflow/kubeflow#5259)
* Extend Tensorboard CRD with status.readyReplicas field

The Tensorboard CRD didn't contain any information about the
Tensorboard server being ready or not. So, the status of the
Tensorboard resource is extended so that it contains a
readyReplicas field, similar to the status.readyReplicas of
the deployment of the Tensorboard server.

* Extend Tensorboard controller to update status of Tensorboard CR

The frontend of the Tensorboard web-app will need information
about whether the Tensorboard servers are ready to connect or not.
As a result, the Tensorboard controller now copies the value of the
status.readyReplicas field of the Tensorboard deployment to the
status.readyReplicas of the Tensorboard CR.

Also, a Deployment() function was added for applying and updating
Tensorboard server deployments.

* Update tensorboard.status.phase of TWA backend response

The frontend of the TWA will need information about the status
of the Tensorboard server, so that it can inform the user about
the server being ready being ready to connect or not.

As a result, the backend sets the status.phase field of the response
to "ready", if tensorboard.status.readyReplicas == 1. Otherwise, the
status.phase field of the response is set to "unavailable".

Also, the getPVCName() function was added, which extracts the name
of a given PVC object.

* Add GET route for PVCs

The Tensorboard web-app frontend will be using an autocomplete
drop-bar to show user the PVCs that live in a specific namespace.
These PVCs could be used as log storages for the Tensorboard server.

So, a PVC GET route was added to the Tensorboard web-app backend.

* Add message to Tensorboard response object in TWA backend

The frontend of the TWA will need to output a response message for
every Tensorboard object. This response message will inform the
user about the current state of the Tensorboard server.

* Use status.STATUS_PHASE for backend response

* Add requirements.txt to TWA backend

* Use status.create_status() for backend response
2020-08-30 05:08:20 -07:00
Kimonas Sotirchos b19054e75b Create an Angular Library with common frontend code (kubeflow/kubeflow#5252)
Create an Angular Library with common frontend code. Our crud web apps
should use this library to share common functionality like:

* Talking to Central Dashboard for the Namespace selection
* Making http calls
* Surfacing and showing error messages and warnings
* Form utilities
* Showing a table with entries and actions

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2020-08-28 05:14:53 -07:00
Konstantinos Andriopoulos 1936429ea5 Tensorboard controller: Add scheduling functionality for Tensorboard servers that use RWO PVCs as log storages (kubeflow/kubeflow#5218)
* Add indexers as custom field selectors for list requests to cache

The tensorboard controller must be able to list pods that have
mounted a PVC with a specific ClaimName.

In order for this list request to cache to work properly, custom
field selectors are added. These selectors are used to index the
"pod.spec.volumes.persistentvolumeclaim.claimname" field so that
unneeded pods can be filtered out.

* Set pod's nodeAffinity if log files exist in a PVC

In the case of using a PVC as a logdir for Tensorboard Server, if
the PVC had a ReadWriteOnce access mode and was alread mounted by
another running pod X, then the Tensorboard Server pod would not
always be scheduled on the same node as X. As a result, the
Tensorboard Server pod would be blocked since multi-node access
is prohibited on ReadWriteOnce volumes.

In order for the Tensorboard Server pod to run successfully,
nodeAffinity was added to the spec.template.spec.affinity field
of the returned deployment.

As a result, both X and the Tensorboard
Server pod are now scheduled on the same node.

Resolves kubernetes/kubernetes#26567

* Set Tensorboard Server scheduling feature to 'off' by default

In the case that the Tensorboard Server used a RWO PVC (as a log
storage) that was already mounted by another pod, nodeAffinity
was used so that the Tensorboard Server would be scheduled
(if possible) on the same node as that pod.

Now, this added functionality is used only if the
'RWO_PVC_SCHEDULING' environmental variable is set to "true"
when running the Tensorboard controller.

This scheduling functionality is disabled by default.
2020-08-26 02:58:03 -07:00
Kimonas Sotirchos 1a0a3986d2 Add owners for the Notebooks Controller (kubeflow/kubeflow#5240)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2020-08-25 06:34:16 -07:00
Konstantinos Andriopoulos f55c0d77dc tensorboard web-app: Create Tensorboard web-app backend (kubeflow/kubeflow#5180)
* Create Tensorboard web-app backend

Create the code for the Tensorboard web-app backend which
includes routes for GET, POST and DELETE requests.

The backend is created with Python/Flask, so it also uses
the common code from 'kubeflow.kubeflow.crud_backend'.

* Add 'get_age(k8s_object)' function to 'crud_backend' common code

It would be useful for all web apps of the 'crud-web-apps' folder
to return age information to their frontends.

As a result, 'get_age(k8s_object)' was added to the common code,
so that all web apps can use it.
2020-08-20 03:25:22 -07:00
Kimonas Sotirchos 1db8a22ca9 Common code between the different python backends (kubeflow/kubeflow#5164)
Create a python module under the kubeflow.kubeflow package that will
be exposing common code and a base app the takes care of:

* Exceptions handling
* Common routes for serving static files and their cache control policy
* Authorization checks with SubjectAccessReview
* Authentication checks on the Kubeflow headers
* Common helper functions for dates, yaml parsing etc
* health/liveness probes

Backends that are written with Python/Flask should use this common code
in order for us to reduce code duplication and have our backends align
with our accepted practices.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2020-08-07 07:30:18 -07:00
Kimonas Sotirchos db97455152 Add OWNERs file to tensorboard controller (kubeflow/kubeflow#5088)
The tensorboard controller should have a distinct list of reviewers and
approvers.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2020-08-07 06:32:19 -07:00
Kimonas Sotirchos 40838253e4 Create a new directory in components for web apps (kubeflow/kubeflow#5184)
* Create a new directory in components for web apps

Since we want to also have some common code between our web apps we
should create a parent dir for any future web app we want to develop.
The code for the web apps, common or not, should be organized under this
directory.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* remove the reviewers

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2020-08-05 06:36:29 -07:00
Nihir Patel b13382b558 notebook_controller.go: make clusterDomain an option (kubeflow/kubeflow#4468) 2020-07-03 19:42:48 -07:00
Humair 8470751a58 Fix notebook controller rbac gen (kubeflow/kubeflow#5083) 2020-06-22 07:18:39 -07:00
Konstantinos Andriopoulos 9ae8d1ff40 tensorboard-controller: Mount GCP secret only when accessing Google storage (kubeflow/kubeflow#5069)
* Remove duplicate package import

Package "k8s.io/api/core/v1" was imported twice with names "v1"
and "corev1".

* Mount GCP secret only when accessing Google storage

The Tensorboard controller used to create pods (running the Tensorboard
server) that would always mount user-gcp-sa secret, regardless of the
logs storage being a Google cloud bucket or not. This would lead to pods
never starting properly in the case of using other cloud services (or
PVCs) as log storages, if the user-gcp-sa secret didn't exist on the
cluster.

In order for the Tensorboard server pods to run properly, user-gcp-sa
secret is now mounted only when Google cloud buckets are used as log
storages.

Fixes kubeflow/kubeflow#5065
2020-06-18 06:46:20 -07:00
Ali Soume'e 6942bf5f87 Remove duplicate import (kubeflow/kubeflow#5058)
"k8s.io/api/core/v1" was imported with names "corev1" and "v1"
2020-06-08 20:47:19 -07:00
Chad Roberts 25bf002c34 Adding env var to suppress automatic additon of fsGroup in notebook pod (kubeflow/kubeflow#4713) (kubeflow/kubeflow#4782)
* Allowing for an env var ADD_FSGROUP to be set to false to suppress the automatic addition of fsGroup: 100 in the pod's security context.
This addresses issue #4617.

* Adding note in README regarding ADD_FSGROUP.
2020-02-19 09:08:25 -08:00
Yannis Zarkadas e02a82fbcc notebook-controller: Fix event filtering (kubeflow/kubeflow#4777)
This commit fixes the event filtering check, so it doesn't crash when
the Pod name doesn't contain a dash ("-").

Signed-off-by: Yannis Zarkadas <yanniszark@arrikto.com>
2020-02-19 08:44:25 -08:00
Zhenghui Wang e8bf7974d4 add loadtest for notebook controller (kubeflow/kubeflow#4779) 2020-02-18 21:00:25 -08:00
Jeremy Lewi 0895c4d135 Fix docker builds of notebook and tensorboard controller (kubeflow/kubeflow#4664)
* Fix docker builds of notebook and tensorboard controller

* The notebook-controllers and tensorboard-controllers now depend on
  the go package components/common

* We need to rewrite the Dockerfiles so that the context is now

  ${KUBEfLOW_REPO}/common

  * so that components/common can be included in the context and copied
    to the Dockerfile

* Create skaffold configs to make it easier to do remote builds with Kaniko

  * The skaffold configs are currently written assuming the kubeflow-ci cluster
    is used to build the images. This could be generalized in the future.

* Remove the code to build the notebook-controller with GCB; we can just
  use skaffold and kaniko to do efficient remote builds.

* Related to #4582 - Jupyter image doesn't build.

* Fix docker build rule.
2020-01-21 17:54:34 -08:00
Zhenghui Wang 89acff862c Add Notebook Controller v1 spec (kubeflow/kubeflow#4649)
* add v1 spec

* change kubeflow.org_nootebooks.yaml
2020-01-13 19:43:08 -08:00
Zhenghui Wang e5410cd7c8 add source code of MPL licensed library. (kubeflow/kubeflow#4643) 2020-01-10 15:57:37 -08:00
Zhenghui Wang 4d2dc369cf Update notebook ctrler dockerfile (kubeflow/kubeflow#4641) 2020-01-09 13:56:34 -08:00
Jeremy Lewi d25a14aea2 Fix notebook controller and tensorboard controller docker image build. (kubeflow/kubeflow#4631)
* The jupyter docker image isn't building because it now depends on code
  in components/common

* To make this work we need to configure it as a multi module package
  and modify go.mod to redirect to a local path.

* Ref: https://github.com/golang/go/wiki/Modules#when-should-i-use-the-replace-directive

* Replaces PR #4583

Related to #4582 - Jupyter image doesn't build.
2020-01-07 16:25:41 -08:00
Zhenghui Wang 71918b8b64 Add licensing info for Notebook Controller (kubeflow/kubeflow#4623)
* add files for third party licensing for notebook ctlr

* lint
2020-01-06 23:20:17 -08:00
Jeremy Lewi a28e6692d6 Move the CD scripts and Tekton pipelines into kubeflow/testing (kubeflow/kubeflow#4593)
* Delete all the Tekton pipelines and scripts for continuous delivery
  of Kubeflow applications because they are moving into kubeflow/testing

* kubeflow/testing#551 is the PR moving the code into kubeflow/testing

Related to: kubeflow/testing#544 redo how we use kustomize and Tekton
            to parameterize the pipelines
2019-12-30 07:09:39 -08:00
Fernando Diaz 1ff2f7a880 Reissue pod and sts events as notebook events (kubeflow/kubeflow#4139) 2019-11-21 12:07:29 -08:00
MrXinWang d4fb94b020 Add arm64 support for controllers (kubeflow/kubeflow#4438)
Change-Id: I9f4b4871a5d02a53230abb836787f665dd8e3998
Signed-off-by: Henry Wang <henry.wang@arm.com>
Jira: ENTOS-1322
2019-10-31 19:53:23 -07:00
Quanjie Lin 1236c5e6d7 initial checkin of tensorboard controller (kubeflow/kubeflow#4312)
* initial checkin of tensorboard controller

* initial checkin of tensorboard controller

* typo

* typo

* fix typo

* support local path

* add status

* conflict

* remove binary
2019-10-29 09:12:44 -07:00
Lun-Kai Hsu 2fe3108347 fix notebook route (kubeflow/kubeflow#4402) 2019-10-24 16:01:39 -07:00
Ben Ye 2e7dc7ec06 add culling metrics (kubeflow/kubeflow#4336)
Signed-off-by: yeya24 <yb532204897@gmail.com>
2019-10-17 21:37:57 -07:00
Ben Ye d14f6ac07f support metrics in notebook-controller (kubeflow/kubeflow#4123)
Signed-off-by: yeya24 <yb532204897@gmail.com>
2019-10-16 00:15:40 -07:00
Kam Kasravi c1eca0937c Ci for components (kubeflow/kubeflow#4238)
* snapshot

* fixes to service-account and task

* adding admission-webhook, notebook-controller

* update to README.md

* update README.md
2019-10-15 08:31:53 -07:00
Jeremie Vallee c88e721fc7 [3945] Configurable Istio Gateway for Notebook Controller (kubeflow/kubeflow#4216) 2019-10-14 12:06:59 -07:00
Ben Ye 807843ec2a cleanup some codes in notebook controller (kubeflow/kubeflow#4098)
* cleanup some codes in notebook controller

Signed-off-by: yeya24 <yb532204897@gmail.com>

* remove ambassador in notebook controller

Signed-off-by: yeya24 <yb532204897@gmail.com>
2019-10-14 12:06:52 -07:00
Jerome Brette b5ff201a8c Migrate kustomize.go to Kustomize3 (kubeflow/kubeflow#4055)
* Migrate to kustomize3: Phase 1. Update kustomization.yaml

* Migrate to kustomize3: Phase 2: Update kustomize.go

- Update kustomize.go to match new package structure.
- Update module dependencies.

* Migrate to kustomize3: Phase 3: Implements code review

- As per request, revert kustomization.yaml back to deprecated syntax.
- As per request, revert kustomize.go to use deprecated .Bases field.
- Note: patchesStrategicMerge: will be turned into a deprecated field pretty soon.
- Rerun go mod tidy

* Migrate to kustomize3: Phase 4: Activate legacy order transformer
2019-09-20 21:21:25 -07:00
Lun-Kai Hsu 2f2938bead Notebook v1beta1 (kubeflow/kubeflow#4105)
* add v1beta1

* add storage version

* wip

* add conversion

* setup webhook

* fix

* fix manifest

* webhook wip

* no webhook
2019-09-13 07:04:29 -07:00
Lun-Kai Hsu 8cad496a13 Migrate notebook CR to kubebuilder V2 (kubeflow/kubeflow#4013)
* wip

* can build

* tested: able to control notebook

* fix
2019-09-04 17:06:22 -07:00
Kimonas Sotirchos 08f43598c2 Culling of Idle Jupyter Notebooks (kubeflow/kubeflow#3856)
* Create a culler as a package

Helper functions for culling resources. Takes for granted that ISTIO is
installed to the system and queries Prometheus to get metrics.
Specifically, requests/{configurable time}.

If the resource should be culled, then it should be done by setting an
annotation. This way the UIs can also show that the Resource is stopping
and also easily stop a resource by making a PATCH request.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Culling logic enhancements

Add necessary ENV Vars. Culling won't happen by default. To enable it
the user will need to set the ENABLE_CULLING=true

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Misc fixes in logging and comment cleanup

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Fix typo

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Add Notebooks specific culling

Query the /api/status endpoint of each Server

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Remove the generic culling logic

We need to discuss if it would make sense to have this logic as a go
library, or use knative.

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Add unit tests

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Remove unused code

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Review changes #1

* rename `getEnvDef` to `getEnvDefault`
* Add a comment to describe how the STOP_ANNOTATION gets used

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>

* Make cluster domain configurable

Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2019-08-26 04:40:21 -07:00
Kam Kasravi 0b5e3bd995 add kkasravi to OWNERS (kubeflow/kubeflow#3311) 2019-06-18 16:58:32 -07:00
Gabriel Wen 70bd7acdf5 Merge branch 'master' into fix-notebook-controller 2019-06-03 14:33:05 -07:00
zabbasi daa4768f96 Add details to "conditions" in notebook status (kubeflow/kubeflow#3319)
* added detailes into NotebookCondition to keep track of notebook  container status change

* update notebook controller image

* fix conitions update

* small fix

* temporary changes to debug

* temporary remove delete step from workflow for debugging

* temoraray merging kfctl-test and kfctl-go-test fir debugging

* debugging

* undo the mistake

* debugging

* debugging tests

* merged kfctl-test and kfctl-go-test

* remove wait-for-kubeflow

* merged with master

* remove test delete step for debugging

* small fix

* update jupyter test component

* update condition test for jupyter component

* revert back deleting step

* revert back change in kfctl.sh

* added some temporary change to debug jupyter-test

* revert back temp changes
2019-06-03 14:19:30 -07:00
Gabriel Wen c22959f0ac check env when setting watch 2019-06-03 13:54:10 -07:00
Gabriel Wen 525eee5ed8 update notebook_controller to use env 2019-06-03 13:15:56 -07:00
Kunming Qu 42bbb0cdbf profile and Istio integration (kubeflow/kubeflow#3234)
* profile and Istio integration

* make profile manage Istio gateway

* add README.md

* make notebooks use gateway in kubeflow namespace

* gateway format to ns/name; add watch for istio ServiceRoleBinding

* Support setting auth header format via parameter

* update README

* update README

* update readme; resolve comments
2019-05-29 18:36:19 -07:00
zabbasi a7e7d75be9 Renamed PodPreset CRD to PodDefault (kubeflow/kubeflow#3320)
* renamed PodPreset CRD to PodDefault

* typos

* update jupyter-web-app image
2019-05-21 11:22:10 -07:00
zabbasi 5ae44fbdb4 Integrates notebook-controller and jupyter-web-app with admission-webhook (kubeflow/kubeflow#3245)
* integrate jupyter-web-app and notebook-controller with webhook

* merged podpreset component into admission-webhook

* applied cr comments

* undo notebook image for tesing

* update notebook controller image

* temporaray disbaling kubeflow delete to debug presubmit failure

* temporary remove cluster delete in kfctl workflow test

* typo

* typo

* undo debugging changes
2019-05-20 12:39:13 -07:00
Kunming Qu a80025787b enable Istio Injection in user-created namespace; notebook and Istio integration (kubeflow/kubeflow#3235)
* enable Istio Injection in user-created namespace; notebook service and Istio rbac integration

* update README
2019-05-09 16:59:58 -07:00
Hung-Ting Wen 58c977c8e9 ISTIO support for notebook controller (kubeflow/kubeflow#3104)
* virtual service func init

* create virtualservice

* fix

* fix

* add cluster role

* fix unstructured format

* updates

* fix

* reconcile virtual service

* fix

* revert quote changes

* add virtualservice update

* comment

* copy if spec is not found in toSpec

* add watch event
2019-04-29 11:43:19 -07:00
Lun-Kai Hsu 9f70ca7f10 add labels for notebook so that gcp credentials will be injected by webhook (kubeflow/kubeflow#2853)
* add labels for gcp cred

* kfctl set flag

* review comment

* review comment
2019-03-30 20:36:33 -07:00
Lun-Kai Hsu dc69b63667 notebook CR shows container status (kubeflow/kubeflow#2787)
* wip

* fix

* fix format
2019-03-26 17:08:47 -07:00
zabbasi 2500faee10 added ReadyReplicas status to notebook-controller (kubeflow/kubeflow#2743)
* added ReadyReplicas status to notebook-controller

* fixed issues related to updating the notebook status

* fixed a problem in updating Notebook's status

* applied cr comments

* small change

* small formating change
2019-03-21 21:46:18 -07:00
Lun-Kai Hsu d47a5864ec pf gcb (kubeflow/kubeflow#2603) 2019-03-04 17:08:23 -08:00
Lun-Kai Hsu bfa59d7769 fix (kubeflow/kubeflow#2620) 2019-03-04 16:48:17 -08:00
Lun-Kai Hsu 931e8e32aa Add status to notebook (kubeflow/kubeflow#2558)
* wip

* wip

* update test to check status condition

* fix
2019-03-04 14:36:17 -08:00
Lun-Kai Hsu a9b8f4e8a0 fix (kubeflow/kubeflow#2506) 2019-02-26 11:21:53 -08:00
Abolfazl Shahbazi 4c48320235 Update python code styles based on what's provided in .style.yapf (kubeflow/kubeflow#2447)
* Fix Python code styles based on Pep8 and flake8

* More syle fixes to Python code

* Update python code styles based on what's provided in .style.yapf

* Sync with master and update styles

* Sync with master

* More Python style fixes

* Changes per code review

* Sync with master and update the remaining files

* Add a .flake8 config file for future reference
2019-02-19 22:44:30 -08:00
Lun-Kai Hsu ffc9a1d674 Add build with GCB support to notebook controller (kubeflow/kubeflow#2486)
* fix

* fix

* ignore
2019-02-15 11:52:54 -08:00
Lun-Kai Hsu e377455ce4 Notebook controller fixes (kubeflow/kubeflow#2463)
* fix

* enable e2e test

* fix

* fix

* fix logging for pytest

* fix

* fix

* fix

* fix

* fix

* fix

* address review

* review comment
2019-02-15 00:09:02 -08:00
Lun-Kai Hsu b7555c6727 NB controller fix (kubeflow/kubeflow#2439)
* fix

* fix
2019-02-10 17:37:51 -08:00
Abolfazl Shahbazi ae07f8d4d8 port leftover diff from kfapp-ksapp branch after kfctl merge (kubeflow/kubeflow#2410)
* port leftover diff from kfapp-ksapp branch after kfctl merge

* minor gofmt fix
2019-02-10 10:50:08 -08:00
Lun-Kai Hsu fa3b0b3b0b Golang notebook controller (kubeflow/kubeflow#2336)
* kubebuilder init

* replae dep with modules

* add notebook api

* notebook controller impl

* remove test

* fix dockerfile

* fix svc reconcile

* notebook controller ksonnet

* update generated crd

* add sample

* remove TODO

* make golang version an arg

* rename

* fix path

* add README

* Add todo in readme

* remove arg default
2019-02-05 16:43:39 -08:00