Commit Graph

37 Commits

Author SHA1 Message Date
dependabot[bot] 67bbd6facd build(deps): bump tensorflow-gpu from 2.5.0 to 2.9.3 in /components/example-notebook-servers/jupyter-tensorflow (kubeflow/kubeflow#6764)
Bumps [tensorflow-gpu](https://github.com/tensorflow/tensorflow) from 2.5.0 to 2.9.3.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.5.0...v2.9.3)

---
updated-dependencies:
- dependency-name: tensorflow-gpu
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-11-28 11:14:13 +00:00
apoger 939e1e22ca Introduce a mechanism to build all Kubeflow images (kubeflow/kubeflow#6555)
* build: Update components makefiles for building

We'll create a top-level Makefile under components/ dir
that has the following rules:

* build-all:
  To build all images locally

* push-all:
  * We can use a specific REGISTRY and retag the images
  * Push all the images

This top-level Makefile will run the sub-Makefiles that every
component has for building and pushing the images.

We modified every sub-Makefile as follows:
* We don't use a registry in images by default
* Removed unused rules and vars
* Use the --dirty flag of git describe in TAG

        --dirty[=<mark>]
               Describe the working tree. It means describe HEAD and
               appends <mark> (-dirty by default) if the working tree
               is dirty.

Signed-off-by: Apotolos Gerakaris <apoger@arrikto.com>

* build: Create makefiles for notebook servers

The common starting point of building the notebook-server
images are the following 4 *base* images:
- base
- codeserver
- jupyter
- rstudio

All other server images need to build on top of them. We'll
dynamically pass the base images in every Dockerfile by
using an ARG IMG. We can set the value of this ARG during
docker build with the --build-arg CLI argument.

This way we build both the base images with a tag locally,
and then we pass that image as arg via the Makefile and build the rest

So we modified our building procedure as follows:
1. Build the base image since everything starts from there

2. Pass the base image as an ARG in the Dockerfiles of
jupyter, codeserver, rstudio images and build on top

3. Pass the base images in all other server images and build
on top

For that we will:

1. Create a Makefile for each of the notebook servers, in each folder
   a. Each makefile will be responsible for building the bases and use args for passing them on

2. Use the central Makefile to call each Makefile from above

Signed-off-by: Apotolos Gerakaris <apoger@arrikto.com>

* cherry-pick: Notebook server upstream fixes

Relevant upstream PR: https://github.com/kubeflow/kubeflow/pull/6466/files

Signed-off-by: Apotolos Gerakaris <apoger@arrikto.com>

* build: Fix Makefiles

- Remove build-gcp and build-gcr rules as we don't use them anywhere in
the project
- Fix code conficts

Signed-off-by: Apotolos Gerakaris <apoger@arrikto.com>

* build: Fix Dockerfiles for notbook-server images

We remove the previous logic of using already built images as bases.
The users must use only the Makefiles to pass the appropriate BASE_IMG
and build the images correctly.

Thus, we have Makefiles everywhere that:

- Can build any base image
- If an image requires another notebook base, then we first build that one using its makefile,
  and then use it as docker ARG for building the next one

Signed-off-by: Apotolos Gerakaris <apoger@arrikto.com>

* build: Fix notebook-controller Makefile

Removed a misplaced "|" char that breaks the Makefile

Signed-off-by: Apotolos Gerakaris <apoger@arrikto.com>

* build: Update GH action workflows

* Update workflow for notebook-server images:
  - Add a step for building all images by using the
  central-Makefile under components/example-notebook-servers/ dir.
  - Add a step for pushing all images by using the
  central-Makefile under components/example-notebook-servers/ dir.

* Update workflow for all Kubeflow images:
  - Add a step for building & pushing all images by using the
  top-level Makefile under components/ dir.

Signed-off-by: Apotolos Gerakaris <apoger@arrikto.com>

* build: Remove completely ECR references from images

Replace everywhere the "public.ecr.aws/j1r0q0g6/notebooks/notebook-servers"
prefix with "kubeflownotebookswg"

Signed-off-by: Apotolos Gerakaris <apoger@arrikto.com>

* build: Fix GH actions for Kubeflow components

Fix GH actions to use the updated make rules
when building the Kubeflow component images.

Remove the "docker.io" prefix when building with
GH action workflows

Signed-off-by: Apotolos Gerakaris <apoger@arrikto.com>
2022-07-01 17:54:06 +00:00
Anna 1e854f4e91 Update install command for code server extension (kubeflow/kubeflow#6554)
Signed-off-by: Anna Jung (VMware) <antheaj@vmware.com>
2022-06-30 19:17:15 +00:00
Mathew Wicks 955e379ada update jupyterlab to 3.4.3 (kubeflow/kubeflow#6527) 2022-06-20 09:04:37 +00:00
dependabot[bot] 6a243dc32a build(deps): bump tensorflow from 2.5.0 to 2.5.3 in /components/example-notebook-servers/jupyter-tensorflow (kubeflow/kubeflow#6445)
Bumps [tensorflow](https://github.com/tensorflow/tensorflow) from 2.5.0 to 2.5.3.
- [Release notes](https://github.com/tensorflow/tensorflow/releases)
- [Changelog](https://github.com/tensorflow/tensorflow/blob/master/RELEASE.md)
- [Commits](https://github.com/tensorflow/tensorflow/compare/v2.5.0...v2.5.3)

---
updated-dependencies:
- dependency-name: tensorflow
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-15 07:38:39 +00:00
dependabot[bot] 3fb615d92c build(deps): bump notebook from 6.4.0 to 6.4.10 in /components/example-notebook-servers/jupyter (kubeflow/kubeflow#6431)
Bumps [notebook](http://jupyter.org) from 6.4.0 to 6.4.10.

---
updated-dependencies:
- dependency-name: notebook
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2022-04-14 07:15:52 +00:00
Kimonas Sotirchos 4b4001e108 Update Notebooks README regarding custom packages (kubeflow/kubeflow#6176)
Signed-off-by: Kimonas Sotirchos <kimwnasptd@arrikto.com>
2021-10-11 20:34:43 -07:00
Mathew Wicks dcec619962 Improve README for example-notebook-servers (kubeflow/kubeflow#6165) 2021-10-05 02:35:17 -07:00
David van der Spek 61cbfabb73 Fix notebook base image gpg keys (kubeflow/kubeflow#6138) 2021-09-13 11:49:31 -07:00
DavidSpek ef5d576cd2 notebooks: Add additional PGP server for RStudio package validation (kubeflow/kubeflow#6010)
* Change PGP server for RStudio validation to pgp.surfnet.nl

* Add as secondary keyserver
2021-06-23 04:15:32 -07:00
DavidSpek c0de144a68 Update last batch of notebook server Dockerfiles (kubeflow/kubeflow#5997) 2021-06-21 05:12:16 -07:00
DavidSpek 4ebde0067b Update dockerfiles and make compatible with Renovate (kubeflow/kubeflow#5968)
* Update dockerfiles and make compatible with Renovate

* Set memory for jupyter pytorch to the same as jupyter tensorflow

* Update protobuf

* Remove conda version and use substring expansion

* Update SQLAlchemy

* Update dill
2021-06-17 06:40:28 -07:00
DavidSpek 8a3ecf2997 Notebook servers: Add explanation about kernel not connecting (kubeflow/kubeflow#5920) 2021-06-03 09:24:37 -07:00
DavidSpek e7c924013e Update jupyter, rstudio and vs code notebook images + allow rstudio in iframe (kubeflow/kubeflow#5961)
* Update jupyter, rstudio and vs code notebook images

* Remove sed and use substring removal
2021-06-03 08:13:37 -07:00
DavidSpek c1a4f6659f Update base notebook for Renovate compatibility (kubeflow/kubeflow#5955)
* Update base notebook for Renovate compatibility

* Separate kubectl and S6 arch
2021-06-03 06:38:36 -07:00
James Liu 51d0acb344 chore: Add comment to reference RStudio license. (kubeflow/kubeflow#5884) 2021-05-06 04:39:05 -07:00
DavidSpek 0563160233 notebook-servers: Update JupyterLab and add Git Extension (kubeflow/kubeflow#5846) 2021-04-27 10:15:14 -07:00
Mathew Wicks 500f5c61ef initial notebook server images README.md (kubeflow/kubeflow#5818) 2021-04-08 10:19:03 -07:00
DavidSpek a0069797df Update image tags and python packages in pytorch and tensorflow full dockerfiles (kubeflow/kubeflow#5817) 2021-04-08 03:50:02 -07:00
DavidSpek e78477ec5d Update second layer docker images to new tags and some python deps (kubeflow/kubeflow#5809) 2021-04-08 02:11:02 -07:00
DavidSpek 686667f5bd Update notebook server base images (kubeflow/kubeflow#5804) 2021-04-06 04:22:00 -07:00
DavidSpek 713f0bc2d3 Add notebook-server-rstudio-tidyverse dockerfile and CI/CD (kubeflow/kubeflow#5711)
* Add notebook-server-rstudio-tidyverse dockerfile and CI/CD

* cleanup rstudio tidyverse notebook image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-23 10:28:44 -07:00
Mathew Wicks 447c63bb03 set TZ in rstudio notebook image (kubeflow/kubeflow#5756) 2021-03-23 09:53:44 -07:00
DavidSpek 1d9c808db7 Add notebook-server-rstudio dockerfile and CI/CD (kubeflow/kubeflow#5624)
* Add R-Studio image

* cleanup rstudio notebook server image
2021-03-23 07:37:44 -07:00
DavidSpek 8bff0c78b5 Fix conda activation for JupyterLab in full images + cleanup (kubeflow/kubeflow#5748) 2021-03-22 10:09:17 -07:00
DavidSpek 93b9c01880 Fix conda activation for JupyterLab + cleanup (kubeflow/kubeflow#5743) 2021-03-22 08:45:17 -07:00
DavidSpek 9cb33192f1 Update notebook dependency + cleanup (kubeflow/kubeflow#5744) 2021-03-22 08:10:17 -07:00
DavidSpek c934536e2c Fix conda activation in notebook-server-base for JupyterLab (kubeflow/kubeflow#5742) 2021-03-22 07:48:18 -07:00
DavidSpek 7bde2e7e71 Add notebook-server-codeserver-python dockerfile and CI/CD (kubeflow/kubeflow#5700)
* Add notebook-server-codeserver-python dockerfile and CI/CD

* cleanup codeserver python image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-22 03:58:17 -07:00
DavidSpek ca6323c7d5 Add notebook-server-jupyter-scipy dockerfile and CI/CD (kubeflow/kubeflow#5699)
* Add notebook-server-jupyter-scipy dockerfile and CI/CD

* cleanup jupyter scipy image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-22 00:32:17 -07:00
DavidSpek f0aaa691d3 Add notebook-server-jupyter-tensorflow-full dockerfiles and CI/CD (kubeflow/kubeflow#5632) 2021-03-22 00:16:17 -07:00
DavidSpek 98d9c5b152 Add notebook-server-codeserver dockerfile and CI/CD (kubeflow/kubeflow#5625)
* Add Code-Server (VS-Code) image

* cleanup codeserver notebook image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 12:20:17 -07:00
DavidSpek 85859c8998 Add notebook-server-tensorflow dockerfiles and CI/CD (kubeflow/kubeflow#5627)
* Add TensorFlow CPU base image

* cleanup jupyter tensorflow notebook images

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 11:48:17 -07:00
DavidSpek 321d60d916 Add notebook-server-jupyter-pytorch-full dockerfiles and CI/CD (kubeflow/kubeflow#5631) 2021-03-21 10:48:17 -07:00
DavidSpek 8908bde330 Add notebook-server-jupyter-pytorch dockerfiles and CI/CD (kubeflow/kubeflow#5626)
* Add pytorch base images

* cleanup jupyter pytorch notebook image

* rename jupyter pytorch dockerfiles

* fix typo

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 09:07:17 -07:00
DavidSpek 3a7bd2d716 Add notebook-server-jupyter dockerfile and CI/CD (kubeflow/kubeflow#5623)
* Add base dockerfile for all jupyter based images

* cleanup jupyter notebook image

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 08:11:17 -07:00
DavidSpek fe7e662392 Add notebook-server-base dockerfile and CI/CD (kubeflow/kubeflow#5622)
* Add base dockerfile for all Web-IDE images (jupyter, r-studio, vs-code)

remove sudo from image

Add S6-overlay

Change naming and add CD

Add ci build test

change naming in prow config to avoid character limit

Add OWNERS file

rename folder

rename folder (again)

remove labels

Rename to the final folder

* cleanup base notebook image Dockerfile

Co-authored-by: Mathew Wicks <thesuperzapper@users.noreply.github.com>
2021-03-21 04:50:17 -07:00