79f837c3c1
* feat(catalog): deploy postgres for model catalog (#1584) * feat(catalog): initialize postgres for model catalog Initialize PostgreSQL database for model catalog with connection setup. Refactored embedmd initialization code from model registry for reuse. Added Kubernetes manifests for PostgreSQL StatefulSet, PVC, and service configuration. Signed-off-by: Paul Boyd <paul@pboyd.io> * fix(catalog): remove chdir before loading catalogs Instead of changing directories, pass the directory that files should be relative to when loading a catalog. Signed-off-by: Paul Boyd <paul@pboyd.io> --------- Signed-off-by: Paul Boyd <paul@pboyd.io> * feat(catalog): add postgres for catalog dev (#1623) Adding to tilt and docker compose. Signed-off-by: Paul Boyd <paul@pboyd.io> * feat(datastore): refactor type creation (#1636) - Refactor embedmd to created types from a spec, instead of database migrations. - Add TypeRepository and TypePropertyRepository services Signed-off-by: Paul Boyd <paul@pboyd.io> * Add artifact types to the model catalog (#1649) * chore: update testutils to take a datastore spec argument Signed-off-by: Paul Boyd <paul@pboyd.io> * feat(catalog): add artifact types to openapi spec And re-generate code. Signed-off-by: Paul Boyd <paul@pboyd.io> * feat(catalog): add database models and services Signed-off-by: Paul Boyd <paul@pboyd.io> --------- Signed-off-by: Paul Boyd <paul@pboyd.io> * Update api/openapi/src/catalog.yaml Co-authored-by: Dhiraj Bokde <dhirajsb@users.noreply.github.com> Signed-off-by: Paul Boyd <paul@pboyd.io> * fix(catalog): set source_id type correctly Signed-off-by: Paul Boyd <paul@pboyd.io> * fix(catalog): fix k8s resource names Signed-off-by: Paul Boyd <paul@pboyd.io> --------- Signed-off-by: Paul Boyd <paul@pboyd.io> Co-authored-by: Dhiraj Bokde <dhirajsb@users.noreply.github.com> |
||
|---|---|---|
| .. | ||
| configs | ||
| .dockerignore | ||
| .gitignore | ||
| Makefile | ||
| README.md | ||
| Tiltfile | ||
| tilt_config.json | ||
README.md
Kubeflow Notebooks -- Dev Environment
Requirements
- Go >= 1.24
- Helm >= 3.16.1
- Python >= 3.8
- Node >= 20
Tilt
This project uses Tilt to manage the development environment. Tilt will watch for changes in the project and automatically rebuild the Docker image and redeploy the application in the current Kubernetes context.
See this example using a kind cluster:
kind create cluster
then:
make tilt-up
Hit space to open the Tilt dashboard in your browser and here you can see the logs and status of every resource deployed.
Notebooks
The development environment creates automatically a user for JupyterHub. The user is created with the following credentials:
- Username:
mr - Password:
1234
You can reach the jupter notebook at http://localhost:8086/user/mr/lab.
Tilt will watch for file changes in the clients/python folder and build/upload the wheel output to the notebook pod, you can find the wheel under the ~/wheels folder.
Troubleshooting
"Build Failed: failed to dial gRPC: unable to upgrade to h2c, received 404"
If you see the following error message when tilt builds the image, try setting DOCKER_BUILDKIT=0:
DOCKER_BUILDKIT=0 make tilt-up