pipelines/backend
James Liu e035a88149
feat: upgrade MLMD to 1.2.0. Fix #6436 (#6437)
* chore(frontend): upgrade MLMD to 1.2.0

* update version for backend

* update dependencies

* makefile

* tfx compatiblity update
2021-08-28 16:59:22 -07:00
..
api chore(release): bumped version to 1.7.0 2021-08-25 06:44:50 +00:00
metadata_writer feat: upgrade MLMD to 1.2.0. Fix #6436 (#6437) 2021-08-28 16:59:22 -07:00
src feat: upgrade MLMD to 1.2.0. Fix #6436 (#6437) 2021-08-28 16:59:22 -07:00
test
third_party_licenses feat: upgrade argo to v3.1.6 (#6333) 2021-08-13 02:32:54 -07:00
Dockerfile feat: upgrade argo to v3.1.6-patch (#6376) 2021-08-18 03:17:38 -07:00
Dockerfile.cacheserver chore: check and comply with go mod licenses when building images. Fixes #4715 (#5908) 2021-06-25 05:48:53 -07:00
Dockerfile.persistenceagent chore: check and comply with go mod licenses when building images. Fixes #4715 (#5908) 2021-06-25 05:48:53 -07:00
Dockerfile.scheduledworkflow chore: check and comply with go mod licenses when building images. Fixes #4715 (#5908) 2021-06-25 05:48:53 -07:00
Dockerfile.viewercontroller chore: check and comply with go mod licenses when building images. Fixes #4715 (#5908) 2021-06-25 05:48:53 -07:00
Dockerfile.visualization feat: upgrade TFX to 1.2.0 (#6375) 2021-08-18 01:50:37 -07:00
Makefile fix(frontend): TFX artifact visualization update. Fix tensorflow/tfx#3933 (#5999) 2021-07-13 12:47:58 -07:00
OWNERS chore: add capri-xiyue to backend OWNERS (#5874) 2021-06-20 21:10:16 -07:00
README.md feat: upgrade TFX to 1.2.0 (#6375) 2021-08-18 01:50:37 -07:00
requirements.in feat: upgrade MLMD to 1.2.0. Fix #6436 (#6437) 2021-08-28 16:59:22 -07:00
requirements.txt feat: upgrade MLMD to 1.2.0. Fix #6436 (#6437) 2021-08-28 16:59:22 -07:00
update_requirements.sh feat: upgrade TFX to 1.2.0 (#6375) 2021-08-18 01:50:37 -07:00

README.md

This directory contains code for the components that comprise the Kubeflow Pipelines backend.

Building & Testing

To run all unittests for backend:

go test -v -cover ./backend/...

The API server itself can be built using:

go build -o /tmp/apiserver backend/src/apiserver/*.go

Building APIServer image locally

The API server image can be built from the root folder of the repo using:

export API_SERVER_IMAGE=api_server
docker build -f backend/Dockerfile . --tag $API_SERVER_IMAGE

Deploy APIServer with the image you own build

Run

kubectl edit deployment.v1.apps/ml-pipeline -n kubeflow

You'll see the field reference the api server docker image. Change it to point to your own build, after saving and closing the file, apiserver will restart with your change.

Building client library and swagger files

After making changes to proto files, the Go client libraries, Python client libraries and swagger files need to be regenerated and checked-in. Refer to backend/api for details.

Updating licenses info

  1. Install go-licenses tool from https://github.com/Bobgy/go-licenses/releases, and refer to its documentation for how to use it.

  2. Run the tool to update all licenses:

    make all
    

Visualization Server Instructions

Updating python dependencies

pip-tools is used to manage python dependencies. To update dependencies, edit requirements.in and run ./update_requirements.sh to update and pin the transitive dependencies.