pipelines/CHANGELOG.md

528 KiB

Changelog

1.4.0-rc.1 (2021-02-01)

Features

  • api: Add AI Platform Custom Job spec to IR (#5035) (32ce8d8)
  • components: Add json format for BigQuery output to GCS (#4994) (3660a63)
  • components: Added support for specifying resources for custom model deployment (#4905) (346bacd)
  • components: Change Katib component output to JsonObject (#4974) (34d23aa)
  • frontend: Add run ID and workflow name in RunDetails config. Part of #4921 (#4922) (dbd4370)
  • frontend: Add Task Details tab when clicking a node: Info includes ID, Name, Time, Status. Fixes #4699 (#5023) (bf65518)
  • sdk: Artifact metadata related placeholder for components. (#5003) (a36a62a)
  • sdk: Components - Support annotations when creating components from python (#4996) (d629397)
  • sdk: Container entrypoint used for new styled KFP component authoring (#4978) (279694e)
  • sdk: Merge artifact ontology from v2 to the classic KFP. (#4963) (a56efb2)
  • sdk: Replace logging and print statements with click echo statements for cli (#4622) (0a7da2d)

Bug Fixes

  • backend: add default value for CRON_SCHEDULE_TIMEZONE (#4977) (ca09c7a)
  • backend: allow multiple values per key/op in filter. Fixes #4975 (#4990) (9a30e97)
  • backend: fix periodic schedule to begin at start time. Fixes #3935 (#5027) (2f04bc6)
  • backend: make the scheduleworkflowontroller timezone aware. Fixes #2653 (#4641) (eeb7f8f)
  • component: Use Python3.6 to build KFP launcher component (#5039) (e6aeb9c)
  • components: Add default V1ContainerPort protocol value for the kfserving component (#4956) (b5af458)
  • components: cast return value of gcp/automl/create_dataset_for_tables. Fixes #5053 (#5054) (c653c30)
  • components: Update components/local/base/Dockerfile to use Python3 (#5047) (d14f64e)
  • frontend: updated the docs to point to the correct cron expression descriptions. Fixes #2654 (#5028) (f653913)
  • mkp: Added default values for parameters (#5010) (7ed110e)
  • mkp: Added service account description to prevent validation errors (#4992) (3b9fdff)
  • sample: Fix missing --region in dataflow sample notebook. Fixes #5007 (#5036) (0fd6580)
  • samples: Bump dataproc image version to 1.5 in xgboost_training_cm.py (#5062) (56476cc)
  • sdk: Allow keyword-only arguments in pipeline function signature (#4544) (ce985bc)
  • sdk: compile ParallelFor in a deterministic manner (#4926) (2f1db59)
  • sdk: Components - Fixed python components that use \n. Fixes #4939 (#4993) (691eefc)
  • sdk: fixes unresolved PipelineParam when static list passed to dsl.ParallelFor. Fixes #4890 (#4891) (5633b9a)
  • SDK: require PyYAML>=5.3 (#5063) (2e7eb9d)
  • sdk.v2: Fix the bug where pipeline_parameters is not used. (#5002) (0c600a2)
  • test: Fix presubmit with python version upgrade (#5033) (a8b7fc9)
  • test: Pin pip version in presubmit-tests-tfx.sh Fixes #5049 (#5050) (cad02dc)

Other Pull Requests

  • disable discovery cache (#5058) (48a34e6)
  • Upgrade tfx version to 0.26.0 in backend (#5052) (35bc50e)
  • fix(backend):Change enqueue base delay in non-error mode to 1 second for persistent agent (#4957) (4ab5d63)
  • Bump kfp-pipeline-spec version to 0.1.4 (#4982) (273890a)
  • Added checks for parallism values (#4950) (c2a8bd0)

1.3.0 (2021-01-07)

Features

  • backend: Bump Go SQL driver to v1.5.0. Fixes #4910 (#4911) (aaa0779)
  • backend: sync pipeline_spec.proto (#4927) (bb0f330)
  • compiler: add dsl operation for parallelism on sub dag level (#4199) (24732b9)
  • frontend: Reorganize Experiments, Runs, and Archive pages. Fixes #4918 (#4919) (c320a5d)
  • sdk: Implements artifact URI placeholder. (#4932) (7540ba5)

Bug Fixes

  • backend: fixed validation logic and resource manager logic when creating job and run (#4914) (768317a)
  • components: Update GCP component container to Python 3.7. Fixes #4959 (#4960) (8463992)
  • frontend: Change CachedIcon to something more intuitive (#4912) (e806f45)
  • sdk: fixes typo of 'desc'. (#4938) (e07ba45)

Other Pull Requests

  • docs(backend)update docs of deploying apiserver (#4930) (1791d8e)
  • chore (sdk.v2): Error out on using InputPath placeholder for artifacts require importer. (#4929) (a347765)

1.3.0 (2021-01-07)

Features

  • backend: Bump Go SQL driver to v1.5.0. Fixes #4910 (#4911) (aaa0779)
  • backend: sync pipeline_spec.proto (#4927) (bb0f330)
  • compiler: add dsl operation for parallelism on sub dag level (#4199) (24732b9)
  • frontend: Reorganize Experiments, Runs, and Archive pages. Fixes #4918 (#4919) (c320a5d)
  • sdk: Implements artifact URI placeholder. (#4932) (7540ba5)

Bug Fixes

  • backend: fixed validation logic and resource manager logic when creating job and run (#4914) (768317a)
  • components: Update GCP component container to Python 3.7. Fixes #4959 (#4960) (8463992)
  • frontend: Change CachedIcon to something more intuitive (#4912) (e806f45)
  • sdk: fixes typo of 'desc'. (#4938) (e07ba45)

Other Pull Requests

  • docs(backend)update docs of deploying apiserver (#4930) (1791d8e)
  • chore (sdk.v2): Error out on using InputPath placeholder for artifacts require importer. (#4929) (a347765)

1.2.0 (2020-12-18)

Features

  • components: Add v1beta1 Katib launcher and samples (#4798) (89e4210)
  • sdk: Add artifact ontology and migrate compiler utils to onboard artifact types (#4901) (2386471)
  • sdk: Add settings of the dnsConfig field. Fixes #4836 (#4837) (5a4b70e)
  • sdk: allow calling GroupOp.after with multiple ops (#4788) (5169489)
  • sdk: Components - Restored stack traces in lightweight python components. Fixes #4273, #4849 (#4861) (7a66414)
  • SDK: adds Artifact base class. (#4895) (7591805)

Bug Fixes

  • frontend: fixed getting executions failure. Fixes #4903 (#4907) (df7a66f)
  • frontend: Use task_display_name annotation when displaying run metrics (#4875) (d4e8b87)
  • sdk: Do not wait for resource deletion (#4820) (8f70bf3)
  • sdk: make healthz exception visible in logs by default (#4904) (44fcda7)

1.1.2 (2020-12-14)

Features

  • backend: Make number of persistence worker goroutine configurable (#3904) (8a2d11c)
  • sdk: add ability to set retry policy (#4858) (2f3a686)
  • Set current namespace for in-cluster SDK in multi-user mode and add healthz endpoint to API backends (#4638) (0df9473)
  • API: exposing api for setting the default version of pipeline. Fixes #4049 (#4406) (5742991)
  • backend: allow configuring if default version should be updated when uploading new pipeline version. Fixes #4049 (#4476) (2317015)
  • backend: Metadata Writer - Record parameter argument values to MLMD (#4564) (ec65dfe)
  • backend: new server API to read run log. Fixes #4468 (#4493) (678ae0f)
  • backend: Refactor authz to perform SubjectAccessReview. Fixes #3513 (#4723) (39203d5)
  • backend: sort by run metrics - step 2 (#4235) (d4d3616)
  • backend: sort by run metrics - step 3. Part of #3591 (#4251) (9c6738f)
  • backend: sorting on run metrics - step 1 (#4203) (a96e8fe)
  • cache: Explicitly specifying which attributes affect the cache key (#4076) (f35462f)
  • compiled: set pod disruption budget for pipelines. Fixes #3877 (#4178) (c32ea23)
  • components: Added the component to convert from KerasModelHdf5 to TensorflowSavedModel (#4524) (4830e03)
  • components: [AWS SageMaker] Minimize inputs for mnist classification pipeline (#4192) (6860681)
  • components: Add yaml support to kfserving component (#4587) (2a1fe45)
  • components: Added a sample C# script component (#4815) (c5e6ca2)
  • components: Added a sample R script component (#4817) (3826edf)
  • components: Added Calculate classification metrics component (#4441) (9a00eb3)
  • components: Added converter components for Tensorflow Lite models (#4532) (1802db3)
  • components: Added converter components for TensorflowJS GraphModel (#4526) (3927a4f)
  • components: Added converter components for TensorflowJS LayersModel (#4527) (b1f46ac)
  • components: Added converters to OnnxModel from Tensorflow and Keras (#4550) (4ec84e6)
  • components: Added JSON query components (#4601) (b656fbf)
  • components: Added the Basics - Calculate data hash component (#4503) (68a367d)
  • components: Added the Google Cloud Optimizer components (#4621) (46eb6f2)
  • components: Added the Run notebook using papermill component. Fixes #497 (#4578) (329ed48)
  • components: AutoML Tables - Added the Create dataset from CSV component (#4558) (a316e1e)
  • components: AWS SageMaker - Add functionality to stop SageMaker jobs on run termination (#4167) (900eeae)
  • components: AWS SageMaker - Add optional parameter to allow training component to accept parameters related to Debugger (#4283) (3ebd075)
  • components: AWS SageMaker - Changes for updating an existing endpoint (#4424) (7c349f3)
  • components: AWS SageMaker - Support for assuming a role (#4212) (8014a44)
  • components: Azure ML component to deploy model (#4711) (ec721fe)
  • components: Google - AutoML - Added the Deploy model component (#4520) (5fe8ef4)
  • components: Google - AutoML - Added the Export model component (#4519) (d5ae723)
  • components: Google Cloud Optimizer - Added the "Suggest parameter sets from measurements" component (#4633) (f30aa09)
  • components: JSON - Added the "Build dict", "Build list" and "Combine lists" components (#4631) (616c48b)
  • components: Keras - Added the Train_classifier component (#4274) (5f7afe3)
  • components: ml_metrics - Calculate_regression_metrics - Added the metrics and number_of_items outputs (#4239) (1d8abb7)
  • components: Simplified the kubeflow - dnntrainer component (#4415) (b769416)
  • components: web - Download (#4068) (240543e)
  • deployment: Add env/platform-agnostic-pns standalone deployment option (#4278) (dac5a94)
  • deployment: GCP managed storage - detailed instructions to set up workload identity bindings before deployment (#4232) (45a91f6)
  • deployment: KFP standalone should keep user data when application deleted (#4332) (f738cb3)
  • deployment: Kustomize manifest for Azure deployments (#4567) (7a5c3c6)
  • deployment: marketplace - allow specifying gcs bucket directly (#4112) (d4a8329)
  • frontend: Show full node names. Fixes #3989 (#4663) (85bdbc1)
  • frontend: support tensorboard viewer and other visualize Results using volume mount path. Part of #4208 (#4236) (7f77e8b)
  • frontend: UX change to support downloading directory artifacts. Fixes #3667 (#4696) (e3992fa)
  • gcp: Revert "turn off archiveLogs for GCP marketplace #4758" (#4771) (aa162e6)
  • gcp: turn off archiveLogs for GCP marketplace (#4758) (1165ed2)
  • manifest: add support for Standalone KFP on AWS. Fixes #4337 (#4350) (5ec7ec8)
  • samples: Added "Output a directory" sample (#4437) (89cdaa4)
  • samples: Added the caching sample. Fixes #4636 (#4664) (9597c8b)
  • sdk: add aws region field in use_aws_secret in kfp sdk (#4363) (390e80e)
  • sdk: Added optional argument to specify description for pipeline upload (#4577) (dd1e3d8)
  • sdk: added pipeline name option to kfp run submit (#4535) (38946d8)
  • sdk: Adds missing short options to the cli (#4604) (ce6cfa5)
  • sdk: adds support for ephemeral-storage in container-op (#4504) (0653e7c)
  • sdk: Components - Prevent passing unserializable objects to components. Fixes #4040 (#4496) (0332584)
  • sdk: Python components - Parse component input/output descriptions from the function docstring (#4512) (5613db0)
  • add grafana as part of the customized kfp deployment (#4404) (f39d879)
  • add kpf pipeline list-versions command (#3928) (c9f621a)
  • add parallelism for dsl.ParallelFor. Fixes #4089 (#4149) (c6ac83f)
  • allow to use pipeline version (#3930) (40f06bf)
  • GCP marketplace - preserve install config in configmap and secret (#4471) (fbfc160)
  • sdk: CLI - Allow upload_version by the pipeline's name. Fixes #3901 (#4087) (aae1eba)
  • sdk: Client - Getting access token without gcloud CLI (#4811) (ab21ec9)
  • sdk: Components - Added Bool as a known type name (#4597) (d4fd6e1)
  • sdk: DSL - Added support for volatile components (#4104) (d707b93)
  • sdk: Expose upload pipeline version (#4146) (45c796e)
  • sdk: Fix print message for run submission with respect to output format (#4691) (a8bd468)
  • sdk: optional context in kubenetes client (#4401) (aed37c7)
  • sdk: Preserve parameter arguments and input names (#4563) (e8fb58a)
  • sdk: SDK - Components - Added annotations to InputSpec and OutputSpec (#4154) (9b15800)
  • sdk: SDK - Components - Added annotations to TaskSpec (#4153) (afd8161)
  • sdk: SDK - Deprecation warning when using ContainerOp (#4166) (2f94827)
  • sdk: SDK - Enable placeholders in task display names. Fixes #4163 (#4164) (db0af86)
  • sdk: support HTTP/S PROXY for SDK client (#4215) (ac66626)
  • sdk: Support to print the cli command output in json format (#4566) (0795597)
  • sdk/cli: add extra header for cli (#4400) (c8b4599)
  • sdk/client: add cookie configuration to kfp client (#2679) (d91ac0f)

Bug Fixes

  • backend: add MaxCallRecvMsgSize(math.MaxInt32) to proxy server (#4402) (cd9c9ff)
  • backend: Add a permission to create events to argo-role (#4449) (d40d66a)
  • backend: added setup structure to simplify adding new tests and removing duplicated code. Fixes #4630 (#4639) (92a932e)
  • backend: allow empty userid header prefix. Fixes #4091 (4098) (042ff09)
  • backend: Backend - Cache - Fixed reinstallation. Fixes #4299 (#4320) (fe77c19)
  • backend: Cache Deployer - Fixed grep call (#4568) (24217ff)
  • backend: Caching - Fixed deployer failure on Kubernetes v1.16+. Fixes #4627 (#4632) (dde7f9a)
  • backend: Caching - Only send cache-enabled pods to the caching webhook (#4429) (6b54eec)
  • backend: Caching - Reduced the cache webhook timeout (#4428) (ada18bc)
  • backend: fix the google-api-core to 1.16.0 for backend visualization server. (#4158) (cf29c61)
  • backend: fix typo in reference key type (#4376) (32c9c2a)
  • backend: fixes useless error message when visualization-server is not accessible. Fixes #4157 (#4201) (d3d4dcb)
  • backend: improve forward / backward compatibility on db status table (#4351) (384afac)
  • backend: improve forward / backward compatibility on experiment table (#4349) (5141201)
  • backend: job api -- deletion/disabling should succeed when swf not found. Fixes #4871 (#4884) (4df8925)
  • backend: logs error when failing to init mysql. Fixes #4334 (#4335) (bb21597)
  • backend: Metadata Writer - Fixed regression with artifact type retrieval. Fixes #3971 (#4231) (1990588)
  • backend: Metadata Writer - Fixed setting execution custom properties (#4670) (fc6b5d6)
  • backend: persistence agent - workflow not found error should be a permanent error (#4486) (29a6aaa)
  • backend: prevent seg fault if workflow manifest is deleted. Fixes #4389 (#4439) (ec733c9)
  • backend: reduce confusing ReadArtifact errors for metrics in api server. Fixes #3699 (#4338) (01a7998)
  • backend: skip reporting native Argo workflows which do not have Run ID label. Fixes #3584 (#4438) (1f2d417)
  • backend: updated the argo version too 2.7.7. Fixes #4392 (#4498) (d7793af)
  • cache: adds certificate approver permission to kubeflow-pipelines-cache-deployer-role. Fixes #4138 (#4246) (#4383) (265c9b7)
  • cache: Cache deployer - Using the same kubectl version as the server (#4525) (58584e1)
  • cache: Cache executions with no outputs. Fixes #3507 (#3808) (40353bf)
  • cache: cache-deployer should check both secret and config (#4186) (e4f4250)
  • cache: Fix cache deployer not regenerating secrets when secret not present (#4171) (75336f7)
  • component: Add new apply action to kfserving component (#4108) (f21e0fe)
  • component: Update default TensorFlow version for Watson ML example (4109) (de2e0f2)
  • components: Add explicit image tag and fix variable references. (#4298) (fed37f7)
  • components: add istio inject and ready status to kfserving component (#4362) (f3a02d1)
  • components: AWS SageMaker - Fix MinIO PID early exit (#4190) (c6754e3)
  • components: AWS SageMaker - Retry delete EKS Cluster after Integ test failure (#4662) (008985a)
  • components: Fix kfserving component url parsing (#4780) (7f32dde)
  • components: fix ml_engine/train interface (#4593) (d115d46)
  • components: Fixed the Download from GCS components for blob URIs (#4557) (0ffcbd7)
  • components: Fixed the GCP - ML Engine - Batch predict component. Fixes #4430 (#4432) (2beddd0)
  • components: GCP - AutoML - Fixed input type in Batch predict (#4499) (41ce68e)
  • components: Login to Dockerhub before running tests for Sa… (#4826) (c78781d)
  • components: Move output path as arguments for ibm components (#4647) (121bfdf)
  • components: Update watson ml sdk with the Aug 2020 release (#4331) (25ee59d)
  • samples: fixes name error and unused parameter in samples for loop_parallelism (#4187) (57bb7ac)
  • sdk: Fix opsgroups dependency resolution (#4370) (22b7b99)
  • all big enough ui proxy requests fail with error proxying with partial data (#4266) (c7300c3)
  • Bitbucket repo no longer available (#4395) (fe21cd2)
  • components: remove needless arguments from AWS EMR scripts (#4252) (262b288)
  • components: sending pyspark jobs and set generated step_id to /output.txt from the generated EMR step (#4725) (d6a2c23)
  • components: sending pyspark jobs to aws EMR with the correct py … (#4721) (b9e2259)
  • components: use default python version for launching dataflow jobs. Fixes #2601 (#4583) (a013edc)
  • deployment: fix database name prefix description (#4198) (c615e37)
  • deployment: gcp managed storage - add service account to minio and cloudsql proxy deployments for workload identity (#4188) (c5c9739)
  • doc: Use Managed NodeGroup for EKS Cluster (#4609) (1c2a4e8)
  • frontend: do not render Retry nodes in UI DAG as they are virtual nodes. Fixes #4425 #2705 (#4474) (ca29b5c)
  • frontend: Fix logic deciding if a node was cached. Fixes #4814 (#4819) (e3bbf16)
  • frontend: fix parsing large workflow graph. Fixes #4179 (#4180) (02b0899)
  • frontend: Fix the yaml cannot show in Safari browser issue. Fixes #4727 (#4818) (1108ad3)
  • Process: update backend development README. Fixes #4750 (#4774) (1b924e6)
  • proxy: fixes GCP inverse proxy url priority. Fixes #4284 (#4702) (9d6ab4c)
  • sample: Fix syntax error in openvino sample component (#4181) (70ac32c)
  • samples: Keras - Fixed the keras sample (#4523) (9287287)
  • samples: Switched the AutoML sample from BQ to GCS datasets (#4501) (3fd72e4)
  • samples: Updated and fixed the secrets sample (#4590) (c8ce4fa)
  • sdk: added clearer error for case when user uses watch and argo isn't installed (#4511) (37362a3)
  • sdk: Allow non-pythonic names for graph components' task's outputs. Fixes #4514. (#4515) (0b31879)
  • sdk: Client - Fixed wait_for_run_completion (#4808) (5c1b919)
  • sdk: Compiler - Fixed input artifact name sanitization when using raw string arguments. Fixes #4110 (#4120) (48889a9)
  • sdk: Compiler - Fixed pipeline parameters with empty default values (#4552) (f7874d3)
  • sdk: Compiler - Fixed the input argument mapping when using dsl.graph_component. Fixes #3915 (4082) (1da1cf4)
  • sdk: Compiler - Fixed the input argument mapping when using dsl.graph_component. Fixes #3915 (4082) (6960366)
  • sdk: Components - Fixed handling of typing.NamedTuple in Python 3.9 (#4614) (8699a05)
  • sdk: Components - Fixed ModelBase handling of open generic types in Python 3.9 (#4613) (be89972)
  • sdk: DSL - Enabled arbitrary ContainerOp names (#4554) (1aa8068)
  • sdk: Fix get_experiment when there are no experiments. Fixes #4176 (#4177) (749538d)
  • sdk: Fixed UI metadata and metrics (#4672) (80e1d70)
  • sdk: Fixes #4703: conflict between .pylintrc and .yapf (#4706) (0179584)
  • sdk: fixes dsl.ContainerOp deprecation warning not shown (#4658) (c52a81c)
  • sdk: fixes the default value for _is_refresh_token. Fixes #4189 (#4195) (d3ef0dc)
  • sdk: fixes too broad except when retrieving experiments. (#4765) (950fae4)
  • sdk: SDK - Avoiding deprecated ContainerOp methods (#4134) (d0b799e)
  • sdk: SDK - Components - Fixed the error message format string (#4130) (79f6a40)
  • sdk: TypeError in Client.get_pipeline_id() when pipeline does not exist (#4319) (d7e5894)
  • sdk: use a meaningful link text in ipython (#4570) (a840ce7)
  • sdk: VolumeOp has apiVersion as parameter (#4694) (5f992f5)
  • sdk/client: reserve the host protocal (http or https) so that http host can work. Fixes #4277 (#4285) (cc78bd1)
  • sdk/component: ml_engine deploy version is incorrect type. Fixes #4291 (#4292) (2394bb2)
  • increase TFX version from 0.20.2 to 0.22.0. Fixes #4084, fixes #4114 (#4133) (ce51c59)

Other Pull Requests

  • feat(components) Adds RoboMaker and SageMaker RLEstimator components (#4813) (4aa11c3)
  • [IR] Add deployment spec to IR spec. (#4881) (ee85ed5)
  • [Doc] update docs that still refer to KFP latest SDK reference (#4845) (518b8b8)
  • Update RELEASE.md (1d4ebdd)
  • Update RELEASE.md (6acd19b)
  • fix(sdk) - fixes missing import in KFP compiler (#4741) (9efc9e5)
  • kfp sdk version to 1.1.0 (#4740) (79e9f68)
  • SDK - Restored module decoupling (#4625) (ccc763f)
  • compiler for IR (#4529) (5020fd1)
  • Update IR ExecutorOutput message to use ArtifactList for artifacts field. (#4619) (72ce138)
  • sample azure components (#4509) (210eb8a)
  • update kfp installation instructions for a number of gcp components (#4594) (7e4d9f4)
  • Samples - Added the continue_training_from_prod sample (#4561) (2471f26)
  • Update ImporterSpec artifact_uri type (#4548) (629a980)
  • Package pipeline_spec proto into SDK (#4546) (097b186)
  • Pipeline IR (#4371) (d8e8260)
  • [AWS SageMaker] Fix small bugs (#4161) (05398cf)
  • Manifests - Added permissions for certificate approval (#4385) (d9ee639)
  • Fix (readme): fixed a typo. (#4410) (b49f5c9)
  • update owners file (#4316) (d135693)
  • Updated components/aws/sagemaker/README.md (#3983) (e3c33a6)
  • Update README.md (#4260) (ee66814)
  • Components - ml_metrics - Added the Aggregate_regression_metrics component (#4240) (d4d692e)
  • Components - XGBoost - Added the Train_regression_and_calculate_metrics component (#4243) (8d373e7)
  • Components - XGBoost - Added Train_and_cross-validate_regression component (#4245) (acb50e7)
  • Components - XGBoost - Added the Cross_validation_for_regression component (#4244) (34cb59d)
  • SDK - Components - Temporary removed Kubernetes options from ComponentSpec (#4230) (39975e3)
  • Add myself as approver/reviewer (#2254) (193d143)
  • SDK - Components - Fixed examples in docstrings (#4074) (aeb0401)
  • Components - tables - Remove_header (#4044) (b1c1431)
  • SDK - Compiler - Validating Argo validator (#3874) (bbc9ff5)
  • [AWS SageMaker] Integ test to check CloudWatch logs print feature (#4056) (799db47)
  • A brief release announcement/note for KFP 1.0 (#4059) (48f3075)
  • [AWS SageMaker] De-hardcode output paths in AWS components (#4119) (f0f8e5d)
  • SDK - Compiler - Removed the deprecated dsl-compile --package command (#4055) (229eff2)
  • [AWS SageMaker] GroundTruth Pre/Post Lambda function region additions (#3932) (131be23)
  • [AWS SageMaker] Processing job sample (#4009) (7619a01)
  • [AWS SageMaker] Add unit tests for cloudwatch logs (#4051) (e0e4b98)
  • Fix typo in error message (#3369) (50fd45f)
  • test(sdk) Restored the ParallelFor compiler test data (4103) (d24eb78)
  • Components - XGBoost - Added the recursive training pipeline (4067) (2268ddd)
  • Components - Added more GCP BigQuery components (3914) (c52a73e)
  • SDK - Compiler - Added support for volume-based data passing (3371) (54a596a)
  • SDK - Components - Python - Switched the default base image to python 3.7 (4054) (ceb860c)
  • SDK - Tests - Fixed two test failures in hermetic systems (4057) (51b1c74)
  • SDK - Compiler - Fixed error message (#4053) (757d43c)
  • Validate resourcekey to avoid apiserver being panic for invalid inputs (#3999) (91f08c4)
  • [Backend] Bug fix: applying filter in listing versions (#4052) (6fdf03a)
  • Components - Calculate_regression_metrics (#4050) (cd0e487)
  • Components - pandas - Transform DataFrame - Fixed transforms that replace dataframe (#4042) (cb4c1b2)
  • Components - XGBoost - Train and Predict from Apache Parquet (#4035) (c7ef9b4)
  • Components - Converters from ApacheParquet to CSV and TSV (#4031) (c4340f6)
  • Components - XGBoost - Parsing CSV using pandas (#4039) (ea94251)
  • better native-keras based sample (#3900) (7f39f18)
  • Metadata Writer - Added timeouts (#4037) (0417f13)
  • Components - CatBoost - Fixed small bug in sample (#4032) (091316b)
  • [SDK] Add list_pipeline_versions to kfp.Client (#3340) (a802dbb)
  • [AWS SageMaker] Print SageMaker job logs in kfp UI (#3954) (b3d8e04)
  • Docs - Show inherited members in the kfp.dsl docs (#4025) (d472d53)
  • Metadata-Writer: Updates metadata writer to use mlmd 0.22.0 (#4027) (24423ff)
  • Reduce ttl of persisted final workflow to 1 day (#4005) (8553497)
  • Update travis CI status badge to use .com version instead of outdated .org version (#3968) (7340fc2)
  • [AWS SageMaker] Component 0.4.1 Release (#4011) (c29ee5d)
  • Add missing import statement (#4010) (5717bc0)
  • SDK - Components - Added authentication support for component loading functions (#3976) (49fab02)
  • Components - Pandas - Transform_DataFrame (#3985) (a613f0c)
  • [AWS SageMaker] Processing job component (#3944) (bea6365)
  • enable pagination when expanding experiment in both the home page and the archive page (#4008) (53d0244)
  • Fix #3980 - mockapi tsconfig should reference root dir correctly (#4006) (4d2e317)
  • Simplified the style config (#4002) (2e9e750)
  • Components - CatBoost (#3844) (c809fc8)
  • Metadata Writer - Stopped using artifact properties (#4004) (4f5a7f0)
  • Fix/log unavailable warning (#3848) (040615c)
  • update refreshing mechanism (#3981) (c04b9f0)
  • [AWS Sagemaker] aws-samples kmeans-hpo pipeline test (#3905) (bc6aed9)
  • Cache - Deployer should check whether the secret is installed (#3992) (8f8ac52)
  • [Manifest] Apply kustomize best practices to standalone manifest (#3978) (c0124cb)
  • [Doc] Cherry pick process for release branch (#3953) (7d6f2bd)
  • [Backend][Mutli-user] Allow shared read in the special multi-user mode. (#3858) (fcd2559)
  • [AWS SageMaker] Add integration test for sample pipeline train (#3876) (35019eb)
  • moved mnis examples (#3979) (370da26)
  • Update Dataflow component _client.py to use projects.locations.templates API endpoint (#3851) (79b9d40)
  • SDK - Compiler - Made compiler compatible with @wraps (#3956) (374b3b0)
  • [AWS SageMaker] Update GroundTruth integration test timeout (#3973) (d6920ca)
  • [Backend] Filter run on status (#3959) (2fa6e2b)
  • [Format] Format yaml files that will be automated (#3958) (3cf36cd)
  • Fix #3906 - mount_pvc transform should ignore non-ContainerOps (#3912) (4812d35)
  • [Python Client] Clean up generated python client template to facilitate version bump (#3937) (c6ac5e0)
  • fix length (#3934) (7fbb7ca)
  • SDK - Compiler - Using properly serialized pipeline parameter defaults (#3832) (40372e5)
  • Only pending or running workflows are considered not-final (#3940) (5f9e56a)
  • Add Bobgy to OWNERS (#3926) (57f415d)
  • Bump websocket-extensions from 0.1.3 to 0.1.4 in /frontend (#3929) (710c664)
  • [Release] Fix $(cat VERSION) not in bash script (#3924) (b0466cb)
  • [Release] Fix missing $TAG_NAME in .cloudbuild.yaml (#3921) (62959d5)
  • [Release] Various fixes to release script (#3918) (b12023e)
  • create cluster using 'cloud-platform' scope (#3892) (0324b2c)
  • SDK - Components - Added ComponentStore search (#3884) (1403b9b)
  • [Release] Regenerate api clients on release (#3910) (04e23d2)
  • Fix build failure because wcwidth LICENSE url changed (#3909) (8ba895d)
  • Docs - Moved the kfp_server_api documentation to a separate page (#3899) (180f0c5)
  • [API] Add license header to python api client files (#3897) (4f34be6)
  • [Release] Automate release script for all the changes (#3777) (c517fc5)
  • Regenerate clients after proto description fix (#3895) (7dfb34e)
  • Docs - Added docs for kfp_server_api.models (#3898) (c67bc7b)
  • [Python Client] Use openapi generator instead of swagger (#3872) (36eba13)
  • fix typo on sort order: 'des' --> 'desc' (#3893) (5d302b6)
  • [Samples] Change the data url to point to ml-pipeline instead of ml-pipeline-playground (#3890) (88ee54f)
  • Move the minio artifact download under try block (#3889) (a7be049)
  • Adds job_id parameter. (#3850) (58f1d13)
  • Fix the missing description in the CreatePipelineAPI (#3754) (b63dd3f)
  • SDK - Client - Use temporary directory context for pipeline package (#3878) (cd8a913)
  • Components - Added the pipeline component repository marker file (#3883) (4ce78dd)
  • SDK - Normalize line endings when calculating component hash (#3882) (da5f86e)
  • SDK - Components - Stabilize JSON serialization by sorting keys (#3879) (f773b9c)
  • [Backend] Fix user identity extraction logic in getUserIdentity() (#3842) (b23e1b4)
  • More documentation on backend API methods (#3758) (2864925)
  • Generate clickable artifact url for s3 URI (#3531) (3cae116)
  • SDK - Tests - Fixed the test_func_to_container_op_with_imported_func2 test case (#3837) (3010e85)
  • [AWS SageMaker] Add working FSx setup and test (#3831) (37a6363)
  • [SDK] Add first party component label (#3861) (1e2b9d4)
  • SDK - Python Components - Stop generating output saving code if no outputs (#3836) (da4acbb)
  • re-enable upgrade test since 0.5.2 is cut (#3696) (da1bc69)
  • fixing case when status is None (#3865) (58ff65f)
  • Modify docstrings to replace 'InitContainer' to 'UserContainer' (#3863) (699ce93)
  • Testing - Fixed SDK Travis tests (#3838) (0e59b68)
  • Components - Apache Parquet converters (#3834) (d737c44)
  • Kfserving component service account option (#3852) (8d738ea)
  • Cleanup - Removed unused code file (#3864) (f7acb71)
  • Testing - Using Argo validation in Travis tests (#3123) (7d94de1)
  • [AWS SageMaker] Add more unit tests (#3783) (b503050)
  • Testing - Handling spaces in paths in the component file loading test (#3856) (695573d)
  • revert the fix in proxy-agent (#3845) (cc46bef)
  • Components - XGBoost (#3843) (2d26a4c)
  • Datasets - Added Chicago Taxi Trips dataset (#3775) (5e3d9aa)
  • Add labels to plots (#3811) (76f7476)
  • A more accurate grpc error code for duplicate pipeline/pipeline version/experiment names (#3846) (ef73aab)
  • Added README for Amazon SageMaker Components for Kubeflow Pipelines (#3824) (3fe9b7e)
  • Components - Moved TFX components to deprecated directory (#3854) (5b50de0)
  • [AWS SageMaker] Integration Test for AWS SageMaker GroundTruth Component (#3830) (fb54953)
  • Testing - Pin numpy version to fix TFX installation instability in Travis tests (#3833) (9f1c596)
  • [UI] Also cloning recurring run schedule, fixes #3761 (#3840) (508f31a)
  • Client - Allow specifying pipeline description when uploading (#3828) (e52481a)
  • Adding HPO unit test (#3791) (bbe598d)
  • Docs - Added kfp.dsl placeholders to docs (#3813) (43ce639)
  • [UI] Fix confusion matrix wrong axes (#3817) (0199de0)
  • AWS SageMaker : Use IAM Roles for Service Account (#3719) (d18ad7a)
  • Add the 'kfp experiment' commands (#3705) (291f5b3)
  • [AWS SageMaker] Integration tests automation (#3768) (f2a860b)
  • Client - Added documentation for the generated members (#3787) (4a961ce)
  • Changing the default volume size to 30 (#3792) (6e2a55c)
  • Infer artifact store endpoint in metadata writer (#3530) (a764405)
  • [ScheduledWorkflow] Fix events permission missing (#3785) (53d35dd)
  • Allow PipelineParams in dict keys too. (#3565) (ec9445a)
  • [Backend] Make user identity header configurable (#3772) (9f8803e)
  • SDK - Tests - Use relative imports (#3784) (92394f6)
  • [Manifest] Use kustomize native image transformer to override image (#3776) (39805ac)
  • fix(testing) - Fix "1.14.10-gke.27" is unsupported (#3781) (205ca79)
  • SDK - Moved the tests closer to the code (#3774) (1dcea49)
  • SDK - Components - Removed the deprecated _python_op.get_default_base_image and set_default_base_image functions (#3773) (55d41df)
  • Add more approvers in AWS sagemaker components (#3740) (af4e8ef)
  • AWS Sagemaker Components - enhance integration test coverage (#3720) (bff8392)
  • SDK - Moved some data from the component_ref annotation to the component_spec annotation (#3751) (92a0d11)
  • manual merge as the change it self is correct (3d2c6ea)
  • Add probes to metadata grpc service (#3765) (61960ef)
  • [Servers] Add liveness and readiness probes (#3757) (f0c8eff)
  • Components - Tensorboard visualization (#3760) (0f40372)
  • [AWS SageMaker] Unit tests for Training component (#3722) (ddd1969)
  • SDK - Components - Improved stability of the input and output renaming (#3738) (d418f57)
  • [UI Server] Refactor for configurable auth header (#3753) (5435e87)
  • Metadata Writer - Preserve all Argo artifact information (#3725) (81dd6a2)
  • [UI] Show tooltip on long version names (#3750) (bb0c4d9)
  • [UI] Fix artifact preview with outdated content (#3749) (06cd029)
  • SDK - Made outputs with original names available in ContainerOp.outputs (#3734) (8ba366b)
  • SDK - Components - Calculate component hash digest (#3726) (fe30d54)
  • [UI] Wrap parameter/urls on overflow (#3747) (bd4be88)
  • Show version tag in UI (#3743) (e8356bc)
  • Fix bug in #3707 - href should show full artifact content instead of preview (#3745) (e57a619)
  • [Backend] Allow capital letters and underscore in metric names (#3741) (5740535)
  • Upgraded Argo to v2.7.5 (#3537) (e83bd7d)
  • [AWS SageMaker] Specify component input types (#3683) (bd8c1dd)
  • SDK - Prioritize lib2to3 when stripping type annotations (#3724) (b9aa106)
  • Travis - Use latest pip version (#3732) (84cd01a)
  • SDK - Annotate pods with component_ref (#3727) (2279bde)
  • Travis - Made flake8 test optional (#3739) (21e8ef1)
  • [frontend] Show artifact preview in UI (#2172) (#3707) (30345d1)
  • [UI] Make visualization tab easier to understand (#3717) (b1c9976)
  • When patching the {{}} placeholder in parameter, check for possible nil pointer (#3714) (d2c784a)
  • remove an accidentally committed debugging log (#3716) (fe01908)
  • Fixed small syntax error in a sample notebook (#3721) (d4cd70d)
  • [UI] Cleanup, remove types from urls in artifact/execution details page (#3715) (cb41f7a)
  • [UI] Hide empty resource op manifest tab in run details page (#3713) (c5ceaf5)
  • [UI] Improve TFX artifact visualization speed (#3712) (eab5d31)
  • 0.5.1 changelog (#3706) (54c490c)
  • Integration tests for AWS SageMaker Components (#3654) (6beab22)
  • [UI] textbox to select KSA when creating runs/jobs (#3651) (e5bd2df)

1.1.2-rc.1 (2020-12-04)

Bug Fixes

  • frontend: Fix the yaml cannot show in Safari browser issue. Fixes #4727 (#4818) (1108ad3)

Other Pull Requests

  • [Doc] update docs that still refer to KFP latest SDK reference (#4845) (518b8b8)

1.1.1-beta.1 (2020-11-26)

Features

  • Set current namespace for in-cluster SDK in multi-user mode and add healthz endpoint to API backends (#4638) (0df9473)
  • backend: new server API to read run log. Fixes #4468 (#4493) (678ae0f)
  • backend: Refactor authz to perform SubjectAccessReview. Fixes #3513 (#4723) (39203d5)
  • components: Added a sample C# script component (#4815) (c5e6ca2)
  • components: Added a sample R script component (#4817) (3826edf)
  • components: Azure ML component to deploy model (#4711) (ec721fe)
  • frontend: UX change to support downloading directory artifacts. Fixes #3667 (#4696) (e3992fa)
  • gcp: Revert "turn off archiveLogs for GCP marketplace #4758" (#4771) (aa162e6)
  • gcp: turn off archiveLogs for GCP marketplace (#4758) (1165ed2)
  • samples: Added the caching sample. Fixes #4636 (#4664) (9597c8b)
  • sdk: added pipeline name option to kfp run submit (#4535) (38946d8)
  • sdk: Client - Getting access token without gcloud CLI (#4811) (ab21ec9)
  • sdk: Fix print message for run submission with respect to output format (#4691) (a8bd468)

Bug Fixes

  • backend: added setup structure to simplify adding new tests and removing duplicated code. Fixes #4630 (#4639) (92a932e)
  • components: AWS SageMaker - Retry delete EKS Cluster after Integ test failure (#4662) (008985a)
  • components: Fix kfserving component url parsing (#4780) (7f32dde)
  • components: sending pyspark jobs and set generated step_id to /output.txt from the generated EMR step (#4725) (d6a2c23)
  • components: sending pyspark jobs to aws EMR with the correct py … (#4721) (b9e2259)
  • frontend: Fix logic deciding if a node was cached. Fixes #4814 (#4819) (e3bbf16)
  • Process: update backend development README. Fixes #4750 (#4774) (1b924e6)
  • sdk: Client - Fixed wait_for_run_completion (#4808) (5c1b919)
  • sdk: Compiler - Fixed pipeline parameters with empty default values (#4552) (f7874d3)
  • sdk: fixes too broad except when retrieving experiments. (#4765) (950fae4)
  • sdk: VolumeOp has apiVersion as parameter (#4694) (5f992f5)

Other Pull Requests

1.1.0-alpha.1 (2020-11-02)

Features

  • API: exposing api for setting the default version of pipeline. Fixes #4049 (#4406) (5742991)
  • backend: allow configuring if default version should be updated when uploading new pipeline version. Fixes #4049 (#4476) (2317015)
  • backend: Metadata Writer - Record parameter argument values to MLMD (#4564) (ec65dfe)
  • compiled: set pod disruption budget for pipelines. Fixes #3877 (#4178) (c32ea23)
  • components: Added the component to convert from KerasModelHdf5 to TensorflowSavedModel (#4524) (4830e03)
  • components: Add yaml support to kfserving component (#4587) (2a1fe45)
  • components: Added Calculate classification metrics component (#4441) (9a00eb3)
  • components: Added converter components for Tensorflow Lite models (#4532) (1802db3)
  • components: Added converter components for TensorflowJS GraphModel (#4526) (3927a4f)
  • components: Added converter components for TensorflowJS LayersModel (#4527) (b1f46ac)
  • components: Added converters to OnnxModel from Tensorflow and Keras (#4550) (4ec84e6)
  • components: Added JSON query components (#4601) (b656fbf)
  • components: Added the Basics - Calculate data hash component (#4503) (68a367d)
  • components: Added the Google Cloud Optimizer components (#4621) (46eb6f2)
  • components: Added the Run notebook using papermill component. Fixes #497 (#4578) (329ed48)
  • components: AutoML Tables - Added the Create dataset from CSV component (#4558) (a316e1e)
  • components: AWS SageMaker - Changes for updating an existing endpoint (#4424) (7c349f3)
  • components: Google - AutoML - Added the Deploy model component (#4520) (5fe8ef4)
  • components: Google - AutoML - Added the Export model component (#4519) (d5ae723)
  • components: Google Cloud Optimizer - Added the "Suggest parameter sets from measurements" component (#4633) (f30aa09)
  • components: JSON - Added the "Build dict", "Build list" and "Combine lists" components (#4631) (616c48b)
  • deployment: Kustomize manifest for Azure deployments (#4567) (7a5c3c6)
  • frontend: Show full node names. Fixes #3989 (#4663) (85bdbc1)
  • samples: Added "Output a directory" sample (#4437) (89cdaa4)
  • sdk: Added optional argument to specify description for pipeline upload (#4577) (dd1e3d8)
  • sdk: Adds missing short options to the cli (#4604) (ce6cfa5)
  • sdk: adds support for ephemeral-storage in container-op (#4504) (0653e7c)
  • sdk: Components - Added Bool as a known type name (#4597) (d4fd6e1)
  • sdk: Components - Prevent passing unserializable objects to components. Fixes #4040 (#4496) (0332584)
  • sdk: optional context in kubenetes client (#4401) (aed37c7)
  • sdk: Preserve parameter arguments and input names (#4563) (e8fb58a)
  • sdk: Python components - Parse component input/output descriptions from the function docstring (#4512) (5613db0)
  • sdk: Support to print the cli command output in json format (#4566) (0795597)
  • sdk/cli: add extra header for cli (#4400) (c8b4599)
  • GCP marketplace - preserve install config in configmap and secret (#4471) (fbfc160)
  • backend: Make number of persistence worker goroutine configurable (#3904) (8a2d11c)
  • backend: sort by run metrics - step 2 (#4235) (d4d3616)
  • backend: sort by run metrics - step 3. Part of #3591 (#4251) (9c6738f)
  • backend: sorting on run metrics - step 1 (#4203) (a96e8fe)
  • cache: Explicitly specifying which attributes affect the cache key (#4076) (f35462f)
  • components: [AWS SageMaker] Minimize inputs for mnist classification pipeline (#4192) (6860681)
  • components: AWS SageMaker - Add functionality to stop SageMaker jobs on run termination (#4167) (900eeae)
  • components: AWS SageMaker - Add optional parameter to allow training component to accept parameters related to Debugger (#4283) (3ebd075)
  • components: AWS SageMaker - Support for assuming a role (#4212) (8014a44)
  • components: Keras - Added the Train_classifier component (#4274) (5f7afe3)
  • components: ml_metrics - Calculate_regression_metrics - Added the metrics and number_of_items outputs (#4239) (1d8abb7)
  • components: Simplified the kubeflow - dnntrainer component (#4415) (b769416)
  • components: web - Download (#4068) (240543e)
  • add grafana as part of the customized kfp deployment (#4404) (f39d879)
  • deployment: Add env/platform-agnostic-pns standalone deployment option (#4278) (dac5a94)
  • deployment: GCP managed storage - detailed instructions to set up workload identity bindings before deployment (#4232) (45a91f6)
  • deployment: KFP standalone should keep user data when application deleted (#4332) (f738cb3)
  • deployment: marketplace - allow specifying gcs bucket directly (#4112) (d4a8329)
  • frontend: support tensorboard viewer and other visualize Results using volume mount path. Part of #4208 (#4236) (7f77e8b)
  • manifest: add support for Standalone KFP on AWS. Fixes #4337 (#4350) (5ec7ec8)
  • sdk: add aws region field in use_aws_secret in kfp sdk (#4363) (390e80e)
  • sdk: CLI - Allow upload_version by the pipeline's name. Fixes #3901 (#4087) (aae1eba)
  • sdk: DSL - Added support for volatile components (#4104) (d707b93)
  • sdk: Expose upload pipeline version (#4146) (45c796e)
  • sdk: SDK - Components - Added annotations to InputSpec and OutputSpec (#4154) (9b15800)
  • sdk: SDK - Components - Added annotations to TaskSpec (#4153) (afd8161)
  • sdk: SDK - Deprecation warning when using ContainerOp (#4166) (2f94827)
  • sdk: SDK - Enable placeholders in task display names. Fixes #4163 (#4164) (db0af86)
  • sdk: support HTTP/S PROXY for SDK client (#4215) (ac66626)
  • sdk/client: add cookie configuration to kfp client (#2679) (d91ac0f)
  • add kpf pipeline list-versions command (#3928) (c9f621a)
  • add parallelism for dsl.ParallelFor. Fixes #4089 (#4149) (c6ac83f)
  • allow to use pipeline version (#3930) (40f06bf)

Bug Fixes

  • backend: add MaxCallRecvMsgSize(math.MaxInt32) to proxy server (#4402) (cd9c9ff)
  • backend: Add a permission to create events to argo-role (#4449) (d40d66a)
  • backend: Cache Deployer - Fixed grep call (#4568) (24217ff)
  • backend: Caching - Fixed deployer failure on Kubernetes v1.16+. Fixes #4627 (#4632) (dde7f9a)
  • backend: Caching - Only send cache-enabled pods to the caching webhook (#4429) (6b54eec)
  • backend: Caching - Reduced the cache webhook timeout (#4428) (ada18bc)
  • backend: fix typo in reference key type (#4376) (32c9c2a)
  • backend: Metadata Writer - Fixed setting execution custom properties (#4670) (fc6b5d6)
  • backend: persistence agent - workflow not found error should be a permanent error (#4486) (29a6aaa)
  • backend: prevent seg fault if workflow manifest is deleted. Fixes #4389 (#4439) (ec733c9)
  • backend: skip reporting native Argo workflows which do not have Run ID label. Fixes #3584 (#4438) (1f2d417)
  • backend: updated the argo version too 2.7.7. Fixes #4392 (#4498) (d7793af)
  • cache: Cache deployer - Using the same kubectl version as the server (#4525) (58584e1)
  • cache: Cache executions with no outputs. Fixes #3507 (#3808) (40353bf)
  • components: add istio inject and ready status to kfserving component (#4362) (f3a02d1)
  • components: fix ml_engine/train interface (#4593) (d115d46)
  • components: Fixed the Download from GCS components for blob URIs (#4557) (0ffcbd7)
  • components: Fixed the GCP - ML Engine - Batch predict component. Fixes #4430 (#4432) (2beddd0)
  • components: GCP - AutoML - Fixed input type in Batch predict (#4499) (41ce68e)
  • components: Move output path as arguments for ibm components (#4647) (121bfdf)
  • components: use default python version for launching dataflow jobs. Fixes #2601 (#4583) (a013edc)
  • doc: Use Managed NodeGroup for EKS Cluster (#4609) (1c2a4e8)
  • frontend: do not render Retry nodes in UI DAG as they are virtual nodes. Fixes #4425 #2705 (#4474) (ca29b5c)
  • frontend: fix parsing large workflow graph. Fixes #4179 (#4180) (02b0899)
  • proxy: fixes GCP inverse proxy url priority. Fixes #4284 (#4702) (9d6ab4c)
  • samples: Keras - Fixed the keras sample (#4523) (9287287)
  • samples: Switched the AutoML sample from BQ to GCS datasets (#4501) (3fd72e4)
  • samples: Updated and fixed the secrets sample (#4590) (c8ce4fa)
  • sdk: added clearer error for case when user uses watch and argo isn't installed (#4511) (37362a3)
  • sdk: Allow non-pythonic names for graph components' task's outputs. Fixes #4514. (#4515) (0b31879)
  • sdk: Components - Fixed handling of typing.NamedTuple in Python 3.9 (#4614) (8699a05)
  • sdk: Components - Fixed ModelBase handling of open generic types in Python 3.9 (#4613) (be89972)
  • sdk: DSL - Enabled arbitrary ContainerOp names (#4554) (1aa8068)
  • sdk: Fix opsgroups dependency resolution (#4370) (22b7b99)
  • sdk: Fixed UI metadata and metrics (#4672) (80e1d70)
  • sdk: Fixes #4703: conflict between .pylintrc and .yapf (#4706) (0179584)
  • sdk: fixes dsl.ContainerOp deprecation warning not shown (#4658) (c52a81c)
  • sdk: use a meaningful link text in ipython (#4570) (a840ce7)
  • Bitbucket repo no longer available (#4395) (fe21cd2)
  • backend: allow empty userid header prefix. Fixes #4091 (4098) (042ff09)
  • backend: Backend - Cache - Fixed reinstallation. Fixes #4299 (#4320) (fe77c19)
  • backend: fix the google-api-core to 1.16.0 for backend visualization server. (#4158) (cf29c61)
  • backend: fixes useless error message when visualization-server is not accessible. Fixes #4157 (#4201) (d3d4dcb)
  • backend: improve forward / backward compatibility on db status table (#4351) (384afac)
  • backend: improve forward / backward compatibility on experiment table (#4349) (5141201)
  • backend: logs error when failing to init mysql. Fixes #4334 (#4335) (bb21597)
  • backend: Metadata Writer - Fixed regression with artifact type retrieval. Fixes #3971 (#4231) (1990588)
  • backend: reduce confusing ReadArtifact errors for metrics in api server. Fixes #3699 (#4338) (01a7998)
  • cache: adds certificate approver permission to kubeflow-pipelines-cache-deployer-role. Fixes #4138 (#4246) (#4383) (265c9b7)
  • cache: cache-deployer should check both secret and config (#4186) (e4f4250)
  • cache: Fix cache deployer not regenerating secrets when secret not present (#4171) (75336f7)
  • component: Add new apply action to kfserving component (#4108) (f21e0fe)
  • component: Update default TensorFlow version for Watson ML example (4109) (de2e0f2)
  • components: Add explicit image tag and fix variable references. (#4298) (fed37f7)
  • components: AWS SageMaker - Fix MinIO PID early exit (#4190) (c6754e3)
  • components: remove needless arguments from AWS EMR scripts (#4252) (262b288)
  • components: Update watson ml sdk with the Aug 2020 release (#4331) (25ee59d)
  • deployment: fix database name prefix description (#4198) (c615e37)
  • deployment: gcp managed storage - add service account to minio and cloudsql proxy deployments for workload identity (#4188) (c5c9739)
  • sample: Fix syntax error in openvino sample component (#4181) (70ac32c)
  • samples: fixes name error and unused parameter in samples for loop_parallelism (#4187) (57bb7ac)
  • sdk: Compiler - Fixed input artifact name sanitization when using raw string arguments. Fixes #4110 (#4120) (48889a9)
  • sdk: Compiler - Fixed the input argument mapping when using dsl.graph_component. Fixes #3915 (4082) (1da1cf4)
  • sdk: Compiler - Fixed the input argument mapping when using dsl.graph_component. Fixes #3915 (4082) (6960366)
  • sdk: Fix get_experiment when there are no experiments. Fixes #4176 (#4177) (749538d)
  • sdk: fixes the default value for _is_refresh_token. Fixes #4189 (#4195) (d3ef0dc)
  • sdk: SDK - Avoiding deprecated ContainerOp methods (#4134) (d0b799e)
  • sdk: SDK - Components - Fixed the error message format string (#4130) (79f6a40)
  • sdk: TypeError in Client.get_pipeline_id() when pipeline does not exist (#4319) (d7e5894)
  • sdk/client: reserve the host protocal (http or https) so that http host can work. Fixes #4277 (#4285) (cc78bd1)
  • sdk/component: ml_engine deploy version is incorrect type. Fixes #4291 (#4292) (2394bb2)
  • all big enough ui proxy requests fail with error proxying with partial data (#4266) (c7300c3)
  • increase TFX version from 0.20.2 to 0.22.0. Fixes #4084, fixes #4114 (#4133) (ce51c59)

Other Pull Requests

  • SDK - Restored module decoupling (#4625) (ccc763f)
  • compiler for IR (#4529) (5020fd1)
  • Update IR ExecutorOutput message to use ArtifactList for artifacts field. (#4619) (72ce138)
  • sample azure components (#4509) (210eb8a)
  • update kfp installation instructions for a number of gcp components (#4594) (7e4d9f4)
  • Samples - Added the continue_training_from_prod sample (#4561) (2471f26)
  • Update ImporterSpec artifact_uri type (#4548) (629a980)
  • Package pipeline_spec proto into SDK (#4546) (097b186)
  • Pipeline IR (#4371) (d8e8260)
  • [AWS SageMaker] Fix small bugs (#4161) (05398cf)
  • Manifests - Added permissions for certificate approval (#4385) (d9ee639)
  • Fix (readme): fixed a typo. (#4410) (b49f5c9)
  • update owners file (#4316) (d135693)
  • Updated components/aws/sagemaker/README.md (#3983) (e3c33a6)
  • Update README.md (#4260) (ee66814)
  • Components - ml_metrics - Added the Aggregate_regression_metrics component (#4240) (d4d692e)
  • Components - XGBoost - Added the Train_regression_and_calculate_metrics component (#4243) (8d373e7)
  • Components - XGBoost - Added Train_and_cross-validate_regression component (#4245) (acb50e7)
  • Components - XGBoost - Added the Cross_validation_for_regression component (#4244) (34cb59d)
  • SDK - Components - Temporary removed Kubernetes options from ComponentSpec (#4230) (39975e3)
  • Add myself as approver/reviewer (#2254) (193d143)
  • SDK - Components - Fixed examples in docstrings (#4074) (aeb0401)
  • Components - tables - Remove_header (#4044) (b1c1431)
  • SDK - Compiler - Validating Argo validator (#3874) (bbc9ff5)
  • [AWS SageMaker] Integ test to check CloudWatch logs print feature (#4056) (799db47)
  • A brief release announcement/note for KFP 1.0 (#4059) (48f3075)
  • [AWS SageMaker] De-hardcode output paths in AWS components (#4119) (f0f8e5d)
  • SDK - Compiler - Removed the deprecated dsl-compile --package command (#4055) (229eff2)
  • [AWS SageMaker] GroundTruth Pre/Post Lambda function region additions (#3932) (131be23)
  • [AWS SageMaker] Processing job sample (#4009) (7619a01)
  • [AWS SageMaker] Add unit tests for cloudwatch logs (#4051) (e0e4b98)
  • Fix typo in error message (#3369) (50fd45f)
  • test(sdk) Restored the ParallelFor compiler test data (4103) (d24eb78)
  • Components - XGBoost - Added the recursive training pipeline (4067) (2268ddd)
  • Components - Added more GCP BigQuery components (3914) (c52a73e)
  • SDK - Compiler - Added support for volume-based data passing (3371) (54a596a)
  • SDK - Components - Python - Switched the default base image to python 3.7 (4054) (ceb860c)
  • SDK - Tests - Fixed two test failures in hermetic systems (4057) (51b1c74)
  • SDK - Compiler - Fixed error message (#4053) (757d43c)
  • Validate resourcekey to avoid apiserver being panic for invalid inputs (#3999) (91f08c4)
  • [Backend] Bug fix: applying filter in listing versions (#4052) (6fdf03a)
  • Components - Calculate_regression_metrics (#4050) (cd0e487)
  • Components - pandas - Transform DataFrame - Fixed transforms that replace dataframe (#4042) (cb4c1b2)
  • Components - XGBoost - Train and Predict from Apache Parquet (#4035) (c7ef9b4)
  • Components - Converters from ApacheParquet to CSV and TSV (#4031) (c4340f6)
  • Components - XGBoost - Parsing CSV using pandas (#4039) (ea94251)
  • better native-keras based sample (#3900) (7f39f18)
  • Metadata Writer - Added timeouts (#4037) (0417f13)
  • Components - CatBoost - Fixed small bug in sample (#4032) (091316b)
  • [SDK] Add list_pipeline_versions to kfp.Client (#3340) (a802dbb)
  • [AWS SageMaker] Print SageMaker job logs in kfp UI (#3954) (b3d8e04)
  • Docs - Show inherited members in the kfp.dsl docs (#4025) (d472d53)
  • Metadata-Writer: Updates metadata writer to use mlmd 0.22.0 (#4027) (24423ff)
  • Reduce ttl of persisted final workflow to 1 day (#4005) (8553497)
  • Update travis CI status badge to use .com version instead of outdated .org version (#3968) (7340fc2)
  • [AWS SageMaker] Component 0.4.1 Release (#4011) (c29ee5d)
  • Add missing import statement (#4010) (5717bc0)
  • SDK - Components - Added authentication support for component loading functions (#3976) (49fab02)
  • Components - Pandas - Transform_DataFrame (#3985) (a613f0c)
  • [AWS SageMaker] Processing job component (#3944) (bea6365)
  • enable pagination when expanding experiment in both the home page and the archive page (#4008) (53d0244)
  • Fix #3980 - mockapi tsconfig should reference root dir correctly (#4006) (4d2e317)
  • Simplified the style config (#4002) (2e9e750)
  • Components - CatBoost (#3844) (c809fc8)
  • Metadata Writer - Stopped using artifact properties (#4004) (4f5a7f0)
  • Fix/log unavailable warning (#3848) (040615c)
  • update refreshing mechanism (#3981) (c04b9f0)
  • [AWS Sagemaker] aws-samples kmeans-hpo pipeline test (#3905) (bc6aed9)
  • Cache - Deployer should check whether the secret is installed (#3992) (8f8ac52)
  • [Manifest] Apply kustomize best practices to standalone manifest (#3978) (c0124cb)
  • [Doc] Cherry pick process for release branch (#3953) (7d6f2bd)
  • [Backend][Mutli-user] Allow shared read in the special multi-user mode. (#3858) (fcd2559)
  • [AWS SageMaker] Add integration test for sample pipeline train (#3876) (35019eb)
  • moved mnis examples (#3979) (370da26)
  • Update Dataflow component _client.py to use projects.locations.templates API endpoint (#3851) (79b9d40)
  • SDK - Compiler - Made compiler compatible with @wraps (#3956) (374b3b0)
  • [AWS SageMaker] Update GroundTruth integration test timeout (#3973) (d6920ca)
  • [Backend] Filter run on status (#3959) (2fa6e2b)
  • [Format] Format yaml files that will be automated (#3958) (3cf36cd)
  • Fix #3906 - mount_pvc transform should ignore non-ContainerOps (#3912) (4812d35)
  • [Python Client] Clean up generated python client template to facilitate version bump (#3937) (c6ac5e0)
  • fix length (#3934) (7fbb7ca)
  • SDK - Compiler - Using properly serialized pipeline parameter defaults (#3832) (40372e5)
  • Only pending or running workflows are considered not-final (#3940) (5f9e56a)
  • Add Bobgy to OWNERS (#3926) (57f415d)
  • Bump websocket-extensions from 0.1.3 to 0.1.4 in /frontend (#3929) (710c664)
  • [Release] Fix $(cat VERSION) not in bash script (#3924) (b0466cb)
  • [Release] Fix missing $TAG_NAME in .cloudbuild.yaml (#3921) (62959d5)
  • [Release] Various fixes to release script (#3918) (b12023e)
  • create cluster using 'cloud-platform' scope (#3892) (0324b2c)
  • SDK - Components - Added ComponentStore search (#3884) (1403b9b)
  • [Release] Regenerate api clients on release (#3910) (04e23d2)
  • Fix build failure because wcwidth LICENSE url changed (#3909) (8ba895d)
  • Docs - Moved the kfp_server_api documentation to a separate page (#3899) (180f0c5)
  • [API] Add license header to python api client files (#3897) (4f34be6)
  • [Release] Automate release script for all the changes (#3777) (c517fc5)
  • Regenerate clients after proto description fix (#3895) (7dfb34e)
  • Docs - Added docs for kfp_server_api.models (#3898) (c67bc7b)
  • [Python Client] Use openapi generator instead of swagger (#3872) (36eba13)
  • fix typo on sort order: 'des' --> 'desc' (#3893) (5d302b6)
  • [Samples] Change the data url to point to ml-pipeline instead of ml-pipeline-playground (#3890) (88ee54f)
  • Move the minio artifact download under try block (#3889) (a7be049)
  • Adds job_id parameter. (#3850) (58f1d13)
  • Fix the missing description in the CreatePipelineAPI (#3754) (b63dd3f)
  • SDK - Client - Use temporary directory context for pipeline package (#3878) (cd8a913)
  • Components - Added the pipeline component repository marker file (#3883) (4ce78dd)
  • SDK - Normalize line endings when calculating component hash (#3882) (da5f86e)
  • SDK - Components - Stabilize JSON serialization by sorting keys (#3879) (f773b9c)
  • [Backend] Fix user identity extraction logic in getUserIdentity() (#3842) (b23e1b4)
  • More documentation on backend API methods (#3758) (2864925)
  • Generate clickable artifact url for s3 URI (#3531) (3cae116)
  • SDK - Tests - Fixed the test_func_to_container_op_with_imported_func2 test case (#3837) (3010e85)
  • [AWS SageMaker] Add working FSx setup and test (#3831) (37a6363)
  • [SDK] Add first party component label (#3861) (1e2b9d4)
  • SDK - Python Components - Stop generating output saving code if no outputs (#3836) (da4acbb)
  • re-enable upgrade test since 0.5.2 is cut (#3696) (da1bc69)
  • fixing case when status is None (#3865) (58ff65f)
  • Modify docstrings to replace 'InitContainer' to 'UserContainer' (#3863) (699ce93)
  • Testing - Fixed SDK Travis tests (#3838) (0e59b68)
  • Components - Apache Parquet converters (#3834) (d737c44)
  • Kfserving component service account option (#3852) (8d738ea)
  • Cleanup - Removed unused code file (#3864) (f7acb71)
  • Testing - Using Argo validation in Travis tests (#3123) (7d94de1)
  • [AWS SageMaker] Add more unit tests (#3783) (b503050)
  • Testing - Handling spaces in paths in the component file loading test (#3856) (695573d)
  • revert the fix in proxy-agent (#3845) (cc46bef)
  • Components - XGBoost (#3843) (2d26a4c)
  • Datasets - Added Chicago Taxi Trips dataset (#3775) (5e3d9aa)
  • Add labels to plots (#3811) (76f7476)
  • A more accurate grpc error code for duplicate pipeline/pipeline version/experiment names (#3846) (ef73aab)
  • Added README for Amazon SageMaker Components for Kubeflow Pipelines (#3824) (3fe9b7e)
  • Components - Moved TFX components to deprecated directory (#3854) (5b50de0)
  • [AWS SageMaker] Integration Test for AWS SageMaker GroundTruth Component (#3830) (fb54953)
  • Testing - Pin numpy version to fix TFX installation instability in Travis tests (#3833) (9f1c596)
  • [UI] Also cloning recurring run schedule, fixes #3761 (#3840) (508f31a)
  • Client - Allow specifying pipeline description when uploading (#3828) (e52481a)
  • Adding HPO unit test (#3791) (bbe598d)
  • Docs - Added kfp.dsl placeholders to docs (#3813) (43ce639)
  • [UI] Fix confusion matrix wrong axes (#3817) (0199de0)
  • AWS SageMaker : Use IAM Roles for Service Account (#3719) (d18ad7a)
  • Add the 'kfp experiment' commands (#3705) (291f5b3)
  • [AWS SageMaker] Integration tests automation (#3768) (f2a860b)
  • Client - Added documentation for the generated members (#3787) (4a961ce)
  • Changing the default volume size to 30 (#3792) (6e2a55c)
  • Infer artifact store endpoint in metadata writer (#3530) (a764405)
  • [ScheduledWorkflow] Fix events permission missing (#3785) (53d35dd)
  • Allow PipelineParams in dict keys too. (#3565) (ec9445a)
  • [Backend] Make user identity header configurable (#3772) (9f8803e)
  • SDK - Tests - Use relative imports (#3784) (92394f6)
  • [Manifest] Use kustomize native image transformer to override image (#3776) (39805ac)
  • fix(testing) - Fix "1.14.10-gke.27" is unsupported (#3781) (205ca79)
  • SDK - Moved the tests closer to the code (#3774) (1dcea49)
  • SDK - Components - Removed the deprecated _python_op.get_default_base_image and set_default_base_image functions (#3773) (55d41df)
  • Add more approvers in AWS sagemaker components (#3740) (af4e8ef)
  • AWS Sagemaker Components - enhance integration test coverage (#3720) (bff8392)
  • SDK - Moved some data from the component_ref annotation to the component_spec annotation (#3751) (92a0d11)
  • manual merge as the change it self is correct (3d2c6ea)
  • Add probes to metadata grpc service (#3765) (61960ef)
  • [Servers] Add liveness and readiness probes (#3757) (f0c8eff)
  • Components - Tensorboard visualization (#3760) (0f40372)
  • [AWS SageMaker] Unit tests for Training component (#3722) (ddd1969)
  • SDK - Components - Improved stability of the input and output renaming (#3738) (d418f57)
  • [UI Server] Refactor for configurable auth header (#3753) (5435e87)
  • Metadata Writer - Preserve all Argo artifact information (#3725) (81dd6a2)
  • [UI] Show tooltip on long version names (#3750) (bb0c4d9)
  • [UI] Fix artifact preview with outdated content (#3749) (06cd029)
  • SDK - Made outputs with original names available in ContainerOp.outputs (#3734) (8ba366b)
  • SDK - Components - Calculate component hash digest (#3726) (fe30d54)
  • [UI] Wrap parameter/urls on overflow (#3747) (bd4be88)
  • Show version tag in UI (#3743) (e8356bc)
  • Fix bug in #3707 - href should show full artifact content instead of preview (#3745) (e57a619)
  • [Backend] Allow capital letters and underscore in metric names (#3741) (5740535)
  • Upgraded Argo to v2.7.5 (#3537) (e83bd7d)
  • [AWS SageMaker] Specify component input types (#3683) (bd8c1dd)
  • SDK - Prioritize lib2to3 when stripping type annotations (#3724) (b9aa106)
  • Travis - Use latest pip version (#3732) (84cd01a)
  • SDK - Annotate pods with component_ref (#3727) (2279bde)
  • Travis - Made flake8 test optional (#3739) (21e8ef1)
  • [frontend] Show artifact preview in UI (#2172) (#3707) (30345d1)
  • [UI] Make visualization tab easier to understand (#3717) (b1c9976)
  • When patching the {{}} placeholder in parameter, check for possible nil pointer (#3714) (d2c784a)
  • remove an accidentally committed debugging log (#3716) (fe01908)
  • Fixed small syntax error in a sample notebook (#3721) (d4cd70d)
  • [UI] Cleanup, remove types from urls in artifact/execution details page (#3715) (cb41f7a)
  • [UI] Hide empty resource op manifest tab in run details page (#3713) (c5ceaf5)
  • [UI] Improve TFX artifact visualization speed (#3712) (eab5d31)
  • 0.5.1 changelog (#3706) (54c490c)
  • Integration tests for AWS SageMaker Components (#3654) (6beab22)
  • [UI] textbox to select KSA when creating runs/jobs (#3651) (e5bd2df)

1.0.1 (2020-09-14)

Features

  • manifest: add support for Standalone KFP on AWS. Fixes #4337 (#4350) (668a3ec)
  • GCP marketplace - preserve install config in configmap and secret (#4471) (d447355)
  • deployment: Add env/platform-agnostic-pns standalone deployment option (#4278) (ee11f9e)
  • deployment: KFP standalone should keep user data when application deleted (#4332) (6e1ceb7)
  • sdk: support HTTP/S PROXY for SDK client (#4215) (9225b75)

Bug Fixes

  • backend: add MaxCallRecvMsgSize(math.MaxInt32) to proxy server (#4402) (62bed1b)
  • backend: Add a permission to create events to argo-role (#4449) (2b48697)
  • backend: Backend - Cache - Fixed reinstallation. Fixes #4299 (#4320) (f5e9901)
  • backend: Caching - Only send cache-enabled pods to the caching webhook (#4429) (f2ed52d)
  • backend: Caching - Reduced the cache webhook timeout (#4428) (eb86087)
  • backend: fix typo in reference key type (#4376) (e5f8209)
  • backend: logs error when failing to init mysql. Fixes #4334 (#4335) (64c377e)
  • backend: persistence agent - workflow not found error should be a permanent error (#4486) (c31a346)
  • backend: prevent seg fault if workflow manifest is deleted. Fixes #4389 (#4439) (9f124d6)
  • backend: reduce confusing ReadArtifact errors for metrics in api server. Fixes #3699 (#4338) (44cd005)
  • backend: skip reporting native Argo workflows which do not have Run ID label. Fixes #3584 (#4438) (f39a98d)
  • sdk/client: reserve the host protocal (http or https) so that http host can work. Fixes #4277 (#4285) (522977f)
  • all big enough ui proxy requests fail with error proxying with partial data (#4266) (3a93080)
  • cache: adds certificate approver permission to kubeflow-pipelines-cache-deployer-role. Fixes #4138 (#4246) (0ba88b0)

Other Pull Requests

  • Reduce ttl of persisted final workflow to 1 day (#4005) (135715d)
  • Manifests - Added permissions for certificate approval (#4385) (1445576)

1.0.0 (2020-07-20)

Features

  • deployment: marketplace - allow specifying gcs bucket directly (#4112) (92a8cfe)
  • sdk: DSL - Added support for volatile components (#4104) (07ebc27)
  • sdk: SDK - Components - Added annotations to InputSpec and OutputSpec (#4154) (98fccca)
  • sdk: SDK - Components - Added annotations to TaskSpec (#4153) (c439ec3)
  • sdk: SDK - Deprecation warning when using ContainerOp (#4166) (ebd62ec)
  • sdk/client: add cookie configuration to kfp client (#2679) (9206b5a)
  • deployment: GCP managed storage - detailed instructions to set up workload identity bindings before deployment (#4232) (11c1cd6)

Bug Fixes

  • backend: allow empty userid header prefix. Fixes #4091 (#4098) (9e00c79)
  • backend: fix the google-api-core to 1.16.0 for backend visualization server. (#4158) (8da057d)
  • backend: Metadata Writer - Fixed regression with artifact type retrieval. Fixes #3971 (#4231) (3ffd55e)
  • cache: cache-deployer should check both secret and config (#4186) (7b3654b)
  • cache: Fix cache deployer not regenerating secrets when secret not present (#4171) (d727c91)
  • deployment: fix database name prefix description (#4198) (2ea1a1f)
  • deployment: gcp managed storage - add service account to minio and cloudsql proxy deployments for workload identity (#4188) (bd7f3c9)
  • sdk: fixes the default value for _is_refresh_token. Fixes #4189 (#4195) (be47d6d)
  • increase TFX version from 0.20.2 to 0.22.0. Fixes #4084, fixes #4114 (#4133) (5d8a59c)

Other Pull Requests

  • SDK - Components - Temporary removed Kubernetes options from ComponentSpec (#4230) (9c16eff)
  • SDK - Compiler - Removed the deprecated dsl-compile --package command (#4055) (6bcb3ef)
  • SDK - Components - Python - Switched the default base image to python 3.7 (#4054) (090fffc)
  • Validate resourcekey to avoid apiserver being panic for invalid inputs (#3999) (6ced6ea)
  • [Backend] Bug fix: applying filter in listing versions (#4052) (3243f73)
  • better native-keras based sample (#3900) (842e8ce)
  • Metadata Writer - Added timeouts (#4037) (e808795)
  • Fix/log unavailable warning (#3848) (3c6f6db)
  • Metadata-Writer: Updates metadata writer to use mlmd 0.22.0 (#4027) (88d6da7)
  • Metadata Writer - Stopped using artifact properties (#4004) (4833d1a)
  • update refreshing mechanism (#3981) (efa5f1e)
  • enable pagination when expanding experiment in both the home page and the archive page (#4012) (8d34f6d)
  • Updated version to 1.0.0-rc.2 (0796340)
  • Cache - Deployer should check whether the secret is installed (#3992) (c60a046)
  • [Manifest] Apply kustomize best practices to standalone manifest (#3978) (7339da0)
  • Update Dataflow component _client.py to use projects.locations.templates API endpoint (#3851) (0e7c05c)
  • SDK - Compiler - Made compiler compatible with @wraps (#3956) (8d19aa8)
  • [Backend] Filter run on status (#3959) (3d41d5d)
  • Fix #3906 - mount_pvc transform should ignore non-ContainerOps (#3912) (e7beae4)
  • SDK - Compiler - Using properly serialized pipeline parameter defaults (#3832) (692b244)
  • Bump websocket-extensions from 0.1.3 to 0.1.4 in /frontend (#3929) (c69f097)
  • Only pending or running workflows are considered not-final (#3940) (#3957) (b021b7c)
  • Remove version from generated python client header comment (#3948) (19ff1b2)
  • Automated cherry pick of #3926: Add Bobgy to OWNERS (#3949) (f7623db)
  • fix length (#3934) (#3946) (524e162)
  • [Release] Fix $(cat VERSION) not in bash script (#3924) (#3925) (7d1de12)
  • [Release] Fix missing $TAG_NAME in .cloudbuild.yaml (#3921) (f9bcbbb)
  • [Release] Various fixes to release script (#3918) (105d43d)
  • Updated version to 1.0.0-rc.1 (2384d8f)
  • Update VERSION to 1.0.0-rc.1 (51c349b)
  • [Release] Regenerate api clients on release (#3910) (04e23d2)
  • Fix build failure because wcwidth LICENSE url changed (#3909) (8ba895d)
  • Docs - Moved the kfp_server_api documentation to a separate page (#3899) (180f0c5)
  • [API] Add license header to python api client files (#3897) (4f34be6)
  • [Release] Automate release script for all the changes (#3777) (c517fc5)
  • Regenerate clients after proto description fix (#3895) (7dfb34e)
  • Docs - Added docs for kfp_server_api.models (#3898) (c67bc7b)
  • [Python Client] Use openapi generator instead of swagger (#3872) (36eba13)
  • fix typo on sort order: 'des' --> 'desc' (#3893) (5d302b6)
  • [Samples] Change the data url to point to ml-pipeline instead of ml-pipeline-playground (#3890) (88ee54f)
  • Move the minio artifact download under try block (#3889) (a7be049)
  • Adds job_id parameter. (#3850) (58f1d13)
  • Fix the missing description in the CreatePipelineAPI (#3754) (b63dd3f)
  • SDK - Client - Use temporary directory context for pipeline package (#3878) (cd8a913)
  • Components - Added the pipeline component repository marker file (#3883) (4ce78dd)
  • SDK - Normalize line endings when calculating component hash (#3882) (da5f86e)
  • SDK - Components - Stabilize JSON serialization by sorting keys (#3879) (f773b9c)
  • [Backend] Fix user identity extraction logic in getUserIdentity() (#3842) (b23e1b4)
  • More documentation on backend API methods (#3758) (2864925)
  • Generate clickable artifact url for s3 URI (#3531) (3cae116)
  • SDK - Tests - Fixed the test_func_to_container_op_with_imported_func2 test case (#3837) (3010e85)
  • [AWS SageMaker] Add working FSx setup and test (#3831) (37a6363)
  • [SDK] Add first party component label (#3861) (1e2b9d4)
  • SDK - Python Components - Stop generating output saving code if no outputs (#3836) (da4acbb)
  • re-enable upgrade test since 0.5.2 is cut (#3696) (da1bc69)
  • fixing case when status is None (#3865) (58ff65f)
  • Modify docstrings to replace 'InitContainer' to 'UserContainer' (#3863) (699ce93)
  • Testing - Fixed SDK Travis tests (#3838) (0e59b68)
  • Components - Apache Parquet converters (#3834) (d737c44)
  • Kfserving component service account option (#3852) (8d738ea)
  • Cleanup - Removed unused code file (#3864) (f7acb71)
  • Testing - Using Argo validation in Travis tests (#3123) (7d94de1)
  • [AWS SageMaker] Add more unit tests (#3783) (b503050)
  • Testing - Handling spaces in paths in the component file loading test (#3856) (695573d)
  • revert the fix in proxy-agent (#3845) (cc46bef)
  • Components - XGBoost (#3843) (2d26a4c)
  • Datasets - Added Chicago Taxi Trips dataset (#3775) (5e3d9aa)
  • Add labels to plots (#3811) (76f7476)
  • A more accurate grpc error code for duplicate pipeline/pipeline version/experiment names (#3846) (ef73aab)
  • Added README for Amazon SageMaker Components for Kubeflow Pipelines (#3824) (3fe9b7e)
  • Components - Moved TFX components to deprecated directory (#3854) (5b50de0)
  • [AWS SageMaker] Integration Test for AWS SageMaker GroundTruth Component (#3830) (fb54953)
  • Testing - Pin numpy version to fix TFX installation instability in Travis tests (#3833) (9f1c596)
  • [UI] Also cloning recurring run schedule, fixes #3761 (#3840) (508f31a)
  • Client - Allow specifying pipeline description when uploading (#3828) (e52481a)
  • Adding HPO unit test (#3791) (bbe598d)
  • Docs - Added kfp.dsl placeholders to docs (#3813) (43ce639)
  • [UI] Fix confusion matrix wrong axes (#3817) (0199de0)
  • AWS SageMaker : Use IAM Roles for Service Account (#3719) (d18ad7a)
  • Add the 'kfp experiment' commands (#3705) (291f5b3)
  • [AWS SageMaker] Integration tests automation (#3768) (f2a860b)
  • Client - Added documentation for the generated members (#3787) (4a961ce)
  • Changing the default volume size to 30 (#3792) (6e2a55c)
  • Infer artifact store endpoint in metadata writer (#3530) (a764405)
  • [ScheduledWorkflow] Fix events permission missing (#3785) (53d35dd)
  • Allow PipelineParams in dict keys too. (#3565) (ec9445a)
  • [Backend] Make user identity header configurable (#3772) (9f8803e)
  • SDK - Tests - Use relative imports (#3784) (92394f6)
  • [Manifest] Use kustomize native image transformer to override image (#3776) (39805ac)
  • fix(testing) - Fix "1.14.10-gke.27" is unsupported (#3781) (205ca79)
  • SDK - Moved the tests closer to the code (#3774) (1dcea49)
  • SDK - Components - Removed the deprecated _python_op.get_default_base_image and set_default_base_image functions (#3773) (55d41df)
  • Add more approvers in AWS sagemaker components (#3740) (af4e8ef)
  • AWS Sagemaker Components - enhance integration test coverage (#3720) (bff8392)
  • SDK - Moved some data from the component_ref annotation to the component_spec annotation (#3751) (92a0d11)
  • manual merge as the change it self is correct (3d2c6ea)
  • Add probes to metadata grpc service (#3765) (61960ef)
  • [Servers] Add liveness and readiness probes (#3757) (f0c8eff)
  • Components - Tensorboard visualization (#3760) (0f40372)
  • [AWS SageMaker] Unit tests for Training component (#3722) (ddd1969)
  • SDK - Components - Improved stability of the input and output renaming (#3738) (d418f57)
  • [UI Server] Refactor for configurable auth header (#3753) (5435e87)
  • Metadata Writer - Preserve all Argo artifact information (#3725) (81dd6a2)
  • [UI] Show tooltip on long version names (#3750) (bb0c4d9)
  • [UI] Fix artifact preview with outdated content (#3749) (06cd029)
  • SDK - Made outputs with original names available in ContainerOp.outputs (#3734) (8ba366b)
  • SDK - Components - Calculate component hash digest (#3726) (fe30d54)
  • [UI] Wrap parameter/urls on overflow (#3747) (bd4be88)
  • Show version tag in UI (#3743) (e8356bc)
  • Fix bug in #3707 - href should show full artifact content instead of preview (#3745) (e57a619)
  • [Backend] Allow capital letters and underscore in metric names (#3741) (5740535)
  • Upgraded Argo to v2.7.5 (#3537) (e83bd7d)
  • [AWS SageMaker] Specify component input types (#3683) (bd8c1dd)
  • SDK - Prioritize lib2to3 when stripping type annotations (#3724) (b9aa106)
  • Travis - Use latest pip version (#3732) (84cd01a)
  • SDK - Annotate pods with component_ref (#3727) (2279bde)
  • Travis - Made flake8 test optional (#3739) (21e8ef1)
  • [frontend] Show artifact preview in UI (#2172) (#3707) (30345d1)
  • [UI] Make visualization tab easier to understand (#3717) (b1c9976)
  • When patching the {{}} placeholder in parameter, check for possible nil pointer (#3714) (d2c784a)
  • remove an accidentally committed debugging log (#3716) (fe01908)
  • Fixed small syntax error in a sample notebook (#3721) (d4cd70d)
  • [UI] Cleanup, remove types from urls in artifact/execution details page (#3715) (cb41f7a)
  • [UI] Hide empty resource op manifest tab in run details page (#3713) (c5ceaf5)
  • [UI] Improve TFX artifact visualization speed (#3712) (eab5d31)
  • 0.5.1 changelog (#3706) (54c490c)
  • Integration tests for AWS SageMaker Components (#3654) (6beab22)
  • [UI] textbox to select KSA when creating runs/jobs (#3651) (e5bd2df)

0.5.1 (2020-05-07)

Full Changelog

Detailed PR can be found here

0.4.0 (2020-04-07)

Full Changelog

Merged pull requests:

  • Release
  • Release eb69a6b8ae #3466 (numerology)
  • Cache
  • SDK - Components - Fixed bug in loading input-less graph components #3446 (Ark-kun)
  • AWS Sagemaker : Updated documents #3440 (akartsky)
  • Refactor the legacy way of using pipeline id to create run in KFP backend #3437 (jingzhang36)
  • Backend
  • Fix
  • Manifest
  • Backend
  • SDK
  • Update deployment resource version from /v1beta1 -> /v1 #3421 (NikeNano)
  • SDK
  • revert kfp-cache from Hosted/MKP #3416 (rmgogogo)
  • Manifest
  • quick fix envoy proxy service name #3413 (rmgogogo)
  • Backend
  • enable native Keras + TFMA #3409 (rmgogogo)
  • Fix presubmit failure by avoiding license downloading when building image #3406 (Bobgy)
  • Testing - Upgraded GKE master version to fix tests #3404 (Ark-kun)
  • UI
  • Add new instructions to ensure compatibility for managed ai platform … #3400 (luotigerlsx)
  • AWS sagemaker : Added license files and updated Dockerfile to use AmazonLinux #3397 (akartsky)
  • Fix lstrip with regex bug in the KFP client #3396 (sngahane)
  • Sample
  • Backend
  • enable CloudSQL+GCSObjStore without default credential #3378 (rmgogogo)
  • Manifest
  • AWS sagemaker : Make 'endpoint_url' argument default to None instead of empty string #3374 (akartsky)
  • Backend
  • Test
  • pass token outside of SDK for server-to-server case #3363 (rmgogogo)
  • Integration test fix #3357 (rmgogogo)
  • Fix Tensorboard viewer image parsing #3356 (rafaelbarreto87)
  • UI
  • Backend
  • UI
  • UI
  • Update CHANGELOG for 0.3.0 #3349 (neuromage)
  • Fix README formatting. #3348 (neuromage)
  • Manifest
  • Backend
  • SDK/CLI
  • Manifest
  • Backend
  • UI Server
  • Testing
  • Add hostNetwork for marketplace proxy-agent manifest #3330 (Bobgy)
  • SDK - Tests - Improved tests for serializing lists containing objects #3326 (Ark-kun)
  • SDK - Added pinned dependency snapshot #3303 (Ark-kun)
  • SDK
  • Post-submit test for Hosted/MKP mpdev verify #3193 (rmgogogo)
  • apiserver: Handle BucketExists() error #3132 (discordianfish)
  • Manifests: Rename metadata gRPC server's resources to metadata-grpc-* #3108 (elikatsis)
  • Sample
  • Frontend

0.3.0 (2020-03-23)

Full Changelog

Merged pull requests:

0.2.5 (2020-02-27)

Full Changelog

Merged pull requests:

0.2.4 (2020-02-20)

Full Changelog

Merged pull requests:

  • Sample
  • Sample
  • UI
  • Visualization
  • bump version to 0.2.4 and tiny BTW doc fix #3115 (rmgogogo)
  • UI
  • TFMA auto-visualization for TFX components in KFP #3111 (jingzhang36)
  • SDK - Components - Fixed dict-style type annotations #3107 (Ark-kun)
  • ml_engine component READMEs incorrect #3103 (TheMichaelHu)
  • Lineage
  • Remove pinning avro-python3, because it is already fixed #3096 (Bobgy)
  • SDK - Compiler - Add optional Argo validation #3094 (Ark-kun)
  • XGBoost demo - change quota calculation #3093 (SinaChavoshi)
  • Doc
  • SDK - Fixed the broken kfp.gcp.use_preemptible_nodepool extension #3091 (Ark-kun)
  • Fix api generation script #3090 (chensun)
  • enable tfdv, remove hardcode as a sample for following PRs #3089 (rmgogogo)
  • UI
  • Pin Pyarrow version to 0.15.1 after we upgrade to use tfdv 0.21.1 #3083 (jingzhang36)
  • UI
  • Community
  • Samples - Add explanation about pipeline failing intentionally #3076 (Ark-kun)
  • Controller
  • update version from 0.2.2 to 0.2.3 for kfp #3072 (jingzhang36)
  • Component
  • XGBoost demo - Removing unnecessary parameters and adding quota check. #3049 (SinaChavoshi)
  • Backend - Removed Tensorflow from backend WORKSPACE #2856 (Ark-kun)

0.2.3 (2020-02-13)

Full Changelog

Merged pull requests:

0.2.2 (2020-02-05)

Full Changelog

Merged pull requests:

0.2.1 (2020-02-02)

Full Changelog

Merged pull requests:

0.2.0 (2020-01-20)

Full Changelog

Merged pull requests:

0.1.40 (2020-01-09)

Full Changelog

Merged pull requests:

0.1.39 (2020-01-06)

Full Changelog

Merged pull requests:

  • release 0.1.39 #2799 (gaoning777)
  • Testing
  • SKL - DSL - Stabilized the PipelineVolume names #2794 (Ark-kun)
  • Testing
  • UI
  • Clean-up
  • Sample tests
  • Manifest
  • Components
  • Manifest
  • Use new K8s version to improve workload identity stability #2777 (Bobgy)
  • Fix vscode README of prettier integration #2776 (Bobgy)
  • Sample
  • UI
  • Standalone
  • Update version in generate_api.sh #2770 (jingzhang36)
  • UI
  • Adjust the namespace for Delete/Terminate/Retry run APIs #2765 (gaoning777)
  • update release changelog #2763 (gaoning777)
  • Component
  • Add min and max lines for displaying json editor #2752 (fenglixa)
  • Frontend
  • Add step by step tutorial using mnist as use case #2716 (luotigerlsx)
  • SDK/compiler
  • Support choosing tensorboard version from UI #2690 (dldaisy)
  • SDK - Unified the function signature parsing implementations #2689 (Ark-kun)
  • support extra parameters for mysql connection #2668 (xaniasd)
  • End to end mnist pipeline use case #2628 (hougangliu)

0.1.38 (2019-12-19)

Full Changelog

Merged pull requests:

0.1.37 (2019-12-05)

Full Changelog

Merged pull requests:

0.1.36 (2019-11-26)

Full Changelog

Merged pull requests:

0.1.35 (2019-11-13)

Full Changelog

Merged pull requests:

0.1.34 (2019-11-07)

Full Changelog

Merged pull requests:

0.1.33 (2019-11-02)

Full Changelog

Merged pull requests:

0.1.32 (2019-10-18)

Full Changelog

Merged pull requests:

  • Update sdk release version #2434 (hongye-sun)
  • Release e9b96de317 #2433 (hongye-sun)
  • Frontend
  • Frontend
  • SDK - DSL - Make is_exit_handler unnecessary in ContainerOp #2411 (Ark-kun)
  • Frontend
  • tech writer edits #2403 (jay-saldanha)
  • Test/Sample test
  • Update Watson ML default framework version #2398 (Tomcli)
  • Add Tomcli as kfs component reviewer #2396 (Tomcli)
  • License crawler for third party golang libraries #2393 (Bobgy)
  • quick custom spec fix #2390 (animeshsingh)
  • add test config comment #2389 (gaoning777)
  • Remove jingzhang36 and rmgogogo from frontend reviewer list #2388 (Bobgy)
  • enable the check for dataflow #2387 (gaoning777)
  • Update samples/core/tfx-oss to tfx==0.14.0 and kfp=0.1.31 #2385 (ucdmkt)
  • Sample
  • move favicon path, root is override by inverse proxy #2382 (rmgogogo)
  • Frontend
  • add animesh to the approvers of the kfserving #2380 (gaoning777)
  • SDK - Added version #2374 (Ark-kun)
  • tech writer edits #2373 (jay-saldanha)
  • Samples
  • Frontend
  • KFServing move to v1alpha2 #2369 (animeshsingh)
  • Components - Updated the gcp dataproc create_cluster component image #2366 (Ark-kun)
  • Doc
  • Sample
  • add cloud-platform scope in the test to reclaim the ai platform sample models #2355 (gaoning777)
  • Fix potential issue of the ai platform sample when running it in the ai platform notebook #2349 (gaoning777)
  • Typo in Data passing in python components.ipynb #2347 (pingsutw)
  • Test
  • SDK - Python components - Fixed handling multiline decorators #2345 (Ark-kun)
  • License
  • Fix pipeline cannot run bug when using marketplace managed storage #2341 (Bobgy)
  • enlarge MKP cluster constraint #2339 (rmgogogo)
  • Add pipeline version api methods #2338 (jingzhang36)
  • tech writer edits #2331 (jay-saldanha)
  • Add sample test for multiple output #2328 (gaoning777)
  • add ai_platform test #2327 (gaoning777)
  • Tests - When testing SDK install it using pip #2325 (Ark-kun)
  • tech writer edits #2324 (jay-saldanha)
  • SDK - Compiler - Added the component spec annotations to the compiled workflow #2323 (Ark-kun)
  • SDK/Compiler
  • Sample
  • SDK - Containers - Made python package installation more robust #2316 (Ark-kun)
  • Extend KFServing component with autoscaling and server mode #2315 (Tomcli)
  • SDK - Tests - Test creating component from the real AutoML pipeline #2314 (Ark-kun)
  • tech writer edits #2313 (jay-saldanha)
  • MKP/doc
  • MKP
  • SDK/DSL: ContainerOp.add_pvolume - Fix volume passed in add_volume #2306 (elikatsis)
  • Frontend
  • SDK - Compiler - Fixed deprecation warning when calling compile #2303 (Ark-kun)
  • tech writer edits #2301 (jay-saldanha)
  • Component
  • SDK - Compiler - Fix bugs in the data passing rewriter #2297 (deepio-oc)
  • Add CMLE deploy comment missing parameters #2296 (hongye-sun)
  • Samples - Simplified pipeline submission code in samples #2293 (Ark-kun)
  • SDK - Client - Added a way to set experiment name using environment variables #2292 (Ark-kun)
  • tech writer edits #2291 (jay-saldanha)
  • MKP
  • fix for MKP #2288 (rmgogogo)
  • tech writer edits #2285 (jay-saldanha)
  • Disable cloudsql and update to v0.1.31 #2284 (rmgogogo)
  • tech writer edits #2282 (jay-saldanha)
  • Remove usage of deprecated ContainerOp methods in use_gcp_secret #2280 (andrewsmartin)
  • Samples - Switched the build_component sample to the new container API #2279 (Ark-kun)
  • Components - Added the "AutoML Export data to GCS" component #2278 (Ark-kun)
  • SDK - Components - Deprecated build_python_component #2277 (Ark-kun)
  • SDK - Containers - Deprecated build_docker_image #2276 (Ark-kun)
  • Refactor resource op sample for sample test coverage #2274 (numerology)
  • SDK - Components - Creating graph components from python pipeline function #2273 (Ark-kun)
  • SDK - Components - Verify the object type when serializing primitive arguments #2272 (Ark-kun)
  • SDK - Compiler - Make it possible to create more portable pipelines #2271 (Ark-kun)
  • SDK - Components - Reorganized TaskSpec execution options #2270 (Ark-kun)
  • SDK - Components - Fixed small bugs in graph component resolving #2269 (Ark-kun)
  • SDK - Notebooks - Deprecated the docker magic #2266 (Ark-kun)
  • SDK - Components - component_ref.name should only be set when component was loaded by name #2265 (Ark-kun)
  • SDK - Components - Added the ComponentSpec.save method #2264 (Ark-kun)
  • Components - Removed trailing whitespace from AutoML components code #2263 (Ark-kun)
  • SDK - Components - Restored attribute order when generating component.yaml files #2262 (Ark-kun)
  • SDK - Lightweight - Convert the names of file inputs and outputs #2260 (Ark-kun)
  • SDK - Compiler - Fixed small bug in data passing rewriter #2259 (Ark-kun)
  • Samples - Added the data passing tutorial #2258 (Ark-kun)
  • SDK - Components - Deprecate the get and set methods for default image in favor of plain variable #2257 (Ark-kun)
  • SDK - Containers - Getting namespace lazily #2256 (Ark-kun)
  • remove default namespace #2250 (SinaChavoshi)
  • SDK - Lightweight - Added package installation support to func_to_container_op #2245 (Ark-kun)
  • SDK: fix label check for ContainerOP entities #2243 (solovyevt)
  • Update doc for MKP release #2242 (rmgogogo)
  • Update changelog for release 0.1.31. And also for 0.1.30 and 0.1.29, whose are not added before #2232 (jingzhang36)
  • SDK - Compiler - Move Argo volume specifications to templates #2229 (Ark-kun)
  • Updated README Swagger CodeGen version #2228 (RedbackThomson)
  • SDK - Components - Fix - Stop serializing string values #2227 (Ark-kun)
  • third_party/metadata_envoy: Modify license file #2224 (dushyanthsc)
  • SDK/Client
  • Sample
  • Component
  • SDK - Containers - Added support for container image cache #2216 (Ark-kun)
  • Add third party license + source code to argo and minio images to comply with their license #2201 (Bobgy)
  • SDK - Moved the _container_builder from kfp.compiler to kfp.containers #2192 (Ark-kun)
  • Added the backend Go module cache to .gitignote #2190 (Ark-kun)
  • Docs - Added the direct kfp module members to documentation #2183 (Ark-kun)
  • Components - Added AutoML Tables components and tests #2174 (Ark-kun)
  • GUI: should pop-up a correct info when delete more than one pipeline #2156 (QxiaoQ)
  • SDK-compiler
  • Add necessary data types to api and database to support pipeline version. #1873 (jingzhang36)
  • SDK - Hiding Argo's workflow.uid placeholder behind DSL #1683 (Ark-kun)
  • Allows uploading a pipeline in new run form #1643 (rileyjbauer)
  • SDK - Improve errors when ContainerOp.output is unavailable #1578 (Ark-kun)
  • Use Remote Build Execution for Bazel builds. #1031 (neuromage)

0.1.31 (2019-09-25)

Full Changelog

Merged pull requests:

0.1.30 (2019-09-13)

Full Changelog

Merged pull requests:

  • update sdk versions #2100 (gaoning777)
  • Fix the logic of passing default values of pipeline parameters. #2098 (numerology)
  • feature parity between notebook sample and normal sample #2095 (gaoning777)
  • Remove broken environment variables in namespace install #2087 (IronPan)
  • gcp-marketplace: Updating metadata deployment to use gRPC server #2083 (dushyanthsc)
  • Expose an API for appending params/names/descriptions in a programmable way. #2082 (numerology)
  • Expose DB username to marketplace schema.yaml #2079 (IronPan)
  • Use GCSHelper to upload test result #2078 (numerology)
  • Fix sample test result upload failure. #2077 (numerology)
  • Add cmle tpu sample link #2074 (gaoning777)
  • Make wget quieter #2069 (Ark-kun)
  • Store DB password as K8s secret for marketplace deployment #2067 (IronPan)
  • Chang object store naming for marketplace deployment #2066 (IronPan)
  • fixes name inconsistency for marketplace manifest and bump kfp version #2065 (IronPan)
  • Release - Fixed the deprecated component image build #2063 (Ark-kun)
  • Release - Creating the release branch from the specified commit #2062 (Ark-kun)
  • manifests/metadata: Metadata server invocation change #2041 (dushyanthsc)
  • Improve notebook check automation #2040 (numerology)
  • Add parameter for service account credential #2039 (IronPan)
  • SDK - Testing - Run some unit-tests in a more correct way #2036 (Ark-kun)
  • Add warning message when there are empty parameters in NewRun.tsx #2016 (ajchili)
  • Fix bug where source and variables are not accessible to visualization #2012 (ajchili)
  • SDK - Stop adding empty descriptions and inputs #1969 (Ark-kun)

0.1.29 (2019-09-07)

Full Changelog

Merged pull requests:

  • Add execution list and details pages #2059 (rileyjbauer)
  • update sample readme for the new structure #2058 (gaoning777)
  • Adds Metadata Artifacts to UI #2057 (rileyjbauer)
  • SDK - Compiler - Failing when PipelineParam is unresolved #2055 (Ark-kun)
  • Removing ResNet-CMLE sample #2053 (SinaChavoshi)
  • Refactor kfp.compiler for better modularity #2052 (numerology)
  • SDK - Compiler - Stopped adding mlpipeline artifacts to every compiled template #2046 (Ark-kun)
  • SDK - Components - Hiding signature attribute from CloudPickle #2045 (Ark-kun)
  • SDK - Compiler - Fixed dsl.Condition when parameter resolves to string with spaces #2043 (Ark-kun)
  • SDK - Compiler - Fixed handling of PipelineParams in artifact arguments #2042 (Ark-kun)
  • SDK - Testing - Make dsl and compiler tests discoverable by unittest #2038 (Ark-kun)
  • Fix Local Development Quickstart sample #2037 (numerology)
  • SDK - Refactoring - Reduced the usage of dsl.Pipeline context #2034 (Ark-kun)
  • move old gcp components to deprecated folder #2031 (gaoning777)
  • add more core samples in the sample test #2030 (gaoning777)
  • Add guideline for including a sample in sample test #2026 (numerology)
  • SDK: fix setting pipeline-wide artifact_location for ResourceOp and VolumeOp classes and add description field for create_experiment() function #2025 (solovyevt)
  • update service account for non managed storage case #2023 (IronPan)
  • update release cb yaml #2022 (IronPan)
  • Add readme and update application parameter #2021 (IronPan)
  • Extend E2E tests: Add VolumeOp test #2019 (elikatsis)
  • SDK/DSL: Fix bug when using PipelineParam in pvc of PipelineVolume #2018 (elikatsis)
  • api: fix generate_api.sh script with bash shebang #2017 (yanniszark)
  • SDK - Components - Enable loading graph components #2010 (Ark-kun)
  • Change schema.yaml to v2 #2009 (IronPan)
  • fix cb for release #2008 (IronPan)
  • speed up cb for merged pr #2007 (IronPan)
  • remove the bigquery components to fabvor the new gcp components #2006 (gaoning777)
  • update release CB to copy images to marketplace compliant location #2005 (IronPan)
  • Changed isVisualizationServiceAlive implementation to not block API server startup #2004 (ajchili)
  • Improve visualization server docker image #2003 (ajchili)
  • Fix ROC Curve visualization argument placeholder #2002 (ajchili)
  • Add schema validation for sample test config yaml #2000 (numerology)
  • pass pipeline runner service account to api server #1996 (IronPan)
  • SDK - Components - Added type to TaskOutputReference #1995 (Ark-kun)
  • add connection for inverse proxy #1993 (IronPan)
  • SDK - Components - Added output references to TaskSpec #1991 (Ark-kun)
  • Testing - Fixed the comparison bug in presubmit test script #1990 (Ark-kun)
  • Print cloud build logs when the task fails #1989 (Bobgy)
  • move pipeline runner service account to backend #1988 (IronPan)
  • Change sample test to read test arguments from yaml config file #1987 (numerology)
  • Disable TFMA visualization #1986 (ajchili)
  • Refactor tedious redefinition using withItem. #1985 (numerology)
  • Remove service account from helm chart #1983 (IronPan)
  • SDK - Tests - Fixed bug in the Artifact location test pipeline #1982 (Ark-kun)
  • Add e2e visualization tests #1981 (ajchili)
  • update kubeflow pipelines application name #1980 (IronPan)
  • Add generated client from visualization swagger #1979 (ajchili)
  • Add CRD admin permission to deployer SA #1977 (IronPan)
  • Remove stdout/stderr from predefined visualization #1976 (ajchili)
  • Update GCP marketplace deployer dockerfile #1975 (IronPan)
  • Fix JavaScript and CSS loading issue with table visualization #1974 (ajchili)
  • manifest/metadata: Switching to use metadata grpc server #1973 (dushyanthsc)
  • Fix python syntax of TFMA visualization #1972 (ajchili)
  • SDK - Containers - Build python container image based on current working directory #1970 (Ark-kun)
  • SDK - Components - Only yaml component files can be used as source #1966 (Ark-kun)
  • SDK - Verifying that the serializer returns string #1965 (Ark-kun)
  • test/project-cleanup - fix #1964 (dushyanthsc)
  • Refactor run_sample_test.py script into python class #1963 (numerology)
  • Add travis CI for new unit test. #1960 (numerology)
  • Add frontend support for Python based visualizations #1959 (ajchili)
  • Test infra - Fixed the batch Prow tests #1958 (Ark-kun)
  • 1953: added missed target_image parameter to build_docker_image method #1955 (pahask8)
  • minor fix for tfx oss readme #1954 (gaoning777)
  • Bug fix and add unit test for sample-test/utils.file_injection #1952 (numerology)
  • Fix support for custom visualizations #1951 (ajchili)
  • Fix the missing argument of re.sub #1948 (numerology)
  • Refactor check_notebook_results.py into python module. #1947 (numerology)
  • SDK - Components - Add support for the Base64Pickle type #1946 (Ark-kun)
  • SDK - Components - Add support for the List, Dict and Json types #1945 (Ark-kun)
  • SDK - Compiler - Deprecated dsl-compile --package #1941 (Ark-kun)
  • Move postsubmit tests to lite deployment #1939 (Bobgy)
  • SDK - Components - Setting default base image or image factory #1937 (Ark-kun)
  • SDK - Components - Add support for the Boolean type #1936 (Ark-kun)
  • Update changelog for 0.1.27 #1935 (hongye-sun)
  • SDK - Components - Improved serialization and deserialization of arguments and defaults #1934 (Ark-kun)
  • sync namespaced install file #1932 (IronPan)
  • Add endpoint to allow custom visualizations #1931 (ajchili)
  • SDK - Refactoring - Replaced the TypeMeta class #1930 (Ark-kun)
  • Add custom visualization support for Python based visualizations #1929 (ajchili)
  • clean up owner file #1928 (IronPan)
  • Add pipeline id to pipeline summary card #1927 (ajchili)
  • Exclude visualization types from flake8 testing #1925 (ajchili)
  • Use cloud build to build images instead #1923 (Bobgy)
  • upgrade backend image versions #1918 (hongye-sun)
  • reduce taxi and xgboost test data to speed up sample test #1917 (gaoning777)
  • versioned the 0.13.0 tfx example #1912 (gaoning777)
  • Sample test improvement - using python fire to launch sample test #1897 (numerology)
  • SDK - Switching python container components to Lightweight components code generator #1889 (Ark-kun)
  • Support Affinity for ContainerOps #1886 (hamedhsn)
  • WithItems Support #1868 (kevinbache)
  • Added README.md for Python based visualizations #1853 (ajchili)
  • Initial kfserving pipeline component #1838 (animeshsingh)
  • SDK - Components - Added component properties to the task factory function #1771 (Ark-kun)
  • add GCP marketplace application manifest for kubeflow pipelines #1621 (IronPan)
  • SDK - Added kfp.run_pipeline_func_on_cluster function alias #1521 (Ark-kun)
  • SDK - Skip attributes with missing values during PipelineMeta serialization #1448 (Ark-kun)
  • SDK - Added support for raw input artifact argument values to ContainerOp #791 (Ark-kun)

0.1.27 (2019-08-22)

Full Changelog

Merged pull requests:

  • update namespaced-install.yaml #1926 (IronPan)
  • Fix lint related issue #1922 (numerology)
  • Cleanup pipeline-lite deployment #1921 (IronPan)
  • Allow visualization kernel timeout to be specifiable via environment variables #1920 (ajchili)
  • Release 151c5349f1 #1916 (hongye-sun)
  • cleanup test directory #1914 (IronPan)
  • SDK - Airflow - Fixed bug in AirFlow op creation #1911 (Ark-kun)
  • Add cloud sql and gcs connection for pipeline-lite deployment #1910 (IronPan)
  • Enable error propagation from nbconvert to frontend #1909 (ajchili)
  • remove tfx notebook sample in favor of the TFX OSS sample #1908 (gaoning777)
  • front-end-server
  • Change the type of resource reference payload column #1905 (IronPan)
  • apiserver: Remove TFX output artifact recording to metadatastore #1904 (dushyanthsc)
  • remove kubeflow training to favor tfx components #1902 (gaoning777)
  • Add TFDV, TFMA, and Table visualization support for Python based visualizations #1898 (ajchili)
  • Add run with json data as input within fixed-data.ts for UI testing and development #1895 (ajchili)
  • Use single part as default #1893 (IronPan)
  • fix unit tests and address some comments #1892 (gaoning777)
  • Replace codemirror editor react component with react-ace editor component #1890 (ajchili)
  • Simplified the build_docker_image function #1887 (Ark-kun)
  • IBM Watson samples: from six.moves import xrange #1877 (cclauss)
  • Undefined name 'e' in openvino #1876 (cclauss)
  • SDK - Lightweight - Fixed custom types in multi-output case #1875 (Ark-kun)
  • SDK - Components - Fixed ModelBase comparison bug #1874 (Ark-kun)
  • Update changelog for 0.1.26 #1872 (neuromage)
  • Remove copying of tfx data for cloudbuild release steps. #1871 (neuromage)
  • Update manifests to point to 0.26 release. #1870 (neuromage)
  • add compile step in the samples to generate zip files #1866 (gaoning777)
  • Update Python SDK versions for release. #1860 (neuromage)
  • test/project-cleanup: Support to cleanup gke-clusters in test project #1857 (dushyanthsc)
  • Created extensible code editor based on react-ace #1855 (ajchili)
  • Add visualization-server service to lightweight deployment #1844 (ajchili)
  • SDK - Tests - Improved the "ContainerOp.set_retry" test #1843 (Ark-kun)
  • pipeline-lite: Introduce metadata component to pipeline-lite #1840 (dushyanthsc)
  • Bug Fix
  • Use KFP lite deployment for presubmit tests #1808 (Bobgy)
  • SDK - Fixed string comparisons #1756 (Ark-kun)
  • 'core' folder included to parameters related On-Premise cluster #1751 (olegchorny)
  • Refactor presubmit-tests-with-pipeline-deployment.sh to run in other projects #1732 (Bobgy)
  • Lint Python code for undefined names #1721 (cclauss)
  • Let backend apiserver mysql dbname configurable #1714 (jwwandy)
  • gcp cred bug fix for multiple credentials in single pipeline #1384 (aakashbajaj)
  • Collecting coverage when running python tests #898 (Ark-kun)

0.1.26 (2019-08-16)

Full Changelog

Merged pull requests:

0.1.25 (2019-07-26)

Full Changelog

Merged pull requests:

0.1.24 (2019-07-12)

Full Changelog

Merged pull requests:

0.1.23 (2019-06-26)

Full Changelog

Merged pull requests:

0.1.22 (2019-06-21)

Full Changelog

Merged pull requests:

0.1.21 (2019-05-29)

Full Changelog

Merged pull requests:

0.1.20 (2019-05-14)

Full Changelog

Closed issues:

  • Cannot create job for experiment via Pipelines Go CLI #1321
  • Support a container flow inside one pod #1313
  • toleration support for ContainerOp #1265
  • Can only create recurring run from within experiment page #1217

Merged pull requests:

0.1.19 (2019-05-03)

Full Changelog

Closed issues:

  • Unfinished run duration shown as negative time #1236
  • Release the SDK in Pypi and automate the release process #1233
  • The post-submit test always fails #1228
  • docker magic command should print kaniko pod logs #924
  • Kubeflow Pipeline conditionals should be able to handle multiple output parameters #679

Merged pull requests:

0.1.18 (2019-04-26)

Full Changelog

Closed issues:

  • sample "DSL Static Type Checking" link to types needs to be updated #1220
  • Update the SDK version automatically during the release #1190
  • Bug: Unable to delete recurring run configs in UI #1181
  • Add integration test for filtering #1155
  • Pipeline submission fails when ContainerOp has numbers as command line arguments #1121
  • Add SDK support for sidecars #949
  • Missing PullPolicy for ContainerOp #832
  • Extend the DSL with support for Persistent Volumes and Snapshots #801
  • Use GCP credentials for existing samples #418
  • Does pipelines only support on GKE? And the workflow run with some problem. #365
  • Remove experiment column from runs list inside experiment #222
  • Support all container APIs through container op #204

Merged pull requests:

0.1.17 (2019-04-17)

Full Changelog

Closed issues:

  • Runs leaked into archived page #1150
  • Pagination broken in UI #1149
  • The number of members in the policy 1,503 is larger than the maximum allowed size 1,500 #1146
  • Backend Docker build fails with python error in resnet-train-pipeline.py #1142
  • Use range instead of pin for python dependencies for kfp #1134
  • Deploy a TFX pipeline from the command line #1127
  • CloudBuild is failing since the CMLE deployer component was deleted #1123
  • Failed to load the trained model using kubeflow deployer component #1102
  • Pipeline parameters should be accessible to pipeline logic #1099
  • Retrieve the experiment during list run #1084
  • Connect local notebook to remote Pipeline cluster #1079
  • How to support continuous online learning? #1053
  • When notebook submits a run and clicks the link they get "Error: failed to retrieve run:" #1017
  • Add static type checking sample test #974
  • Test coverage for runs without experiments #685

Merged pull requests:

0.1.16 (2019-04-06)

Full Changelog

Closed issues:

  • usage reporting link broken #1073
  • Exit handler task does not have proper name in the UX #1051
  • Remove link to JupyterHub from pipelines UI #1029
  • Invalid memory address or nil pointer dereference in metadata_store.go #1024
  • KFP SDK: suggest retry if pipeline launch returns 500 error 'warmup' apparently required #1007
  • Refactor the test infra code #875
  • Ability to stop runs #413
  • Surface the sample test results to github #361
  • feature ask: support for loops #303

Merged pull requests:

0.1.14 (2019-03-28)

Full Changelog

Closed issues:

  • Users should be able to add metadata to component.yaml #1013
  • Allow Python functions defined in a pipeline to be run as entrypoint for operations. #979
  • Unable to use TFJob in Kubeflow Pipeline, current dsl compiler have not support for TFJOBOP #973
  • Make the data generated by a pipeline step available before the pipeline step completes. #959
  • Kubeflow version vs Jupyter Hub Image Versions Confusion #948
  • Moving and retrieving logs from persistent volume #940
  • Use DL VM as default container for Notebooks. #911
  • Unable to delete service account in e2e tests #893
  • How to accessing the source code from Images #881
  • ModuleNotFoundError: No module named 'kfp' #872
  • Error regarding syncing workflow #869
  • Errors in the test logs #865
  • Switch default package format to .zip #854
  • How to deploy distribute training with tensorflow or pytorch with pipelines #848
  • Add option in DSL compiler to output YAML #834
  • Flaky presubmit step in build-scheduledworkflow-image #831
  • Pipeline view UX is completely blank #824
  • kfctl.sh apply platform #820
  • 500 Error Jupyter notebook #818
  • Move e2e tests out of us-central1-a #807
  • Are there plans to allow kubeflow pipelines to be created through a manifest file? #804
  • Support inline html in html viewer #795
  • Namespace "kubeflow" is "Terminating" forever #768
  • Kubeflow 0.4 still include argo UI #753
  • pipeline step failed with exit status code 2: failed to save outputs #750
  • Allow eventing in Kubeflow Pipelines #725
  • Can not use NFS volume for Tensorboard logs #708
  • Unschedulable: 0/2 nodes are available: 2 Insufficient cpu. #706
  • Pipeline upload via URL doesn't work when port-forwarding from cloud shell #700
  • Error running TF training job on KF 0.3.5 using GPUs #686
  • "Google Compute Engine does not have enough resources available to fulfill request: us-central1-a" #673
  • Add bigquery component in release #643
  • Pipeline notebook samples : "Install Pipeline SDK " error #610
  • Deployer component to output model URL #593
  • TFMA output is empty #592
  • Pending run step shown as error #591
  • UI dashboard needs to show the pipelines system version #590
  • CMLE/TFX failure: Exceeded the max allowed number of models per project: 100. #587
  • File output is too long #577
  • Deployment problem with private cluster #534
  • How to deploy distribute training with tensorflow #533
  • ERROR: gcloud.container.clusters.delete One of [--zone, --region] must be supplied: Please specify location.. #488
  • Support TPU in DSL #485
  • Show an error message for output viewers that can't fetch their data #479
  • Recurring runs create runs with an embedded pipeline spec, rather than id #475
  • Unable to visualize any HTML content with Output Viewer #473
  • Improve logic to preload sample pipeline #455
  • Add component metadata to the generated Argo YAML for consumption by the UI #452
  • Enable users to launch and manage multiple Tensorboard instances within kubeflow pipelines #443
  • Python SDK is not continuous integration friendly. #420
  • K8s 1.11 fails on generateName when upgrading pipelines #409
  • TFJob doesn't stop trainer jobs after a timeout #408
  • TFJob doesn't forward error logs from the jobs #407
  • Pipeline GCP sample components need to switch to default gcp ops #406
  • Permanent storage for pipeline system #395
  • Error installing package with ks #372
  • Pre-install samples via bootstrapper. #356
  • Backend should not rely on presence of samples. #355
  • deploy problem: 3 pvc like mysql not created at the script and not specified label selector #352
  • RESOURCE_EXHAUSTED: Maximum number of keys on account reached #348
  • TFX Components pipeline- Expanding model analysis artifact does not go full screen #341
  • Support for Argo artifacts #336
  • Cloud platform scope not carried through on autoscaling #332
  • Unclear how much cpu/memory actually available #330
  • uninstall failed, there are twenty pod has not been deleted #329
  • Conditions are not visualized properly #321
  • Container op should expose method to append volume/mount/envs #311
  • UI says "Successfully created new Run", but it isn't in the list #308
  • Error running pipeline: cannot create tfjobs.kubeflow.org 403 #294
  • Python DSL should support multiple storage options GCS, PVC, etc. #275
  • Modify container images so that they support multiple data store options depending on parameters #274
  • Add sample tests for notebooks #263
  • UI feature ask: Search experiments and runs #257
  • Containers should not be allowed to directly create K8s objects #254
  • GKE cluster creation warnings #253
  • Consider never deleting the runs #247
  • Our ksonnet sometimes throws "SIGSEGV: segmentation violation" failing deployment #241
  • Get experiment by name, create run in experiment by name #237
  • UI should display documentations for the steps of a pipeline #227
  • Missing dropoff latitudes #225
  • Tensorboard not showing historical AUC / Accuracy #223
  • Our tests fail on external PRs #215
  • We need automatic labels indicating whether an issue/PR is internal/external. #207
  • Support submitting runs from local machine #206
  • Make it easy for people to write pipeline tests in python #203
  • Tests are launched in doubles since Nov 09 18:30 #197
  • Tests sometimes run multiple times for the same commit creating multiple GKE clusters. #192
  • We have ~40 GKE clusters ~=100 instances running tests and our quotas are exhausted #191
  • Instruction for running it on minikube #184
  • feature request: restore the client method for creating a pipeline #175
  • Create GCS path checker component #170
  • feature request: in SDK support 'get_or_create_experiment()' #161
  • Pipeline API Server Swagger Client Go for Pipeline Create does not take a "name" parameter #123
  • Pipeline API Server Swagger Client Go for Pipeline Upload returns incomplete output #122
  • Fasten release process for the image tag update. #115
  • Persist pod logs after they finish #93
  • Need to add notebooks with end-to-end sample scenarios #80
  • After the user creates a run, redirect to the run page, not the runs list page. #64
  • Remember the page I was on #62
  • Doesn't remove old containers \> maxHistory #15
  • ScheduledWorkflow CRD: Investigate need for retries beyond the ones provided by Argo #5

Merged pull requests:

0.1.13 (2019-03-22)

Full Changelog

Closed issues:

  • bazel test command does not actually run tests #977
  • bazel build fails with fatal error: ares.h: No such file or directory #970
  • dsl.ContainerOp.after() only works with Ops that have already sanitized names #965
  • value in file_outputs is not being passed to input parameters correctly #957
  • Support Azure authentication for pipeline ops #953
  • CMLE
  • dependency analysis issue with 'component.yaml'-based ops #941
  • rename sample GCS path to fix model-name typo #936
  • GitHub checks have been enabled in this repo, but are not supported by Tide. #930
  • Cannot find module for path ml_metadata/metadata_store/mlmetadata #928
  • Pipeline name is not checked #825
  • Can not mount volume in Container op #477
  • Travis tests do not properly test what happens when the branch is merged. #431
  • Full solution to tests and code desync problem #200
  • Prow code, test image code and code being tested can still desync. #198
  • SDK/Components/Python - Functions that do not return anything #186

Merged pull requests:

0.1.12 (2019-03-06)

Full Changelog

Merged pull requests:

0.1.11 (2019-02-27)

Full Changelog

Closed issues:

  • ROADMAP for pipelines #675
  • python components don't work for images with python 2 #666
  • dsl PipelineParam does not work under Image or Command #521

Merged pull requests:

0.1.10 (2019-02-15)

Full Changelog

Closed issues:

  • Pipeline Release V0.1.10 #805
  • Failed to create recurring run #802
  • Persistent Agent doesn't like v1beta1 scheduledworkflow in on-prem scenario #790
  • Metric bars do not always show up correctly #775
  • ml-pipeline-persistenceagent restarts forever #741
  • 403 Insufficient Permission error when writing to GCS #709
  • Support archiving/unarchiving runs on the UI #621
  • Incorrect validation in new run form when filling name then pipeline #612

Merged pull requests:

0.1.9 (2019-02-06)

Full Changelog

Closed issues:

  • XGBoost sample failure #736
  • TFX taxi client utility run abnormally after serving started #728
  • Pipeline deploy component does not support local model #726
  • Failed to execute the component roc and confusion_matrix in TFX sample for local mode #719
  • An error occurs when run TFX example in local kubeflow cluster #703
  • Not using secret when pulling from private Registry #695
  • Release 1.7 - TFX taxi cab example failing the deploy step #692
  • Run details page should autorefresh #683
  • problem when deploying kubeflow 0.4.0 #676
  • Do I need to be running kubeflow on GCP to use pipelines? #661
  • Design doc for pipelines #569
  • Some error logs in sample for ML - TFX - Taxi Tip Prediction Model Trainer #547
  • Return the total number of resources in list APIs #103

Merged pull requests:

  • Creating ROADMAP.md #786 (paveldournov)
  • Revert GPU tests to unblock release #778 (hongye-sun)
  • Modifications done by the execution of the release script. #777 (vicaire)
  • Refactor BaseOp to context manager pattern #762 (hongye-sun)
  • Add component_sdk tests to travis tests #761 (hongye-sun)
  • Fix Dockerfile for viewer CRD image. #760 (neuromage)
  • Add UI actions to Buttons module #758 (yebrahim)
  • Regenerate frontend API files now that listCount APIs are merged #757 (rileyjbauer)
  • Enhance deploy.sh to support local storage #755 (jinchihe)
  • Releasing components fixing xgboost #747 (gaoning777)
  • support pipeline level imagepullsecret in DSL #745 (gaoning777)
  • Updated dev guide for apiserver build with minikube. #743 (gyliu513)
  • Add Dockerfile for building Viewer CRD controller. #740 (neuromage)
  • Remove pipeline bootstrapper #739 (IronPan)
  • Refactor UI buttons to lib file #737 (yebrahim)
  • fix dataproc cluster version #735 (gaoning777)
  • Improve runtime graph starting and running experience #734 (rileyjbauer)
  • SDK/Components - convert_object_to_struct now uses __init__ to get field list #733 (Ark-kun)
  • SDK/Components - Improved error when type checking fails in constructor #732 (Ark-kun)
  • Create kfp componet sdk #729 (hongye-sun)
  • Add CMLE sample test script. #724 (qimingj)
  • Add "set_retry()" on ContainerOp. #723 (qimingj)
  • Auto-refreshes the run details page #722 (rileyjbauer)
  • create nonexistent directory for roc and confusion_matrix component #720 (jinchihe)
  • SDK/Components/Python - Improved Python2 compatibility #718 (Ark-kun)
  • SDK/Components/Python - Made the typing.NamedTuple import optional #717 (Ark-kun)
  • SDK/Components - Added _naming._convert_to_human_name function #715 (Ark-kun)
  • SDK/Components - Command line args can only be strings or placeholders #711 (Ark-kun)
  • SDK/Components - More meaningful error when trying to convert graph component to ContainerOp #710 (Ark-kun)
  • randomize the deployment name to avoid collision #704 (gaoning777)
  • SDK - Removed stray debug print from tests #701 (Ark-kun)
  • Update changelog for release 0.1.8 #697 (yebrahim)
  • Add gpu pool to test deployment and enable gpu in sample test #696 (hongye-sun)
  • bump ks version in presubmit test #693 (IronPan)
  • SDK - Update minimum Python version to 3.5.3 #691 (Ark-kun)
  • Update all Pipelines CRD versions to v1beta1. #681 (neuromage)
  • Return resource count from ListXXX calls #595 (yebrahim)

0.1.8 (2019-01-17)

Full Changelog

Closed issues:

  • Docs about how to write mlpipeline-ui-metadata and mlpipeline-metrics artifacts #660
  • Pipeline run created from python shows experiment but not pipeline in UI. #617
  • Load samples returns an error in 0.4 Kubeflow #603
  • Error deploying latest bootstrapper #594
  • Provide argument to assign GCP service account to use for DSL operator #218
  • Run status tooltip should include creation time #61

Merged pull requests:

0.1.7 (2019-01-09)

Full Changelog

Closed issues:

  • Use "Start" for runs, "Create" for experiments #649
  • go vet in Travis tests breaks tests for unrelated PRs #646
  • Building backend using Bazel fails on mac #638
  • ml-pipeline-persistenceagent fails a few times. #624
  • Unable to plug-in default values to Pipeline #618
  • Add deployed model cleanup code to the Kubeflow notebook #608
  • Compare page perf optimizations #597
  • OAth client instructions are ambiguous #586
  • "Waiting for the IAP setup to get ready..." after clicking "Skip IAP" #585
  • UI should allow creating a run with no experiment #573
  • studyjob-controller start failed #546
  • Failing e2e sample tests do not log any errors #515
  • Authentication and service account plan for Pipeline + Kubeflow #374
  • Error getting logs #290
  • Support filtering in list APIs #270
  • Switch to Go 1.11 modules and package management. #187

Merged pull requests:

  • Release component image version d3c4add0a9 #655 (IronPan)
  • Correctly ignore src/apis when building frontend #654 (yebrahim)
  • Use linguist annotations to skip diffing generated files #652 (yebrahim)
  • Use "create" rather than "start" except when initiating a run #650 (rileyjbauer)
  • Fix shadowing errors in Viewer reconciler #648 (neuromage)
  • Add IS_SUBSTRING operator for use in API resource filtering. #645 (neuromage)
  • Add changelog to pipeline repo #644 (IronPan)
  • Update WORKSPACE and BUILD files incoporating recent changes #639 (neuromage)
  • fix deploy model name conflict in case of concurrent notebook sample test #636 (gaoning777)
  • Print sample test logs in case of exception throw #635 (gaoning777)
  • Expose pipeline/job API through setup.py #634 (IronPan)
  • Fix retrying logic which was causing persistenceagent to crash loop. #633 (neuromage)
  • Add resnet-cmle sample back. Update all component images. #632 (qimingj)
  • Updates material-ui and react npm libraries #630 (rileyjbauer)
  • Generate pipeline and job python client as part of SDK #628 (IronPan)
  • Fix gpu sample issues #627 (hongye-sun)
  • Run go vet as part of the Travis CI. #626 (neuromage)
  • Sanity check filtering/sorting options in list requests. #625 (neuromage)
  • Support replacable arguments in command as well besides arguments in container op. #623 (qimingj)
  • Update sample notebook to clean up deployed models. #622 (qimingj)
  • URLEncode instead of base64 encode the filter string #620 (neuromage)
  • DSL refactor #619 (gaoning777)
  • Expose that the python API is Python3.5+ only #616 (TimZaman)
  • Load sample when pipeline initially started #615 (IronPan)
  • Use Bazel to build the entire backend and perform API code generation #609 (neuromage)
  • Improve condition sample to demonstrate ==, >= and <. #607 (qimingj)
  • fix for boostrapp problem #602 (xiaozhouX)
  • Initial version of BigQuery query execution component. #601 (cbreuel)
  • First step to bring back CMLE sample. #599 (qimingj)
  • Compare perf - pure components, disable ROC curve thumbnail animations #598 (yebrahim)
  • Move backend unit tests to Travis #589 (yebrahim)
  • Deployment - Minikube support - Passing the platform parameter to kfctl #588 (Ark-kun)
  • Fix the List run to get all runs #583 (IronPan)
  • retry on create table in api server #582 (IronPan)
  • switch from go dep to go module #581 (IronPan)
  • Add sample test without image build #578 (gaoning777)
  • remove xgboost compiled sample #576 (gaoning777)
  • Add a gpu sample #575 (hongye-sun)
  • Backend - Removed hardcoded metrics file name #574 (Ark-kun)
  • update dockerfile and add build step of frontend #567 (chenzhiwei)
  • Encode filter parameter as a base64-encoded JSON string in List requests #563 (neuromage)
  • Tests - Updated image-builder Makefile #500 (Ark-kun)
  • Add the Viewer CRD controller for managing web views such as Tensorboard instances from within the Pipelines UI. #449 (neuromage)

0.1.6 (2018-12-20)

Full Changelog

Closed issues:

  • Support creating runs without experiments #560

Merged pull requests:

0.1.5 (2018-12-20)

Full Changelog

Closed issues:

  • remove duplicate volumes in the DSL #557
  • Cut a Pipeline v0.1.5 release #549
  • "Information in the Argo UI appears much faster compared to the KF Pipelines UI" #544
  • KubeFlow Pipeline example notebook is half way updated for 0.1.4 #520
  • UI loses state after being idle for a while #502
  • No way in the UI to upload a pipeline from the cluster itself #495
  • Confusion Matrix UI Doesn't Work if My Labels are "True", "False" #446
  • input parameter for creating pipelines - does not allow camelCase #445
  • Pipeline install timeout #414
  • 'Run output' tab for Run details page #331
  • Create a container wrapper op with Default GCP auth #310
  • Test/Server code out of sync, blocking PRs #196
  • Show results of the entire workflow in one view #92
  • User should be able to start a new run from the pipeline page. #53

Merged pull requests:

0.1.4 (2018-12-07)

Full Changelog

Closed issues:

  • DSL Condition Feature/Bug #481
  • Persist pod logs to permanent storage #439
  • Pipeline name does not show up when submitting from SDK #347

Merged pull requests:

0.1.3 (2018-12-05)

Full Changelog

Closed issues:

  • Bug in pipeline samples' parameters #478
  • Frontend integration test is flaky #464
  • Jupyter Notebook [tf-hub-0] run failed #458
  • AssertionError [ERR_ASSERTION]: logs do not look right: 1 #453
  • Why can not delete experiments and runs? #441
  • grant kubeflow user account CMLE permission #416
  • where is bootstrapper code gcr.io/ml-pipeline/bootstrapper:0.1.2 #412
  • Compare page tests #382
  • Pipeline UI should work behind Kubeflow reverse proxy Ambassador #373
  • Presubmit tests are broken since we rely on pulling node.js image that was removed #370
  • Backend ships with very old SDK version #358
  • Python fire interprets string incorrectly #318
  • Include kubectl install command in Github page #284
  • Embeddable run view page #182
  • Better render pipeline description #89
  • Support cloning run started from notebook #75
  • "No runs were found for this experiment" is a misleading message when the list is still being loaded. #63
  • User should be able to create a new Recurring Run from the pipeline page. #54

Merged pull requests:

  • Return string from pod logs #476 (yebrahim)
  • Fix serializing cloned embedded pipeline #474 (yebrahim)
  • Refresh while waiting for run to start #472 (yebrahim)
  • Add article on Jupyter notebooks #471 (lakshmanok)
  • Adds tests for the run comparison page #469 (rileyjbauer)
  • Sanitize inputs from SDK when submitting run. #466 (qimingj)
  • Support cloning runs created with an embedded pipeline #465 (yebrahim)
  • import bug #463 (gaoning777)
  • Wait until logs appear right in e2e test #459 (yebrahim)
  • Fix sample test - Add gcp permission #454 (IronPan)
  • Show pipeline details embedded in runs #447 (yebrahim)
  • SDK/PythonContainer - Compiling pipelines without needing kubernetes #442 (Ark-kun)
  • SDK/Components - Renamed container.arguments to container.args #437 (Ark-kun)
  • DSL - return self for .after() #435 (IronPan)
  • Tests - Try fix GCS file being inaccessible right after upload #433 (Ark-kun)
  • Testing - Fix Travis tests SDK/Components #432 (Ark-kun)
  • SDK/GCP - Replaced default_gcp_op with task.apply(use_gcp_secret) #430 (Ark-kun)
  • Fix tb viewer test #427 (yebrahim)
  • SDK/Client - Removed import six #425 (Ark-kun)
  • SDK/Components/PythonContainerOp - Make the local output path configurable #424 (Ark-kun)
  • Propagate secret to kaniko #423 (IronPan)
  • fix bug in the notebook sample #419 (gaoning777)
  • Failed the sample tests when it should #417 (gaoning777)
  • Fix for k8s dict parsing #411 (vanpelt)
  • Clean up the resource after test finish #410 (IronPan)
  • Add loading spinner to custom table while loading items #405 (yebrahim)
  • SDK/Components/PythonContainerOp - Switch from dict to ComponentSpec #396 (Ark-kun)
  • SDK/Components - Removed outputs from task factory function signature #388 (Ark-kun)
  • Add Gopkg dependency for kubernetes code-generator. #371 (neuromage)
  • SDK - Improve the python package build #364 (Ark-kun)
  • SDK/DSL - Added support for conditions: !=, <, <=, >=, > #309 (Ark-kun)
  • SDK/Components - Support for optional inputs #214 (Ark-kun)
  • SDK/Components/PythonContainerOp - Simplified GCSHelper by extracting duplicate code #210 (Ark-kun)

0.1.3-rc.3 (2018-11-29)

Full Changelog

Closed issues:

  • Pipeline names are truncated and the columns are not realizable #400
  • RunDetails page tests #383
  • ExperimentDetails page tests #381
  • PipelineDetails page tests #379
  • Our tests clone our repo 40+ times for each PR commit and some PRs have dozens of commits #368
  • Backend image build does not fail when sample compilation fails #354
  • Back-button not working when creating a run from a notebook #221

Merged pull requests:

  • Adds tests for the ExperimentDetails page #404 (rileyjbauer)
  • Removed unused docs directory including OWNERS file and images. #401 (sarahmaddox)
  • Pointed doc links to Kubeflow website instead of wiki. #398 (sarahmaddox)
  • RunDetails test suite, bug fixes #394 (yebrahim)
  • update image tag with the new release #393 (gaoning777)
  • Increase timeout waiting for test run to start #392 (yebrahim)
  • Delete kf_deploy.sh #391 (IronPan)
  • Clean up vendor directory #390 (neuromage)
  • Add support for minio hosted artifacts #389 (vanpelt)
  • Backend - Fixed handling of sample compilation failure #387 (Ark-kun)
  • Add finish timestamp to backend API interceptor #386 (yebrahim)
  • remove fire dependency in the component image build #384 (gaoning777)
  • PipelineDetails page tests #380 (yebrahim)
  • update samples with dependency requirement in the component image build #378 (gaoning777)
  • Disables back button when there is no history #377 (rileyjbauer)
  • move default gcp op to dsl/ #376 (IronPan)
  • Add Amy and Lak's Blogs Link to README #375 (qimingj)
  • Tests - Improve Minikube source code copy process #367 (Ark-kun)
  • restructure local components directory #357 (gaoning777)
  • Switching test to kubeflow deployment #351 (IronPan)
  • added component with tf slim model generator and pipeline adjustments #335 (dtrawins)
  • PipelineSelector, RecurringRunsManager, and 404Page tests #319 (yebrahim)
  • Tests - Fixed many test issues external PRs, code de-sync by getting rid of git clone #315 (Ark-kun)
  • Now pipeline function takes direct default values rather than dsp.PipelineParam. #110 (qimingj)

0.1.3-rc.2 (2018-11-22)

Full Changelog

Closed issues:

Merged pull requests:

  • Tests - Stop repeating the logs three times #366 (Ark-kun)
  • Fixes issue with footer overlapping side panel and fixes summary layout #353 (rileyjbauer)
  • PipelineDetails cleanup #350 (yebrahim)
  • Add support for nvidia gpu limit #346 (hongye-sun)
  • mount gcp credentials for kaniko worker #343 (IronPan)
  • rename ks registry ml-pipeline -> pipeline #340 (IronPan)
  • restructure dataflow component structure #338 (gaoning777)
  • formating jsonnet registry #333 (IronPan)
  • Use upper case for ks parameter #328 (IronPan)
  • Use ks env for pipeline namespace #326 (IronPan)
  • Tests - Fixed the argo submit failure not failing the script #324 (Ark-kun)
  • SDK/Components - Renamed DockerContainer spec to to Container #323 (Ark-kun)
  • fix bug for the component build with requirements #320 (gaoning777)
  • Use latest npm and node on travis, fix tests #317 (yebrahim)
  • add metric image file for wiki #316 (hongye-sun)
  • Add default_gcp_op #314 (IronPan)
  • return self for container op initialization methods to allow chaining the construction #313 (IronPan)
  • switch set() to add() for better inheritance. #312 (IronPan)
  • Changes "Hide" button on Pipeline summary to fully hide the paper card #305 (rileyjbauer)
  • add ngao to test owner because frequent contributions to this directory, including e2e, sample tests and imagebuilder. #299 (gaoning777)
  • reenable basic sample tests, serially after frontend integ tests(triggering 5 times, successful always) #298 (gaoning777)
  • Add run status to page title #287 (yebrahim)
  • Update button styling for new experiment and new run #264 (rileyjbauer)
  • refactor component build codes #260 (gaoning777)
  • Remove tfjob operator from sdk #233 (IronPan)
  • SDK/Components/PythonContainerOp - Fixed string escaping warning #208 (Ark-kun)
  • SDK/DSL/Compiler - Improved compilation of dsl.Conditional - UX support done #177 (Ark-kun)

0.1.3-rc.1 (2018-11-17)

Full Changelog

Closed issues:

  • Cannot copy pipeline source on Pipeline details page #301
  • Notebook Kaniko job shows logs in red background #288
  • a pipeline must be sellected #286
  • Create experiment from Notebook and use link to open KFP UI. Back button doesn't work. #281
  • Text/link displayed after calling run_pipeline should be "Run link" not "Job link" #266
  • Perf issue - All runs page loads very slowly with >100 runs #259
  • UI - feature ask: Remember the "Rows per page:" setting #258
  • Upload Error Invalid response: 404 #239
  • Auth Error when running TFX notebook. #229
  • Cannot create a Notebook when starting KFP from cloud shell #179
  • Unsupported Scan Error While Listing the Jobs of an Experiment #171
  • Our test code and test images code is not always the same. #163
  • Popped out TFMA is too small #160
  • SDK should require kubernetes client lib #158
  • Experiment list title should not change #71
  • Create a sample notebook #69
  • Frontend should give 404s for non-existing pages/routes. #55
  • Remove python op decorator #44

Merged pull requests:

0.1.2 (2018-11-08)

Full Changelog

Merged pull requests:

0.1.1 (2018-11-07)

Full Changelog

Merged pull requests:

0.1.0 (2018-11-06)

Full Changelog

Closed issues:

  • The "Recurrent run configs" tab is showing inaccurate # of jobs #100
  • Duplicate experiment name would return me a blank page #97
  • The Experiments/All runs tab should probably be the default tab in Experiments. #58
  • The Experiments tab should be the default tab. #57

Merged pull requests:

  • Use the experiment's resource reference in the listJobs request #105 (yebrahim)
  • Fix validation check for maximum size limit #104 (IronPan)
  • Add Ning and Alexey to OWNERS for components, samples and sample-test #102 (Ark-kun)
  • Don't barf when experiment name is already used #101 (yebrahim)
  • CSS changes for nav menu and tables #99 (ajayalfred)
  • Fixed the Minikube tests after moving to the new repo #98 (Ark-kun)
  • sort by run display name by default #96 (IronPan)
  • SDK/DSL/Compiler - Reverted fix of dsl.Condition until the UI is ready. #94 (Ark-kun)
  • debug tfma failure #91 (gaoning777)
  • fix miscellaneous List API issue #90 (IronPan)
  • mlp -> kfp.dsl #88 (Ark-kun)
  • ExperimentList tests, use immer.js #86 (yebrahim)
  • Moves docs from pipelines main README to wiki #83 (sarahmaddox)
  • Add rileyjbauer to frontend OWNERS #82 (yebrahim)
  • Update OWNERS to add qimingj #77 (qimingj)
  • Compile samples instead of hard code them in API server #76 (IronPan)
  • Added @gaoning777 and @Ark-kun to OWNERS #74 (Ark-kun)
  • Change title from 'Start a new run' to 'Start recurring run' as appropriate #73 (rileyjbauer)
  • Add %%docker magic to jupyter kernel. #72 (qimingj)
  • Build Python SDK in the releasing #70 (gaoning777)
  • Fix tfx name bug in the tfma sample test #67 (gaoning777)
  • Fixes off-by-one error with months in Trigger #66 (rileyjbauer)
  • Updating OWNER files. Adding per-subdirectory OWNER files. #65 (vicaire)
  • This is a test. #51 (vicaire)
  • PipelineList tests, fix clearing error banner #50 (yebrahim)
  • Adds the Kubeflow logo to the side nav. Fetches specific font weights #48 (rileyjbauer)
  • Refresh button now reloads logs and artifacts as well on RunDetails page #47 (rileyjbauer)
  • Cleans up StaticGraphParser tests as per PR commends from #30 #45 (rileyjbauer)
  • Fix resnet-cmle sample. #43 (qimingj)
  • Add ngao to the owners #42 (gaoning777)
  • SDK/Tests/Components - Corrected test argument types #41 (Ark-kun)
  • SDK/Components/Python - Stopped using the Fire library #40 (Ark-kun)
  • Upgrade kubeflow to v0.3.2 #39 (IronPan)
  • Components - Removed debug print #38 (Ark-kun)
  • SDK/Tests/Components - Improve temporary file handling #37 (Ark-kun)
  • Add Alexey Volkov to OWNERS #36 (Ark-kun)
  • Propagate name for runs from scheduled job #33 (IronPan)
  • add rileyjbauer to OWNERS #32 (rileyjbauer)
  • Push pagination control to CustomTable #31 (yebrahim)
  • Adds many more static workflow parser tests #30 (rileyjbauer)
  • SDK/Components - Switching to map-based syntax for the arguments. #29 (Ark-kun)
  • SDK/DSL/Compiler - Fixed compilation of dsl.Condition #28 (Ark-kun)
  • TFMA deployer bug fix #27 (gaoning777)
  • Upgrading the container versions to 0.0.42, the version of the first release of kubeflow/pipelines. #26 (vicaire)

0.0.42 (2018-11-02)

Closed issues:

  • ScheduledWorkflow CRD: CLI #7
  • How does it proceed with this project? #1

Merged pull requests:

* This Change Log was automatically generated by github_changelog_generator