Kubeflow Pipelines is a platform for building and deploying portable, scalable machine learning workflows based on Docker containers within the [Kubeflow](https://www.kubeflow.org/) project.
Use Kubeflow Pipelines to compose a multi-step workflow ([pipeline](https://www.kubeflow.org/docs/components/pipelines/concepts/pipeline/)) as a [graph](https://www.kubeflow.org/docs/components/pipelines/concepts/graph/) of containerized [tasks](https://www.kubeflow.org/docs/components/pipelines/concepts/step/) using Python code and/or YAML. Then, [run](https://www.kubeflow.org/docs/components/pipelines/concepts/run/) your pipeline with specified pipeline arguments, rerun your pipeline with new arguments or data, [schedule](https://www.kubeflow.org/docs/components/pipelines/concepts/run-trigger/) your pipeline to run on a recurring basis, organize your runs into [experiments](https://www.kubeflow.org/docs/components/pipelines/concepts/experiment/), save machine learning artifacts to compliant [artifact registries](https://www.kubeflow.org/docs/components/pipelines/concepts/metadata/), and visualize it all through the [Kubeflow Dashboard](https://www.kubeflow.org/docs/components/central-dash/overview/).
## Installation
To install `kfp`, run:
```sh
pip install kfp
```
## Getting started
The following is an example of a simple pipeline that uses the `kfp` v2 syntax:
```python
from kfp import dsl
import kfp
@dsl.component
def add(a: float, b: float) -> float:
'''Calculates sum of two arguments'''
return a + b
@dsl.pipeline(
name='Addition pipeline',
description='An example pipeline that performs addition calculations.')
def add_pipeline(
a: float = 1.0,
b: float = 7.0,
):
first_add_task = add(a=a, b=4.0)
second_add_task = add(a=first_add_task.output, b=b)
client = kfp.Client(host='<my-host-url>')
client.create_run_from_pipeline_func(
add_pipeline, arguments={
'a': 7.0,
'b': 8.0
})
```
Raw data
{
"_id": null,
"home_page": "https://github.com/kubeflow/pipelines",
"name": "kfp",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.7.0,<3.13.0",
"maintainer_email": "",
"keywords": "",
"author": "The Kubeflow Authors",
"author_email": "",
"download_url": "https://files.pythonhosted.org/packages/e3/f8/8f9a4e34c6222fa8808644aa14b3cbc0fdba95eb06eed7ce8aeb299c1dc2/kfp-2.7.0.tar.gz",
"platform": null,
"description": "Kubeflow Pipelines is a platform for building and deploying portable, scalable machine learning workflows based on Docker containers within the [Kubeflow](https://www.kubeflow.org/) project.\n\nUse Kubeflow Pipelines to compose a multi-step workflow ([pipeline](https://www.kubeflow.org/docs/components/pipelines/concepts/pipeline/)) as a [graph](https://www.kubeflow.org/docs/components/pipelines/concepts/graph/) of containerized [tasks](https://www.kubeflow.org/docs/components/pipelines/concepts/step/) using Python code and/or YAML. Then, [run](https://www.kubeflow.org/docs/components/pipelines/concepts/run/) your pipeline with specified pipeline arguments, rerun your pipeline with new arguments or data, [schedule](https://www.kubeflow.org/docs/components/pipelines/concepts/run-trigger/) your pipeline to run on a recurring basis, organize your runs into [experiments](https://www.kubeflow.org/docs/components/pipelines/concepts/experiment/), save machine learning artifacts to compliant [artifact registries](https://www.kubeflow.org/docs/components/pipelines/concepts/metadata/), and visualize it all through the [Kubeflow Dashboard](https://www.kubeflow.org/docs/components/central-dash/overview/).\n\n## Installation\n\nTo install `kfp`, run:\n\n```sh\npip install kfp\n```\n\n## Getting started\n\nThe following is an example of a simple pipeline that uses the `kfp` v2 syntax:\n\n```python\nfrom kfp import dsl\nimport kfp\n\n\n@dsl.component\ndef add(a: float, b: float) -> float:\n '''Calculates sum of two arguments'''\n return a + b\n\n\n@dsl.pipeline(\n name='Addition pipeline',\n description='An example pipeline that performs addition calculations.')\ndef add_pipeline(\n a: float = 1.0,\n b: float = 7.0,\n):\n first_add_task = add(a=a, b=4.0)\n second_add_task = add(a=first_add_task.output, b=b)\n\n\nclient = kfp.Client(host='<my-host-url>')\nclient.create_run_from_pipeline_func(\n add_pipeline, arguments={\n 'a': 7.0,\n 'b': 8.0\n })\n\n```",
"bugtrack_url": null,
"license": "",
"summary": "Kubeflow Pipelines SDK",
"version": "2.7.0",
"project_urls": {
"Bug Tracker": "https://github.com/kubeflow/pipelines/issues",
"Changelog": "https://github.com/kubeflow/pipelines/blob/master/sdk/RELEASE.md",
"Documentation": "https://kubeflow-pipelines.readthedocs.io/en/stable/",
"Homepage": "https://github.com/kubeflow/pipelines",
"Source": "https://github.com/kubeflow/pipelines/tree/master/sdk"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "e3f88f9a4e34c6222fa8808644aa14b3cbc0fdba95eb06eed7ce8aeb299c1dc2",
"md5": "b9a07fc48ba78b7d6e74e0998b22d1fc",
"sha256": "8a2065527ec3d50617bd374c2b25cffeab16d93b34e4be08c1ca3e4bd8d2cc0c"
},
"downloads": -1,
"filename": "kfp-2.7.0.tar.gz",
"has_sig": false,
"md5_digest": "b9a07fc48ba78b7d6e74e0998b22d1fc",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.7.0,<3.13.0",
"size": 441776,
"upload_time": "2024-02-14T20:25:43",
"upload_time_iso_8601": "2024-02-14T20:25:43.265491Z",
"url": "https://files.pythonhosted.org/packages/e3/f8/8f9a4e34c6222fa8808644aa14b3cbc0fdba95eb06eed7ce8aeb299c1dc2/kfp-2.7.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-02-14 20:25:43",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "kubeflow",
"github_project": "pipelines",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"requirements": [],
"lcname": "kfp"
}