<p align="center">
<picture>
<source media="(prefers-color-scheme: light)" srcset="https://raw.githubusercontent.com/kedro-org/kedro/main/.github/demo-light.png">
<source media="(prefers-color-scheme: dark)" srcset="https://raw.githubusercontent.com/kedro-org/kedro/main/.github/demo-dark.png">
<img src="https://raw.githubusercontent.com/kedro-org/kedro/main/.github/demo-light.png" alt="Kedro">
</picture>
</p>
[](https://pypi.org/project/kedro/)
[](https://pypi.org/project/kedro/)
[](https://anaconda.org/conda-forge/kedro)
[](https://github.com/kedro-org/kedro/blob/main/LICENSE.md)
[](https://slack.kedro.org)
[](https://linen-slack.kedro.org/)
[](https://docs.kedro.org/)
[](https://bestpractices.coreinfrastructure.org/projects/6711)
[](https://pepy.tech/project/kedro)
[](https://pepy.tech/project/kedro)
[](https://kedro.org)
## What is Kedro?
Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular. You can find out more at [kedro.org](https://kedro.org).
Kedro is an open-source Python framework hosted by the [LF AI & Data Foundation](https://lfaidata.foundation/).
## How do I install Kedro?
To install Kedro from the Python Package Index (PyPI) run:
```
pip install kedro
```
It is also possible to install Kedro using `conda`:
```
conda install -c conda-forge kedro
```
Our [Get Started guide](https://docs.kedro.org/en/stable/get_started/install.html) contains full installation instructions, and includes how to set up Python virtual environments.
### Installation from source
To access the latest Kedro version before its official release, install it from the `main` branch.
```
pip install git+https://github.com/kedro-org/kedro@main
```
## What are the main features of Kedro?
| Feature | What is this? |
| -------------------- |----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Project Template | A standard, modifiable and easy-to-use project template based on [Cookiecutter Data Science](https://github.com/drivendata/cookiecutter-data-science/). |
| Data Catalog | A series of lightweight data connectors used to save and load data across many different file formats and file systems, including local and network file systems, cloud object stores, and HDFS. The Data Catalog also includes data and model versioning for file-based systems. |
| Pipeline Abstraction | Automatic resolution of dependencies between pure Python functions and data pipeline visualisation using [Kedro-Viz](https://github.com/kedro-org/kedro-viz). |
| Coding Standards | Test-driven development using [`pytest`](https://github.com/pytest-dev/pytest), produce well-documented code using [Sphinx](http://www.sphinx-doc.org/en/master/), create linted code with support for [`ruff`](https://github.com/astral-sh/ruff) and make use of the standard Python logging library. |
| Flexible Deployment | Deployment strategies that include single or distributed-machine deployment as well as additional support for deploying on Argo, Prefect, Kubeflow, AWS Batch, and Databricks. |
## How do I use Kedro?
The [Kedro documentation](https://docs.kedro.org/en/stable/) first explains [how to install Kedro](https://docs.kedro.org/en/stable/get_started/install.html) and then introduces [key Kedro concepts](https://docs.kedro.org/en/stable/get_started/kedro_concepts.html).
You can then review the [spaceflights tutorial](https://docs.kedro.org/en/stable/tutorial/spaceflights_tutorial.html) to build a Kedro project for hands-on experience.
For new and intermediate Kedro users, there's a comprehensive section on [how to visualise Kedro projects using Kedro-Viz](https://docs.kedro.org/en/stable/visualisation/index.html).
<p align="center">
<img src="https://raw.githubusercontent.com/kedro-org/kedro-viz/main/.github/img/banner.png" alt>
<em>A pipeline visualisation generated using Kedro-Viz</em>
</p>
Additional documentation explains [how to work with Kedro and Jupyter notebooks](https://docs.kedro.org/en/stable/notebooks_and_ipython/index.html), and there are a set of advanced user guides for advanced for key Kedro features. We also recommend the [API reference documentation](/kedro) for further information.
## Why does Kedro exist?
Kedro is built upon our collective best-practice (and mistakes) trying to deliver real-world ML applications that have vast amounts of raw unvetted data. We developed Kedro to achieve the following:
- To address the main shortcomings of Jupyter notebooks, one-off scripts, and glue-code because there is a focus on
creating **maintainable data science code**
- To enhance **team collaboration** when different team members have varied exposure to software engineering concepts
- To increase efficiency, because applied concepts like modularity and separation of concerns inspire the creation of
**reusable analytics code**
Find out more about how Kedro can answer your use cases from the [product FAQs on the Kedro website](https://kedro.org/#faq).
## The humans behind Kedro
The [Kedro product team](https://docs.kedro.org/en/stable/contribution/technical_steering_committee.html#kedro-maintainers) and a number of [open source contributors from across the world](https://github.com/kedro-org/kedro/releases) maintain Kedro.
## Can I contribute?
Yes! We welcome all kinds of contributions. Check out our [guide to contributing to Kedro](https://github.com/kedro-org/kedro/wiki/Contribute-to-Kedro).
## Where can I learn more?
There is a growing community around Kedro. We encourage you to ask and answer technical questions on [Slack](https://slack.kedro.org/) and bookmark the [Linen archive of past discussions](https://linen-slack.kedro.org/).
We keep a list of [technical FAQs in the Kedro documentation](https://docs.kedro.org/en/stable/faq/faq.html) and you can find a growing list of blog posts, videos and projects that use Kedro over on the [`awesome-kedro` GitHub repository](https://github.com/kedro-org/awesome-kedro). If you have created anything with Kedro we'd love to include it on the list. Just make a PR to add it!
## How can I cite Kedro?
If you're an academic, Kedro can also help you, for example, as a tool to solve the problem of reproducible research. Use the "Cite this repository" button on [our repository](https://github.com/kedro-org/kedro) to generate a citation from the [CITATION.cff file](https://docs.github.com/en/repositories/managing-your-repositorys-settings-and-features/customizing-your-repository/about-citation-files).
## Python version support policy
* The core [Kedro Framework](https://github.com/kedro-org/kedro) supports all Python versions that are actively maintained by the CPython core team. When a [Python version reaches end of life](https://devguide.python.org/versions/#versions), support for that version is dropped from Kedro. This is not considered a breaking change.
* The [Kedro Datasets](https://github.com/kedro-org/kedro-plugins/tree/main/kedro-datasets) package follows the [NEP 29](https://numpy.org/neps/nep-0029-deprecation_policy.html) Python version support policy. This means that `kedro-datasets` generally drops Python version support before `kedro`. This is because `kedro-datasets` has a lot of dependencies that follow NEP 29 and the more conservative version support approach of the Kedro Framework makes it hard to manage those dependencies properly.
Raw data
{
"_id": null,
"home_page": null,
"name": "kedro",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.9",
"maintainer_email": null,
"keywords": "pipelines, machine learning, data pipelines, data science, data engineering",
"author": "Kedro",
"author_email": null,
"download_url": "https://files.pythonhosted.org/packages/58/de/c10e3acd68665ae54bde8af40520eac1afbb190272daadf24d1f6e7c2f93/kedro-0.19.9.tar.gz",
"platform": null,
"description": "<p align=\"center\">\n <picture>\n <source media=\"(prefers-color-scheme: light)\" srcset=\"https://raw.githubusercontent.com/kedro-org/kedro/main/.github/demo-light.png\">\n <source media=\"(prefers-color-scheme: dark)\" srcset=\"https://raw.githubusercontent.com/kedro-org/kedro/main/.github/demo-dark.png\">\n <img src=\"https://raw.githubusercontent.com/kedro-org/kedro/main/.github/demo-light.png\" alt=\"Kedro\">\n </picture>\n</p>\n\n[](https://pypi.org/project/kedro/)\n[](https://pypi.org/project/kedro/)\n[](https://anaconda.org/conda-forge/kedro)\n[](https://github.com/kedro-org/kedro/blob/main/LICENSE.md)\n[](https://slack.kedro.org)\n[](https://linen-slack.kedro.org/)\n\n\n[](https://docs.kedro.org/)\n[](https://bestpractices.coreinfrastructure.org/projects/6711)\n[](https://pepy.tech/project/kedro)\n[](https://pepy.tech/project/kedro)\n\n[](https://kedro.org)\n\n## What is Kedro?\n\nKedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular. You can find out more at [kedro.org](https://kedro.org).\n\nKedro is an open-source Python framework hosted by the [LF AI & Data Foundation](https://lfaidata.foundation/).\n\n## How do I install Kedro?\n\nTo install Kedro from the Python Package Index (PyPI) run:\n\n```\npip install kedro\n```\n\nIt is also possible to install Kedro using `conda`:\n\n```\nconda install -c conda-forge kedro\n```\n\nOur [Get Started guide](https://docs.kedro.org/en/stable/get_started/install.html) contains full installation instructions, and includes how to set up Python virtual environments.\n\n### Installation from source\nTo access the latest Kedro version before its official release, install it from the `main` branch.\n```\npip install git+https://github.com/kedro-org/kedro@main\n```\n\n## What are the main features of Kedro?\n\n| Feature | What is this? |\n| -------------------- |----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|\n| Project Template | A standard, modifiable and easy-to-use project template based on [Cookiecutter Data Science](https://github.com/drivendata/cookiecutter-data-science/). |\n| Data Catalog | A series of lightweight data connectors used to save and load data across many different file formats and file systems, including local and network file systems, cloud object stores, and HDFS. The Data Catalog also includes data and model versioning for file-based systems. |\n| Pipeline Abstraction | Automatic resolution of dependencies between pure Python functions and data pipeline visualisation using [Kedro-Viz](https://github.com/kedro-org/kedro-viz). |\n| Coding Standards | Test-driven development using [`pytest`](https://github.com/pytest-dev/pytest), produce well-documented code using [Sphinx](http://www.sphinx-doc.org/en/master/), create linted code with support for [`ruff`](https://github.com/astral-sh/ruff) and make use of the standard Python logging library. |\n| Flexible Deployment | Deployment strategies that include single or distributed-machine deployment as well as additional support for deploying on Argo, Prefect, Kubeflow, AWS Batch, and Databricks. |\n\n## How do I use Kedro?\n\nThe [Kedro documentation](https://docs.kedro.org/en/stable/) first explains [how to install Kedro](https://docs.kedro.org/en/stable/get_started/install.html) and then introduces [key Kedro concepts](https://docs.kedro.org/en/stable/get_started/kedro_concepts.html).\n\nYou can then review the [spaceflights tutorial](https://docs.kedro.org/en/stable/tutorial/spaceflights_tutorial.html) to build a Kedro project for hands-on experience.\n\nFor new and intermediate Kedro users, there's a comprehensive section on [how to visualise Kedro projects using Kedro-Viz](https://docs.kedro.org/en/stable/visualisation/index.html).\n\n\n<p align=\"center\">\n <img src=\"https://raw.githubusercontent.com/kedro-org/kedro-viz/main/.github/img/banner.png\" alt>\n <em>A pipeline visualisation generated using Kedro-Viz</em>\n</p>\n\nAdditional documentation explains [how to work with Kedro and Jupyter notebooks](https://docs.kedro.org/en/stable/notebooks_and_ipython/index.html), and there are a set of advanced user guides for advanced for key Kedro features. We also recommend the [API reference documentation](/kedro) for further information.\n\n\n## Why does Kedro exist?\n\nKedro is built upon our collective best-practice (and mistakes) trying to deliver real-world ML applications that have vast amounts of raw unvetted data. We developed Kedro to achieve the following:\n\n- To address the main shortcomings of Jupyter notebooks, one-off scripts, and glue-code because there is a focus on\n creating **maintainable data science code**\n- To enhance **team collaboration** when different team members have varied exposure to software engineering concepts\n- To increase efficiency, because applied concepts like modularity and separation of concerns inspire the creation of\n **reusable analytics code**\n\nFind out more about how Kedro can answer your use cases from the [product FAQs on the Kedro website](https://kedro.org/#faq).\n\n## The humans behind Kedro\n\nThe [Kedro product team](https://docs.kedro.org/en/stable/contribution/technical_steering_committee.html#kedro-maintainers) and a number of [open source contributors from across the world](https://github.com/kedro-org/kedro/releases) maintain Kedro.\n\n## Can I contribute?\n\nYes! We welcome all kinds of contributions. Check out our [guide to contributing to Kedro](https://github.com/kedro-org/kedro/wiki/Contribute-to-Kedro).\n\n## Where can I learn more?\n\nThere is a growing community around Kedro. We encourage you to ask and answer technical questions on [Slack](https://slack.kedro.org/) and bookmark the [Linen archive of past discussions](https://linen-slack.kedro.org/).\n\nWe keep a list of [technical FAQs in the Kedro documentation](https://docs.kedro.org/en/stable/faq/faq.html) and you can find a growing list of blog posts, videos and projects that use Kedro over on the [`awesome-kedro` GitHub repository](https://github.com/kedro-org/awesome-kedro). If you have created anything with Kedro we'd love to include it on the list. Just make a PR to add it!\n\n## How can I cite Kedro?\n\nIf you're an academic, Kedro can also help you, for example, as a tool to solve the problem of reproducible research. Use the \"Cite this repository\" button on [our repository](https://github.com/kedro-org/kedro) to generate a citation from the [CITATION.cff file](https://docs.github.com/en/repositories/managing-your-repositorys-settings-and-features/customizing-your-repository/about-citation-files).\n\n## Python version support policy\n* The core [Kedro Framework](https://github.com/kedro-org/kedro) supports all Python versions that are actively maintained by the CPython core team. When a [Python version reaches end of life](https://devguide.python.org/versions/#versions), support for that version is dropped from Kedro. This is not considered a breaking change.\n* The [Kedro Datasets](https://github.com/kedro-org/kedro-plugins/tree/main/kedro-datasets) package follows the [NEP 29](https://numpy.org/neps/nep-0029-deprecation_policy.html) Python version support policy. This means that `kedro-datasets` generally drops Python version support before `kedro`. This is because `kedro-datasets` has a lot of dependencies that follow NEP 29 and the more conservative version support approach of the Kedro Framework makes it hard to manage those dependencies properly.\n",
"bugtrack_url": null,
"license": "Apache Software License (Apache 2.0)",
"summary": "Kedro helps you build production-ready data and analytics pipelines",
"version": "0.19.9",
"project_urls": {
"Documentation": "https://docs.kedro.org",
"Homepage": "https://kedro.org",
"Source": "https://github.com/kedro-org/kedro",
"Tracker": "https://github.com/kedro-org/kedro/issues"
},
"split_keywords": [
"pipelines",
" machine learning",
" data pipelines",
" data science",
" data engineering"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "b58eacb94d2e89b34930dc4825f8c30ece6fd60367ec8fb7e7d255b66fbbe98c",
"md5": "66f93429946bcc6ab9b2023adff4f78d",
"sha256": "1b67e5bc4526474bb7270e366a1e69fd2acfa255568b6dbd93d3c56e7b731425"
},
"downloads": -1,
"filename": "kedro-0.19.9-py3-none-any.whl",
"has_sig": false,
"md5_digest": "66f93429946bcc6ab9b2023adff4f78d",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.9",
"size": 179657,
"upload_time": "2024-10-10T19:13:11",
"upload_time_iso_8601": "2024-10-10T19:13:11.554173Z",
"url": "https://files.pythonhosted.org/packages/b5/8e/acb94d2e89b34930dc4825f8c30ece6fd60367ec8fb7e7d255b66fbbe98c/kedro-0.19.9-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "58dec10e3acd68665ae54bde8af40520eac1afbb190272daadf24d1f6e7c2f93",
"md5": "8bc4ca26513c935dec6fb11dbd33f2d8",
"sha256": "3757ae5fa96dc3fe2f3f249512953e254b61d324fa2bdecfb4bfced379e54395"
},
"downloads": -1,
"filename": "kedro-0.19.9.tar.gz",
"has_sig": false,
"md5_digest": "8bc4ca26513c935dec6fb11dbd33f2d8",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.9",
"size": 147345,
"upload_time": "2024-10-10T19:13:13",
"upload_time_iso_8601": "2024-10-10T19:13:13.580036Z",
"url": "https://files.pythonhosted.org/packages/58/de/c10e3acd68665ae54bde8af40520eac1afbb190272daadf24d1f6e7c2f93/kedro-0.19.9.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-10-10 19:13:13",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "kedro-org",
"github_project": "kedro",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "kedro"
}
JSON
