Name | ploomber JSON |
Version |
0.19.6
JSON |
| download |
home_page | https://github.com/ploomber/ploomber |
Summary | Write maintainable, production-ready pipelines using Jupyter or your favorite text editor. Develop locally, deploy to the cloud. |
upload_time | 2022-06-02 12:31:51 |
maintainer | |
docs_url | None |
author | Ploomber |
requires_python | |
license | |
keywords |
|
VCS |
 |
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
|
<p align="center" width="100%">
<img src="_static/logo.png" height="250">
</p>
[](https://github.com/ploomber/ploomber/workflows/CI%20Linux/badge.svg)
[](https://github.com/ploomber/ploomber/workflows/CI%20macOS/badge.svg)
[](https://github.com/ploomber/ploomber/workflows/CI%20Windows/badge.svg)
[](https://docs.ploomber.io/en/latest/?badge=latest)
[](https://badge.fury.io/py/ploomber)
[](https://anaconda.org/conda-forge/ploomber)
[](https://anaconda.org/conda-forge/ploomber)
[](https://coveralls.io/github/ploomber/ploomber?branch=master)
[](https://twitter.com/intent/user?screen_name=ploomber)
[](https://mybinder.org/v2/gh/ploomber/binder-env/main?urlpath=git-pull%3Frepo%3Dhttps%253A%252F%252Fgithub.com%252Fploomber%252Fprojects%26urlpath%3Dlab%252Ftree%252Fprojects%252Fguides/first-pipeline%252FREADME.ipynb%26branch%3Dmaster)
[](https://pepy.tech/project/ploomber)
<p align="center">
<a href="https://ploomber.io/community">Join our community</a>
|
<a href="https://www.getrevue.co/profile/ploomber">Newsletter</a>
|
<a href="mailto:contact@ploomber.io">Contact us</a>
|
<a href="https://docs.ploomber.io/">Docs</a>
|
<a href="https://ploomber.io/">Blog</a>
|
<a href="https://www.ploomber.io">Website</a>
|
<a href="https://www.youtube.com/channel/UCaIS5BMlmeNQE4-Gn0xTDXQ">YouTube</a>
</p>
Ploomber is the fastest way to build data pipelines ⚡️. Use your favorite editor (**[Jupyter](https://docs.ploomber.io/en/latest/user-guide/jupyter.html), [VSCode](https://docs.ploomber.io/en/latest/user-guide/editors.html), [PyCharm](https://docs.ploomber.io/en/latest/user-guide/editors.html)**) to develop interactively and deploy ☁️ without code changes (**[Kubernetes](https://soopervisor.readthedocs.io/en/latest/tutorials/kubernetes.html), [Airflow](https://soopervisor.readthedocs.io/en/latest/tutorials/airflow.html), [AWS Batch](https://soopervisor.readthedocs.io/en/latest/tutorials/aws-batch.html), and [SLURM](https://soopervisor.readthedocs.io/en/latest/tutorials/slurm.html)**). Do you have legacy notebooks? Refactor them into modular pipelines with a single command.
<p align="center">
<a href="https://docs.ploomber.io/en/latest/get-started/quick-start.html"> <img src="_static/get-started.svg" alt="Get Started"> </a>
</p>
## Installation
*Compatible with Python 3.6 and higher.*
Install with `pip`:
```sh
pip install ploomber
```
Or with `conda`:
```sh
conda install ploomber -c conda-forge
```
## Getting started
**Open a hosted JupyterLab instance:**
[](https://mybinder.org/v2/gh/ploomber/binder-env/main?urlpath=git-pull%3Frepo%3Dhttps%253A%252F%252Fgithub.com%252Fploomber%252Fprojects%26urlpath%3Dlab%252Ftree%252Fprojects%252Fguides/first-pipeline%252FREADME.ipynb%26branch%3Dmaster)
**or learn it locally in 2 minutes:**
```sh
pip install ploomber --upgrade
python -m ploomber.onboard
```
**What's next?**
Ready to **migrate your project?** [Click here.](https://docs.ploomber.io/en/latest/user-guide/refactoring.html)
Do you want to **learn more?** [Check out the introductory tutorial.](https://docs.ploomber.io/en/latest/get-started/first-pipeline.html)
Run more [examples.](https://docs.ploomber.io/en/latest/user-guide/templates.html)
## Community
* [Join us on Slack](https://ploomber.io/community)
* [Newsletter](https://www.getrevue.co/profile/ploomber)
* [YouTube](https://www.youtube.com/channel/UCaIS5BMlmeNQE4-Gn0xTDXQ)
* [Contact the development team](mailto:contact@ploomber.io)
## Main Features
### ⚡️ Get started quickly
A simple YAML API to get started quickly, a powerful Python API for total flexibility.
https://user-images.githubusercontent.com/989250/150660813-fc289c6c-0ed5-432d-b6df-063ce98c0093.mp4
### ⏱ Shorter development cycles
Automatically cache your pipeline’s previous results and only re-compute tasks that have changed since your last execution.
https://user-images.githubusercontent.com/989250/150660820-9a3a0abd-5904-492b-97ff-5494285dfebf.mp4
### ☁️ Deploy anywhere
Run as a shell script in a single machine or distributively in [Kubernetes](https://soopervisor.readthedocs.io/en/latest/tutorials/kubernetes.html), [Airflow](https://soopervisor.readthedocs.io/en/latest/tutorials/airflow.html), [AWS Batch](https://soopervisor.readthedocs.io/en/latest/tutorials/aws-batch.html), or [SLURM](https://soopervisor.readthedocs.io/en/latest/tutorials/slurm.html).
https://user-images.githubusercontent.com/989250/150660830-3f81c9a2-5392-49e5-976d-cb8a38441ecb.mp4
### 📙 Automated migration from legacy notebooks
Bring your old monolithic notebooks, and we’ll automatically convert them into maintainable, modular pipelines.
https://user-images.githubusercontent.com/989250/150660840-b0c12f85-504c-4233-8c3d-6724d291f1aa.mp4
[I want to migrate my notebook.](https://docs.ploomber.io/en/latest/user-guide/refactoring.html)
[Show me a demo.](https://www.youtube.com/watch?v=EJecqsZBr3Q)
## Resources
* [Documentation](https://docs.ploomber.io/)
* [PyData Chicago talk (covers motivation and demo)](https://youtu.be/qUL7QabcKcw)
* [Develop and deploy an ML pipeline in 30 minutes (EuroPython 2021)](https://youtu.be/O8tqiCkIWPs)
* [Guest blog post on the official Jupyter blog](https://blog.jupyter.org/ploomber-maintainable-and-collaborative-pipelines-in-jupyter-acb3ad2101a7)
* [Examples (Machine Learning pipeline, ETL, among others)](https://github.com/ploomber/projects)
* [Blog](https://ploomber.io/)
* [Comparison with other tools](https://ploomber.io/posts/survey)
* [More videos](https://docs.ploomber.io/en/latest/videos.html)
Raw data
{
"_id": null,
"home_page": "https://github.com/ploomber/ploomber",
"name": "ploomber",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "",
"author": "Ploomber",
"author_email": "contact@ploomber.io",
"download_url": "https://files.pythonhosted.org/packages/6d/1a/48f9bc6ef580c70947be171c756426d33a7b062376f59b633edadd7a2786/ploomber-0.19.6.tar.gz",
"platform": null,
"description": "<p align=\"center\" width=\"100%\">\n <img src=\"_static/logo.png\" height=\"250\">\n</p>\n\n[](https://github.com/ploomber/ploomber/workflows/CI%20Linux/badge.svg)\n[](https://github.com/ploomber/ploomber/workflows/CI%20macOS/badge.svg)\n[](https://github.com/ploomber/ploomber/workflows/CI%20Windows/badge.svg)\n[](https://docs.ploomber.io/en/latest/?badge=latest)\n[](https://badge.fury.io/py/ploomber)\n[](https://anaconda.org/conda-forge/ploomber)\n[](https://anaconda.org/conda-forge/ploomber)\n[](https://coveralls.io/github/ploomber/ploomber?branch=master)\n[](https://twitter.com/intent/user?screen_name=ploomber)\n[](https://mybinder.org/v2/gh/ploomber/binder-env/main?urlpath=git-pull%3Frepo%3Dhttps%253A%252F%252Fgithub.com%252Fploomber%252Fprojects%26urlpath%3Dlab%252Ftree%252Fprojects%252Fguides/first-pipeline%252FREADME.ipynb%26branch%3Dmaster)\n[](https://pepy.tech/project/ploomber)\n\n<p align=\"center\">\n <a href=\"https://ploomber.io/community\">Join our community</a>\n |\n <a href=\"https://www.getrevue.co/profile/ploomber\">Newsletter</a>\n |\n <a href=\"mailto:contact@ploomber.io\">Contact us</a>\n |\n <a href=\"https://docs.ploomber.io/\">Docs</a>\n |\n <a href=\"https://ploomber.io/\">Blog</a>\n | \n <a href=\"https://www.ploomber.io\">Website</a>\n |\n <a href=\"https://www.youtube.com/channel/UCaIS5BMlmeNQE4-Gn0xTDXQ\">YouTube</a>\n</p>\n\n\nPloomber is the fastest way to build data pipelines \u26a1\ufe0f. Use your favorite editor (**[Jupyter](https://docs.ploomber.io/en/latest/user-guide/jupyter.html), [VSCode](https://docs.ploomber.io/en/latest/user-guide/editors.html), [PyCharm](https://docs.ploomber.io/en/latest/user-guide/editors.html)**) to develop interactively and deploy \u2601\ufe0f without code changes (**[Kubernetes](https://soopervisor.readthedocs.io/en/latest/tutorials/kubernetes.html), [Airflow](https://soopervisor.readthedocs.io/en/latest/tutorials/airflow.html), [AWS Batch](https://soopervisor.readthedocs.io/en/latest/tutorials/aws-batch.html), and [SLURM](https://soopervisor.readthedocs.io/en/latest/tutorials/slurm.html)**). Do you have legacy notebooks? Refactor them into modular pipelines with a single command.\n\n<p align=\"center\">\n <a href=\"https://docs.ploomber.io/en/latest/get-started/quick-start.html\"> <img src=\"_static/get-started.svg\" alt=\"Get Started\"> </a>\n</p>\n\n\n## Installation\n\n*Compatible with Python 3.6 and higher.*\n\nInstall with `pip`:\n\n```sh\npip install ploomber\n```\n\nOr with `conda`:\n\n```sh\nconda install ploomber -c conda-forge\n```\n\n## Getting started\n\n**Open a hosted JupyterLab instance:**\n\n[](https://mybinder.org/v2/gh/ploomber/binder-env/main?urlpath=git-pull%3Frepo%3Dhttps%253A%252F%252Fgithub.com%252Fploomber%252Fprojects%26urlpath%3Dlab%252Ftree%252Fprojects%252Fguides/first-pipeline%252FREADME.ipynb%26branch%3Dmaster)\n\n**or learn it locally in 2 minutes:**\n\n```sh\npip install ploomber --upgrade\n\npython -m ploomber.onboard\n```\n\n**What's next?**\n\nReady to **migrate your project?** [Click here.](https://docs.ploomber.io/en/latest/user-guide/refactoring.html)\n\nDo you want to **learn more?** [Check out the introductory tutorial.](https://docs.ploomber.io/en/latest/get-started/first-pipeline.html)\n\nRun more [examples.](https://docs.ploomber.io/en/latest/user-guide/templates.html)\n\n## Community\n\n* [Join us on Slack](https://ploomber.io/community)\n* [Newsletter](https://www.getrevue.co/profile/ploomber)\n* [YouTube](https://www.youtube.com/channel/UCaIS5BMlmeNQE4-Gn0xTDXQ)\n* [Contact the development team](mailto:contact@ploomber.io)\n\n## Main Features\n\n### \u26a1\ufe0f Get started quickly\n\nA simple YAML API to get started quickly, a powerful Python API for total flexibility.\n\nhttps://user-images.githubusercontent.com/989250/150660813-fc289c6c-0ed5-432d-b6df-063ce98c0093.mp4\n\n### \u23f1 Shorter development cycles\n\nAutomatically cache your pipeline\u2019s previous results and only re-compute tasks that have changed since your last execution.\n\nhttps://user-images.githubusercontent.com/989250/150660820-9a3a0abd-5904-492b-97ff-5494285dfebf.mp4\n\n### \u2601\ufe0f Deploy anywhere\n\nRun as a shell script in a single machine or distributively in [Kubernetes](https://soopervisor.readthedocs.io/en/latest/tutorials/kubernetes.html), [Airflow](https://soopervisor.readthedocs.io/en/latest/tutorials/airflow.html), [AWS Batch](https://soopervisor.readthedocs.io/en/latest/tutorials/aws-batch.html), or [SLURM](https://soopervisor.readthedocs.io/en/latest/tutorials/slurm.html).\n\nhttps://user-images.githubusercontent.com/989250/150660830-3f81c9a2-5392-49e5-976d-cb8a38441ecb.mp4\n\n\n### \ud83d\udcd9 Automated migration from legacy notebooks\n\nBring your old monolithic notebooks, and we\u2019ll automatically convert them into maintainable, modular pipelines.\n\nhttps://user-images.githubusercontent.com/989250/150660840-b0c12f85-504c-4233-8c3d-6724d291f1aa.mp4\n\n\n[I want to migrate my notebook.](https://docs.ploomber.io/en/latest/user-guide/refactoring.html)\n\n[Show me a demo.](https://www.youtube.com/watch?v=EJecqsZBr3Q)\n\n## Resources\n\n* [Documentation](https://docs.ploomber.io/)\n* [PyData Chicago talk (covers motivation and demo)](https://youtu.be/qUL7QabcKcw)\n* [Develop and deploy an ML pipeline in 30 minutes (EuroPython 2021)](https://youtu.be/O8tqiCkIWPs)\n* [Guest blog post on the official Jupyter blog](https://blog.jupyter.org/ploomber-maintainable-and-collaborative-pipelines-in-jupyter-acb3ad2101a7)\n* [Examples (Machine Learning pipeline, ETL, among others)](https://github.com/ploomber/projects)\n* [Blog](https://ploomber.io/)\n* [Comparison with other tools](https://ploomber.io/posts/survey)\n* [More videos](https://docs.ploomber.io/en/latest/videos.html)\n\n\n",
"bugtrack_url": null,
"license": "",
"summary": "Write maintainable, production-ready pipelines using Jupyter or your favorite text editor. Develop locally, deploy to the cloud.",
"version": "0.19.6",
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"md5": "88c6dd474916f5812912b1688a4afae5",
"sha256": "1c611fdcdc4370d63e0e02a1331fec087e85169a80e03d302015b3904a1b025d"
},
"downloads": -1,
"filename": "ploomber-0.19.6-py3-none-any.whl",
"has_sig": false,
"md5_digest": "88c6dd474916f5812912b1688a4afae5",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 329583,
"upload_time": "2022-06-02T12:31:49",
"upload_time_iso_8601": "2022-06-02T12:31:49.916711Z",
"url": "https://files.pythonhosted.org/packages/6e/ef/283721d775b12fc505fe212002a4a571249b0c1bd01014537ffde3416cee/ploomber-0.19.6-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"md5": "55001c3dde0e89f728884cdc8ce72d4f",
"sha256": "8058e148301df4503e2e5095b8343d2dc8ad03e2344ee69f29b97392ff10a558"
},
"downloads": -1,
"filename": "ploomber-0.19.6.tar.gz",
"has_sig": false,
"md5_digest": "55001c3dde0e89f728884cdc8ce72d4f",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 281859,
"upload_time": "2022-06-02T12:31:51",
"upload_time_iso_8601": "2022-06-02T12:31:51.921383Z",
"url": "https://files.pythonhosted.org/packages/6d/1a/48f9bc6ef580c70947be171c756426d33a7b062376f59b633edadd7a2786/ploomber-0.19.6.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2022-06-02 12:31:51",
"github": true,
"gitlab": false,
"bitbucket": false,
"github_user": "ploomber",
"github_project": "ploomber",
"travis_ci": false,
"coveralls": true,
"github_actions": true,
"lcname": "ploomber"
}