ploomber


Nameploomber JSON
Version 0.23.2 PyPI version JSON
download
home_pagehttps://github.com/ploomber/ploomber
SummaryWrite maintainable, production-ready pipelines using Jupyter or your favorite text editor. Develop locally, deploy to the cloud.
upload_time2024-02-08 01:24:19
maintainer
docs_urlNone
authorPloomber
requires_python
license
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage
            <p align="center" width="100%">
  <img src="_static/logo.png" height="250">
</p>

[![CI Linux](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-linux.yml/badge.svg)](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-linux.yml/badge.svg)
[![CI macOS](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-macos.yml/badge.svg)](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-macos.yml/badge.svg)
[![CI Windows](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-windows.yml/badge.svg)](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-windows.yml/badge.svg)
[![Documentation Status](https://readthedocs.org/projects/ploomber/badge/?version=latest)](https://docs.ploomber.io/en/latest/?badge=latest)
[![PyPI](https://badge.fury.io/py/ploomber.svg)](https://badge.fury.io/py/ploomber)
[![Conda (channel only)](https://img.shields.io/conda/vn/conda-forge/ploomber)](https://anaconda.org/conda-forge/ploomber)
[![Conda](https://img.shields.io/conda/pn/conda-forge/ploomber)](https://anaconda.org/conda-forge/ploomber)
[![Coverage](https://coveralls.io/repos/github/ploomber/ploomber/badge.svg?branch=master)](https://coveralls.io/github/ploomber/ploomber?branch=master)
[![Twitter](https://img.shields.io/twitter/follow/ploomber?label=Follow&style=social)](https://twitter.com/intent/user?screen_name=ploomber)
[![Downloads](https://pepy.tech/badge/ploomber)](https://pepy.tech/project/ploomber)

> [!TIP]
> Deploy AI apps for free on [Ploomber Cloud!](https://ploomber.io/?utm_medium=github&utm_source=ploomber)

<p align="center">
  <a href="https://ploomber.io/community">Join our community</a>
  |
  <a href="https://share.hsforms.com/1E7Qa_OpcRPi_MV-segFsaAe6c2g">Newsletter</a>
  |
  <a href="mailto:contact@ploomber.io">Contact us</a>
  |
  <a href="https://docs.ploomber.io/">Docs</a>
  |
  <a href="https://ploomber.io/blog/">Blog</a>
  |  
  <a href="https://www.ploomber.io">Website</a>
  |
  <a href="https://www.youtube.com/channel/UCaIS5BMlmeNQE4-Gn0xTDXQ">YouTube</a>
</p>


Ploomber is the fastest way to build data pipelines ⚡️. Use your favorite editor (**[Jupyter](https://docs.ploomber.io/en/latest/user-guide/jupyter.html), [VSCode](https://docs.ploomber.io/en/latest/user-guide/editors.html), [PyCharm](https://docs.ploomber.io/en/latest/user-guide/editors.html)**) to develop interactively and deploy ☁️ without code changes (**[Kubernetes](https://soopervisor.readthedocs.io/en/latest/tutorials/kubernetes.html), [Airflow](https://soopervisor.readthedocs.io/en/latest/tutorials/airflow.html), [AWS Batch](https://soopervisor.readthedocs.io/en/latest/tutorials/aws-batch.html), and [SLURM](https://soopervisor.readthedocs.io/en/latest/tutorials/slurm.html)**). Do you have legacy notebooks? Refactor them into modular pipelines with a single command.


## Installation

*Compatible with Python 3.7 and higher.*

Install with `pip`:

```sh
pip install ploomber
```

Or with `conda`:

```sh
conda install ploomber -c conda-forge
```

## Getting started

### Try the tutorial:
<p>
  <a href="https://github.com/ploomber/projects/blob/master/guides/first-pipeline/README.md"> </a>
</p>

## Community

* [Join us on Slack](https://ploomber.io/community)
* [Newsletter](https://share.hsforms.com/1E7Qa_OpcRPi_MV-segFsaAe6c2g)
* [YouTube](https://www.youtube.com/channel/UCaIS5BMlmeNQE4-Gn0xTDXQ)
* [Contact the development team](mailto:contact@ploomber.io)

## Main Features

### ⚡️ Get started quickly

A simple YAML API to get started quickly, a powerful Python API for total flexibility.

https://user-images.githubusercontent.com/989250/150660813-fc289c6c-0ed5-432d-b6df-063ce98c0093.mp4

### ⏱ Shorter development cycles

Automatically cache your pipeline’s previous results and only re-compute tasks that have changed since your last execution.

https://user-images.githubusercontent.com/989250/150660820-9a3a0abd-5904-492b-97ff-5494285dfebf.mp4

### ☁️ Deploy anywhere

Run as a shell script in a single machine or distributively in [Kubernetes](https://soopervisor.readthedocs.io/en/latest/tutorials/kubernetes.html), [Airflow](https://soopervisor.readthedocs.io/en/latest/tutorials/airflow.html), [AWS Batch](https://soopervisor.readthedocs.io/en/latest/tutorials/aws-batch.html), or [SLURM](https://soopervisor.readthedocs.io/en/latest/tutorials/slurm.html).

https://user-images.githubusercontent.com/989250/150660830-3f81c9a2-5392-49e5-976d-cb8a38441ecb.mp4


### 📙 Automated migration from legacy notebooks

Bring your old monolithic notebooks, and we’ll automatically convert them into maintainable, modular pipelines.

https://user-images.githubusercontent.com/989250/150660840-b0c12f85-504c-4233-8c3d-6724d291f1aa.mp4


[I want to migrate my notebook.](https://docs.ploomber.io/en/latest/user-guide/refactoring.html)

[Show me a demo.](https://www.youtube.com/watch?v=EJecqsZBr3Q)

## Resources

* [Documentation](https://docs.ploomber.io/)
* [PyData Chicago talk (covers motivation and demo)](https://youtu.be/qUL7QabcKcw)
* [Develop and deploy an ML pipeline in 30 minutes (EuroPython 2021)](https://youtu.be/O8tqiCkIWPs)
* [Guest blog post on the official Jupyter blog](https://blog.jupyter.org/ploomber-maintainable-and-collaborative-pipelines-in-jupyter-acb3ad2101a7)
* [Examples (Machine Learning pipeline, ETL, among others)](https://github.com/ploomber/projects)
* [Blog](https://ploomber.io/)
* [Comparison with other tools](https://ploomber.io/posts/survey)
* [More videos](https://docs.ploomber.io/en/latest/videos.html)

## About Ploomber

Ploomber is a big community of data enthusiasts pushing the boundaries of Data Science and Machine Learning tooling.

Whatever your skillset is, you can contribute to our mission. So whether you're a beginner or an experienced professional, you're welcome to join us on this journey!

[Click here to know how you can contribute to Ploomber.](https://github.com/ploomber/contributing/blob/main/README.md)

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/ploomber/ploomber",
    "name": "ploomber",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "",
    "author": "Ploomber",
    "author_email": "contact@ploomber.io",
    "download_url": "https://files.pythonhosted.org/packages/d4/24/f44e9ad85807f538c8fd5a2764da40f7605bd8bbf7b93764fbfc976a08c3/ploomber-0.23.2.tar.gz",
    "platform": null,
    "description": "<p align=\"center\" width=\"100%\">\n  <img src=\"_static/logo.png\" height=\"250\">\n</p>\n\n[![CI Linux](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-linux.yml/badge.svg)](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-linux.yml/badge.svg)\n[![CI macOS](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-macos.yml/badge.svg)](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-macos.yml/badge.svg)\n[![CI Windows](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-windows.yml/badge.svg)](https://github.com/ploomber/ploomber/actions/workflows/ci-unit-windows.yml/badge.svg)\n[![Documentation Status](https://readthedocs.org/projects/ploomber/badge/?version=latest)](https://docs.ploomber.io/en/latest/?badge=latest)\n[![PyPI](https://badge.fury.io/py/ploomber.svg)](https://badge.fury.io/py/ploomber)\n[![Conda (channel only)](https://img.shields.io/conda/vn/conda-forge/ploomber)](https://anaconda.org/conda-forge/ploomber)\n[![Conda](https://img.shields.io/conda/pn/conda-forge/ploomber)](https://anaconda.org/conda-forge/ploomber)\n[![Coverage](https://coveralls.io/repos/github/ploomber/ploomber/badge.svg?branch=master)](https://coveralls.io/github/ploomber/ploomber?branch=master)\n[![Twitter](https://img.shields.io/twitter/follow/ploomber?label=Follow&style=social)](https://twitter.com/intent/user?screen_name=ploomber)\n[![Downloads](https://pepy.tech/badge/ploomber)](https://pepy.tech/project/ploomber)\n\n> [!TIP]\n> Deploy AI apps for free on [Ploomber Cloud!](https://ploomber.io/?utm_medium=github&utm_source=ploomber)\n\n<p align=\"center\">\n  <a href=\"https://ploomber.io/community\">Join our community</a>\n  |\n  <a href=\"https://share.hsforms.com/1E7Qa_OpcRPi_MV-segFsaAe6c2g\">Newsletter</a>\n  |\n  <a href=\"mailto:contact@ploomber.io\">Contact us</a>\n  |\n  <a href=\"https://docs.ploomber.io/\">Docs</a>\n  |\n  <a href=\"https://ploomber.io/blog/\">Blog</a>\n  |  \n  <a href=\"https://www.ploomber.io\">Website</a>\n  |\n  <a href=\"https://www.youtube.com/channel/UCaIS5BMlmeNQE4-Gn0xTDXQ\">YouTube</a>\n</p>\n\n\nPloomber is the fastest way to build data pipelines \u26a1\ufe0f. Use your favorite editor (**[Jupyter](https://docs.ploomber.io/en/latest/user-guide/jupyter.html), [VSCode](https://docs.ploomber.io/en/latest/user-guide/editors.html), [PyCharm](https://docs.ploomber.io/en/latest/user-guide/editors.html)**) to develop interactively and deploy \u2601\ufe0f without code changes (**[Kubernetes](https://soopervisor.readthedocs.io/en/latest/tutorials/kubernetes.html), [Airflow](https://soopervisor.readthedocs.io/en/latest/tutorials/airflow.html), [AWS Batch](https://soopervisor.readthedocs.io/en/latest/tutorials/aws-batch.html), and [SLURM](https://soopervisor.readthedocs.io/en/latest/tutorials/slurm.html)**). Do you have legacy notebooks? Refactor them into modular pipelines with a single command.\n\n\n## Installation\n\n*Compatible with Python 3.7 and higher.*\n\nInstall with `pip`:\n\n```sh\npip install ploomber\n```\n\nOr with `conda`:\n\n```sh\nconda install ploomber -c conda-forge\n```\n\n## Getting started\n\n### Try the tutorial:\n<p>\n  <a href=\"https://github.com/ploomber/projects/blob/master/guides/first-pipeline/README.md\"> </a>\n</p>\n\n## Community\n\n* [Join us on Slack](https://ploomber.io/community)\n* [Newsletter](https://share.hsforms.com/1E7Qa_OpcRPi_MV-segFsaAe6c2g)\n* [YouTube](https://www.youtube.com/channel/UCaIS5BMlmeNQE4-Gn0xTDXQ)\n* [Contact the development team](mailto:contact@ploomber.io)\n\n## Main Features\n\n### \u26a1\ufe0f Get started quickly\n\nA simple YAML API to get started quickly, a powerful Python API for total flexibility.\n\nhttps://user-images.githubusercontent.com/989250/150660813-fc289c6c-0ed5-432d-b6df-063ce98c0093.mp4\n\n### \u23f1 Shorter development cycles\n\nAutomatically cache your pipeline\u2019s previous results and only re-compute tasks that have changed since your last execution.\n\nhttps://user-images.githubusercontent.com/989250/150660820-9a3a0abd-5904-492b-97ff-5494285dfebf.mp4\n\n### \u2601\ufe0f Deploy anywhere\n\nRun as a shell script in a single machine or distributively in [Kubernetes](https://soopervisor.readthedocs.io/en/latest/tutorials/kubernetes.html), [Airflow](https://soopervisor.readthedocs.io/en/latest/tutorials/airflow.html), [AWS Batch](https://soopervisor.readthedocs.io/en/latest/tutorials/aws-batch.html), or [SLURM](https://soopervisor.readthedocs.io/en/latest/tutorials/slurm.html).\n\nhttps://user-images.githubusercontent.com/989250/150660830-3f81c9a2-5392-49e5-976d-cb8a38441ecb.mp4\n\n\n### \ud83d\udcd9 Automated migration from legacy notebooks\n\nBring your old monolithic notebooks, and we\u2019ll automatically convert them into maintainable, modular pipelines.\n\nhttps://user-images.githubusercontent.com/989250/150660840-b0c12f85-504c-4233-8c3d-6724d291f1aa.mp4\n\n\n[I want to migrate my notebook.](https://docs.ploomber.io/en/latest/user-guide/refactoring.html)\n\n[Show me a demo.](https://www.youtube.com/watch?v=EJecqsZBr3Q)\n\n## Resources\n\n* [Documentation](https://docs.ploomber.io/)\n* [PyData Chicago talk (covers motivation and demo)](https://youtu.be/qUL7QabcKcw)\n* [Develop and deploy an ML pipeline in 30 minutes (EuroPython 2021)](https://youtu.be/O8tqiCkIWPs)\n* [Guest blog post on the official Jupyter blog](https://blog.jupyter.org/ploomber-maintainable-and-collaborative-pipelines-in-jupyter-acb3ad2101a7)\n* [Examples (Machine Learning pipeline, ETL, among others)](https://github.com/ploomber/projects)\n* [Blog](https://ploomber.io/)\n* [Comparison with other tools](https://ploomber.io/posts/survey)\n* [More videos](https://docs.ploomber.io/en/latest/videos.html)\n\n## About Ploomber\n\nPloomber is a big community of data enthusiasts pushing the boundaries of Data Science and Machine Learning tooling.\n\nWhatever your skillset is, you can contribute to our mission. So whether you're a beginner or an experienced professional, you're welcome to join us on this journey!\n\n[Click here to know how you can contribute to Ploomber.](https://github.com/ploomber/contributing/blob/main/README.md)\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "Write maintainable, production-ready pipelines using Jupyter or your favorite text editor. Develop locally, deploy to the cloud.",
    "version": "0.23.2",
    "project_urls": {
        "Homepage": "https://github.com/ploomber/ploomber"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "6b7a7456e796928a78c4e6bf69a2e7cf92990164359f94444d3eaf465bbb7f74",
                "md5": "9c78da7baf3e4a0703828773ff3bf6b9",
                "sha256": "09c05c96b375f52e71e93d074f542a064dacaceb6416271ab40130b50aab9ae4"
            },
            "downloads": -1,
            "filename": "ploomber-0.23.2-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "9c78da7baf3e4a0703828773ff3bf6b9",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 333355,
            "upload_time": "2024-02-08T01:24:17",
            "upload_time_iso_8601": "2024-02-08T01:24:17.403877Z",
            "url": "https://files.pythonhosted.org/packages/6b/7a/7456e796928a78c4e6bf69a2e7cf92990164359f94444d3eaf465bbb7f74/ploomber-0.23.2-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d424f44e9ad85807f538c8fd5a2764da40f7605bd8bbf7b93764fbfc976a08c3",
                "md5": "92582f0550c8ed57da094a3aad573b1b",
                "sha256": "4c0c38a92443dfc9195ea4975928de94aa211366cb86ba13ab5b7a6519fb9fb2"
            },
            "downloads": -1,
            "filename": "ploomber-0.23.2.tar.gz",
            "has_sig": false,
            "md5_digest": "92582f0550c8ed57da094a3aad573b1b",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 280033,
            "upload_time": "2024-02-08T01:24:19",
            "upload_time_iso_8601": "2024-02-08T01:24:19.921989Z",
            "url": "https://files.pythonhosted.org/packages/d4/24/f44e9ad85807f538c8fd5a2764da40f7605bd8bbf7b93764fbfc976a08c3/ploomber-0.23.2.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-02-08 01:24:19",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "ploomber",
    "github_project": "ploomber",
    "travis_ci": false,
    "coveralls": true,
    "github_actions": true,
    "lcname": "ploomber"
}
        
Elapsed time: 0.18781s