prefect


Nameprefect JSON
Version 2.1.1 PyPI version JSON
download
home_pagehttps://github.com/PrefectHQ/prefect/tree/orion
SummaryWorkflow orchestration and management.
upload_time2022-08-18 15:30:26
maintainer
docs_urlNone
authorPrefect Technologies, Inc.
requires_python>=3.7
license
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            <p align="center"><img src="https://images.ctfassets.net/gm98wzqotmnx/6rIpC9ZCAewsRGLwOw5BRe/bb17e1ef62f60d1ec32c1ae69487704c/prefect-2-logo-dark.png" width=1000></p>

<p align="center">
    <a href="https://pypi.python.org/pypi/prefect/" alt="PyPI version">
        <img src="https://badge.fury.io/py/prefect.svg" /></a>
    <a href="https://github.com/prefecthq/prefect/" alt="Stars">
        <img src="https://img.shields.io/github/stars/prefecthq/prefect" /></a>
    <a href="https://pepy.tech/badge/prefect/" alt="Downloads">
        <img src="https://pepy.tech/badge/prefect" /></a>
    <a href="https://github.com/prefecthq/prefect/pulse" alt="Activity">
        <img src="https://img.shields.io/github/commit-activity/m/prefecthq/prefect" /></a>
    <a href="https://github.com/prefecthq/prefect/graphs/contributors" alt="Contributors">
        <img src="https://img.shields.io/github/contributors/prefecthq/prefect" /></a>
    <br>
    <a href="https://prefect-community.slack.com" alt="Slack">
        <img src="https://img.shields.io/badge/slack-join_community-red.svg?logo=slack" /></a>
    <a href="https://discourse.prefect.io/" alt="Discourse">
        <img src="https://img.shields.io/badge/discourse-browse_forum-red.svg?logo=discourse" /></a>
</p>

# Prefect 2.0

Prefect 2.0 is the second-generation dataflow coordination and orchestration platform from [Prefect](https://www.prefect.io).

Prefect 2.0 has been designed from the ground up to handle the dynamic, scalable workloads that the modern data stack demands. Powered by Prefect Orion, a brand-new, asynchronous rules engine, it represents an enormous amount of research, development, and dedication to a simple idea:

_**You should love your workflows again.**_

[Read the docs](https://docs.prefect.io/), run the code, or host the UI. Join thousands of community members in [our Slack community](https://www.prefect.io/slack) to share your thoughts and feedback. Thanks for being part of the mission to build a new kind of workflow system and, of course, **happy engineering!**

**"Don't Panic"**

Still using Prefect 1.0 Core and Server? Find the [legacy Prefect 1.0 docs](https://docs-v1.prefect.io/) at [https://docs-v1.prefect.io/](https://docs.prefect.io/).

---

## Hello, Orion!

Powered by the Orion engine, Prefect is the easiest way to transform any function into a unit of work that can be observed and governed by orchestration rules. 

Add workflow features like retries, distributed execution, scheduling, caching, and much more, with minimal changes to your code. Every activity is tracked and becomes visible in the Orion Dashboard.

```python
from prefect import flow, task
from typing import List
import httpx


@task(retries=3)
def get_stars(repo: str):
    url = f"https://api.github.com/repos/{repo}"
    count = httpx.get(url).json()["stargazers_count"]
    print(f"{repo} has {count} stars!")


@flow(name="GitHub Stars")
def github_stars(repos: List[str]):
    for repo in repos:
        get_stars(repo)


# run the flow!
github_stars(["PrefectHQ/Prefect"])
```

After running any running some flows, fire up the UI to gain insight into their execution:

```bash
prefect orion start
```

![](/docs/img/ui/orion-dashboard.png)

From here, you can continue to use Prefect interactively or set up automated [deployments](https://docs.prefect.io/concepts/deployments).

## Next steps

Prefect 2.0 was designed to be incrementally adopted into your workflows, and our documentation is organized to support your exploration as much as possible. It is organized into four main sections whose applicability will depend on your objectives and comfort level.

### Getting started

Begin by [installing Prefect](https://docs.prefect.io/getting-started/installation) on your machine--Prefect currently supports the following Python versions: 3.7, 3.8, 3.9, 3.10. Then follow one of our [friendly tutorials](https://docs.prefect.io/tutorials/first-steps) to learn by example. See the [Getting Started overview](https://docs.prefect.io/getting-started/overview) for more.

### Concepts

Learn more about Prefect's features and design by reading our in-depth [concept docs](https://docs.prefect.io/concepts/overview). These are intended to introduce the building blocks of Prefect, build up to orchestration and deployment, and finally cover some of the advanced use cases that Prefect makes possible.

### Frequently asked questions

Prefect 2.0 represents a fundamentally new way of building and orchestrating data workflows. Learn more about the project by reading our [FAQ](https://docs.prefect.io/faq).

### API reference

Prefect provides a number of programmatic workflow interfaces, each of which is documented in the [API Reference](https://docs.prefect.io/api-ref/overview). This is where you can learn how a specific function works, or see the expected payload for a REST endpoint.

### Contributing

See our [documentation on contributing to Prefect 2.0](https://docs.prefect.io/contributing/overview/).


## Join the community

Prefect 2.0 was made possible by the fastest-growing community of data engineers. The [Prefect Slack community](https://prefect.io/slack) is a fantastic place to learn more, ask questions, or get help with workflow design. The [Prefect Discourse](https://discourse.prefect.io/) is an additional community-driven knowledge base to find answers to your Prefect-related questions. Join us and thousands of friendly data engineers to help build a new kind of workflow system.

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/PrefectHQ/prefect/tree/orion",
    "name": "prefect",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.7",
    "maintainer_email": "",
    "keywords": "",
    "author": "Prefect Technologies, Inc.",
    "author_email": "help@prefect.io",
    "download_url": "https://files.pythonhosted.org/packages/54/af/a1a6315d4c66b4d765401c9042986a741a0e284cdaa0f09765e588aafa69/prefect-2.1.1.tar.gz",
    "platform": null,
    "description": "<p align=\"center\"><img src=\"https://images.ctfassets.net/gm98wzqotmnx/6rIpC9ZCAewsRGLwOw5BRe/bb17e1ef62f60d1ec32c1ae69487704c/prefect-2-logo-dark.png\" width=1000></p>\n\n<p align=\"center\">\n    <a href=\"https://pypi.python.org/pypi/prefect/\" alt=\"PyPI version\">\n        <img src=\"https://badge.fury.io/py/prefect.svg\" /></a>\n    <a href=\"https://github.com/prefecthq/prefect/\" alt=\"Stars\">\n        <img src=\"https://img.shields.io/github/stars/prefecthq/prefect\" /></a>\n    <a href=\"https://pepy.tech/badge/prefect/\" alt=\"Downloads\">\n        <img src=\"https://pepy.tech/badge/prefect\" /></a>\n    <a href=\"https://github.com/prefecthq/prefect/pulse\" alt=\"Activity\">\n        <img src=\"https://img.shields.io/github/commit-activity/m/prefecthq/prefect\" /></a>\n    <a href=\"https://github.com/prefecthq/prefect/graphs/contributors\" alt=\"Contributors\">\n        <img src=\"https://img.shields.io/github/contributors/prefecthq/prefect\" /></a>\n    <br>\n    <a href=\"https://prefect-community.slack.com\" alt=\"Slack\">\n        <img src=\"https://img.shields.io/badge/slack-join_community-red.svg?logo=slack\" /></a>\n    <a href=\"https://discourse.prefect.io/\" alt=\"Discourse\">\n        <img src=\"https://img.shields.io/badge/discourse-browse_forum-red.svg?logo=discourse\" /></a>\n</p>\n\n# Prefect 2.0\n\nPrefect 2.0 is the second-generation dataflow coordination and orchestration platform from [Prefect](https://www.prefect.io).\n\nPrefect 2.0 has been designed from the ground up to handle the dynamic, scalable workloads that the modern data stack demands. Powered by Prefect Orion, a brand-new, asynchronous rules engine, it represents an enormous amount of research, development, and dedication to a simple idea:\n\n_**You should love your workflows again.**_\n\n[Read the docs](https://docs.prefect.io/), run the code, or host the UI. Join thousands of community members in [our Slack community](https://www.prefect.io/slack) to share your thoughts and feedback. Thanks for being part of the mission to build a new kind of workflow system and, of course, **happy engineering!**\n\n**\"Don't Panic\"**\n\nStill using Prefect 1.0 Core and Server? Find the [legacy Prefect 1.0 docs](https://docs-v1.prefect.io/) at [https://docs-v1.prefect.io/](https://docs.prefect.io/).\n\n---\n\n## Hello, Orion!\n\nPowered by the Orion engine, Prefect is the easiest way to transform any function into a unit of work that can be observed and governed by orchestration rules. \n\nAdd workflow features like retries, distributed execution, scheduling, caching, and much more, with minimal changes to your code. Every activity is tracked and becomes visible in the Orion Dashboard.\n\n```python\nfrom prefect import flow, task\nfrom typing import List\nimport httpx\n\n\n@task(retries=3)\ndef get_stars(repo: str):\n    url = f\"https://api.github.com/repos/{repo}\"\n    count = httpx.get(url).json()[\"stargazers_count\"]\n    print(f\"{repo} has {count} stars!\")\n\n\n@flow(name=\"GitHub Stars\")\ndef github_stars(repos: List[str]):\n    for repo in repos:\n        get_stars(repo)\n\n\n# run the flow!\ngithub_stars([\"PrefectHQ/Prefect\"])\n```\n\nAfter running any running some flows, fire up the UI to gain insight into their execution:\n\n```bash\nprefect orion start\n```\n\n![](/docs/img/ui/orion-dashboard.png)\n\nFrom here, you can continue to use Prefect interactively or set up automated [deployments](https://docs.prefect.io/concepts/deployments).\n\n## Next steps\n\nPrefect 2.0 was designed to be incrementally adopted into your workflows, and our documentation is organized to support your exploration as much as possible. It is organized into four main sections whose applicability will depend on your objectives and comfort level.\n\n### Getting started\n\nBegin by [installing Prefect](https://docs.prefect.io/getting-started/installation) on your machine--Prefect currently supports the following Python versions: 3.7, 3.8, 3.9, 3.10. Then follow one of our [friendly tutorials](https://docs.prefect.io/tutorials/first-steps) to learn by example. See the [Getting Started overview](https://docs.prefect.io/getting-started/overview) for more.\n\n### Concepts\n\nLearn more about Prefect's features and design by reading our in-depth [concept docs](https://docs.prefect.io/concepts/overview). These are intended to introduce the building blocks of Prefect, build up to orchestration and deployment, and finally cover some of the advanced use cases that Prefect makes possible.\n\n### Frequently asked questions\n\nPrefect 2.0 represents a fundamentally new way of building and orchestrating data workflows. Learn more about the project by reading our [FAQ](https://docs.prefect.io/faq).\n\n### API reference\n\nPrefect provides a number of programmatic workflow interfaces, each of which is documented in the [API Reference](https://docs.prefect.io/api-ref/overview). This is where you can learn how a specific function works, or see the expected payload for a REST endpoint.\n\n### Contributing\n\nSee our [documentation on contributing to Prefect 2.0](https://docs.prefect.io/contributing/overview/).\n\n\n## Join the community\n\nPrefect 2.0 was made possible by the fastest-growing community of data engineers. The [Prefect Slack community](https://prefect.io/slack) is a fantastic place to learn more, ask questions, or get help with workflow design. The [Prefect Discourse](https://discourse.prefect.io/) is an additional community-driven knowledge base to find answers to your Prefect-related questions. Join us and thousands of friendly data engineers to help build a new kind of workflow system.\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "Workflow orchestration and management.",
    "version": "2.1.1",
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "39d4395f6107ed2dfe398ad292a31b6f",
                "sha256": "dac2357900c78d0657b9fd0e1fca5755bfb94ad2168b7d3448eba7f7730d59d0"
            },
            "downloads": -1,
            "filename": "prefect-2.1.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "39d4395f6107ed2dfe398ad292a31b6f",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.7",
            "size": 1004460,
            "upload_time": "2022-08-18T15:30:24",
            "upload_time_iso_8601": "2022-08-18T15:30:24.581760Z",
            "url": "https://files.pythonhosted.org/packages/98/9b/bcfa974bef970ee6be457701831f91c5f92aa0a0e3f916d25f96deca3b24/prefect-2.1.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "7dbeb9ee0741b4c5436494b91528304b",
                "sha256": "9ff9a631180859cc80591b07d4be965e4a2aa86fb7a909247a88359c8e533e1d"
            },
            "downloads": -1,
            "filename": "prefect-2.1.1.tar.gz",
            "has_sig": false,
            "md5_digest": "7dbeb9ee0741b4c5436494b91528304b",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.7",
            "size": 890076,
            "upload_time": "2022-08-18T15:30:26",
            "upload_time_iso_8601": "2022-08-18T15:30:26.134960Z",
            "url": "https://files.pythonhosted.org/packages/54/af/a1a6315d4c66b4d765401c9042986a741a0e284cdaa0f09765e588aafa69/prefect-2.1.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2022-08-18 15:30:26",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "lcname": "prefect"
}
        
Elapsed time: 0.52788s