polyaxon


Namepolyaxon JSON
Version 1.8.3 PyPI version JSON
download
home_pagehttps://github.com/polyaxon/polyaxon
SummaryCommand Line Interface (CLI) and client to interact with Polyaxon API.
upload_time2021-04-16 08:22:47
maintainerPolyaxon, Inc.
docs_urlNone
authorPolyaxon, Inc.
requires_python>=3.5
licenseApache 2.0
keywords polyaxon aws s3 microsoft azure google cloud storage gcs deep-learning machine-learning data-science neural-networks artificial-intelligence ai reinforcement-learning kubernetes aws microsoft azure google cloud tensorflow pytorch
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            [![License: Apache 2](https://img.shields.io/badge/License-apache2-blue.svg?style=flat&longCache=true)](LICENSE)
[![Polyaxon API](https://img.shields.io/docker/pulls/polyaxon/polyaxon-api)](https://hub.docker.com/r/polyaxon/polyaxon-api)
[![Slack](https://img.shields.io/badge/Slack-1.2k%20members-blue.svg?style=flat&logo=slack&longCache=true)](https://polyaxon.com/slack/)

[![Docs](https://img.shields.io/badge/docs-stable-brightgreen.svg?style=flat&longCache=true)](https://polyaxon.com/docs/)
[![Release](https://img.shields.io/badge/release-v1.8.3-brightgreen.svg?longCache=true)](https://github.com/polyaxon/polyaxon/releases/tag/v1.8.3)
[![GitHub](https://img.shields.io/badge/issue_tracker-github-blue?style=flat&logo=github&longCache=true)](https://github.com/polyaxon/polyaxon/issues)
[![GitHub](https://img.shields.io/badge/roadmap-github-blue?style=flat&logo=github&longCache=true)](https://github.com/polyaxon/polyaxon/milestones)

[![Operator](https://github.com/polyaxon/polyaxon/workflows/Polyaxon%20Operator/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Polyaxon+Operator%22)
[![Core](https://github.com/polyaxon/polyaxon/workflows/Polyaxon%20Core/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Polyaxon+Core%22)
[![Api](https://github.com/polyaxon/polyaxon/workflows/Polyaxon%20Api/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Polyaxon+Api%22)
[![scheduler](https://github.com/polyaxon/polyaxon/workflows/Polyaxon%20scheduler/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Polyaxon+Scheduler%22)

[![Hub](https://github.com/polyaxon/polyaxon/workflows/Test%20hub/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Test+hub%22)
[![Helm Charts](https://github.com/polyaxon/polyaxon/workflows/Helm%20Charts/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Helm+Charts%22)
[![Codacy Badge](https://api.codacy.com/project/badge/Grade/90c05b6b112548c1a88b950beceacb69)](https://www.codacy.com/app/polyaxon/polyaxon?utm_source=github.com&utm_medium=referral&utm_content=polyaxon/polyaxon&utm_campaign=Badge_Grade)

<br>
<p align="center">
  <p align="center">
    <a href="https://polyaxon.com/?utm_source=github&utm_medium=logo" target="_blank">
      <img src="https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/logo/vector/primary-white-default-monochrome.svg" alt="polyaxon" height="100">
    </a>
  </p>
  <p align="center">
    Reproduce, Automate, Scale your data science.
  </p>
</p>
<br>


Welcome to Polyaxon, a platform for building, training, and monitoring large scale deep learning applications.
We are making a system to solve reproducibility, automation, and scalability for machine learning applications.

Polyaxon deploys into any data center, cloud provider, or can be hosted and managed by Polyaxon, and it supports all the major deep learning frameworks such as Tensorflow, MXNet, Caffe, Torch, etc.

Polyaxon makes it faster, easier, and more efficient to develop deep learning applications by managing workloads with smart container and node management. And it turns GPU servers into shared, self-service resources for your team or organization.

<br>
<p align="center">
  <img src="https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/demo.gif" alt="demo" width="80%">
</p>
<br>

# Install

#### TL;DR;

* Install CLI

    ```bash
    # Install Polyaxon CLI
    $ pip install -U polyaxon
    ```

 * Create a deployment

    ```bash
    # Create a namespace
    $ kubectl create namespace polyaxon

    # Add Polyaxon charts repo
    $ helm repo add polyaxon https://charts.polyaxon.com

    # Deploy Polyaxon
    $ polyaxon admin deploy -f config.yaml

    # Access API
    $ polyaxon port-forward
    ```

Please check [polyaxon installation guide](https://polyaxon.com/docs/setup/)

# Quick start

#### TL;DR;

 * Start a project

    ```bash
    # Create a project
    $ polyaxon project create --name=quick-start --description='Polyaxon quick start.'
    ```

 * Train and track logs & resources

    ```bash
    # Upload code and start experiments
    $ polyaxon run -f experiment.yaml -u -l
    ```

 * Dashboard

    ```bash
    # Start Polyaxon dashboard
    $ polyaxon dashboard

    Dashboard page will now open in your browser. Continue? [Y/n]: y
    ```

 * Notebook
    ```bash
    # Start Jupyter notebook for your project
    $ polyaxon run --hub notebook
    ```

 * Tensorboard
    ```bash
    # Start TensorBoard for a run's output
    $ polyaxon run --hub tensorboard -P uuid=UUID
    ```

<br>
<p align="center">
  <img src="https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/compare.png" alt="compare" width="400">
  <img src="https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/dashboards.png" alt="dashboards" width="400">
  <img src="https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/tensorboard.png" alt="tensorboard" width="400">
  <img src="https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/notebook.png" alt="compare" width="400">
</p>
<br>

Please check our [quick start guide](https://polyaxon.com/docs/intro/quick-start/) to start training your first experiment.

# Distributed job

Polyaxon supports and simplifies distributed jobs.
Depending on the framework you are using, you need to deploy the corresponding operator, adapt your code to enable the distributed training,
and update your polyaxonfile.

Here are some examples of using distributed training: 

 * [Distributed Tensorflow](https://polyaxon.com/docs/experimentation/distributed/tf-jobs/)
 * [Distributed Pytorch](https://polyaxon.com/docs/experimentation/distributed/pytorch-jobs/)
 * [Distributed MPI](https://polyaxon.com/docs/experimentation/distributed/mpi-jobs/)
 * [Horovod](https://polyaxon.com/integrations/horovod/)
 * [Spark](https://polyaxon.com/docs/experimentation/distributed/spark-jobs/)
 * [Dask](https://polyaxon.com/docs/experimentation/distributed/dask-jobs/)

# Hyperparameters tuning

Polyaxon has a concept for suggesting hyperparameters and managing their results very similar to Google Vizier called experiment groups.
An experiment group in Polyaxon defines a search algorithm, a search space, and a model to train.

 * [Grid search](https://polyaxon.com/docs/automation/optimization-engine/grid-search/)
 * [Random search](https://polyaxon.com/docs/automation/optimization-engine/random-search/)
 * [Hyperband](https://polyaxon.com/docs/automation/optimization-engine/hyperband/)
 * [Bayesian Optimization](https://polyaxon.com/docs/automation/optimization-engine/bayesian-optimization/)
 * [Hyperopt](https://polyaxon.com/docs/automation/optimization-engine/hyperopt/)
 * [Custom Iterative Optimization](https://polyaxon.com/docs/automation/optimization-engine/iterative/)

# Parallel executions

You can run your processing or model training jobs in parallel, Polyaxon provides a [mapping](https://polyaxon.com/docs/automation/mapping/) abstraction to manage concurrent jobs.

# DAGs and workflows

[Polyaxon DAGs](https://polyaxon.com/docs/automation/flow-engine/) is a tool that provides container-native engine for running machine learning pipelines. 
A DAG manages multiple operations with dependencies. Each operation is defined by a component runtime. 
This means that operations in a DAG can be jobs, services, distributed jobs, parallel executions, or nested DAGs.


# Architecture

![Polyaxon architecture](artifacts/polyaxon_architecture.png)

# Documentation

Check out our [documentation](https://polyaxon.com/docs/) to learn more about Polyaxon.

# Dashboard

Polyaxon comes with a dashboard that shows the projects and experiments created by you and your team members.

To start the dashboard, just run the following command in your terminal

```bash
$ polyaxon dashboard -y
```

# Project status

Polyaxon is stable and it's running in production mode at many startups and Fortune 500 companies. 

# Contributions

Please follow the contribution guide line: *[Contribute to Polyaxon](CONTRIBUTING.md)*.


# Research

If you use Polyaxon in your academic research, we would be grateful if you could cite it.

Feel free to [contact us](mailto:contact@polyaxon.com), we would love to learn about your project and see how we can support your custom need.



            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/polyaxon/polyaxon",
    "name": "polyaxon",
    "maintainer": "Polyaxon, Inc.",
    "docs_url": null,
    "requires_python": ">=3.5",
    "maintainer_email": "contact@polyaxon.com",
    "keywords": "polyaxon,aws,s3,microsoft,azure,google cloud storage,gcs,deep-learning,machine-learning,data-science,neural-networks,artificial-intelligence,ai,reinforcement-learning,kubernetes,aws,microsoft,azure,google cloud,tensorFlow,pytorch",
    "author": "Polyaxon, Inc.",
    "author_email": "contact@polyaxon.com",
    "download_url": "https://files.pythonhosted.org/packages/1d/62/648f8bcd8ad2575a5ca28fd94877e7839359ca303352456d4536df191f46/polyaxon-1.8.3.tar.gz",
    "platform": "any",
    "description": "[![License: Apache 2](https://img.shields.io/badge/License-apache2-blue.svg?style=flat&longCache=true)](LICENSE)\n[![Polyaxon API](https://img.shields.io/docker/pulls/polyaxon/polyaxon-api)](https://hub.docker.com/r/polyaxon/polyaxon-api)\n[![Slack](https://img.shields.io/badge/Slack-1.2k%20members-blue.svg?style=flat&logo=slack&longCache=true)](https://polyaxon.com/slack/)\n\n[![Docs](https://img.shields.io/badge/docs-stable-brightgreen.svg?style=flat&longCache=true)](https://polyaxon.com/docs/)\n[![Release](https://img.shields.io/badge/release-v1.8.3-brightgreen.svg?longCache=true)](https://github.com/polyaxon/polyaxon/releases/tag/v1.8.3)\n[![GitHub](https://img.shields.io/badge/issue_tracker-github-blue?style=flat&logo=github&longCache=true)](https://github.com/polyaxon/polyaxon/issues)\n[![GitHub](https://img.shields.io/badge/roadmap-github-blue?style=flat&logo=github&longCache=true)](https://github.com/polyaxon/polyaxon/milestones)\n\n[![Operator](https://github.com/polyaxon/polyaxon/workflows/Polyaxon%20Operator/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Polyaxon+Operator%22)\n[![Core](https://github.com/polyaxon/polyaxon/workflows/Polyaxon%20Core/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Polyaxon+Core%22)\n[![Api](https://github.com/polyaxon/polyaxon/workflows/Polyaxon%20Api/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Polyaxon+Api%22)\n[![scheduler](https://github.com/polyaxon/polyaxon/workflows/Polyaxon%20scheduler/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Polyaxon+Scheduler%22)\n\n[![Hub](https://github.com/polyaxon/polyaxon/workflows/Test%20hub/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Test+hub%22)\n[![Helm Charts](https://github.com/polyaxon/polyaxon/workflows/Helm%20Charts/badge.svg)](https://github.com/polyaxon/polyaxon/actions?query=workflow%3A%22Helm+Charts%22)\n[![Codacy Badge](https://api.codacy.com/project/badge/Grade/90c05b6b112548c1a88b950beceacb69)](https://www.codacy.com/app/polyaxon/polyaxon?utm_source=github.com&amp;utm_medium=referral&amp;utm_content=polyaxon/polyaxon&amp;utm_campaign=Badge_Grade)\n\n<br>\n<p align=\"center\">\n  <p align=\"center\">\n    <a href=\"https://polyaxon.com/?utm_source=github&utm_medium=logo\" target=\"_blank\">\n      <img src=\"https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/logo/vector/primary-white-default-monochrome.svg\" alt=\"polyaxon\" height=\"100\">\n    </a>\n  </p>\n  <p align=\"center\">\n    Reproduce, Automate, Scale your data science.\n  </p>\n</p>\n<br>\n\n\nWelcome to Polyaxon, a platform for building, training, and monitoring large scale deep learning applications.\nWe are making a system to solve reproducibility, automation, and scalability for machine learning applications.\n\nPolyaxon deploys into any data center, cloud provider, or can be hosted and managed by Polyaxon, and it supports all the major deep learning frameworks such as Tensorflow, MXNet, Caffe, Torch, etc.\n\nPolyaxon makes it faster, easier, and more efficient to develop deep learning applications by managing workloads with smart container and node management. And it turns GPU servers into shared, self-service resources for your team or organization.\n\n<br>\n<p align=\"center\">\n  <img src=\"https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/demo.gif\" alt=\"demo\" width=\"80%\">\n</p>\n<br>\n\n# Install\n\n#### TL;DR;\n\n* Install CLI\n\n    ```bash\n    # Install Polyaxon CLI\n    $ pip install -U polyaxon\n    ```\n\n * Create a deployment\n\n    ```bash\n    # Create a namespace\n    $ kubectl create namespace polyaxon\n\n    # Add Polyaxon charts repo\n    $ helm repo add polyaxon https://charts.polyaxon.com\n\n    # Deploy Polyaxon\n    $ polyaxon admin deploy -f config.yaml\n\n    # Access API\n    $ polyaxon port-forward\n    ```\n\nPlease check [polyaxon installation guide](https://polyaxon.com/docs/setup/)\n\n# Quick start\n\n#### TL;DR;\n\n * Start a project\n\n    ```bash\n    # Create a project\n    $ polyaxon project create --name=quick-start --description='Polyaxon quick start.'\n    ```\n\n * Train and track logs & resources\n\n    ```bash\n    # Upload code and start experiments\n    $ polyaxon run -f experiment.yaml -u -l\n    ```\n\n * Dashboard\n\n    ```bash\n    # Start Polyaxon dashboard\n    $ polyaxon dashboard\n\n    Dashboard page will now open in your browser. Continue? [Y/n]: y\n    ```\n\n * Notebook\n    ```bash\n    # Start Jupyter notebook for your project\n    $ polyaxon run --hub notebook\n    ```\n\n * Tensorboard\n    ```bash\n    # Start TensorBoard for a run's output\n    $ polyaxon run --hub tensorboard -P uuid=UUID\n    ```\n\n<br>\n<p align=\"center\">\n  <img src=\"https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/compare.png\" alt=\"compare\" width=\"400\">\n  <img src=\"https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/dashboards.png\" alt=\"dashboards\" width=\"400\">\n  <img src=\"https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/tensorboard.png\" alt=\"tensorboard\" width=\"400\">\n  <img src=\"https://raw.githubusercontent.com/polyaxon/polyaxon/master/artifacts/notebook.png\" alt=\"compare\" width=\"400\">\n</p>\n<br>\n\nPlease check our [quick start guide](https://polyaxon.com/docs/intro/quick-start/) to start training your first experiment.\n\n# Distributed job\n\nPolyaxon supports and simplifies distributed jobs.\nDepending on the framework you are using, you need to deploy the corresponding operator, adapt your code to enable the distributed training,\nand update your polyaxonfile.\n\nHere are some examples of using distributed training: \n\n * [Distributed Tensorflow](https://polyaxon.com/docs/experimentation/distributed/tf-jobs/)\n * [Distributed Pytorch](https://polyaxon.com/docs/experimentation/distributed/pytorch-jobs/)\n * [Distributed MPI](https://polyaxon.com/docs/experimentation/distributed/mpi-jobs/)\n * [Horovod](https://polyaxon.com/integrations/horovod/)\n * [Spark](https://polyaxon.com/docs/experimentation/distributed/spark-jobs/)\n * [Dask](https://polyaxon.com/docs/experimentation/distributed/dask-jobs/)\n\n# Hyperparameters tuning\n\nPolyaxon has a concept for suggesting hyperparameters and managing their results very similar to Google Vizier called experiment groups.\nAn experiment group in Polyaxon defines a search algorithm, a search space, and a model to train.\n\n * [Grid search](https://polyaxon.com/docs/automation/optimization-engine/grid-search/)\n * [Random search](https://polyaxon.com/docs/automation/optimization-engine/random-search/)\n * [Hyperband](https://polyaxon.com/docs/automation/optimization-engine/hyperband/)\n * [Bayesian Optimization](https://polyaxon.com/docs/automation/optimization-engine/bayesian-optimization/)\n * [Hyperopt](https://polyaxon.com/docs/automation/optimization-engine/hyperopt/)\n * [Custom Iterative Optimization](https://polyaxon.com/docs/automation/optimization-engine/iterative/)\n\n# Parallel executions\n\nYou can run your processing or model training jobs in parallel, Polyaxon provides a [mapping](https://polyaxon.com/docs/automation/mapping/) abstraction to manage concurrent jobs.\n\n# DAGs and workflows\n\n[Polyaxon DAGs](https://polyaxon.com/docs/automation/flow-engine/) is a tool that provides container-native engine for running machine learning pipelines. \nA DAG manages multiple operations with dependencies. Each operation is defined by a component runtime. \nThis means that operations in a DAG can be jobs, services, distributed jobs, parallel executions, or nested DAGs.\n\n\n# Architecture\n\n![Polyaxon architecture](artifacts/polyaxon_architecture.png)\n\n# Documentation\n\nCheck out our [documentation](https://polyaxon.com/docs/) to learn more about Polyaxon.\n\n# Dashboard\n\nPolyaxon comes with a dashboard that shows the projects and experiments created by you and your team members.\n\nTo start the dashboard, just run the following command in your terminal\n\n```bash\n$ polyaxon dashboard -y\n```\n\n# Project status\n\nPolyaxon is stable and it's running in production mode at many startups and Fortune 500 companies. \n\n# Contributions\n\nPlease follow the contribution guide line: *[Contribute to Polyaxon](CONTRIBUTING.md)*.\n\n\n# Research\n\nIf you use Polyaxon in your academic research, we would be grateful if you could cite it.\n\nFeel free to [contact us](mailto:contact@polyaxon.com), we would love to learn about your project and see how we can support your custom need.\n\n\n",
    "bugtrack_url": null,
    "license": "Apache 2.0",
    "summary": "Command Line Interface (CLI) and client to interact with Polyaxon API.",
    "version": "1.8.3",
    "split_keywords": [
        "polyaxon",
        "aws",
        "s3",
        "microsoft",
        "azure",
        "google cloud storage",
        "gcs",
        "deep-learning",
        "machine-learning",
        "data-science",
        "neural-networks",
        "artificial-intelligence",
        "ai",
        "reinforcement-learning",
        "kubernetes",
        "aws",
        "microsoft",
        "azure",
        "google cloud",
        "tensorflow",
        "pytorch"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "deea530ebb7891e5b1f02bfd37b86d88",
                "sha256": "48b8cf6456136fcb478446d5b6f23c99ae4908dbdaee07f5ca6acf1af310c3b3"
            },
            "downloads": -1,
            "filename": "polyaxon-1.8.3-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "deea530ebb7891e5b1f02bfd37b86d88",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.5",
            "size": 1128523,
            "upload_time": "2021-04-16T08:22:45",
            "upload_time_iso_8601": "2021-04-16T08:22:45.614051Z",
            "url": "https://files.pythonhosted.org/packages/54/84/38802b10a2b3d503ae38bb8faf49ce25a6295c3e5d034ebf44930638ba62/polyaxon-1.8.3-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "md5": "4d38761a7dca4d21097b9ef3ddc6e177",
                "sha256": "40b7c05b8d679c57f63dacc6a3f575814e89da5bddec1c8d8af1267e767ac52b"
            },
            "downloads": -1,
            "filename": "polyaxon-1.8.3.tar.gz",
            "has_sig": false,
            "md5_digest": "4d38761a7dca4d21097b9ef3ddc6e177",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.5",
            "size": 510456,
            "upload_time": "2021-04-16T08:22:47",
            "upload_time_iso_8601": "2021-04-16T08:22:47.539709Z",
            "url": "https://files.pythonhosted.org/packages/1d/62/648f8bcd8ad2575a5ca28fd94877e7839359ca303352456d4536df191f46/polyaxon-1.8.3.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2021-04-16 08:22:47",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "github_user": null,
    "github_project": "polyaxon",
    "error": "Could not fetch GitHub repository",
    "lcname": "polyaxon"
}
        
Elapsed time: 0.26168s