python-pachyderm


Namepython-pachyderm JSON
Version 7.6.0 PyPI version JSON
download
home_pagehttps://github.com/pachyderm/python-pachyderm
SummaryPython Pachyderm Client
upload_time2023-08-18 20:38:21
maintainer
docs_urlNone
authorPachyderm Integrations
requires_python>=3.8,<4.0
licenseApache 2.0
keywords pachyderm
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # Python Pachyderm

[![PyPI Package latest release](https://img.shields.io/pypi/v/python-pachyderm.svg)](https://pypi.python.org/pypi/python-pachyderm)
[![Supported versions](https://img.shields.io/pypi/pyversions/python-pachyderm.svg)](https://pypi.python.org/pypi/python-pachyderm)
[![Slack Status](https://badge.slack.pachyderm.io/badge.svg)](http://slack.pachyderm.io)

Official Python Pachyderm client.

This library provides the autogenerated gRPC/protobuf code for Pachyderm, along with a higher-level and more pythonic `Client` class.
See the [API docs](https://python-pachyderm.readthedocs.io/en/stable/).

## Installation

```bash
pip install python-pachyderm
```

## A Small Taste

Here's an example that creates a repo and adds a file:

```python
import python_pachyderm

# Connects to a pachyderm cluster on localhost:30650.
# For other options, see the API docs.
client = python_pachyderm.Client()

# Create a pachyderm repo called `test`
client.create_repo("test")

# Create a file in `(repo="test", branch="master")` at `/dir_a/data.txt`
# Similar to `pachctl put file test@master:/dir_a/data.txt`
with client.commit("test", "master") as commit:
    client.put_file_bytes(commit, "/dir_a/data.txt", b"DATA")

# Get back the file
f = client.get_file(("test", "master"), "/dir_a/data.txt")
print(f.read())  # >>> b"DATA"
```

How to load a CSV file into a Pandas dataframe

```python
import pandas as pd

f = client.get_file(("my_repo", "my_branch"), "/path_to/my_data.csv")
df = pd.read_csv(f)
```

For more sophisticated examples, [see the examples directory](https://github.com/pachyderm/python-pachyderm/tree/master/examples).

## Versioning

Prior to python-pachyderm 2.0, this library's versioning synced with pachyderm's core versioning; e.g. version 1.8.5 of this library synced with 1.8.5 of pachyderm core. python-pachyderm 2.0 onwards uses semver instead, so versions are not tied to pachyderm core. This was done for two reasons:

1. Sometimes this library makes breaking or backwards-incompatible changes, which aren't properly conveyed by revision changes.
2. Pachyderm core is stable enough that most features of this library will work for disparate versions of pachyderm clusters. To help ensure this, this library's CI tests against several versions of pachyderm core.

However, if for whatever reason you need to know which version of pachyderm core a version of python-pachyderm was built with, consult `CHANGELOG.md`. As a broad rule of thumb, we recommend working with the latest version of both pachyderm core and python-pachyderm where possible.

## Contributing

This driver is co-maintained by Pachyderm and the community. If you're looking to contribute to the project, this is a fantastic place to get involved. Take a look at [the contributing guide](./contributing.md) for more info (including testing instructions).

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/pachyderm/python-pachyderm",
    "name": "python-pachyderm",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.8,<4.0",
    "maintainer_email": "",
    "keywords": "pachyderm",
    "author": "Pachyderm Integrations",
    "author_email": "integrations@pachyderm.io",
    "download_url": "https://files.pythonhosted.org/packages/18/14/7b72dce47bac12674a81658b33e25d6f1183bab11d857e3fffd6f42d996e/python_pachyderm-7.6.0.tar.gz",
    "platform": null,
    "description": "# Python Pachyderm\n\n[![PyPI Package latest release](https://img.shields.io/pypi/v/python-pachyderm.svg)](https://pypi.python.org/pypi/python-pachyderm)\n[![Supported versions](https://img.shields.io/pypi/pyversions/python-pachyderm.svg)](https://pypi.python.org/pypi/python-pachyderm)\n[![Slack Status](https://badge.slack.pachyderm.io/badge.svg)](http://slack.pachyderm.io)\n\nOfficial Python Pachyderm client.\n\nThis library provides the autogenerated gRPC/protobuf code for Pachyderm, along with a higher-level and more pythonic `Client` class.\nSee the [API docs](https://python-pachyderm.readthedocs.io/en/stable/).\n\n## Installation\n\n```bash\npip install python-pachyderm\n```\n\n## A Small Taste\n\nHere's an example that creates a repo and adds a file:\n\n```python\nimport python_pachyderm\n\n# Connects to a pachyderm cluster on localhost:30650.\n# For other options, see the API docs.\nclient = python_pachyderm.Client()\n\n# Create a pachyderm repo called `test`\nclient.create_repo(\"test\")\n\n# Create a file in `(repo=\"test\", branch=\"master\")` at `/dir_a/data.txt`\n# Similar to `pachctl put file test@master:/dir_a/data.txt`\nwith client.commit(\"test\", \"master\") as commit:\n    client.put_file_bytes(commit, \"/dir_a/data.txt\", b\"DATA\")\n\n# Get back the file\nf = client.get_file((\"test\", \"master\"), \"/dir_a/data.txt\")\nprint(f.read())  # >>> b\"DATA\"\n```\n\nHow to load a CSV file into a Pandas dataframe\n\n```python\nimport pandas as pd\n\nf = client.get_file((\"my_repo\", \"my_branch\"), \"/path_to/my_data.csv\")\ndf = pd.read_csv(f)\n```\n\nFor more sophisticated examples, [see the examples directory](https://github.com/pachyderm/python-pachyderm/tree/master/examples).\n\n## Versioning\n\nPrior to python-pachyderm 2.0, this library's versioning synced with pachyderm's core versioning; e.g. version 1.8.5 of this library synced with 1.8.5 of pachyderm core. python-pachyderm 2.0 onwards uses semver instead, so versions are not tied to pachyderm core. This was done for two reasons:\n\n1. Sometimes this library makes breaking or backwards-incompatible changes, which aren't properly conveyed by revision changes.\n2. Pachyderm core is stable enough that most features of this library will work for disparate versions of pachyderm clusters. To help ensure this, this library's CI tests against several versions of pachyderm core.\n\nHowever, if for whatever reason you need to know which version of pachyderm core a version of python-pachyderm was built with, consult `CHANGELOG.md`. As a broad rule of thumb, we recommend working with the latest version of both pachyderm core and python-pachyderm where possible.\n\n## Contributing\n\nThis driver is co-maintained by Pachyderm and the community. If you're looking to contribute to the project, this is a fantastic place to get involved. Take a look at [the contributing guide](./contributing.md) for more info (including testing instructions).\n",
    "bugtrack_url": null,
    "license": "Apache 2.0",
    "summary": "Python Pachyderm Client",
    "version": "7.6.0",
    "project_urls": {
        "Documentation": "https://python-pachyderm.readthedocs.io/en/stable/",
        "Homepage": "https://github.com/pachyderm/python-pachyderm",
        "Repository": "https://github.com/pachyderm/python-pachyderm"
    },
    "split_keywords": [
        "pachyderm"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "b1fc36ff22051880a564c81a02ac90e2715f4ae2471d2213dd147155e1723825",
                "md5": "7d9f08dd28711c2fe8ffb9c68f8a1e7b",
                "sha256": "b4e5919159e2dd357998325e997a23b5ac37d3c569d97bf926ede5902efaa224"
            },
            "downloads": -1,
            "filename": "python_pachyderm-7.6.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "7d9f08dd28711c2fe8ffb9c68f8a1e7b",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8,<4.0",
            "size": 156529,
            "upload_time": "2023-08-18T20:38:19",
            "upload_time_iso_8601": "2023-08-18T20:38:19.638952Z",
            "url": "https://files.pythonhosted.org/packages/b1/fc/36ff22051880a564c81a02ac90e2715f4ae2471d2213dd147155e1723825/python_pachyderm-7.6.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "18147b72dce47bac12674a81658b33e25d6f1183bab11d857e3fffd6f42d996e",
                "md5": "df9aa064b396f8d892c3c049dce8c092",
                "sha256": "5398ae558e5603acba4629822b307251c226c4a64551e8d3d7a4bde5555eb87d"
            },
            "downloads": -1,
            "filename": "python_pachyderm-7.6.0.tar.gz",
            "has_sig": false,
            "md5_digest": "df9aa064b396f8d892c3c049dce8c092",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8,<4.0",
            "size": 135541,
            "upload_time": "2023-08-18T20:38:21",
            "upload_time_iso_8601": "2023-08-18T20:38:21.700351Z",
            "url": "https://files.pythonhosted.org/packages/18/14/7b72dce47bac12674a81658b33e25d6f1183bab11d857e3fffd6f42d996e/python_pachyderm-7.6.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-08-18 20:38:21",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "pachyderm",
    "github_project": "python-pachyderm",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "circle": true,
    "tox": true,
    "lcname": "python-pachyderm"
}
        
Elapsed time: 0.12593s