Native HDFS Python bindings based on hdfs-native Rust package.
## Installation
```bash
pip install hdfs-native
```
## Example
```python
from hdfs_native import Client
client = Client("hdfs://localhost:9000")
status = client.get_file_info("/file.txt")
```
## Kerberos support
Kerberos (SASL GSSAPI) is supported through a runtime dynamic link to `libgssapi_krb5`. This must be installed separately, but is likely already installed on your system. If not you can install it by:
#### Debian-based systems
```bash
apt-get install libgssapi-krb5-2
```
#### RHEL-based systems
```bash
yum install krb5-libs
```
#### MacOS
```bash
brew install krb5
```
## Running tests
The same requirements apply as the Rust tests, requiring Java, Maven, Hadoop, and Kerberos tools to be on your path. Then you can:
```bash
python3 -m venv .venv
source .venv/bin/activate
pip3 install maturin
maturin develop -E devel
pytest
```
Raw data
{
"_id": null,
"home_page": "https://github.com/Kimahriman/hdfs-native",
"name": "hdfs-native",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": "hadoop, hdfs",
"author": "Adam Binford <adamq43@gmail.com>",
"author_email": "Adam Binford <adamq43@gmail.com>",
"download_url": "https://files.pythonhosted.org/packages/e3/dc/e7e75d1224c9b7e8065cf8e99ee5b5aa5a67ecb340d91b0e80bdd9e9d259/hdfs_native-0.10.3.tar.gz",
"platform": null,
"description": "Native HDFS Python bindings based on hdfs-native Rust package.\n\n## Installation\n\n```bash\npip install hdfs-native\n```\n\n## Example\n\n```python\nfrom hdfs_native import Client\nclient = Client(\"hdfs://localhost:9000\")\n\nstatus = client.get_file_info(\"/file.txt\")\n```\n\n## Kerberos support\nKerberos (SASL GSSAPI) is supported through a runtime dynamic link to `libgssapi_krb5`. This must be installed separately, but is likely already installed on your system. If not you can install it by:\n\n#### Debian-based systems\n```bash\napt-get install libgssapi-krb5-2\n```\n\n#### RHEL-based systems\n```bash\nyum install krb5-libs\n```\n\n#### MacOS\n```bash\nbrew install krb5\n```\n\n## Running tests\nThe same requirements apply as the Rust tests, requiring Java, Maven, Hadoop, and Kerberos tools to be on your path. Then you can:\n\n```bash\npython3 -m venv .venv\nsource .venv/bin/activate\npip3 install maturin\nmaturin develop -E devel\npytest\n```\n",
"bugtrack_url": null,
"license": "Apache-2.0",
"summary": "Python bindings for hdfs-native Rust library",
"version": "0.10.3",
"project_urls": {
"Homepage": "https://github.com/Kimahriman/hdfs-native",
"repository": "https://github.com/Kimahriman/hdfs-native"
},
"split_keywords": [
"hadoop",
" hdfs"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "cd8745b92cd50610e26207ba120875f02f4df69df7a540aeda5656f50f2b414f",
"md5": "3992989031752132f3ff8082f6d9a1bd",
"sha256": "d5e9c1f14a2d410089a0023184cba6f85cd447d7775ae53c5650a63fcd5c7d56"
},
"downloads": -1,
"filename": "hdfs_native-0.10.3-cp38-abi3-macosx_10_12_x86_64.whl",
"has_sig": false,
"md5_digest": "3992989031752132f3ff8082f6d9a1bd",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.8",
"size": 2271097,
"upload_time": "2024-11-07T17:06:00",
"upload_time_iso_8601": "2024-11-07T17:06:00.893232Z",
"url": "https://files.pythonhosted.org/packages/cd/87/45b92cd50610e26207ba120875f02f4df69df7a540aeda5656f50f2b414f/hdfs_native-0.10.3-cp38-abi3-macosx_10_12_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "f9e7fa0fc8d015968c416a5bca0723f6dcd6446e38dde20c52969178996837b3",
"md5": "f56b5c66ae9f21131260b2f97459f049",
"sha256": "8b40b2076492b0c8da219af2fe7b75cc1f0d6fa9608e71c4206fdc3da8d3b2df"
},
"downloads": -1,
"filename": "hdfs_native-0.10.3-cp38-abi3-macosx_11_0_arm64.whl",
"has_sig": false,
"md5_digest": "f56b5c66ae9f21131260b2f97459f049",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.8",
"size": 2156837,
"upload_time": "2024-11-07T17:06:02",
"upload_time_iso_8601": "2024-11-07T17:06:02.881156Z",
"url": "https://files.pythonhosted.org/packages/f9/e7/fa0fc8d015968c416a5bca0723f6dcd6446e38dde20c52969178996837b3/hdfs_native-0.10.3-cp38-abi3-macosx_11_0_arm64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "201fbeee4e8dd46e064f6a3ee44189c7e0d779e4fb4ea709f79a5297eb9dc65b",
"md5": "8026f59e417370c1faa8c716d74466a2",
"sha256": "15455e2bdb50ead9bde7bfeb534be50281d96015f4cdfcc1a8a5c3ea24e7c444"
},
"downloads": -1,
"filename": "hdfs_native-0.10.3-cp38-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"has_sig": false,
"md5_digest": "8026f59e417370c1faa8c716d74466a2",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.8",
"size": 2383713,
"upload_time": "2024-11-07T17:06:04",
"upload_time_iso_8601": "2024-11-07T17:06:04.143362Z",
"url": "https://files.pythonhosted.org/packages/20/1f/beee4e8dd46e064f6a3ee44189c7e0d779e4fb4ea709f79a5297eb9dc65b/hdfs_native-0.10.3-cp38-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "8a440b5203a8b8378bef69c8437116623bc4de979eb8e537741c7c8ed71e67d3",
"md5": "499f35e14aa2932cc8a064ae92f7a0fd",
"sha256": "c1fd8289f95fba0ca307a49612c3337bba7e9213c6cb578d244044665463000a"
},
"downloads": -1,
"filename": "hdfs_native-0.10.3-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "499f35e14aa2932cc8a064ae92f7a0fd",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": ">=3.8",
"size": 2476725,
"upload_time": "2024-11-07T17:06:05",
"upload_time_iso_8601": "2024-11-07T17:06:05.535927Z",
"url": "https://files.pythonhosted.org/packages/8a/44/0b5203a8b8378bef69c8437116623bc4de979eb8e537741c7c8ed71e67d3/hdfs_native-0.10.3-cp38-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "e3dce7e75d1224c9b7e8065cf8e99ee5b5aa5a67ecb340d91b0e80bdd9e9d259",
"md5": "5b0382a26612ac2da7865c54be7e0c80",
"sha256": "0c1ed53ffef85f416c9238fc3e2a68b17800e5807467137eb505bec7bb0c5caf"
},
"downloads": -1,
"filename": "hdfs_native-0.10.3.tar.gz",
"has_sig": false,
"md5_digest": "5b0382a26612ac2da7865c54be7e0c80",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 154013,
"upload_time": "2024-11-07T17:06:06",
"upload_time_iso_8601": "2024-11-07T17:06:06.851967Z",
"url": "https://files.pythonhosted.org/packages/e3/dc/e7e75d1224c9b7e8065cf8e99ee5b5aa5a67ecb340d91b0e80bdd9e9d259/hdfs_native-0.10.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-11-07 17:06:06",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "Kimahriman",
"github_project": "hdfs-native",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "hdfs-native"
}
JSON
