fs-dlk


Namefs-dlk JSON
Version 0.1.3 PyPI version JSON
download
home_pagehttps://github.com/emedgene/fs_dlk
SummaryAzure Datalake filesystem for PyFilesystem2
upload_time2020-03-29 22:02:26
maintainer
docs_urlNone
authoremedgene
requires_python
licenseMIT
keywords pyfilesystem azure datalake dlk
VCS
bugtrack_url
requirements six fs azure-datalake-store
Travis-CI No Travis.
coveralls test coverage No coveralls.
            fs\_dlk
=======

`pyfilesystem2 <https://github.com/PyFilesystem/pyfilesystem2>`_ interface to `Azure Datalake <https://github.com/Azure/azure-data-lake-store-python>`_


Installing
----------

::

    pip install fs-dlk


Opening FS Datalake
-------------------

Authentication with username and password:

.. code-block:: python

    from fs_dlk import DLKFS
    dlkfs = DLKFS("/path/to/the/remote/dir", username="username", password="password")


Authentication with tenant secret:

.. code-block:: python

    from fs_dlk import DLKFS
    dlkfs = DLKFS("/path/to/the/remote/dir", tenant_id="tenant id", client_id="client id", client_secret="client_secret")


Specifying custom store name:

.. code-block:: python

    from fs_dlk import DLKFS
    dlkfs = DLKFS("/path/to/the/remote/dir", store="store name", **auth_args_here)


Authentication with connection strings:
---------------------------------------

Username and password auth:

.. code-block:: python

    import fs
    dlkfs = fs.open_fs("dlk://username:password@/store_name/path/to/remote")


Tenant secret auth:

.. code-block:: python

    import fs
    dlkfs = fs.open_fs("dlk://username:password@tenant-id/store_name/path/to/remote")


Downloading files
-----------------

.. code-block:: python

    with open("local_file", "wb") as local_file:
        dlkfs.download("path/to/remote/file", local_file)


Uploading files
-----------------

.. code-block:: python

    with open("local_file", "wb") as local_file:
        dlkfs.upload("path/to/remote/file", local_file)
            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/emedgene/fs_dlk",
    "name": "fs-dlk",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "pyfilesystem,Azure,Datalake,dlk",
    "author": "emedgene",
    "author_email": "pypi@emedgene.com",
    "download_url": "https://files.pythonhosted.org/packages/04/c7/7b0b0907101c3bd69049b2bd344d8c24173a6507d493071c1f284d8944e9/fs-dlk-0.1.3.tar.gz",
    "platform": "any",
    "description": "fs\\_dlk\n=======\n\n`pyfilesystem2 <https://github.com/PyFilesystem/pyfilesystem2>`_ interface to `Azure Datalake <https://github.com/Azure/azure-data-lake-store-python>`_\n\n\nInstalling\n----------\n\n::\n\n    pip install fs-dlk\n\n\nOpening FS Datalake\n-------------------\n\nAuthentication with username and password:\n\n.. code-block:: python\n\n    from fs_dlk import DLKFS\n    dlkfs = DLKFS(\"/path/to/the/remote/dir\", username=\"username\", password=\"password\")\n\n\nAuthentication with tenant secret:\n\n.. code-block:: python\n\n    from fs_dlk import DLKFS\n    dlkfs = DLKFS(\"/path/to/the/remote/dir\", tenant_id=\"tenant id\", client_id=\"client id\", client_secret=\"client_secret\")\n\n\nSpecifying custom store name:\n\n.. code-block:: python\n\n    from fs_dlk import DLKFS\n    dlkfs = DLKFS(\"/path/to/the/remote/dir\", store=\"store name\", **auth_args_here)\n\n\nAuthentication with connection strings:\n---------------------------------------\n\nUsername and password auth:\n\n.. code-block:: python\n\n    import fs\n    dlkfs = fs.open_fs(\"dlk://username:password@/store_name/path/to/remote\")\n\n\nTenant secret auth:\n\n.. code-block:: python\n\n    import fs\n    dlkfs = fs.open_fs(\"dlk://username:password@tenant-id/store_name/path/to/remote\")\n\n\nDownloading files\n-----------------\n\n.. code-block:: python\n\n    with open(\"local_file\", \"wb\") as local_file:\n        dlkfs.download(\"path/to/remote/file\", local_file)\n\n\nUploading files\n-----------------\n\n.. code-block:: python\n\n    with open(\"local_file\", \"wb\") as local_file:\n        dlkfs.upload(\"path/to/remote/file\", local_file)",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Azure Datalake filesystem for PyFilesystem2",
    "version": "0.1.3",
    "split_keywords": [
        "pyfilesystem",
        "azure",
        "datalake",
        "dlk"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "md5": "80f20fb422d979b5a78373a2e2a66121",
                "sha256": "10791eaf2496c31e84847b6be91bac7e8b77a5694ae5b13c0900a85e624bad8e"
            },
            "downloads": -1,
            "filename": "fs-dlk-0.1.3.tar.gz",
            "has_sig": false,
            "md5_digest": "80f20fb422d979b5a78373a2e2a66121",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 5171,
            "upload_time": "2020-03-29T22:02:26",
            "upload_time_iso_8601": "2020-03-29T22:02:26.915429Z",
            "url": "https://files.pythonhosted.org/packages/04/c7/7b0b0907101c3bd69049b2bd344d8c24173a6507d493071c1f284d8944e9/fs-dlk-0.1.3.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2020-03-29 22:02:26",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "github_user": "emedgene",
    "github_project": "fs_dlk",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "requirements": [
        {
            "name": "six",
            "specs": [
                [
                    "==",
                    "1.12.*"
                ]
            ]
        },
        {
            "name": "fs",
            "specs": [
                [
                    "==",
                    "2.4.*"
                ]
            ]
        },
        {
            "name": "azure-datalake-store",
            "specs": [
                [
                    "==",
                    "0.0.*"
                ]
            ]
        }
    ],
    "lcname": "fs-dlk"
}
        
Elapsed time: 0.24135s