delta-spark


Namedelta-spark JSON
Version 3.2.0 PyPI version JSON
download
home_pagehttps://github.com/delta-io/delta/
SummaryPython APIs for using Delta Lake with Apache Spark
upload_time2024-05-09 17:26:10
maintainerNone
docs_urlNone
authorThe Delta Lake Project Authors
requires_python>=3.6
licenseApache-2.0
keywords delta.io
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # Delta Lake

[Delta Lake](https://delta.io) is an open source storage layer that brings reliability to data lakes. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. Delta Lake runs on top of your existing data lake and is fully compatible with Apache Spark APIs.

This PyPi package contains the Python APIs for using Delta Lake with Apache Spark.

## Installation and usage

1. Install using `pip install delta-spark`
2. To use the Delta Lake with Apache Spark, you have to set additional configurations when creating the SparkSession. See the online [project web page](https://docs.delta.io/latest/delta-intro.html) for details.

## Documentation

This README file only contains basic information related to pip installed Delta Lake. You can find the full documentation on the [project web page](https://docs.delta.io/latest/delta-intro.html)



            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/delta-io/delta/",
    "name": "delta-spark",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.6",
    "maintainer_email": null,
    "keywords": "delta.io",
    "author": "The Delta Lake Project Authors",
    "author_email": "delta-users@googlegroups.com",
    "download_url": "https://files.pythonhosted.org/packages/38/06/a64cc4e17fe959cf60dc126bf3283fc9f22fc91f000b7f3f5e465338022d/delta-spark-3.2.0.tar.gz",
    "platform": null,
    "description": "# Delta Lake\n\n[Delta Lake](https://delta.io) is an open source storage layer that brings reliability to data lakes. Delta Lake provides ACID transactions, scalable metadata handling, and unifies streaming and batch data processing. Delta Lake runs on top of your existing data lake and is fully compatible with Apache Spark APIs.\n\nThis PyPi package contains the Python APIs for using Delta Lake with Apache Spark.\n\n## Installation and usage\n\n1. Install using `pip install delta-spark`\n2. To use the Delta Lake with Apache Spark, you have to set additional configurations when creating the SparkSession. See the online [project web page](https://docs.delta.io/latest/delta-intro.html) for details.\n\n## Documentation\n\nThis README file only contains basic information related to pip installed Delta Lake. You can find the full documentation on the [project web page](https://docs.delta.io/latest/delta-intro.html)\n\n\n",
    "bugtrack_url": null,
    "license": "Apache-2.0",
    "summary": "Python APIs for using Delta Lake with Apache Spark",
    "version": "3.2.0",
    "project_urls": {
        "Documentation": "https://docs.delta.io/latest/index.html",
        "Homepage": "https://github.com/delta-io/delta/",
        "Issues": "https://github.com/delta-io/delta/issues",
        "Source": "https://github.com/delta-io/delta"
    },
    "split_keywords": [
        "delta.io"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "3c8ebb778f5049aa371bf80a7a781b237eb10ef104f8736fe00d25fcfee80c2b",
                "md5": "fd3e7e4b86dbaffd1261f4b64cae4de9",
                "sha256": "c4ff3fa7218e58a702cb71eb64384b0005c4d6f0bbdd0fe0b38a53564d946e09"
            },
            "downloads": -1,
            "filename": "delta_spark-3.2.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "fd3e7e4b86dbaffd1261f4b64cae4de9",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.6",
            "size": 21186,
            "upload_time": "2024-05-09T17:26:09",
            "upload_time_iso_8601": "2024-05-09T17:26:09.544434Z",
            "url": "https://files.pythonhosted.org/packages/3c/8e/bb778f5049aa371bf80a7a781b237eb10ef104f8736fe00d25fcfee80c2b/delta_spark-3.2.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "3806a64cc4e17fe959cf60dc126bf3283fc9f22fc91f000b7f3f5e465338022d",
                "md5": "5ceacf522557f75e6b388a459973d2d0",
                "sha256": "641967828e47c64805f8c746513da80bea24b5f19b069cdcf64561cd3692e11d"
            },
            "downloads": -1,
            "filename": "delta-spark-3.2.0.tar.gz",
            "has_sig": false,
            "md5_digest": "5ceacf522557f75e6b388a459973d2d0",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.6",
            "size": 22147,
            "upload_time": "2024-05-09T17:26:10",
            "upload_time_iso_8601": "2024-05-09T17:26:10.754466Z",
            "url": "https://files.pythonhosted.org/packages/38/06/a64cc4e17fe959cf60dc126bf3283fc9f22fc91f000b7f3f5e465338022d/delta-spark-3.2.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-05-09 17:26:10",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "delta-io",
    "github_project": "delta",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "delta-spark"
}
        
Elapsed time: 0.77417s