tablelineage

Name	tablelineage JSON
Version	0.0.6 JSON
	download
home_page	https://github.com/famutimine/tablelineage
Summary	A python library to get unity catalog table lineage information using azure databricks api
upload_time	2025-01-20 21:16:02
maintainer	None
docs_url	None
author	Daniel Famutimi MD, MPH
requires_python	None
license	MIT
keywords	descriptive statistics
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # tablelineage
A Python package that can be used to retrieve data lineage using Databricks Data Lineage REST API

## Installation

This package is intended to be installed within Databricks as a Python library.

## Example Usage

```python
from tablelineage import ShowMeLineage

## Define the parameters
catalog_name = "<catalog_name>"
schema_name = "<schema_name>"
table_name = "<table_name>"
databricks_instance = "<databricks_instance"  # example: adb--xxxxxxxxxxx.x.azuredatabricks.net
workspace_id = "<workspace_id>"

conn = ShowMeLineage(databricks_instance, workspace_id)
df = conn.getTableLineage(catalog_name, schema_name, table_name)

df.display()

"""
Always exclude 'NA' in the 'lineage_direction' column from the resulting dataframe,
unless you are interested in the links to the notebooks referencing specified table/view name.

"""

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/famutimine/tablelineage",
    "name": "tablelineage",
    "maintainer": null,
    "docs_url": null,
    "requires_python": null,
    "maintainer_email": null,
    "keywords": "descriptive statistics",
    "author": "Daniel Famutimi MD, MPH",
    "author_email": "danielfamutimi@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/7b/98/3b26a27869196bc858349a511f9393c07f0f7c2363675feaa2a167486c50/tablelineage-0.0.6.tar.gz",
    "platform": null,
    "description": "# tablelineage\nA Python package that can be used to retrieve data lineage using Databricks Data Lineage REST API\n\n## Installation\n\nThis package is intended to be installed within Databricks as a Python library.\n\n## Example Usage\n\n```python\nfrom tablelineage import ShowMeLineage\n\n## Define the parameters\ncatalog_name = \"<catalog_name>\"\nschema_name = \"<schema_name>\"\ntable_name = \"<table_name>\"\ndatabricks_instance = \"<databricks_instance\"  # example: adb--xxxxxxxxxxx.x.azuredatabricks.net\nworkspace_id = \"<workspace_id>\"\n\nconn = ShowMeLineage(databricks_instance, workspace_id)\ndf = conn.getTableLineage(catalog_name, schema_name, table_name)\n\ndf.display()\n\n\"\"\"\nAlways exclude 'NA' in the 'lineage_direction' column from the resulting dataframe,\nunless you are interested in the links to the notebooks referencing specified table/view name.\n\n\"\"\"\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "A python library to get unity catalog table lineage information using azure databricks api",
    "version": "0.0.6",
    "project_urls": {
        "Homepage": "https://github.com/famutimine/tablelineage"
    },
    "split_keywords": [
        "descriptive",
        "statistics"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "578b20fe92fd9aaa5f215859878e9c45f81648885cfdb2282418e3451f10a625",
                "md5": "2790411945a2e522fe58eb31de5dcb2a",
                "sha256": "d49f7a89bcb780edc103c6d86a56318563c4d4a344aca6af1fab704cb856a6b6"
            },
            "downloads": -1,
            "filename": "tablelineage-0.0.6-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "2790411945a2e522fe58eb31de5dcb2a",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 2696,
            "upload_time": "2025-01-20T21:16:01",
            "upload_time_iso_8601": "2025-01-20T21:16:01.575559Z",
            "url": "https://files.pythonhosted.org/packages/57/8b/20fe92fd9aaa5f215859878e9c45f81648885cfdb2282418e3451f10a625/tablelineage-0.0.6-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "7b983b26a27869196bc858349a511f9393c07f0f7c2363675feaa2a167486c50",
                "md5": "51ac521fc5ce25e67ae4517683d59181",
                "sha256": "503380fb702acdcf01f2a86b52874b9a492bb3d285b041c2271690c1a47d9b9a"
            },
            "downloads": -1,
            "filename": "tablelineage-0.0.6.tar.gz",
            "has_sig": false,
            "md5_digest": "51ac521fc5ce25e67ae4517683d59181",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 2713,
            "upload_time": "2025-01-20T21:16:02",
            "upload_time_iso_8601": "2025-01-20T21:16:02.960378Z",
            "url": "https://files.pythonhosted.org/packages/7b/98/3b26a27869196bc858349a511f9393c07f0f7c2363675feaa2a167486c50/tablelineage-0.0.6.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2025-01-20 21:16:02",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "famutimine",
    "github_project": "tablelineage",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "tablelineage"
}