getallcolumnname


Namegetallcolumnname JSON
Version 0.2 PyPI version JSON
download
home_pageNone
Summarygetallcolumns
upload_time2024-06-17 00:58:13
maintainerNone
docs_urlNone
authorsrini
requires_pythonNone
licenseNone
keywords python pyspark catalog schema hive_metastore
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            Name of the package: getallcolumnname
Version:0.2
Description : 
For a give catalog it will fetch the below : 
databases
tables
columns
================

Installation
------------

You can install this package using pip:

```sh
pip install getallcolumnname==0.2

Restart kernel:
From databricks:
==================
dbutils.library.restartPython()

Usage
-----

Here is an example of how to use the functions in this package:

```python
import getallcolumnname

```python

## List of catalogs/hive_metastore from which you want to fetch all columns:
Lets says name of the catalog is : "catalog_test"
LIST_OF_CATALOG = ["catalog_test"]

For hive_metastore :
LIST_OF_CATALOG = ["hive_metastore"]

num_databases, num_tables, column_counts_df, df_all_columns = getallcolumnname.get_catalogs_and_databases(LIST_OF_CATALOG)

Display all the catalogs/hive_metastore provided, its databases, its corresponding tables and its corresponding columns
display(df_all_columns)

END OF README.TXT


            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "getallcolumnname",
    "maintainer": null,
    "docs_url": null,
    "requires_python": null,
    "maintainer_email": null,
    "keywords": "python, pyspark, catalog, schema, hive_metastore",
    "author": "srini",
    "author_email": null,
    "download_url": "https://files.pythonhosted.org/packages/39/3c/88552be92c9f00a5e7e742fda92a1c725668e1ad4017de6b7b11d822cc02/getallcolumnname-0.2.tar.gz",
    "platform": null,
    "description": "Name of the package: getallcolumnname\nVersion:0.2\nDescription : \nFor a give catalog it will fetch the below : \ndatabases\ntables\ncolumns\n================\n\nInstallation\n------------\n\nYou can install this package using pip:\n\n```sh\npip install getallcolumnname==0.2\n\nRestart kernel:\nFrom databricks:\n==================\ndbutils.library.restartPython()\n\nUsage\n-----\n\nHere is an example of how to use the functions in this package:\n\n```python\nimport getallcolumnname\n\n```python\n\n## List of catalogs/hive_metastore from which you want to fetch all columns:\nLets says name of the catalog is : \"catalog_test\"\nLIST_OF_CATALOG = [\"catalog_test\"]\n\nFor hive_metastore :\nLIST_OF_CATALOG = [\"hive_metastore\"]\n\nnum_databases, num_tables, column_counts_df, df_all_columns = getallcolumnname.get_catalogs_and_databases(LIST_OF_CATALOG)\n\nDisplay all the catalogs/hive_metastore provided, its databases, its corresponding tables and its corresponding columns\ndisplay(df_all_columns)\n\nEND OF README.TXT\n\n",
    "bugtrack_url": null,
    "license": null,
    "summary": "getallcolumns",
    "version": "0.2",
    "project_urls": null,
    "split_keywords": [
        "python",
        " pyspark",
        " catalog",
        " schema",
        " hive_metastore"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "9642fbfc5c494b9a9484adf336ec6906dd5bd7f73ee2e039a0f78dcffe89e17e",
                "md5": "e555fe54a08c19e374e6a3fc9421b791",
                "sha256": "460da8b3b4e7cdd824526cac1a91fca57ceaac4ec09a5a9268959b32b2d29f7f"
            },
            "downloads": -1,
            "filename": "getallcolumnname-0.2-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "e555fe54a08c19e374e6a3fc9421b791",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 3163,
            "upload_time": "2024-06-17T00:58:12",
            "upload_time_iso_8601": "2024-06-17T00:58:12.014271Z",
            "url": "https://files.pythonhosted.org/packages/96/42/fbfc5c494b9a9484adf336ec6906dd5bd7f73ee2e039a0f78dcffe89e17e/getallcolumnname-0.2-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "393c88552be92c9f00a5e7e742fda92a1c725668e1ad4017de6b7b11d822cc02",
                "md5": "5196c5b11b846c17373de2982bb2a1df",
                "sha256": "0fe75d75a176a543018df7a2e1f2184c36d5dc50317d546c0e748aa42da53266"
            },
            "downloads": -1,
            "filename": "getallcolumnname-0.2.tar.gz",
            "has_sig": false,
            "md5_digest": "5196c5b11b846c17373de2982bb2a1df",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 3072,
            "upload_time": "2024-06-17T00:58:13",
            "upload_time_iso_8601": "2024-06-17T00:58:13.695567Z",
            "url": "https://files.pythonhosted.org/packages/39/3c/88552be92c9f00a5e7e742fda92a1c725668e1ad4017de6b7b11d822cc02/getallcolumnname-0.2.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-06-17 00:58:13",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "getallcolumnname"
}
        
Elapsed time: 2.91991s