# Dagster Unity Catalog Polars
A IO Manager to read Unity Catalog Tables in Dagster orchestrated pipelines.
## Instantiating the IO Manager
To instantiate the IO Manager you need to pass a non-cached token generating function as a `Callable[..., str]` such that the load functions generate and refresh the thoken as needed. Is set to every 1000 queries by default, this should suffice most of the time.
You also need to pass the server hostname to your databricks workspace and the SQL Warehouse endpoint to which you'll be connecting to.
Raw data
{
"_id": null,
"home_page": null,
"name": "dagster-unity-catalog-polars",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.9",
"maintainer_email": null,
"keywords": "dagster, polars, io manager, databricks, unity catalog",
"author": null,
"author_email": "Gian Violi <96206151+gfvioli@users.noreply.github.com>, Ion Koutsouris <15728914+ion-elgreco@users.noreply.github.com>, Stefan Verbruggen <27513235+sverbruggen@users.noreply.github.com>",
"download_url": null,
"platform": null,
"description": "# Dagster Unity Catalog Polars\n\nA IO Manager to read Unity Catalog Tables in Dagster orchestrated pipelines.\n\n## Instantiating the IO Manager\n\nTo instantiate the IO Manager you need to pass a non-cached token generating function as a `Callable[..., str]` such that the load functions generate and refresh the thoken as needed. Is set to every 1000 queries by default, this should suffice most of the time.\nYou also need to pass the server hostname to your databricks workspace and the SQL Warehouse endpoint to which you'll be connecting to.\n\n",
"bugtrack_url": null,
"license": null,
"summary": "Polars Unity Catalog IO Managers for Dagster",
"version": "0.1.4",
"project_urls": null,
"split_keywords": [
"dagster",
" polars",
" io manager",
" databricks",
" unity catalog"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "177abc6666b0b8c72728ca6c28d7a6b22c3d61da53ba7b75bc2fdcb10a1e4b3f",
"md5": "7b5b0f6d108fb875f4b25bf9477e1a24",
"sha256": "8a459fcf93bb72352306dde22a05f661762b03157567f5ab610c797418ef2520"
},
"downloads": -1,
"filename": "dagster_unity_catalog_polars-0.1.4-py3-none-any.whl",
"has_sig": false,
"md5_digest": "7b5b0f6d108fb875f4b25bf9477e1a24",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.9",
"size": 9233,
"upload_time": "2025-01-02T13:35:50",
"upload_time_iso_8601": "2025-01-02T13:35:50.594855Z",
"url": "https://files.pythonhosted.org/packages/17/7a/bc6666b0b8c72728ca6c28d7a6b22c3d61da53ba7b75bc2fdcb10a1e4b3f/dagster_unity_catalog_polars-0.1.4-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-01-02 13:35:50",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "dagster-unity-catalog-polars"
}
JSON