| Name | msfabricutils JSON |
| Version |
0.6.1
JSON |
| download |
| home_page | None |
| Summary | A Python library exposes additional functionality to work with Python Notebooks in Microsoft Fabric. |
| upload_time | 2024-12-26 15:31:42 |
| maintainer | None |
| docs_url | None |
| author | Jimmy Jensen |
| requires_python | >=3.10 |
| license | The MIT License (MIT) Copyright (c) [2024] [Jimmy Jensen] Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE. |
| keywords |
fabric
microsoft
duckdb
deltalake
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# MSFabricUtils
A collection of Spark-free Python utilities for working with Microsoft Fabric in Python Notebooks.
Mainly focused on Data Engineering tasks utilising [Polars](https://github.com/pola-rs/polars) and [delta-rs](https://github.com/delta-io/delta-rs).
## Installation
```bash
pip install msfabricutils
```
## Features
### Local development first
- Aim to provide a local development "within" Fabric. This means you can develop and run code locally, but reading and writing to Fabric Lakehouses. You can also read and write to Azure Data Lake, or even locally.
### ETL
- Read from delta tables or parquet files with automatic authentication to Azure Data Lake or OneLake
- Common transformations (add audit columns, reorder columns, deduplicate etc.)
- Load delta tables with one of the provided load methods (upsert, overwrite, append etc.)
### Thin Fabric API wrapper
Intregate functions to manage workspaces, lakehouses, notebooks, environments, libraries, etc.
For more details, see the [Fabric API Reference](https://mrjsj.github.io/msfabricutils/core/fabric-api/)
### Fabric API as CLI
CLI for managing workspaces, lakehouses, notebooks, environments, libraries, etc.
To get started, run:
```bash
msfu --help
```
### Fabric DuckDB Connection
Seamless integration between DuckDB and Microsoft Fabric Lakehouses for data exploration and analysis.
- Cross-workspace and cross-lakehouse querying capabilities
- Automatic table registration
- Reading and writing to Onelake outside and inside Fabric
- Support for Delta Lake tables
- Flexible table name referencing (1-part to 4-part names)
## Documentation
For quick start and detailed documentation, examples, and API reference, visit our [GitHub Pages documentation](https://mrjsj.github.io/msfabricutils/).
## Contributing
Contributions are welcome! Here are some ways you can contribute:
- Report bugs and feature requests through GitHub issues
- Submit pull requests for bug fixes or new features
- Improve documentation
- Share ideas for new utilities
## License
This project is licensed under the MIT License - see the LICENSE file for details.
Raw data
{
"_id": null,
"home_page": null,
"name": "msfabricutils",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.10",
"maintainer_email": null,
"keywords": "fabric, Microsoft, duckdb, deltalake",
"author": "Jimmy Jensen",
"author_email": null,
"download_url": null,
"platform": null,
"description": "# MSFabricUtils\nA collection of Spark-free Python utilities for working with Microsoft Fabric in Python Notebooks.\nMainly focused on Data Engineering tasks utilising [Polars](https://github.com/pola-rs/polars) and [delta-rs](https://github.com/delta-io/delta-rs).\n\n\n\n## Installation\n```bash\npip install msfabricutils\n```\n\n## Features\n\n### Local development first\n- Aim to provide a local development \"within\" Fabric. This means you can develop and run code locally, but reading and writing to Fabric Lakehouses. You can also read and write to Azure Data Lake, or even locally.\n\n### ETL\n- Read from delta tables or parquet files with automatic authentication to Azure Data Lake or OneLake\n- Common transformations (add audit columns, reorder columns, deduplicate etc.)\n- Load delta tables with one of the provided load methods (upsert, overwrite, append etc.)\n\n\n\n### Thin Fabric API wrapper\nIntregate functions to manage workspaces, lakehouses, notebooks, environments, libraries, etc.\nFor more details, see the [Fabric API Reference](https://mrjsj.github.io/msfabricutils/core/fabric-api/)\n\n### Fabric API as CLI\nCLI for managing workspaces, lakehouses, notebooks, environments, libraries, etc.\n\nTo get started, run:\n```bash\nmsfu --help\n```\n\n\n\n\n\n### Fabric DuckDB Connection\nSeamless integration between DuckDB and Microsoft Fabric Lakehouses for data exploration and analysis.\n\n- Cross-workspace and cross-lakehouse querying capabilities\n- Automatic table registration\n- Reading and writing to Onelake outside and inside Fabric\n- Support for Delta Lake tables\n- Flexible table name referencing (1-part to 4-part names)\n\n\n## Documentation\nFor quick start and detailed documentation, examples, and API reference, visit our [GitHub Pages documentation](https://mrjsj.github.io/msfabricutils/).\n\n## Contributing\nContributions are welcome! Here are some ways you can contribute:\n\n- Report bugs and feature requests through GitHub issues\n- Submit pull requests for bug fixes or new features\n- Improve documentation\n- Share ideas for new utilities\n\n## License\nThis project is licensed under the MIT License - see the LICENSE file for details.\n",
"bugtrack_url": null,
"license": "The MIT License (MIT) Copyright (c) [2024] [Jimmy Jensen] Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the \"Software\"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions: The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software. THE SOFTWARE IS PROVIDED \"AS IS\", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.",
"summary": "A Python library exposes additional functionality to work with Python Notebooks in Microsoft Fabric.",
"version": "0.6.1",
"project_urls": {
"Repository": "https://github.com/mrjsj/msfabricutils"
},
"split_keywords": [
"fabric",
" microsoft",
" duckdb",
" deltalake"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "8b0a5c197453a49255d47dab85a5a2df2e47cd95ade707236f77e2812c47fefd",
"md5": "a3d969e6e7be68f2c6ca13293a2dc545",
"sha256": "88818ede611d4e7a13a6123c352d7fca0a0427e9c17bc1ffc773daf6e5749bb6"
},
"downloads": -1,
"filename": "msfabricutils-0.6.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "a3d969e6e7be68f2c6ca13293a2dc545",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10",
"size": 117847,
"upload_time": "2024-12-26T15:31:42",
"upload_time_iso_8601": "2024-12-26T15:31:42.679349Z",
"url": "https://files.pythonhosted.org/packages/8b/0a/5c197453a49255d47dab85a5a2df2e47cd95ade707236f77e2812c47fefd/msfabricutils-0.6.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-12-26 15:31:42",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "mrjsj",
"github_project": "msfabricutils",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "msfabricutils"
}
