Name | brixy JSON |
Version |
0.2.0
JSON |
| download |
home_page | None |
Summary | Helpers for developing solution on Databricks and PySpark |
upload_time | 2024-08-17 19:24:09 |
maintainer | None |
docs_url | None |
author | None |
requires_python | None |
license | MIT license |
keywords |
|
VCS |
 |
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
[](https://github.com/egde/brixy/actions/workflows/python-package.yml)
# brixy
brixy is a package with many utilities for developing on Databricks and PySpark.
## Features
### Logging
log the steps of a workflow using the decorator `@log_step`.
```py
from brixy import log_step
@log_step()
def step1():
return 1+2
```
This will log:
```sh
2024-08-17 20:58:50.f | INFO | RUNNING | test_logstep.<l | 🏃♀️ Running step1
2024-08-17 20:58:50.f | INFO | COMPLETED | test_logstep.<l | ✅ Completed running step1
```
Logs are indented to show nested calls nicely:
```sh
2024-08-17 20:59:55.f | INFO | RUNNING | test_logstep_in | 🏃♀️ Running step_a
2024-08-17 20:59:55.f | INFO | RUNNING | test_logstep_in | 🏃♀️ Running step1
2024-08-17 20:59:55.f | INFO | RUNNING | step2 | 🏃♀️ Running step2
2024-08-17 20:59:55.f | INFO | COMPLETED | step2 | ✅ Completed running step2
2024-08-17 20:59:55.f | INFO | RUNNING | step2 | 🏃♀️ Running step2
2024-08-17 20:59:55.f | INFO | COMPLETED | step2 | ✅ Completed running step2
2024-08-17 20:59:55.f | INFO | COMPLETED | test_logstep_in | ✅ Completed running step1
2024-08-17 20:59:55.f | INFO | RUNNING | test_logstep_in | 🏃♀️ Running step1
2024-08-17 20:59:55.f | INFO | RUNNING | step2 | 🏃♀️ Running step2
2024-08-17 20:59:55.f | INFO | COMPLETED | step2 | ✅ Completed running step2
2024-08-17 20:59:55.f | INFO | RUNNING | step2 | 🏃♀️ Running step2
2024-08-17 20:59:55.f | INFO | COMPLETED | step2 | ✅ Completed running step2
2024-08-17 20:59:55.f | INFO | COMPLETED | test_logstep_in | ✅ Completed running step1
2024-08-17 20:59:55.f | INFO | COMPLETED | test_logstep_in | ✅ Completed running step_a
```
Raw data
{
"_id": null,
"home_page": null,
"name": "brixy",
"maintainer": null,
"docs_url": null,
"requires_python": null,
"maintainer_email": "Dennis Egert <degertsa@yahoo.com>",
"keywords": null,
"author": null,
"author_email": "Dennis Egert <degertsa@yahoo.com>",
"download_url": "https://files.pythonhosted.org/packages/81/05/66d58708c11dd4f83db1d763e14c6ee364608bf5dce6344c0ffbd2e1f5ac/brixy-0.2.0.tar.gz",
"platform": null,
"description": "[](https://github.com/egde/brixy/actions/workflows/python-package.yml)\n\n# brixy\n\nbrixy is a package with many utilities for developing on Databricks and PySpark.\n\n## Features\n\n### Logging\nlog the steps of a workflow using the decorator `@log_step`.\n\n```py\nfrom brixy import log_step\n\n@log_step()\ndef step1():\n return 1+2\n```\n\nThis will log:\n```sh\n2024-08-17 20:58:50.f | INFO | RUNNING | test_logstep.<l | \ud83c\udfc3\u200d\u2640\ufe0f Running step1\n2024-08-17 20:58:50.f | INFO | COMPLETED | test_logstep.<l | \u2705 Completed running step1\n```\n\nLogs are indented to show nested calls nicely:\n```sh\n2024-08-17 20:59:55.f | INFO | RUNNING | test_logstep_in | \ud83c\udfc3\u200d\u2640\ufe0f Running step_a\n2024-08-17 20:59:55.f | INFO | RUNNING | test_logstep_in | \ud83c\udfc3\u200d\u2640\ufe0f Running step1\n2024-08-17 20:59:55.f | INFO | RUNNING | step2 | \ud83c\udfc3\u200d\u2640\ufe0f Running step2\n2024-08-17 20:59:55.f | INFO | COMPLETED | step2 | \u2705 Completed running step2\n2024-08-17 20:59:55.f | INFO | RUNNING | step2 | \ud83c\udfc3\u200d\u2640\ufe0f Running step2\n2024-08-17 20:59:55.f | INFO | COMPLETED | step2 | \u2705 Completed running step2\n2024-08-17 20:59:55.f | INFO | COMPLETED | test_logstep_in | \u2705 Completed running step1\n2024-08-17 20:59:55.f | INFO | RUNNING | test_logstep_in | \ud83c\udfc3\u200d\u2640\ufe0f Running step1\n2024-08-17 20:59:55.f | INFO | RUNNING | step2 | \ud83c\udfc3\u200d\u2640\ufe0f Running step2\n2024-08-17 20:59:55.f | INFO | COMPLETED | step2 | \u2705 Completed running step2\n2024-08-17 20:59:55.f | INFO | RUNNING | step2 | \ud83c\udfc3\u200d\u2640\ufe0f Running step2\n2024-08-17 20:59:55.f | INFO | COMPLETED | step2 | \u2705 Completed running step2\n2024-08-17 20:59:55.f | INFO | COMPLETED | test_logstep_in | \u2705 Completed running step1\n2024-08-17 20:59:55.f | INFO | COMPLETED | test_logstep_in | \u2705 Completed running step_a\n```\n\n\n",
"bugtrack_url": null,
"license": "MIT license",
"summary": "Helpers for developing solution on Databricks and PySpark",
"version": "0.2.0",
"project_urls": {
"bugs": "https://github.com/egde/brixy/issues",
"changelog": "https://github.com/egde/brixy/blob/master/changelog.md",
"homepage": "https://github.com/egde/brixy"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "7345059cc61162074cb2c5a5e5769808de0992db99c108bb67dd555a8a7878aa",
"md5": "f96c60b141937d50a8efb23f3ef7501a",
"sha256": "e611aee5732d9b25993abbfb2beed571e7d397189c727ca1dc22036393e63e4a"
},
"downloads": -1,
"filename": "brixy-0.2.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "f96c60b141937d50a8efb23f3ef7501a",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 3610,
"upload_time": "2024-08-17T19:24:08",
"upload_time_iso_8601": "2024-08-17T19:24:08.157840Z",
"url": "https://files.pythonhosted.org/packages/73/45/059cc61162074cb2c5a5e5769808de0992db99c108bb67dd555a8a7878aa/brixy-0.2.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "810566d58708c11dd4f83db1d763e14c6ee364608bf5dce6344c0ffbd2e1f5ac",
"md5": "710da66f81336b19265fcf598c36f195",
"sha256": "1070ab30382a0e0562b78afd899a2530efad036a16eb5ce7b9532e81d97cf02e"
},
"downloads": -1,
"filename": "brixy-0.2.0.tar.gz",
"has_sig": false,
"md5_digest": "710da66f81336b19265fcf598c36f195",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 3663,
"upload_time": "2024-08-17T19:24:09",
"upload_time_iso_8601": "2024-08-17T19:24:09.396741Z",
"url": "https://files.pythonhosted.org/packages/81/05/66d58708c11dd4f83db1d763e14c6ee364608bf5dce6344c0ffbd2e1f5ac/brixy-0.2.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-08-17 19:24:09",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "egde",
"github_project": "brixy",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "brixy"
}