# AI/ML Utils | [@GitHub](https://github.com/legendu-net/aiutil) | [@PyPI](https://pypi.org/project/aiutil/)
This is a Python pacakage that contains misc utils for AI/ML.
1. Misc enhancement of Python's built-in functionalities.
- string
- collections
- pandas DataFrame
- datetime
2. Misc other tools
- `aiutil.filesystem`: misc tools for querying and manipulating filesystems; convenient tools for manipulating text files.
- `aiutil.url`: URL formatting for HTML, Excel, etc.
- `aiutil.sql`: SQL formatting
- `aiutil.cv`: some more tools (in addition to OpenCV) for image processing
- `aiutil.shell`: parse command-line output to a pandas DataFrame
- `aiutil.shebang`: auto correct SheBang of scripts
- `aiutil.poetry`: tools for making it even easier to manage Python project using Poetry
- `aiutil.pdf`: easy and flexible extracting of PDF pages
- `aiutil.memory`: query and consume memory to a specified range
- `aiutil.notebook`: Jupyter/Lab notebook related tools
- `aiutil.dockerhub`: managing Docker images on DockerHub in batch mode using Python
- `aiutil.hadoop`:
- A Spark application log analyzing tool for identify root causes of failed Spark applications.
- Pythonic wrappers to the `hdfs` command.
- A auto authentication tool for Kerberos.
- An improved version of `spark_submit`.
- Other misc PySpark functions.
## Supported Operating Systems and Python Versions
Python 3.10.x on Linux and macOS.
It might work on Windows but is not tested on Windows.
## Installation
```bash
pip3 install --user -U aiutil
```
Use the following commands if you want to install all components of aiutil.
Available additional components are `cv`, `docker`, `pdf`, `jupyter`, `admin` and `all`.
```bash
pip3 install --user -U aiutil[all]
```
Raw data
{
"_id": null,
"home_page": "https://github.com/legendu-net/aiutil",
"name": "aiutil",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.10,<3.12",
"maintainer_email": "",
"keywords": "AI,Machine Learning,tools,utils",
"author": "Benjamin Du",
"author_email": "longendu@yahoo.com",
"download_url": "https://files.pythonhosted.org/packages/cb/2d/c9b60248382da2e455aae596912eeb5c419a9ac3e2ad60892982b7fb81d8/aiutil-0.82.0.tar.gz",
"platform": null,
"description": "# AI/ML Utils | [@GitHub](https://github.com/legendu-net/aiutil) | [@PyPI](https://pypi.org/project/aiutil/)\n\nThis is a Python pacakage that contains misc utils for AI/ML.\n\n1. Misc enhancement of Python's built-in functionalities.\n - string\n - collections\n - pandas DataFrame\n - datetime\n2. Misc other tools\n - `aiutil.filesystem`: misc tools for querying and manipulating filesystems; convenient tools for manipulating text files.\n - `aiutil.url`: URL formatting for HTML, Excel, etc.\n - `aiutil.sql`: SQL formatting\n - `aiutil.cv`: some more tools (in addition to OpenCV) for image processing\n - `aiutil.shell`: parse command-line output to a pandas DataFrame\n - `aiutil.shebang`: auto correct SheBang of scripts\n - `aiutil.poetry`: tools for making it even easier to manage Python project using Poetry\n - `aiutil.pdf`: easy and flexible extracting of PDF pages\n - `aiutil.memory`: query and consume memory to a specified range\n - `aiutil.notebook`: Jupyter/Lab notebook related tools\n - `aiutil.dockerhub`: managing Docker images on DockerHub in batch mode using Python\n - `aiutil.hadoop`: \n - A Spark application log analyzing tool for identify root causes of failed Spark applications.\n - Pythonic wrappers to the `hdfs` command.\n - A auto authentication tool for Kerberos.\n - An improved version of `spark_submit`.\n - Other misc PySpark functions. \n \n## Supported Operating Systems and Python Versions\n\nPython 3.10.x on Linux and macOS.\nIt might work on Windows but is not tested on Windows.\n\n## Installation\n\n```bash\npip3 install --user -U aiutil\n```\nUse the following commands if you want to install all components of aiutil. \nAvailable additional components are `cv`, `docker`, `pdf`, `jupyter`, `admin` and `all`.\n```bash\npip3 install --user -U aiutil[all]\n```\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "A utils Python package for data scientists.",
"version": "0.82.0",
"project_urls": {
"Homepage": "https://github.com/legendu-net/aiutil",
"Repository": "https://github.com/legendu-net/aiutil"
},
"split_keywords": [
"ai",
"machine learning",
"tools",
"utils"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "332353560e0441d07882897d9a1d327a1ccf6b9caa74c0e56c370e606ef1f22e",
"md5": "bc7e51217194ba4a7182493d72190fbb",
"sha256": "56e9e6b8b08b438cd83abc03211b0589e25a6e864cb576f0c016aba8e18997e6"
},
"downloads": -1,
"filename": "aiutil-0.82.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "bc7e51217194ba4a7182493d72190fbb",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10,<3.12",
"size": 48200,
"upload_time": "2023-09-22T18:29:10",
"upload_time_iso_8601": "2023-09-22T18:29:10.885970Z",
"url": "https://files.pythonhosted.org/packages/33/23/53560e0441d07882897d9a1d327a1ccf6b9caa74c0e56c370e606ef1f22e/aiutil-0.82.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "cb2dc9b60248382da2e455aae596912eeb5c419a9ac3e2ad60892982b7fb81d8",
"md5": "c5468dd70a8f0c4a88e1a4591dc9a7ff",
"sha256": "21a50155ccfb5004f5a3910a2b3230d5c07c1a144226907ed5d15f3850ffc70d"
},
"downloads": -1,
"filename": "aiutil-0.82.0.tar.gz",
"has_sig": false,
"md5_digest": "c5468dd70a8f0c4a88e1a4591dc9a7ff",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10,<3.12",
"size": 39359,
"upload_time": "2023-09-22T18:29:12",
"upload_time_iso_8601": "2023-09-22T18:29:12.625989Z",
"url": "https://files.pythonhosted.org/packages/cb/2d/c9b60248382da2e455aae596912eeb5c419a9ac3e2ad60892982b7fb81d8/aiutil-0.82.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-09-22 18:29:12",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "legendu-net",
"github_project": "aiutil",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "aiutil"
}
JSON
