[](https://badge.fury.io/py/BulkFileOperationsManager)
[](https://opensource.org/licenses/MIT)
[](https://pepy.tech/project/bulkfileoperationsmanager)
# BulkFileOperationsManager
`BulkFileOperationsManager` is a Python tool designed to manage and execute bulk Create, Read, Update, and Delete (CRUD) operations on files, especially useful for handling large files that need to be processed in chunks to fit into memory constraints.
## Installation
To install `BulkFileOperationsManager`, you can use pip:
```bash
pip install BulkFileOperationsManager
```
## Usage
### As a Python Module
`BulkFileOperationsManager` can be used as a Python module in your scripts for orchestrating bulk file operations.
#### Adding and Executing Tasks
```python
from bulkfileoperationsmanager.bulk_operations_manager import BulkOperationsManager
from filechunkcrud import FileHandler
# Initialize the manager
manager = BulkOperationsManager()
# Example of adding and executing a create task
file_path = '/path/to/your/largefile.txt'
manager.add_task(("create", file_path, "Initial content"))
manager.run()
# Example of adding and executing a read task with handler
def read_handler(chunk):
print(chunk) # or process the chunk
manager.add_task(("read", file_path, 1024, read_handler))
manager.run()
# Example of adding and executing an update task with content generator
def additional_data_generator():
yield "\nMore data...\n"
manager.add_task(("update", file_path, additional_data_generator()))
manager.run()
# Example of adding and executing a delete task
manager.add_task(("delete", file_path))
manager.run()
```
## Features
- **Manage Bulk Operations**: Efficiently manage and execute multiple file operations in a queue-based system.
- **Integration with FileChunkCRUD**: Seamlessly integrates with FileChunkCRUD for handling large files in chunks.
- **Supports CRUD operations**: Supports creating, reading, updating, and deleting files, especially suitable for large files.
## Contributing
Contributions, issues, and feature requests are welcome! Feel free to check the [issues page](https://github.com/yourusername/BulkFileOperationsManager/issues).
## License
This project is licensed under the [MIT License](https://choosealicense.com/licenses/mit/).
Raw data
{
"_id": null,
"home_page": "https://github.com/chigwell/BulkFileOperationsManager",
"name": "BulkFileOperationsManager",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "",
"author": "Eugene Evstafev",
"author_email": "chigwel@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/e0/42/3ea2a0f8ca896d44effa2946d93a1ee892062437a12d174688e924768bed/BulkFileOperationsManager-0.0.7.tar.gz",
"platform": null,
"description": "[](https://badge.fury.io/py/BulkFileOperationsManager)\n[](https://opensource.org/licenses/MIT)\n[](https://pepy.tech/project/bulkfileoperationsmanager)\n\n# BulkFileOperationsManager\n\n`BulkFileOperationsManager` is a Python tool designed to manage and execute bulk Create, Read, Update, and Delete (CRUD) operations on files, especially useful for handling large files that need to be processed in chunks to fit into memory constraints.\n\n## Installation\n\nTo install `BulkFileOperationsManager`, you can use pip:\n\n```bash\npip install BulkFileOperationsManager\n```\n\n## Usage\n\n### As a Python Module\n\n`BulkFileOperationsManager` can be used as a Python module in your scripts for orchestrating bulk file operations.\n\n#### Adding and Executing Tasks\n\n```python\nfrom bulkfileoperationsmanager.bulk_operations_manager import BulkOperationsManager\nfrom filechunkcrud import FileHandler\n\n# Initialize the manager\nmanager = BulkOperationsManager()\n\n# Example of adding and executing a create task\nfile_path = '/path/to/your/largefile.txt'\nmanager.add_task((\"create\", file_path, \"Initial content\"))\nmanager.run()\n\n# Example of adding and executing a read task with handler\ndef read_handler(chunk):\n print(chunk) # or process the chunk\n\nmanager.add_task((\"read\", file_path, 1024, read_handler))\nmanager.run()\n\n# Example of adding and executing an update task with content generator\ndef additional_data_generator():\n yield \"\\nMore data...\\n\"\n\nmanager.add_task((\"update\", file_path, additional_data_generator()))\nmanager.run()\n\n# Example of adding and executing a delete task\nmanager.add_task((\"delete\", file_path))\nmanager.run()\n```\n\n## Features\n\n- **Manage Bulk Operations**: Efficiently manage and execute multiple file operations in a queue-based system.\n- **Integration with FileChunkCRUD**: Seamlessly integrates with FileChunkCRUD for handling large files in chunks.\n- **Supports CRUD operations**: Supports creating, reading, updating, and deleting files, especially suitable for large files.\n\n## Contributing\n\nContributions, issues, and feature requests are welcome! Feel free to check the [issues page](https://github.com/yourusername/BulkFileOperationsManager/issues).\n\n## License\n\nThis project is licensed under the [MIT License](https://choosealicense.com/licenses/mit/).\n\n\n",
"bugtrack_url": null,
"license": "",
"summary": "Python package for managing bulk file CRUD operations.",
"version": "0.0.7",
"project_urls": {
"Homepage": "https://github.com/chigwell/BulkFileOperationsManager"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "2f3c91802b7775887617f28769ce2f7609d76029ac7a0d139c5dc1d0bacb439e",
"md5": "8ecf781e3654c29592a6a5155ce7c82f",
"sha256": "05c74b26708e3cd116cea6d6ecb4452c7c4074de848d9b5db7437ce78d046dcf"
},
"downloads": -1,
"filename": "BulkFileOperationsManager-0.0.7-py3-none-any.whl",
"has_sig": false,
"md5_digest": "8ecf781e3654c29592a6a5155ce7c82f",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 6003,
"upload_time": "2024-01-07T17:13:26",
"upload_time_iso_8601": "2024-01-07T17:13:26.218973Z",
"url": "https://files.pythonhosted.org/packages/2f/3c/91802b7775887617f28769ce2f7609d76029ac7a0d139c5dc1d0bacb439e/BulkFileOperationsManager-0.0.7-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "e0423ea2a0f8ca896d44effa2946d93a1ee892062437a12d174688e924768bed",
"md5": "9bb3d1792d5d9f9abd908830dede1bee",
"sha256": "d1ccc68a6279d11db50d3c65cd1a46076bf20bc27c977e73b30876674b453382"
},
"downloads": -1,
"filename": "BulkFileOperationsManager-0.0.7.tar.gz",
"has_sig": false,
"md5_digest": "9bb3d1792d5d9f9abd908830dede1bee",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 3827,
"upload_time": "2024-01-07T17:13:29",
"upload_time_iso_8601": "2024-01-07T17:13:29.457475Z",
"url": "https://files.pythonhosted.org/packages/e0/42/3ea2a0f8ca896d44effa2946d93a1ee892062437a12d174688e924768bed/BulkFileOperationsManager-0.0.7.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-01-07 17:13:29",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "chigwell",
"github_project": "BulkFileOperationsManager",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "bulkfileoperationsmanager"
}
JSON
