# OpenCF Core: The File Convertion Framework
The `opencf-core` package provides a robust framework for handling file conversion tasks in Python. It offers a set of classes and utilities designed to simplify the process of reading from and writing to different file formats efficiently.
## Features
- **Modular Input/Output Handlers**: Defines abstract base classes for file readers and writers, allowing for easy extension and customization.
- **Support for Various File Formats**: Provides built-in support for common file formats such as text, CSV, JSON, XML, Excel, and image files.
- **MIME Type Detection**: Includes a MIME type guesser utility to automatically detect the MIME type of files, facilitating seamless conversion based on file content.
- **File Type Enumeration**: Defines an enum for representing different file types, enabling easy validation and processing of input and output files.
- **Exception Handling**: Implements custom exceptions for handling errors related to unsupported file types, empty suffixes, file not found, and mismatches between file types.
- **Base Converter Class**: Offers an abstract base class for implementing specific file converters, providing a standardized interface for file conversion operations.
- **Resolved Input File Representation**: Introduces a class for representing input files with resolved file types, ensuring consistency and correctness in conversion tasks.
## Conversion Strategies
When using the `opencf-core`, you can adopt different strategies for file conversion based on your specific requirements:
### 1. Direct Conversion
In this approach, conversion is achieved without utilizing a dedicated writer. The reader module parses the input files into a list of objects. Subsequently, the `_convert` method orchestrates the writing process into a file or folder. This method is suitable for scenarios where direct manipulation of data structures suffices for conversion.
### 2. Indirect Conversion
Conversely, indirect conversion employs a converter that supports a dedicated writer. Here, the `convert` function's primary role is to transform the parsed list of objects into a format compatible with the writer. The actual conversion process may be executed by the writer, leveraging its capabilities. For instance, converting images to videos involves parsing images into a list of Pillow objects, which are then reformatted into a numpy array. This array, encapsulating frame dimensions and color channels, serves as input for the video writer.
## Component Instances
The file conversion process can be dissected into three distinct instances:
- **Reader**: Handles input-output (IO) operations, transforming files into objects. Readers are implementations of the abstract class `FileReader` present in `io_handler.py`.
- **Converter**: Facilitates object-to-object conversion, acting as an intermediary for data transformation. Converters are implementations of the abstract class `BaseConverter` present in `base_converter.py`.
- **Writer (Optional)**: Reverses the IO process, converting objects back into files. Writers are implementations of the abstract class `FileWriter` present in `io_handler.py`.
## Modules
- **io_handler.py**: Contains classes for reading from and writing to files, including text, CSV, JSON, XML, and image files. It includes abstract classes for `FileReader` and `FileWriter`.
- **mimes.py**: Provides a MIME type guesser utility for detecting file MIME types based on file content.
- **filetypes.py**: Defines enums and classes for representing different file types and handling file type validation.
- **base_converter.py**: Implements the base converter class and the resolved input file class for performing file conversion tasks. It includes the `BaseConverter` abstract class.
## Installation
```bash
# with pip
pip install -i https://test.pypi.org/simple/opencf-core
# with poetry
poetry add opencf-core --source test-pypi
```
## Usage
The `opencf-core` package can be used independently to build custom file conversion utilities or integrated into larger projects for handling file format transformations efficiently.
```python
from opencf_core.io_handler import CsvToListReader, ListToCsvWriter
from opencf_core.base_converter import BaseConverter, ResolvedInputFile
from opencf_core.filetypes import FileType
class CSVToJSONConverter(BaseConverter):
file_reader = CsvToListReader()
file_writer = DictToJsonWriter()
@classmethod
def _get_supported_input_type(cls) -> FileType:
return FileType.CSV
@classmethod
def _get_supported_output_type(cls) -> FileType:
return FileType.JSON
def _convert(self, input_path: Path, output_file: Path):
# Implement conversion logic from CSV to JSON
pass
# Usage
input_file_path = "input.csv"
output_file_path = "output.json"
input_file = ResolvedInputFile(input_file_path, is_dir=False, should_exist=True)
output_file = ResolvedInputFile(output_file_path, is_dir=False, should_exist=False, add_suffix=True)
converter = CSVToJSONConverter(input_file, output_file)
converter.convert()
```
## More Examples
The `examples` folder in this repository contains practical demonstrations of how to use the `opencf-core` package for file conversion tasks. Currently, it includes the following examples:
- **simple_converter.py**: Demonstrates a basic file converter that converts Excel (XLSX) files to CSV format. It utilizes the `XLXSToCSVConverter` class defined within the `opencf-core` package to perform the conversion.
- **cli_app_example.py**: Illustrates how to build a command-line interface (CLI) application using the `ConverterApp` class from the `opencf-core.converter_app` module. This CLI app allows users to specify input and output files, as well as input and output file types, for performing file conversions.
These examples serve as practical demonstrations of how to leverage the capabilities of the `opencf-core` package in real-world scenarios. Users can refer to these examples for guidance on building their own file conversion utilities or integrating file conversion functionality into existing projects.
## Todo
### Backend Support
- Introduce the concept of backend labeling for `FileReader` and `FileWriter` implementations.
- Enable multiple file readers/writers to share common backends. For instance, if an `ImageOpenCVReader` utilizes both numpy and OpenCV, the `VideoWriter` can leverage the same dependencies.
- Allow users to specify preferred backend configurations, ensuring that conversion methods accommodate all selected backends seamlessly.
## Contributing
Contributions to the `opencf-core` package are welcome! Feel free to submit bug reports, feature requests, or pull requests via the GitHub repository.
## Disclaimer
Please note that while the `opencf-core` package aims to provide a versatile framework for file conversion tasks, it may not cover every possible use case or handle all edge cases. Users are encouraged to review and customize the code according to their specific requirements.
Raw data
{
"_id": null,
"home_page": "https://github.com/Hermann-web/opencf-core",
"name": "opencf-core",
"maintainer": "Hermann Agossou",
"docs_url": null,
"requires_python": "<4.0,>=3.7",
"maintainer_email": "agossouhermann7@gmail.com",
"keywords": "file conversion, data processing, file formats",
"author": "Hermann Agossou",
"author_email": "agossouhermann7@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/14/f5/8077a30e265aeddfd08583fc5aa9e96c0d4deaaafc63fb5be826bd18d134/opencf_core-0.3.0.tar.gz",
"platform": null,
"description": "# OpenCF Core: The File Convertion Framework\n\nThe `opencf-core` package provides a robust framework for handling file conversion tasks in Python. It offers a set of classes and utilities designed to simplify the process of reading from and writing to different file formats efficiently.\n\n## Features\n\n- **Modular Input/Output Handlers**: Defines abstract base classes for file readers and writers, allowing for easy extension and customization.\n- **Support for Various File Formats**: Provides built-in support for common file formats such as text, CSV, JSON, XML, Excel, and image files.\n- **MIME Type Detection**: Includes a MIME type guesser utility to automatically detect the MIME type of files, facilitating seamless conversion based on file content.\n- **File Type Enumeration**: Defines an enum for representing different file types, enabling easy validation and processing of input and output files.\n- **Exception Handling**: Implements custom exceptions for handling errors related to unsupported file types, empty suffixes, file not found, and mismatches between file types.\n- **Base Converter Class**: Offers an abstract base class for implementing specific file converters, providing a standardized interface for file conversion operations.\n- **Resolved Input File Representation**: Introduces a class for representing input files with resolved file types, ensuring consistency and correctness in conversion tasks.\n\n## Conversion Strategies\n\nWhen using the `opencf-core`, you can adopt different strategies for file conversion based on your specific requirements:\n\n### 1. Direct Conversion\n\nIn this approach, conversion is achieved without utilizing a dedicated writer. The reader module parses the input files into a list of objects. Subsequently, the `_convert` method orchestrates the writing process into a file or folder. This method is suitable for scenarios where direct manipulation of data structures suffices for conversion.\n\n### 2. Indirect Conversion\n\nConversely, indirect conversion employs a converter that supports a dedicated writer. Here, the `convert` function's primary role is to transform the parsed list of objects into a format compatible with the writer. The actual conversion process may be executed by the writer, leveraging its capabilities. For instance, converting images to videos involves parsing images into a list of Pillow objects, which are then reformatted into a numpy array. This array, encapsulating frame dimensions and color channels, serves as input for the video writer.\n\n## Component Instances\n\nThe file conversion process can be dissected into three distinct instances:\n\n- **Reader**: Handles input-output (IO) operations, transforming files into objects. Readers are implementations of the abstract class `FileReader` present in `io_handler.py`.\n \n- **Converter**: Facilitates object-to-object conversion, acting as an intermediary for data transformation. Converters are implementations of the abstract class `BaseConverter` present in `base_converter.py`.\n\n- **Writer (Optional)**: Reverses the IO process, converting objects back into files. Writers are implementations of the abstract class `FileWriter` present in `io_handler.py`.\n\n## Modules\n\n- **io_handler.py**: Contains classes for reading from and writing to files, including text, CSV, JSON, XML, and image files. It includes abstract classes for `FileReader` and `FileWriter`.\n- **mimes.py**: Provides a MIME type guesser utility for detecting file MIME types based on file content.\n- **filetypes.py**: Defines enums and classes for representing different file types and handling file type validation.\n- **base_converter.py**: Implements the base converter class and the resolved input file class for performing file conversion tasks. It includes the `BaseConverter` abstract class.\n\n## Installation\n\n```bash\n# with pip\npip install -i https://test.pypi.org/simple/opencf-core\n# with poetry\npoetry add opencf-core --source test-pypi\n```\n\n## Usage\n\nThe `opencf-core` package can be used independently to build custom file conversion utilities or integrated into larger projects for handling file format transformations efficiently.\n\n```python\nfrom opencf_core.io_handler import CsvToListReader, ListToCsvWriter\nfrom opencf_core.base_converter import BaseConverter, ResolvedInputFile\nfrom opencf_core.filetypes import FileType\n\nclass CSVToJSONConverter(BaseConverter):\n file_reader = CsvToListReader()\n file_writer = DictToJsonWriter()\n\n @classmethod\n def _get_supported_input_type(cls) -> FileType:\n return FileType.CSV\n\n @classmethod\n def _get_supported_output_type(cls) -> FileType:\n return FileType.JSON\n\n def _convert(self, input_path: Path, output_file: Path):\n # Implement conversion logic from CSV to JSON\n pass\n\n# Usage\ninput_file_path = \"input.csv\"\noutput_file_path = \"output.json\"\ninput_file = ResolvedInputFile(input_file_path, is_dir=False, should_exist=True)\noutput_file = ResolvedInputFile(output_file_path, is_dir=False, should_exist=False, add_suffix=True)\nconverter = CSVToJSONConverter(input_file, output_file)\nconverter.convert()\n```\n\n## More Examples\n\nThe `examples` folder in this repository contains practical demonstrations of how to use the `opencf-core` package for file conversion tasks. Currently, it includes the following examples:\n\n- **simple_converter.py**: Demonstrates a basic file converter that converts Excel (XLSX) files to CSV format. It utilizes the `XLXSToCSVConverter` class defined within the `opencf-core` package to perform the conversion.\n\n- **cli_app_example.py**: Illustrates how to build a command-line interface (CLI) application using the `ConverterApp` class from the `opencf-core.converter_app` module. This CLI app allows users to specify input and output files, as well as input and output file types, for performing file conversions.\n\nThese examples serve as practical demonstrations of how to leverage the capabilities of the `opencf-core` package in real-world scenarios. Users can refer to these examples for guidance on building their own file conversion utilities or integrating file conversion functionality into existing projects.\n\n## Todo\n\n### Backend Support\n\n- Introduce the concept of backend labeling for `FileReader` and `FileWriter` implementations.\n- Enable multiple file readers/writers to share common backends. For instance, if an `ImageOpenCVReader` utilizes both numpy and OpenCV, the `VideoWriter` can leverage the same dependencies.\n- Allow users to specify preferred backend configurations, ensuring that conversion methods accommodate all selected backends seamlessly.\n\n## Contributing\n\nContributions to the `opencf-core` package are welcome! Feel free to submit bug reports, feature requests, or pull requests via the GitHub repository.\n\n## Disclaimer\n\nPlease note that while the `opencf-core` package aims to provide a versatile framework for file conversion tasks, it may not cover every possible use case or handle all edge cases. Users are encouraged to review and customize the code according to their specific requirements.\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "A robust framework for handling file conversion tasks in Python",
"version": "0.3.0",
"project_urls": {
"Documentation": "https://opencf-core.readthedocs.io",
"Homepage": "https://github.com/Hermann-web/opencf-core",
"Repository": "https://github.com/Hermann-web/opencf-core"
},
"split_keywords": [
"file conversion",
" data processing",
" file formats"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "cd40c77208fbd15c1198fed6c8ab0351a3c0354a7a67f00b74ab7d687fe209d1",
"md5": "337627aed691f0532e45b9014aa3b38a",
"sha256": "fd7cb89d4238cf3a5dbb819fbb8273eed60425ef18ef30c043363fdc24a1ff4f"
},
"downloads": -1,
"filename": "opencf_core-0.3.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "337627aed691f0532e45b9014aa3b38a",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.7",
"size": 18067,
"upload_time": "2024-05-08T08:26:13",
"upload_time_iso_8601": "2024-05-08T08:26:13.894398Z",
"url": "https://files.pythonhosted.org/packages/cd/40/c77208fbd15c1198fed6c8ab0351a3c0354a7a67f00b74ab7d687fe209d1/opencf_core-0.3.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "14f58077a30e265aeddfd08583fc5aa9e96c0d4deaaafc63fb5be826bd18d134",
"md5": "1f78ad4706a4835e0606c5b0f12527f3",
"sha256": "00ebce49f552ea459256fdacd6de991f887f2703661288a4410ae65544334a2a"
},
"downloads": -1,
"filename": "opencf_core-0.3.0.tar.gz",
"has_sig": false,
"md5_digest": "1f78ad4706a4835e0606c5b0f12527f3",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.7",
"size": 17863,
"upload_time": "2024-05-08T08:26:17",
"upload_time_iso_8601": "2024-05-08T08:26:17.158713Z",
"url": "https://files.pythonhosted.org/packages/14/f5/8077a30e265aeddfd08583fc5aa9e96c0d4deaaafc63fb5be826bd18d134/opencf_core-0.3.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-05-08 08:26:17",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "Hermann-web",
"github_project": "opencf-core",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "opencf-core"
}
JSON
