llama-index-readers-file


Namellama-index-readers-file JSON
Version 0.1.20 PyPI version JSON
download
home_pageNone
Summaryllama-index readers file integration
upload_time2024-05-02 17:12:09
maintainerFarisHijazi
docs_urlNone
authorYour Name
requires_python<4.0,>=3.8.1
licenseMIT
keywords 10k 10q chart eml figure html hwp image invoice ipynb jupyter notebook pdf pymupdf receipt sec spreadsheet tabular unstructured.io yaml yml
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # LlamaIndex Readers Integration: File

```bash
pip install llama-index-readers-file
```

This is the default integration for different loaders that are used within `SimpleDirectoryReader`.

Provides support for the following loaders:

- DocxReader
- HWPReader
- PDFReader
- EpubReader
- FlatReader
- HTMLTagReader
- ImageCaptionReader
- ImageReader
- ImageVisionLLMReader
- IPYNBReader
- MarkdownReader
- MboxReader
- PptxReader
- PandasCSVReader
- VideoAudioReader
- UnstructuredReader
- PyMuPDFReader
- ImageTabularChartReader
- XMLReader
- PagedCSVReader
- CSVReader
- RTFReader

## Installation

```bash
pip install llama-index-readers-file
```

## Usage

Once installed, You can import any of the loader. Here's an example usage of one of the loader.

```python
from llama_index.core import SimpleDirectoryReader
from llama_index.readers.file import (
    DocxReader,
    HWPReader,
    PDFReader,
    EpubReader,
    FlatReader,
    HTMLTagReader,
    ImageCaptionReader,
    ImageReader,
    ImageVisionLLMReader,
    IPYNBReader,
    MarkdownReader,
    MboxReader,
    PptxReader,
    PandasCSVReader,
    VideoAudioReader,
    UnstructuredReader,
    PyMuPDFReader,
    ImageTabularChartReader,
    XMLReader,
    PagedCSVReader,
    CSVReader,
    RTFReader,
)

# PDF Reader with `SimpleDirectoryReader`
parser = PDFReader()
file_extractor = {".pdf": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# Docx Reader example
parser = DocxReader()
file_extractor = {".docx": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# HWP Reader example
parser = HWPReader()
file_extractor = {".hwp": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# Epub Reader example
parser = EpubReader()
file_extractor = {".epub": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# Flat Reader example
parser = FlatReader()
file_extractor = {".txt": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# HTML Tag Reader example
parser = HTMLTagReader()
file_extractor = {".html": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# Image Reader example
parser = ImageReader()
file_extractor = {
    ".jpg": parser,
    ".jpeg": parser,
    ".png": parser,
}  # Add other image formats as needed
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# IPYNB Reader example
parser = IPYNBReader()
file_extractor = {".ipynb": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# Markdown Reader example
parser = MarkdownReader()
file_extractor = {".md": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# Mbox Reader example
parser = MboxReader()
file_extractor = {".mbox": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# Pptx Reader example
parser = PptxReader()
file_extractor = {".pptx": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()


# Pandas CSV Reader example
parser = PandasCSVReader()
file_extractor = {".csv": parser}  # Add other CSV formats as needed
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# PyMuPDF Reader example
parser = PyMuPDFReader()
file_extractor = {".pdf": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# XML Reader example
parser = XMLReader()
file_extractor = {".xml": parser}
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# Paged CSV Reader example
parser = PagedCSVReader()
file_extractor = {".csv": parser}  # Add other CSV formats as needed
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()

# CSV Reader example
parser = CSVReader()
file_extractor = {".csv": parser}  # Add other CSV formats as needed
documents = SimpleDirectoryReader(
    "./data", file_extractor=file_extractor
).load_data()
```

This loader is designed to be used as a way to load data into [LlamaIndex](https://github.com/run-llama/llama_index/tree/main/llama_index) and/or subsequently used as a Tool in a [LangChain](https://github.com/hwchase17/langchain) Agent.

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "llama-index-readers-file",
    "maintainer": "FarisHijazi",
    "docs_url": null,
    "requires_python": "<4.0,>=3.8.1",
    "maintainer_email": null,
    "keywords": "10k, 10q, chart, eml, figure, html, hwp, image, invoice, ipynb, jupyter, notebook, pdf, pymupdf, receipt, sec, spreadsheet, tabular, unstructured.io, yaml, yml",
    "author": "Your Name",
    "author_email": "you@example.com",
    "download_url": "https://files.pythonhosted.org/packages/1a/1e/1d5ba8c9c3ee0c2ba956db71f58159ce1706a735b4c761810ff535e611b8/llama_index_readers_file-0.1.20.tar.gz",
    "platform": null,
    "description": "# LlamaIndex Readers Integration: File\n\n```bash\npip install llama-index-readers-file\n```\n\nThis is the default integration for different loaders that are used within `SimpleDirectoryReader`.\n\nProvides support for the following loaders:\n\n- DocxReader\n- HWPReader\n- PDFReader\n- EpubReader\n- FlatReader\n- HTMLTagReader\n- ImageCaptionReader\n- ImageReader\n- ImageVisionLLMReader\n- IPYNBReader\n- MarkdownReader\n- MboxReader\n- PptxReader\n- PandasCSVReader\n- VideoAudioReader\n- UnstructuredReader\n- PyMuPDFReader\n- ImageTabularChartReader\n- XMLReader\n- PagedCSVReader\n- CSVReader\n- RTFReader\n\n## Installation\n\n```bash\npip install llama-index-readers-file\n```\n\n## Usage\n\nOnce installed, You can import any of the loader. Here's an example usage of one of the loader.\n\n```python\nfrom llama_index.core import SimpleDirectoryReader\nfrom llama_index.readers.file import (\n    DocxReader,\n    HWPReader,\n    PDFReader,\n    EpubReader,\n    FlatReader,\n    HTMLTagReader,\n    ImageCaptionReader,\n    ImageReader,\n    ImageVisionLLMReader,\n    IPYNBReader,\n    MarkdownReader,\n    MboxReader,\n    PptxReader,\n    PandasCSVReader,\n    VideoAudioReader,\n    UnstructuredReader,\n    PyMuPDFReader,\n    ImageTabularChartReader,\n    XMLReader,\n    PagedCSVReader,\n    CSVReader,\n    RTFReader,\n)\n\n# PDF Reader with `SimpleDirectoryReader`\nparser = PDFReader()\nfile_extractor = {\".pdf\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# Docx Reader example\nparser = DocxReader()\nfile_extractor = {\".docx\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# HWP Reader example\nparser = HWPReader()\nfile_extractor = {\".hwp\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# Epub Reader example\nparser = EpubReader()\nfile_extractor = {\".epub\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# Flat Reader example\nparser = FlatReader()\nfile_extractor = {\".txt\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# HTML Tag Reader example\nparser = HTMLTagReader()\nfile_extractor = {\".html\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# Image Reader example\nparser = ImageReader()\nfile_extractor = {\n    \".jpg\": parser,\n    \".jpeg\": parser,\n    \".png\": parser,\n}  # Add other image formats as needed\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# IPYNB Reader example\nparser = IPYNBReader()\nfile_extractor = {\".ipynb\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# Markdown Reader example\nparser = MarkdownReader()\nfile_extractor = {\".md\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# Mbox Reader example\nparser = MboxReader()\nfile_extractor = {\".mbox\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# Pptx Reader example\nparser = PptxReader()\nfile_extractor = {\".pptx\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n\n# Pandas CSV Reader example\nparser = PandasCSVReader()\nfile_extractor = {\".csv\": parser}  # Add other CSV formats as needed\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# PyMuPDF Reader example\nparser = PyMuPDFReader()\nfile_extractor = {\".pdf\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# XML Reader example\nparser = XMLReader()\nfile_extractor = {\".xml\": parser}\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# Paged CSV Reader example\nparser = PagedCSVReader()\nfile_extractor = {\".csv\": parser}  # Add other CSV formats as needed\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n\n# CSV Reader example\nparser = CSVReader()\nfile_extractor = {\".csv\": parser}  # Add other CSV formats as needed\ndocuments = SimpleDirectoryReader(\n    \"./data\", file_extractor=file_extractor\n).load_data()\n```\n\nThis loader is designed to be used as a way to load data into [LlamaIndex](https://github.com/run-llama/llama_index/tree/main/llama_index) and/or subsequently used as a Tool in a [LangChain](https://github.com/hwchase17/langchain) Agent.\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "llama-index readers file integration",
    "version": "0.1.20",
    "project_urls": null,
    "split_keywords": [
        "10k",
        " 10q",
        " chart",
        " eml",
        " figure",
        " html",
        " hwp",
        " image",
        " invoice",
        " ipynb",
        " jupyter",
        " notebook",
        " pdf",
        " pymupdf",
        " receipt",
        " sec",
        " spreadsheet",
        " tabular",
        " unstructured.io",
        " yaml",
        " yml"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "0719281b49217bf50fdb50bc39571c223c184d1590a15a0df9d1084e7728bad7",
                "md5": "8b09fed8ea89ad232aceec9679756d7d",
                "sha256": "055999f86ad11130445bfe10c0886ddecb63e1b727678ab4ba58602282443289"
            },
            "downloads": -1,
            "filename": "llama_index_readers_file-0.1.20-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "8b09fed8ea89ad232aceec9679756d7d",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.8.1",
            "size": 37016,
            "upload_time": "2024-05-02T17:12:07",
            "upload_time_iso_8601": "2024-05-02T17:12:07.780971Z",
            "url": "https://files.pythonhosted.org/packages/07/19/281b49217bf50fdb50bc39571c223c184d1590a15a0df9d1084e7728bad7/llama_index_readers_file-0.1.20-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "1a1e1d5ba8c9c3ee0c2ba956db71f58159ce1706a735b4c761810ff535e611b8",
                "md5": "cb86b3ca6a493297e9f9943f46cfddce",
                "sha256": "1258c016bc8ee1efe37a3b081384ba47dbca13b92c205d3154ba235fc09cc2fb"
            },
            "downloads": -1,
            "filename": "llama_index_readers_file-0.1.20.tar.gz",
            "has_sig": false,
            "md5_digest": "cb86b3ca6a493297e9f9943f46cfddce",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.8.1",
            "size": 19990,
            "upload_time": "2024-05-02T17:12:09",
            "upload_time_iso_8601": "2024-05-02T17:12:09.086724Z",
            "url": "https://files.pythonhosted.org/packages/1a/1e/1d5ba8c9c3ee0c2ba956db71f58159ce1706a735b4c761810ff535e611b8/llama_index_readers_file-0.1.20.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-05-02 17:12:09",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "llama-index-readers-file"
}
        
Elapsed time: 0.27210s