# LlamaIndex Node_Parser-Relational Integration: Dashscope
Transform your documents into nodes with ease using the Dashscope integration for LlamaIndex. This tool allows for precise control over chunk size, overlap size, and more, tailored for the Dashscope reader output format.
## Quick Start
Get up and running with just a few lines of code:
```python
import json
import os
from llama_index.node_parser.relational.dashscope import (
DashScopeJsonNodeParser,
)
from llama_index.core.ingestion import IngestionPipeline
from llama_index.core.schema import Document
# Set your Dashscope API key in the environment
os.environ["DASHSCOPE_API_KEY"] = "your_api_key_here"
documents = [
# Prepare your documents obtained from the Dashscope reader
]
# Initialize the DashScope JsonNodeParser
node_parser = DashScopeJsonNodeParser(
chunk_size=100, overlap_size=0, separator=" |,|，|。|？|！|\n|\?|\!"
)
# Set up the ingestion pipeline with the node parser
pipeline = IngestionPipeline(transformations=[node_parser])
# Process the documents and print the resulting nodes
nodes = pipeline.run(documents=documents, show_progress=True)
for node in nodes:
print(node)
```
## Configuration
- API Key: You need a Dashscope API key to begin. Set it in your environment as shown in the Quick Start section.
- Document Preparation: Your documents must be in the Dashscope reader output format.
Raw data
{
"_id": null,
"home_page": null,
"name": "llama-index-node-parser-relational-dashscope-custom",
"maintainer": null,
"docs_url": null,
"requires_python": "<4.0,>=3.8.1",
"maintainer_email": null,
"keywords": null,
"author": "Ruixue Ding",
"author_email": "ada.drx@alibaba-inc.com",
"download_url": "https://files.pythonhosted.org/packages/0a/3a/6664cece7e94b1aa60a3463a4a7c7214fe3e3b1d6157afbf70d365a7e41e/llama_index_node_parser_relational_dashscope_custom-0.1.1.tar.gz",
"platform": null,
"description": "# LlamaIndex Node_Parser-Relational Integration: Dashscope\n\nTransform your documents into nodes with ease using the Dashscope integration for LlamaIndex. This tool allows for precise control over chunk size, overlap size, and more, tailored for the Dashscope reader output format.\n\n## Quick Start\n\nGet up and running with just a few lines of code:\n\n```python\nimport json\nimport os\nfrom llama_index.node_parser.relational.dashscope import (\n DashScopeJsonNodeParser,\n)\nfrom llama_index.core.ingestion import IngestionPipeline\nfrom llama_index.core.schema import Document\n\n# Set your Dashscope API key in the environment\nos.environ[\"DASHSCOPE_API_KEY\"] = \"your_api_key_here\"\n\ndocuments = [\n # Prepare your documents obtained from the Dashscope reader\n]\n\n# Initialize the DashScope JsonNodeParser\nnode_parser = DashScopeJsonNodeParser(\n chunk_size=100, overlap_size=0, separator=\" |,|\uff0c|\u3002|\uff1f|\uff01|\\n|\\?|\\!\"\n)\n\n# Set up the ingestion pipeline with the node parser\npipeline = IngestionPipeline(transformations=[node_parser])\n\n# Process the documents and print the resulting nodes\nnodes = pipeline.run(documents=documents, show_progress=True)\nfor node in nodes:\n print(node)\n```\n\n## Configuration\n\n- API Key: You need a Dashscope API key to begin. Set it in your environment as shown in the Quick Start section.\n- Document Preparation: Your documents must be in the Dashscope reader output format.\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "llama-index node_parser relational dashscope integration",
"version": "0.1.1",
"project_urls": null,
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "b54bb2ed1e0e29474d17bc7c066d0d98cebf8e0a6bf2bf7a7241d958558676af",
"md5": "66e4ecaaf9f98ebb1f8899f17f96afc7",
"sha256": "8dde3efc3b4bb567d635f67de65463aa2f59f275e80a3a3e400c21e3e214e695"
},
"downloads": -1,
"filename": "llama_index_node_parser_relational_dashscope_custom-0.1.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "66e4ecaaf9f98ebb1f8899f17f96afc7",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.8.1",
"size": 4141,
"upload_time": "2024-05-08T06:27:41",
"upload_time_iso_8601": "2024-05-08T06:27:41.359661Z",
"url": "https://files.pythonhosted.org/packages/b5/4b/b2ed1e0e29474d17bc7c066d0d98cebf8e0a6bf2bf7a7241d958558676af/llama_index_node_parser_relational_dashscope_custom-0.1.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "0a3a6664cece7e94b1aa60a3463a4a7c7214fe3e3b1d6157afbf70d365a7e41e",
"md5": "a449f1143ba145899028e9bfb3007f75",
"sha256": "3f53fc3c687842bce86cc02f35694b4ab4749f3f984808aa6ba6605012110688"
},
"downloads": -1,
"filename": "llama_index_node_parser_relational_dashscope_custom-0.1.1.tar.gz",
"has_sig": false,
"md5_digest": "a449f1143ba145899028e9bfb3007f75",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.8.1",
"size": 3725,
"upload_time": "2024-05-08T06:27:42",
"upload_time_iso_8601": "2024-05-08T06:27:42.879496Z",
"url": "https://files.pythonhosted.org/packages/0a/3a/6664cece7e94b1aa60a3463a4a7c7214fe3e3b1d6157afbf70d365a7e41e/llama_index_node_parser_relational_dashscope_custom-0.1.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-05-08 06:27:42",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "llama-index-node-parser-relational-dashscope-custom"
}
JSON