neumai


Nameneumai JSON
Version 0.0.40 PyPI version JSON
download
home_pagehttps://neum.ai
SummaryPackage containing connectors for Neum AI.
upload_time2024-01-07 17:36:43
maintainer
docs_urlNone
authorDavid de Matheu
requires_python>=3.10,<4.0
licenseMIT
keywords neumai ai tools data tools
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            <h1 align="center">Neum AI</h1>

<div align="center">
  
  [Homepage](https://www.neum.ai) | [Documentation](https://docs.neum.ai) | [Discord](https://discord.gg/mJeNZYRz4m) | [Twitter](https://twitter.com/neum_ai)
  
  <a href="https://www.ycombinator.com/companies/neum-ai"><img src="https://badgen.net/badge/Y%20Combinator/S23/orange"/></a>
</div>

Core library with Neum AI components to connect, load, chunk and sink vector embeddings. **[Neum AI](https://neum.ai) is a data platform that helps developers leverage their data to contextualize Large Language Models through Retrieval Augmented Generation (RAG)** This includes
extracting data from existing data sources like document storage and NoSQL, processing the contents into vector embeddings and ingesting the vector embeddings into vector databases for similarity search. 

It provides you a comprehensive solution for RAG that can scale with your application and reduce the time spent integrating services like data connectors, embedding models and vector databases.

## Features

- 🏭 **High throughput distrubted architecture** to handle billions of data points. Allows high degrees of parallelization to optimize embedding generation and ingestion.
- 🧱 **Built-in data connectors** to common data sources, embedding services and vector stores.
- 🔄 **Real-time synchronization** of data sources to ensure your data is always up-to-date. 
- 🤝 **Cohesive data management** to support hybrid retrieval with metdata. Neum AI automatically augments and tracks metadata to provide rich retrieval experience.

## Getting Started

### Neum AI Cloud

Sign up today at [dasboard.neum.ai](https://dashboard.neum.ai). See our [quickstart]() to get started.

The Neum AI Cloud supports a large-scale, distrubted architecture to run millions of documents through vector embedding. For the full set of features see: [Cloud vs Local](https://neumai.mintlify.app/get-started/cloud-vs-local)

### Local Development

Install the [`neumai`](https://pypi.org/project/neumai/) package:

```bash
pip install neumai
```

To create your first data pipelines visit our [quickstart]().

### Self-host

If you are interested in deploying Neum AI to your own cloud contact us at [founders@tryneum.com](mailto:founders@tryneum.com).

We will publish soon an open-source self-host that leverages the framework's architecture to do high throughput data processing.

## Roadmap

Connectors
- [ ]  MySQL - Source
- [ ]  GitHub - Source
- [ ]  Google Drive - Source
- [ ]  Hugging Face - Embedding
- [ ]  LanceDB - Sink
- [ ]  Milvus - Sink
- [ ]  Chroma - Sink

Search
- [ ]  Retrieval feedback
- [ ]  Filter support
- [ ]  Unified Neum AI filters
- [ ]  Self-Query Retrieval (w/ Metadata attributes generation)

Extensibility
- [ ]  Langchain / Llama Index Document to Neum Document converter
- [ ]  Custom chunking and loading

Experimental
- [ ]  Async metadata augmentation
- [ ]  Chat history connector
- [ ]  Structured (SQL and GraphQL) search connector
            

Raw data

            {
    "_id": null,
    "home_page": "https://neum.ai",
    "name": "neumai",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.10,<4.0",
    "maintainer_email": "",
    "keywords": "neumai,ai tools,data tools",
    "author": "David de Matheu",
    "author_email": "david@tryneum.com",
    "download_url": "https://files.pythonhosted.org/packages/78/3e/d26213378b85d7bc2916f9db49222daf83ab969520fac0192f44d3767443/neumai-0.0.40.tar.gz",
    "platform": null,
    "description": "<h1 align=\"center\">Neum AI</h1>\n\n<div align=\"center\">\n  \n  [Homepage](https://www.neum.ai) | [Documentation](https://docs.neum.ai) | [Discord](https://discord.gg/mJeNZYRz4m) | [Twitter](https://twitter.com/neum_ai)\n  \n  <a href=\"https://www.ycombinator.com/companies/neum-ai\"><img src=\"https://badgen.net/badge/Y%20Combinator/S23/orange\"/></a>\n</div>\n\nCore library with Neum AI components to connect, load, chunk and sink vector embeddings. **[Neum AI](https://neum.ai) is a data platform that helps developers leverage their data to contextualize Large Language Models through Retrieval Augmented Generation (RAG)** This includes\nextracting data from existing data sources like document storage and NoSQL, processing the contents into vector embeddings and ingesting the vector embeddings into vector databases for similarity search. \n\nIt provides you a comprehensive solution for RAG that can scale with your application and reduce the time spent integrating services like data connectors, embedding models and vector databases.\n\n## Features\n\n- \ud83c\udfed **High throughput distrubted architecture** to handle billions of data points. Allows high degrees of parallelization to optimize embedding generation and ingestion.\n- \ud83e\uddf1 **Built-in data connectors** to common data sources, embedding services and vector stores.\n- \ud83d\udd04 **Real-time synchronization** of data sources to ensure your data is always up-to-date. \n- \ud83e\udd1d **Cohesive data management** to support hybrid retrieval with metdata. Neum AI automatically augments and tracks metadata to provide rich retrieval experience.\n\n## Getting Started\n\n### Neum AI Cloud\n\nSign up today at [dasboard.neum.ai](https://dashboard.neum.ai). See our [quickstart]() to get started.\n\nThe Neum AI Cloud supports a large-scale, distrubted architecture to run millions of documents through vector embedding. For the full set of features see: [Cloud vs Local](https://neumai.mintlify.app/get-started/cloud-vs-local)\n\n### Local Development\n\nInstall the [`neumai`](https://pypi.org/project/neumai/) package:\n\n```bash\npip install neumai\n```\n\nTo create your first data pipelines visit our [quickstart]().\n\n### Self-host\n\nIf you are interested in deploying Neum AI to your own cloud contact us at [founders@tryneum.com](mailto:founders@tryneum.com).\n\nWe will publish soon an open-source self-host that leverages the framework's architecture to do high throughput data processing.\n\n## Roadmap\n\nConnectors\n- [ ]  MySQL - Source\n- [ ]  GitHub - Source\n- [ ]  Google Drive - Source\n- [ ]  Hugging Face - Embedding\n- [ ]  LanceDB - Sink\n- [ ]  Milvus - Sink\n- [ ]  Chroma - Sink\n\nSearch\n- [ ]  Retrieval feedback\n- [ ]  Filter support\n- [ ]  Unified Neum AI filters\n- [ ]  Self-Query Retrieval (w/ Metadata attributes generation)\n\nExtensibility\n- [ ]  Langchain / Llama Index Document to Neum Document converter\n- [ ]  Custom chunking and loading\n\nExperimental\n- [ ]  Async metadata augmentation\n- [ ]  Chat history connector\n- [ ]  Structured (SQL and GraphQL) search connector",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Package containing connectors for Neum AI.",
    "version": "0.0.40",
    "project_urls": {
        "Homepage": "https://neum.ai",
        "Repository": "https://github.com/NeumTry/NeumAI"
    },
    "split_keywords": [
        "neumai",
        "ai tools",
        "data tools"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "1ac2586f7a6c90f9d540ed5bb37f44d9a088896fc0433dd008de9e586df709b6",
                "md5": "50c3439aeb365645a4e4654e12804c5d",
                "sha256": "39cdf7f8a165118ab85c23a07b369bea68a2f521919a9674e1f05d06aa1406e9"
            },
            "downloads": -1,
            "filename": "neumai-0.0.40-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "50c3439aeb365645a4e4654e12804c5d",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.10,<4.0",
            "size": 73105,
            "upload_time": "2024-01-07T17:36:41",
            "upload_time_iso_8601": "2024-01-07T17:36:41.478943Z",
            "url": "https://files.pythonhosted.org/packages/1a/c2/586f7a6c90f9d540ed5bb37f44d9a088896fc0433dd008de9e586df709b6/neumai-0.0.40-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "783ed26213378b85d7bc2916f9db49222daf83ab969520fac0192f44d3767443",
                "md5": "cc07e98809ae5768cf8947c10d6d3891",
                "sha256": "b9d8bd9e2d9b102397f4c758aa10a22794ddb18fca06c56101b6303077d8b826"
            },
            "downloads": -1,
            "filename": "neumai-0.0.40.tar.gz",
            "has_sig": false,
            "md5_digest": "cc07e98809ae5768cf8947c10d6d3891",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.10,<4.0",
            "size": 42269,
            "upload_time": "2024-01-07T17:36:43",
            "upload_time_iso_8601": "2024-01-07T17:36:43.689222Z",
            "url": "https://files.pythonhosted.org/packages/78/3e/d26213378b85d7bc2916f9db49222daf83ab969520fac0192f44d3767443/neumai-0.0.40.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-01-07 17:36:43",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "NeumTry",
    "github_project": "NeumAI",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "neumai"
}
        
Elapsed time: 0.54893s