<div align="center">
<a href="https://www.deepset.ai/haystack/"><img src="https://raw.githubusercontent.com/deepset-ai/haystack/main/docs/img/haystack_logo_colored.png" alt="Haystack"></a>
| | |
| ------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| CI/CD | [](https://github.com/deepset-ai/haystack/actions/workflows/tests.yml) [](https://github.com/deepset-ai/haystack/actions/workflows/docker_release.yml) [](https://github.com/deepset-ai/haystack/actions/workflows/schemas.yml) [](https://github.com/psf/black) [](https://github.com/python/mypy) [](https://coveralls.io/github/deepset-ai/haystack?branch=main) |
| Docs | [](https://github.com/deepset-ai/haystack/actions/workflows/readme_sync.yml) [](https://docs.haystack.deepset.ai) |
| Package | [](https://pypi.org/project/farm-haystack/)   [](LICENSE) [](https://github.com/deepset-ai/haystack/actions/workflows/license_compliance.yml) |
| Meta | [](https://discord.gg/haystack) [](https://twitter.com/haystack_ai) |
</div>
[Haystack](https://haystack.deepset.ai/) is an end-to-end NLP framework that enables you to build applications powered by LLMs, Transformer models, vector search and more. Whether you want to perform question answering, answer generation, semantic document search, or build tools that are capable of complex decision-making and query resolution, you can use state-of-the-art NLP models with Haystack to build end-to-end NLP applications to solve your use case.
## Quickstart
Haystack is built around the concept of pipelines. A pipeline is a powerful structure that performs an NLP task. It's made up of components connected together. For example, you can connect a `Retriever` and a `PromptNode` to build a Generative Question Answering pipeline that uses your own data.
Try out how Haystack answers questions about Game of Thrones using the Retrieval Augmented Generation (RAG) approach π
First, run the minimal Haystack installation:
```sh
pip install farm-haystack
```
Then, index your data to the DocumentStore, build a RAG pipeline, and ask a question on your data:
```python
from haystack.document_stores import InMemoryDocumentStore
from haystack.utils import build_pipeline, add_example_data, print_answers
# We are model agnostic :) Here, you can choose from: "anthropic", "cohere", "huggingface", and "openai".
provider = "openai"
API_KEY = "sk-..." # ADD YOUR KEY HERE
# We support many different databases. Here, we load a simple and lightweight in-memory database.
document_store = InMemoryDocumentStore(use_bm25=True)
# Download and add Game of Thrones TXT articles to Haystack DocumentStore.
# You can also provide a folder with your local documents.
add_example_data(document_store, "data/GoT_getting_started")
# Build a pipeline with a Retriever to get relevant documents to the query and a PromptNode interacting with LLMs using a custom prompt.
pipeline = build_pipeline(provider, API_KEY, document_store)
# Ask a question on the data you just added.
result = pipeline.run(query="Who is the father of Arya Stark?")
# For details, like which documents were used to generate the answer, look into the <result> object
print_answers(result, details="medium")
```
The output of the pipeline will reference the documents used to generate the answer:
```
'Query: Who is the father of Arya Stark?'
'Answers:'
[{'answer': 'The father of Arya Stark is Lord Eddard Stark of '
'Winterfell. [Document 1, Document 4, Document 5]'}]
```
Congratulations, you have just built your first Haystack app!
## Core Concepts
πββοΈ **[Pipelines](https://docs.haystack.deepset.ai/docs/pipelines):** This is the standard Haystack structure that builds on top of your data to perform various NLP tasks such as retrieval augmented generation, question answering and more. The data in a Pipeline flows from one Node to the next. You define how Nodes interact with each other and how one Node pushes data to the next.
An example pipeline would consist of one `Retriever` Node and one `PromptNode`. When the pipeline runs with a query, the Retriever first retrieves the relevant context to the query from your data, and then the PromptNode uses an LLM to generate the final answer.
βοΈ **[Nodes](https://docs.haystack.deepset.ai/docs/nodes_overview):** Each Node achieves one thing. Such as preprocessing documents, retrieving documents, using language models to answer questions, and so on.
π΅οΈ **[Agent](https://docs.haystack.deepset.ai/docs/agent):** (since 1.15) An Agent is a component that is powered by an LLM, such as GPT-3. It can decide on the next best course of action so as to get to the result of a query. It uses the Tools available to it to achieve this. While a pipeline has a clear start and end, an Agent is able to decide whether the query has been resolved or not. It may also make use of a Pipeline as a Tool.
π οΈ **[Tools](https://docs.haystack.deepset.ai/docs/agent#tools):** You can think of a Tool as an expert, that is able to do something really well. Such as a calculator, good at mathematics. Or a [WebRetriever](https://docs.haystack.deepset.ai/docs/agent#web-tools), good at retrieving pages from the internet. A Node or pipeline in Haystack can also be used as a Tool. A Tool is a component that is used by an Agent, to resolve complex queries.
ποΈ **[DocumentStores](https://docs.haystack.deepset.ai/docs/document_store):** A DocumentStore is database where you store your text data for Haystack to access. Haystack DocumentStores are available with ElasticSearch, Opensearch, Weaviate, Pinecone, FAISS and more. For a full list of available DocumentStores, check out our [documentation](https://docs.haystack.deepset.ai/docs/document_store).
## What to Build with Haystack
- Build **retrieval augmented generation (RAG)** by making use of one of the available vector databases and customizing your LLM interaction, the sky is the limit π
- Perform Question Answering **in natural language** to find granular answers in your documents.
- Perform **semantic search** and retrieve documents according to meaning.
- Build applications that can make complex decisions making to answer complex queries: such as systems that can resolve complex customer queries, do knowledge search on many disconnected resources and so on.
- Use **off-the-shelf models** or **fine-tune** them to your data.
- Use **user feedback** to evaluate, benchmark, and continuously improve your models.
## Features
- **Latest models**: Haystack allows you to use and compare models available from OpenAI, Cohere and Hugging Face, as well as your own local models or models hosted on SageMaker. Use the latest LLMs or Transformer-based models (for example: BERT, RoBERTa, MiniLM).
- **Modular**: Multiple choices to fit your tech stack and use case. A wide choice of DocumentStores to store your data, file conversion tools and more
- **Open**: Integrated with Hugging Face's model hub, OpenAI, Cohere and various Azure services.
- **Scalable**: Scale to millions of docs using retrievers and production-scale components like Elasticsearch and a fastAPI REST API.
- **End-to-End**: All tooling in one place: file conversion, cleaning, splitting, training, eval, inference, labeling, and more.
- **Customizable**: Fine-tune models to your domain or implement your custom Nodes.
- **Continuous Learning**: Collect new training data from user feedback in production & improve your models continuously.
## Resources
| | |
| ---------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| π [Docs](https://docs.haystack.deepset.ai) | Components, Pipeline Nodes, Guides, API Reference |
| πΎ [Installation](https://github.com/deepset-ai/haystack#-installation) | How to install Haystack |
| π [Tutorials](https://haystack.deepset.ai/tutorials) | See what Haystack can do with our Notebooks & Scripts |
| πΒ [Haystack Extras](https://github.com/deepset-ai/haystack-extras) | A repository that lists extra Haystack packages and components that can be installed separately. |
| π° [Demos](https://github.com/deepset-ai/haystack-demos) | A repository containing Haystack demo applications with Docker Compose and a REST API |
| π [Community](https://github.com/deepset-ai/haystack#-community) | [Discord](https://discord.gg/haystack), [π (Twitter)](https://twitter.com/haystack_ai), [Stack Overflow](https://stackoverflow.com/questions/tagged/haystack), [GitHub Discussions](https://github.com/deepset-ai/haystack/discussions) |
| π [Contributing](https://github.com/deepset-ai/haystack#-contributing) | We welcome all contributions! |
| π [Benchmarks](https://haystack.deepset.ai/benchmarks/) | Speed & Accuracy of Retriever, Readers and DocumentStores |
| π [Roadmap](https://haystack.deepset.ai/overview/roadmap) | Public roadmap of Haystack |
| π° [Blog](https://haystack.deepset.ai/blog) | Learn about the latest with Haystack and NLP |
| βοΈ [Jobs](https://www.deepset.ai/jobs) | We're hiring! Have a look at our open positions |
## πΎ Installation
For a detailed installation guide see [the official documentation](https://docs.haystack.deepset.ai/docs/installation). There youβll find instructions for custom installations handling Windows and Apple Silicon.
**Basic Installation**
Use [pip](https://github.com/pypa/pip) to install a basic version of Haystack's latest release:
```sh
pip install farm-haystack
```
This command installs everything needed for basic Pipelines that use an in-memory DocumentStore and external LLM provider (e.g. OpenAI).
**Full Installation**
To use more advanced features, like certain DocumentStores, inference with local transformer models, FileConverters, OCR, or Ray,
you need to install further dependencies. The following command installs the [latest release](https://github.com/deepset-ai/haystack/releases) of Haystack and all its dependencies:
```sh
pip install 'farm-haystack[all]' ## or 'all-gpu' for the GPU-enabled dependencies
```
If you want to install only the dependencies needed for model inference on your local hardware (not remote API endpoints), such as torch and sentence-transformers, you can use the following command:
```sh
pip install 'farm-haystack[inference]' ## installs torch, sentence-transformers, sentencepiece, and huggingface-hub
```
If you want to try out the newest features that are not in an official release yet, you can install the unstable version from the main branch with the following command:
```sh
pip install git+https://github.com/deepset-ai/haystack.git@main#egg=farm-haystack
```
To be able to make changes to Haystack code, first of all clone this repo:
```sh
git clone https://github.com/deepset-ai/haystack.git
```
Then move into the cloned folder and install the project with `pip`, including the development dependencies:
```console
cd haystack && pip install -e '.[dev]'
```
If you want to contribute to the Haystack repo, check our [Contributor Guidelines](https://github.com/deepset-ai/haystack/blob/main/CONTRIBUTING.md) first.
See the list of [dependencies](https://github.com/deepset-ai/haystack/blob/main/pyproject.toml) to check which ones you want to install (for example, `[all]`, `[dev]`, or other).
**Installing the REST API**
Haystack comes packaged with a REST API so that you can deploy it as a service. Run the following command from the root directory of the Haystack repo to install REST_API:
```
pip install rest_api/
```
You can find out more about our PyPi package on our [PyPi page](https://pypi.org/project/farm-haystack/).
## π°Demos
You can find some of our hosted demos with instructions to run them locally too on our [haystack-demos](https://github.com/deepset-ai/haystack-demos) repository
:dizzy: **[Reduce Hallucinations with Retrieval Augmentation](https://huggingface.co/spaces/deepset/retrieval-augmentation-svb) - Generative QA with LLMs**
π₯ **[Should I follow?](https://huggingface.co/spaces/deepset/should-i-follow) - Summarizing tweets with LLMs**
π **[Explore The World](https://haystack-demo.deepset.ai/) - Extractive Question Answering**
### π Community
If you have a feature request or a bug report, feel free to open an [issue in Github](https://github.com/deepset-ai/haystack/issues). We regularly check these and you can expect a quick response. If you'd like to discuss a topic, or get more general advice on how to make Haystack work for your project, you can start a thread in [Github Discussions](https://github.com/deepset-ai/haystack/discussions) or our [Discord channel](https://discord.gg/haystack). We also check [π (Twitter)](https://twitter.com/haystack_ai) and [Stack Overflow](https://stackoverflow.com/questions/tagged/haystack).
### π Contributing
We are very open to the community's contributions - be it a quick fix of a typo, or a completely new feature! You don't need to be a Haystack expert to provide meaningful improvements. To learn how to get started, check out our [Contributor Guidelines](https://github.com/deepset-ai/haystack/blob/main/CONTRIBUTING.md) first.
## Who Uses Haystack
Here's a list of projects and companies using Haystack. Want to add yours? Open a PR, add it to the list and let the
world know that you use Haystack!
- [Airbus](https://www.airbus.com/en)
- [Alcatel-Lucent](https://www.al-enterprise.com/)
- [Apple](https://www.apple.com/)
- [BetterUp](https://www.betterup.com/)
- [Databricks](https://www.databricks.com/)
- [Deepset](https://deepset.ai/)
- [Etalab](https://www.deepset.ai/blog/improving-on-site-search-for-government-agencies-etalab)
- [Infineon](https://www.infineon.com/)
- [Intel](https://github.com/intel/open-domain-question-and-answer#readme)
- [Intelijus](https://www.intelijus.ai/)
- [Intel Labs](https://github.com/IntelLabs/fastRAG#readme)
- [LEGO](https://github.com/larsbaunwall/bricky#readme)
- [Netflix](https://netflix.com)
- [Nvidia](https://developer.nvidia.com/blog/reducing-development-time-for-intelligent-virtual-assistants-in-contact-centers/)
- [PostHog](https://github.com/PostHog/max-ai#readme)
- [Rakuten](https://www.rakuten.com/)
- [Sooth.ai](https://www.deepset.ai/blog/advanced-neural-search-with-sooth-ai)
Raw data
{
"_id": null,
"home_page": null,
"name": "farm-haystack",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": "BERT, QA, Question-Answering, Reader, Retriever, albert, language-model, mrc, roberta, search, semantic-search, squad, transfer-learning, transformer",
"author": null,
"author_email": "\"deepset.ai\" <malte.pietsch@deepset.ai>",
"download_url": "https://files.pythonhosted.org/packages/ac/b3/8362c28323fe1a76697da1a6b282f51b6fdcaf38009bdd931deb6677d3d2/farm_haystack-1.25.5.tar.gz",
"platform": null,
"description": "<div align=\"center\">\n <a href=\"https://www.deepset.ai/haystack/\"><img src=\"https://raw.githubusercontent.com/deepset-ai/haystack/main/docs/img/haystack_logo_colored.png\" alt=\"Haystack\"></a>\n\n| | |\n| ------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |\n| CI/CD | [](https://github.com/deepset-ai/haystack/actions/workflows/tests.yml) [](https://github.com/deepset-ai/haystack/actions/workflows/docker_release.yml) [](https://github.com/deepset-ai/haystack/actions/workflows/schemas.yml) [](https://github.com/psf/black) [](https://github.com/python/mypy) [](https://coveralls.io/github/deepset-ai/haystack?branch=main) |\n| Docs | [](https://github.com/deepset-ai/haystack/actions/workflows/readme_sync.yml) [](https://docs.haystack.deepset.ai) |\n| Package | [](https://pypi.org/project/farm-haystack/)   [](LICENSE) [](https://github.com/deepset-ai/haystack/actions/workflows/license_compliance.yml) |\n| Meta | [](https://discord.gg/haystack) [](https://twitter.com/haystack_ai) |\n</div>\n\n[Haystack](https://haystack.deepset.ai/) is an end-to-end NLP framework that enables you to build applications powered by LLMs, Transformer models, vector search and more. Whether you want to perform question answering, answer generation, semantic document search, or build tools that are capable of complex decision-making and query resolution, you can use state-of-the-art NLP models with Haystack to build end-to-end NLP applications to solve your use case.\n\n## Quickstart\n\nHaystack is built around the concept of pipelines. A pipeline is a powerful structure that performs an NLP task. It's made up of components connected together. For example, you can connect a `Retriever` and a `PromptNode` to build a Generative Question Answering pipeline that uses your own data.\n\nTry out how Haystack answers questions about Game of Thrones using the Retrieval Augmented Generation (RAG) approach \ud83d\udc47\n\nFirst, run the minimal Haystack installation:\n\n```sh\npip install farm-haystack\n```\n\nThen, index your data to the DocumentStore, build a RAG pipeline, and ask a question on your data:\n\n```python\nfrom haystack.document_stores import InMemoryDocumentStore\nfrom haystack.utils import build_pipeline, add_example_data, print_answers\n\n# We are model agnostic :) Here, you can choose from: \"anthropic\", \"cohere\", \"huggingface\", and \"openai\".\nprovider = \"openai\"\nAPI_KEY = \"sk-...\" # ADD YOUR KEY HERE\n\n# We support many different databases. Here, we load a simple and lightweight in-memory database.\ndocument_store = InMemoryDocumentStore(use_bm25=True)\n\n# Download and add Game of Thrones TXT articles to Haystack DocumentStore.\n# You can also provide a folder with your local documents.\nadd_example_data(document_store, \"data/GoT_getting_started\")\n\n# Build a pipeline with a Retriever to get relevant documents to the query and a PromptNode interacting with LLMs using a custom prompt.\npipeline = build_pipeline(provider, API_KEY, document_store)\n\n# Ask a question on the data you just added.\nresult = pipeline.run(query=\"Who is the father of Arya Stark?\")\n\n# For details, like which documents were used to generate the answer, look into the <result> object\nprint_answers(result, details=\"medium\")\n```\n\nThe output of the pipeline will reference the documents used to generate the answer:\n\n```\n'Query: Who is the father of Arya Stark?'\n'Answers:'\n[{'answer': 'The father of Arya Stark is Lord Eddard Stark of '\n 'Winterfell. [Document 1, Document 4, Document 5]'}]\n```\n\nCongratulations, you have just built your first Haystack app!\n\n## Core Concepts\n\n\ud83c\udfc3\u200d\u2640\ufe0f **[Pipelines](https://docs.haystack.deepset.ai/docs/pipelines):** This is the standard Haystack structure that builds on top of your data to perform various NLP tasks such as retrieval augmented generation, question answering and more. The data in a Pipeline flows from one Node to the next. You define how Nodes interact with each other and how one Node pushes data to the next.\n\nAn example pipeline would consist of one `Retriever` Node and one `PromptNode`. When the pipeline runs with a query, the Retriever first retrieves the relevant context to the query from your data, and then the PromptNode uses an LLM to generate the final answer.\n\n\u269b\ufe0f **[Nodes](https://docs.haystack.deepset.ai/docs/nodes_overview):** Each Node achieves one thing. Such as preprocessing documents, retrieving documents, using language models to answer questions, and so on.\n\n\ud83d\udd75\ufe0f **[Agent](https://docs.haystack.deepset.ai/docs/agent):** (since 1.15) An Agent is a component that is powered by an LLM, such as GPT-3. It can decide on the next best course of action so as to get to the result of a query. It uses the Tools available to it to achieve this. While a pipeline has a clear start and end, an Agent is able to decide whether the query has been resolved or not. It may also make use of a Pipeline as a Tool.\n\n\ud83d\udee0\ufe0f **[Tools](https://docs.haystack.deepset.ai/docs/agent#tools):** You can think of a Tool as an expert, that is able to do something really well. Such as a calculator, good at mathematics. Or a [WebRetriever](https://docs.haystack.deepset.ai/docs/agent#web-tools), good at retrieving pages from the internet. A Node or pipeline in Haystack can also be used as a Tool. A Tool is a component that is used by an Agent, to resolve complex queries.\n\n\ud83d\uddc2\ufe0f **[DocumentStores](https://docs.haystack.deepset.ai/docs/document_store):** A DocumentStore is database where you store your text data for Haystack to access. Haystack DocumentStores are available with ElasticSearch, Opensearch, Weaviate, Pinecone, FAISS and more. For a full list of available DocumentStores, check out our [documentation](https://docs.haystack.deepset.ai/docs/document_store).\n\n## What to Build with Haystack\n\n- Build **retrieval augmented generation (RAG)** by making use of one of the available vector databases and customizing your LLM interaction, the sky is the limit \ud83d\ude80\n- Perform Question Answering **in natural language** to find granular answers in your documents.\n- Perform **semantic search** and retrieve documents according to meaning.\n- Build applications that can make complex decisions making to answer complex queries: such as systems that can resolve complex customer queries, do knowledge search on many disconnected resources and so on.\n- Use **off-the-shelf models** or **fine-tune** them to your data.\n- Use **user feedback** to evaluate, benchmark, and continuously improve your models.\n\n## Features\n\n- **Latest models**: Haystack allows you to use and compare models available from OpenAI, Cohere and Hugging Face, as well as your own local models or models hosted on SageMaker. Use the latest LLMs or Transformer-based models (for example: BERT, RoBERTa, MiniLM).\n- **Modular**: Multiple choices to fit your tech stack and use case. A wide choice of DocumentStores to store your data, file conversion tools and more\n- **Open**: Integrated with Hugging Face's model hub, OpenAI, Cohere and various Azure services.\n- **Scalable**: Scale to millions of docs using retrievers and production-scale components like Elasticsearch and a fastAPI REST API.\n- **End-to-End**: All tooling in one place: file conversion, cleaning, splitting, training, eval, inference, labeling, and more.\n- **Customizable**: Fine-tune models to your domain or implement your custom Nodes.\n- **Continuous Learning**: Collect new training data from user feedback in production & improve your models continuously.\n\n## Resources\n| | |\n| ---------------------------------------------------------------------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |\n| \ud83d\udcd2 [Docs](https://docs.haystack.deepset.ai) | Components, Pipeline Nodes, Guides, API Reference |\n| \ud83d\udcbe [Installation](https://github.com/deepset-ai/haystack#-installation) | How to install Haystack |\n| \ud83c\udf93 [Tutorials](https://haystack.deepset.ai/tutorials) | See what Haystack can do with our Notebooks & Scripts |\n| \ud83c\udf89\u00a0[Haystack Extras](https://github.com/deepset-ai/haystack-extras) | A repository that lists extra Haystack packages and components that can be installed separately. |\n| \ud83d\udd30 [Demos](https://github.com/deepset-ai/haystack-demos) | A repository containing Haystack demo applications with Docker Compose and a REST API |\n| \ud83d\udd96 [Community](https://github.com/deepset-ai/haystack#-community) | [Discord](https://discord.gg/haystack), [\ud835\udd4f (Twitter)](https://twitter.com/haystack_ai), [Stack Overflow](https://stackoverflow.com/questions/tagged/haystack), [GitHub Discussions](https://github.com/deepset-ai/haystack/discussions) |\n| \ud83d\udc99 [Contributing](https://github.com/deepset-ai/haystack#-contributing) | We welcome all contributions! |\n| \ud83d\udcca [Benchmarks](https://haystack.deepset.ai/benchmarks/) | Speed & Accuracy of Retriever, Readers and DocumentStores |\n| \ud83d\udd2d [Roadmap](https://haystack.deepset.ai/overview/roadmap) | Public roadmap of Haystack |\n| \ud83d\udcf0 [Blog](https://haystack.deepset.ai/blog) | Learn about the latest with Haystack and NLP |\n| \u260e\ufe0f [Jobs](https://www.deepset.ai/jobs) | We're hiring! Have a look at our open positions |\n\n\n## \ud83d\udcbe Installation\n\nFor a detailed installation guide see [the official documentation](https://docs.haystack.deepset.ai/docs/installation). There you\u2019ll find instructions for custom installations handling Windows and Apple Silicon.\n\n**Basic Installation**\n\nUse [pip](https://github.com/pypa/pip) to install a basic version of Haystack's latest release:\n\n```sh\npip install farm-haystack\n```\n\nThis command installs everything needed for basic Pipelines that use an in-memory DocumentStore and external LLM provider (e.g. OpenAI).\n\n**Full Installation**\n\nTo use more advanced features, like certain DocumentStores, inference with local transformer models, FileConverters, OCR, or Ray,\nyou need to install further dependencies. The following command installs the [latest release](https://github.com/deepset-ai/haystack/releases) of Haystack and all its dependencies:\n\n```sh\npip install 'farm-haystack[all]' ## or 'all-gpu' for the GPU-enabled dependencies\n```\n\nIf you want to install only the dependencies needed for model inference on your local hardware (not remote API endpoints), such as torch and sentence-transformers, you can use the following command:\n```sh\npip install 'farm-haystack[inference]' ## installs torch, sentence-transformers, sentencepiece, and huggingface-hub\n```\n\nIf you want to try out the newest features that are not in an official release yet, you can install the unstable version from the main branch with the following command:\n\n```sh\npip install git+https://github.com/deepset-ai/haystack.git@main#egg=farm-haystack\n```\n\nTo be able to make changes to Haystack code, first of all clone this repo:\n\n```sh\ngit clone https://github.com/deepset-ai/haystack.git\n```\n\nThen move into the cloned folder and install the project with `pip`, including the development dependencies:\n\n```console\ncd haystack && pip install -e '.[dev]'\n```\n\nIf you want to contribute to the Haystack repo, check our [Contributor Guidelines](https://github.com/deepset-ai/haystack/blob/main/CONTRIBUTING.md) first.\n\nSee the list of [dependencies](https://github.com/deepset-ai/haystack/blob/main/pyproject.toml) to check which ones you want to install (for example, `[all]`, `[dev]`, or other).\n\n**Installing the REST API**\n\nHaystack comes packaged with a REST API so that you can deploy it as a service. Run the following command from the root directory of the Haystack repo to install REST_API:\n\n```\npip install rest_api/\n```\n\nYou can find out more about our PyPi package on our [PyPi page](https://pypi.org/project/farm-haystack/).\n\n## \ud83d\udd30Demos\n\nYou can find some of our hosted demos with instructions to run them locally too on our [haystack-demos](https://github.com/deepset-ai/haystack-demos) repository\n\n:dizzy: **[Reduce Hallucinations with Retrieval Augmentation](https://huggingface.co/spaces/deepset/retrieval-augmentation-svb) - Generative QA with LLMs**\n\n\ud83d\udc25 **[Should I follow?](https://huggingface.co/spaces/deepset/should-i-follow) - Summarizing tweets with LLMs**\n\n\ud83c\udf0e **[Explore The World](https://haystack-demo.deepset.ai/) - Extractive Question Answering**\n\n### \ud83d\udd96 Community\n\nIf you have a feature request or a bug report, feel free to open an [issue in Github](https://github.com/deepset-ai/haystack/issues). We regularly check these and you can expect a quick response. If you'd like to discuss a topic, or get more general advice on how to make Haystack work for your project, you can start a thread in [Github Discussions](https://github.com/deepset-ai/haystack/discussions) or our [Discord channel](https://discord.gg/haystack). We also check [\ud835\udd4f (Twitter)](https://twitter.com/haystack_ai) and [Stack Overflow](https://stackoverflow.com/questions/tagged/haystack).\n\n### \ud83d\udc99 Contributing\n\nWe are very open to the community's contributions - be it a quick fix of a typo, or a completely new feature! You don't need to be a Haystack expert to provide meaningful improvements. To learn how to get started, check out our [Contributor Guidelines](https://github.com/deepset-ai/haystack/blob/main/CONTRIBUTING.md) first.\n\n\n## Who Uses Haystack\n\nHere's a list of projects and companies using Haystack. Want to add yours? Open a PR, add it to the list and let the\nworld know that you use Haystack!\n\n- [Airbus](https://www.airbus.com/en)\n- [Alcatel-Lucent](https://www.al-enterprise.com/)\n- [Apple](https://www.apple.com/)\n- [BetterUp](https://www.betterup.com/)\n- [Databricks](https://www.databricks.com/)\n- [Deepset](https://deepset.ai/)\n- [Etalab](https://www.deepset.ai/blog/improving-on-site-search-for-government-agencies-etalab)\n- [Infineon](https://www.infineon.com/)\n- [Intel](https://github.com/intel/open-domain-question-and-answer#readme)\n- [Intelijus](https://www.intelijus.ai/)\n- [Intel Labs](https://github.com/IntelLabs/fastRAG#readme)\n- [LEGO](https://github.com/larsbaunwall/bricky#readme)\n- [Netflix](https://netflix.com)\n- [Nvidia](https://developer.nvidia.com/blog/reducing-development-time-for-intelligent-virtual-assistants-in-contact-centers/)\n- [PostHog](https://github.com/PostHog/max-ai#readme)\n- [Rakuten](https://www.rakuten.com/)\n- [Sooth.ai](https://www.deepset.ai/blog/advanced-neural-search-with-sooth-ai)\n",
"bugtrack_url": null,
"license": null,
"summary": "LLM framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data.",
"version": "1.25.5",
"project_urls": {
"CI: GitHub": "https://github.com/deepset-ai/haystack/actions",
"Docs: RTD": "https://haystack.deepset.ai/overview/intro",
"GitHub: issues": "https://github.com/deepset-ai/haystack/issues",
"GitHub: repo": "https://github.com/deepset-ai/haystack",
"Homepage": "https://github.com/deepset-ai/haystack"
},
"split_keywords": [
"bert",
" qa",
" question-answering",
" reader",
" retriever",
" albert",
" language-model",
" mrc",
" roberta",
" search",
" semantic-search",
" squad",
" transfer-learning",
" transformer"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "18abf171001011c3d6e2b6b469d7b2e93c8a2ccf9350d0ed06d37e9179c51de3",
"md5": "309b170520b8e3c6086f205a947fb6e0",
"sha256": "cbe4d622f318ea8c4fa61111355444c7fa3eb1118189ed253fba3da1682f8687"
},
"downloads": -1,
"filename": "farm_haystack-1.25.5-py3-none-any.whl",
"has_sig": false,
"md5_digest": "309b170520b8e3c6086f205a947fb6e0",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 770310,
"upload_time": "2024-04-24T13:24:10",
"upload_time_iso_8601": "2024-04-24T13:24:10.262781Z",
"url": "https://files.pythonhosted.org/packages/18/ab/f171001011c3d6e2b6b469d7b2e93c8a2ccf9350d0ed06d37e9179c51de3/farm_haystack-1.25.5-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "acb38362c28323fe1a76697da1a6b282f51b6fdcaf38009bdd931deb6677d3d2",
"md5": "3ae2b74e2ead59cdcca687e73f743b76",
"sha256": "564e3057b5c799e95c9f8bba0e49ad07a76868c4add4feb92913d1359342560c"
},
"downloads": -1,
"filename": "farm_haystack-1.25.5.tar.gz",
"has_sig": false,
"md5_digest": "3ae2b74e2ead59cdcca687e73f743b76",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 628022,
"upload_time": "2024-04-24T13:24:06",
"upload_time_iso_8601": "2024-04-24T13:24:06.957871Z",
"url": "https://files.pythonhosted.org/packages/ac/b3/8362c28323fe1a76697da1a6b282f51b6fdcaf38009bdd931deb6677d3d2/farm_haystack-1.25.5.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-04-24 13:24:06",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "deepset-ai",
"github_project": "haystack",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"tox": true,
"lcname": "farm-haystack"
}
JSON
