# Palimpzest (PZ)
[](https://discord.gg/dN85JJ6jaH)
[](https://palimpzest.org/)
[](https://colab.research.google.com/drive/1Fm8I4yL1az395MsFkQbEIZSmUZs0oGvZ?usp=sharing)
[](https://pypi.org/project/palimpzest/)
[](https://pypi.org/project/palimpzest/)
<!-- [](https://arxiv.org/pdf/2405.14696) -->
<!-- [](https://youtu.be/T8VQfyBiki0?si=eiph57DSEkDNbEIu) -->
## 📚 Learn How to Use PZ
Our [full documentation](https://palimpzest.org) is the definitive resource for learning how to use PZ. It contains all of the installation and quickstart materials on this page, as well as user guides, full API documentation (coming soon), and much more.
## 🚀 Getting started
You can find a stable version of the PZ package on PyPI [here](https://pypi.org/project/palimpzest/). To install the package, run:
```bash
$ pip install palimpzest
```
You can also install PZ with [uv](https://docs.astral.sh/uv/) for a faster installation:
```bash
$ uv pip install palimpzest
```
Alternatively, to install the latest version of the package from this repository, you can clone this repository and run the following commands:
```bash
$ git clone git@github.com:mitdbg/palimpzest.git
$ cd palimpzest
$ pip install .
```
## 🙋🏽 Join the PZ Community
We are actively hacking on PZ and would love to have you join our community [](https://discord.gg/dN85JJ6jaH)
[Our Discord server](https://discord.gg/dN85JJ6jaH) is the best place to:
- Get help with your PZ program(s)
- Give feedback to the maintainers
- Discuss the future direction(s) of the project
- Discuss anything related to data processing with LLMs!
We are eager to learn more about your workloads and use cases, and will take them into consideration in planning our future roadmap.
### 📓 Citation
If you would like to cite our original paper on Palimpzest, please use the following citation:
```
@inproceedings{palimpzestCIDR,
title={Palimpzest: Optimizing AI-Powered Analytics with Declarative Query Processing},
author={Liu, Chunwei and Russo, Matthew and Cafarella, Michael and Cao, Lei and Chen, Peter Baile and Chen, Zui and Franklin, Michael and Kraska, Tim and Madden, Samuel and Shahout, Rana and Vitagliano, Gerardo},
booktitle = {Proceedings of the {{Conference}} on {{Innovative Database Research}} ({{CIDR}})},
date = 2025,
}
```
If you would like to cite our paper on Palimpzest's optimizer Abacus, please use the following citation:
```
@misc{russo2025abacuscostbasedoptimizersemantic,
title={Abacus: A Cost-Based Optimizer for Semantic Operator Systems},
author={Matthew Russo and Sivaprasad Sudhir and Gerardo Vitagliano and Chunwei Liu and Tim Kraska and Samuel Madden and Michael Cafarella},
year={2025},
eprint={2505.14661},
archivePrefix={arXiv},
primaryClass={cs.DB},
url={https://arxiv.org/abs/2505.14661},
}
```
Raw data
{
"_id": null,
"home_page": null,
"name": "palimpzest",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.12",
"maintainer_email": null,
"keywords": "relational, optimization, llm, AI programming, extraction, tools, document, search, integration",
"author": null,
"author_email": "MIT DSG Semantic Management Lab <michjc@csail.mit.edu>",
"download_url": "https://files.pythonhosted.org/packages/54/85/ad0757a7ee32c6e6f5ad2c90c8496a1fea4dcda2dd538a8475fe85892ec2/palimpzest-1.1.0.tar.gz",
"platform": null,
"description": "\n\n# Palimpzest (PZ)\n[](https://discord.gg/dN85JJ6jaH)\n[](https://palimpzest.org/)\n[](https://colab.research.google.com/drive/1Fm8I4yL1az395MsFkQbEIZSmUZs0oGvZ?usp=sharing)\n[](https://pypi.org/project/palimpzest/)\n[](https://pypi.org/project/palimpzest/)\n<!-- [](https://arxiv.org/pdf/2405.14696) -->\n<!-- [](https://youtu.be/T8VQfyBiki0?si=eiph57DSEkDNbEIu) -->\n\n## \ud83d\udcda Learn How to Use PZ\nOur [full documentation](https://palimpzest.org) is the definitive resource for learning how to use PZ. It contains all of the installation and quickstart materials on this page, as well as user guides, full API documentation (coming soon), and much more.\n\n## \ud83d\ude80 Getting started\nYou can find a stable version of the PZ package on PyPI [here](https://pypi.org/project/palimpzest/). To install the package, run:\n```bash\n$ pip install palimpzest\n```\n\nYou can also install PZ with [uv](https://docs.astral.sh/uv/) for a faster installation:\n```bash\n$ uv pip install palimpzest\n```\n\nAlternatively, to install the latest version of the package from this repository, you can clone this repository and run the following commands:\n```bash\n$ git clone git@github.com:mitdbg/palimpzest.git\n$ cd palimpzest\n$ pip install .\n```\n\n## \ud83d\ude4b\ud83c\udffd Join the PZ Community\nWe are actively hacking on PZ and would love to have you join our community [](https://discord.gg/dN85JJ6jaH)\n\n[Our Discord server](https://discord.gg/dN85JJ6jaH) is the best place to:\n- Get help with your PZ program(s)\n- Give feedback to the maintainers\n- Discuss the future direction(s) of the project\n- Discuss anything related to data processing with LLMs!\n\nWe are eager to learn more about your workloads and use cases, and will take them into consideration in planning our future roadmap.\n\n### \ud83d\udcd3 Citation\nIf you would like to cite our original paper on Palimpzest, please use the following citation:\n```\n@inproceedings{palimpzestCIDR,\n title={Palimpzest: Optimizing AI-Powered Analytics with Declarative Query Processing},\n author={Liu, Chunwei and Russo, Matthew and Cafarella, Michael and Cao, Lei and Chen, Peter Baile and Chen, Zui and Franklin, Michael and Kraska, Tim and Madden, Samuel and Shahout, Rana and Vitagliano, Gerardo},\n booktitle = {Proceedings of the {{Conference}} on {{Innovative Database Research}} ({{CIDR}})},\n date = 2025,\n}\n```\n\nIf you would like to cite our paper on Palimpzest's optimizer Abacus, please use the following citation:\n```\n@misc{russo2025abacuscostbasedoptimizersemantic,\n title={Abacus: A Cost-Based Optimizer for Semantic Operator Systems}, \n author={Matthew Russo and Sivaprasad Sudhir and Gerardo Vitagliano and Chunwei Liu and Tim Kraska and Samuel Madden and Michael Cafarella},\n year={2025},\n eprint={2505.14661},\n archivePrefix={arXiv},\n primaryClass={cs.DB},\n url={https://arxiv.org/abs/2505.14661}, \n}\n```\n",
"bugtrack_url": null,
"license": null,
"summary": "Palimpzest is a system which enables anyone to process AI-powered analytical queries simply by defining them in a declarative language",
"version": "1.1.0",
"project_urls": {
"documentation": "https://palimpzest.org",
"homepage": "https://palimpzest.org",
"repository": "https://github.com/mitdbg/palimpzest/"
},
"split_keywords": [
"relational",
" optimization",
" llm",
" ai programming",
" extraction",
" tools",
" document",
" search",
" integration"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "98c563a2fcfb995e5345b49aacebeebadbe258f8bf1c388f8b891b01ca984045",
"md5": "9c2c7f2ea0cbc6be0cbb655906bcc035",
"sha256": "b276a14a6539e6aebf0ba89dd6673a485aa6e2256bba6fd48d05a46a5dec1369"
},
"downloads": -1,
"filename": "palimpzest-1.1.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "9c2c7f2ea0cbc6be0cbb655906bcc035",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.12",
"size": 222866,
"upload_time": "2025-10-22T16:35:39",
"upload_time_iso_8601": "2025-10-22T16:35:39.946436Z",
"url": "https://files.pythonhosted.org/packages/98/c5/63a2fcfb995e5345b49aacebeebadbe258f8bf1c388f8b891b01ca984045/palimpzest-1.1.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "5485ad0757a7ee32c6e6f5ad2c90c8496a1fea4dcda2dd538a8475fe85892ec2",
"md5": "eac270baa07f94f6078baa12840b6cc3",
"sha256": "118121ba5deebd55939bd209b7b7f21f0e2d34ea16cc3685277ad3e2963a362d"
},
"downloads": -1,
"filename": "palimpzest-1.1.0.tar.gz",
"has_sig": false,
"md5_digest": "eac270baa07f94f6078baa12840b6cc3",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.12",
"size": 182500,
"upload_time": "2025-10-22T16:35:41",
"upload_time_iso_8601": "2025-10-22T16:35:41.772700Z",
"url": "https://files.pythonhosted.org/packages/54/85/ad0757a7ee32c6e6f5ad2c90c8496a1fea4dcda2dd538a8475fe85892ec2/palimpzest-1.1.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-10-22 16:35:41",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "mitdbg",
"github_project": "palimpzest",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "palimpzest"
}
JSON
