# pg-streamline-py
## Streamlining PostgreSQL Logical Replication and Event Processing
pg-streamline is a Python library designed to simplify and streamline the process of logical replication and event processing with PostgreSQL. It provides modular components for producers, consumers, parsers, and plugins, making it highly extensible and customizable.
---
### Table of Contents
1. [Installation](#installation)
2. [Features](#features)
3. [Usage](#usage)
- [Producer](#producer)
- [Consumer](#consumer)
- [Parser](#parser)
- [Plugins](#plugins)
4. [Contributing](#contributing)
5. [License](#license)
---
### Installation
```bash
pip install pg-streamline
```
## Features
### Producer
- Handles PostgreSQL logical replication.
- Supports multiple output plugins like 'pgoutput' and 'wal2json'.
- Pooling support for better performance.
For more details, see the [Producer README](./pg_streamline/producer/README.md).
### Consumer
- Consumes and processes the events replicated by the producer.
- Extensible: Can be extended to perform custom actions when specific database changes occur.
For more details, see the [Consumer README](./pg_streamline/consumer/README.md).
### Parser
- Parses different types of logical events from PostgreSQL.
- Supports parsing of INSERT, UPDATE, and DELETE events.
- Makes it easier to understand and act upon the changes in the database.
For more details, see the [Parser README](./pg_streamline/parser/README.md).
### Plugins
- Extend the functionality of pgStreamline with various plugins.
- Currently supports RabbitMQ for message queuing.
- More plugins are in development.
For more details, see the [Plugins README](./pg_streamline/plugins/README.md).
## Usage
Please refer to the README files in each module's directory for specific usage instructions:
- [Producer Usage](./pg_streamline/producer/README.md)
- [Consumer Usage](./pg_streamline/consumer/README.md)
- [Parser Usage](./pg_streamline/parser/README.md)
- [Plugins Usage](./pg_streamline/plugins/README.md)
## Contributing
We welcome contributions! Please see the [Contributing Guidelines](CONTRIBUTING.md) for more details.
## License
This project is licensed under the MIT License. See the [LICENSE](LICENSE) file for details.
Raw data
{
"_id": null,
"home_page": "https://github.com/shwetabhk/pg-streamline-py",
"name": "pg-streamline",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "netsuite,api,python,sdk",
"author": "Shwetabh Kumar",
"author_email": "shwetabh002@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/5a/88/94cb388754d03d421d20616466e54585f3e4feb0ca578426428f555338e8/pg-streamline-1.1.0.tar.gz",
"platform": null,
"description": "# pg-streamline-py\n\n## Streamlining PostgreSQL Logical Replication and Event Processing\n\npg-streamline is a Python library designed to simplify and streamline the process of logical replication and event processing with PostgreSQL. It provides modular components for producers, consumers, parsers, and plugins, making it highly extensible and customizable.\n\n---\n\n### Table of Contents\n\n1. [Installation](#installation)\n2. [Features](#features)\n3. [Usage](#usage)\n - [Producer](#producer)\n - [Consumer](#consumer)\n - [Parser](#parser)\n - [Plugins](#plugins)\n4. [Contributing](#contributing)\n5. [License](#license)\n\n---\n\n### Installation\n\n```bash\npip install pg-streamline\n```\n\n## Features\n\n### Producer\n\n- Handles PostgreSQL logical replication.\n- Supports multiple output plugins like 'pgoutput' and 'wal2json'.\n- Pooling support for better performance.\n\nFor more details, see the [Producer README](./pg_streamline/producer/README.md).\n\n### Consumer\n\n- Consumes and processes the events replicated by the producer.\n- Extensible: Can be extended to perform custom actions when specific database changes occur.\n\nFor more details, see the [Consumer README](./pg_streamline/consumer/README.md).\n\n### Parser\n\n- Parses different types of logical events from PostgreSQL.\n- Supports parsing of INSERT, UPDATE, and DELETE events.\n- Makes it easier to understand and act upon the changes in the database.\n\nFor more details, see the [Parser README](./pg_streamline/parser/README.md).\n\n### Plugins\n\n- Extend the functionality of pgStreamline with various plugins.\n- Currently supports RabbitMQ for message queuing.\n- More plugins are in development.\n\nFor more details, see the [Plugins README](./pg_streamline/plugins/README.md).\n\n## Usage\n\nPlease refer to the README files in each module's directory for specific usage instructions:\n\n- [Producer Usage](./pg_streamline/producer/README.md)\n- [Consumer Usage](./pg_streamline/consumer/README.md)\n- [Parser Usage](./pg_streamline/parser/README.md)\n- [Plugins Usage](./pg_streamline/plugins/README.md)\n\n## Contributing\n\nWe welcome contributions! Please see the [Contributing Guidelines](CONTRIBUTING.md) for more details.\n\n## License\n\nThis project is licensed under the MIT License. See the [LICENSE](LICENSE) file for details.\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "pg-streamline is a Python library designed to simplify and streamline the process of logical replication",
"version": "1.1.0",
"project_urls": {
"Homepage": "https://github.com/shwetabhk/pg-streamline-py"
},
"split_keywords": [
"netsuite",
"api",
"python",
"sdk"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "28a9810aeefb42d26c76b2197ae43d97bb7a0bf1d1bd16f9180844b917a300e1",
"md5": "7ea28ed6d19e385dd878758b730c9d7a",
"sha256": "40805b8d9e0e86f020de0eab2f8fa1aa397ecf4724ef8c1357c4c822edff0ad5"
},
"downloads": -1,
"filename": "pg_streamline-1.1.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "7ea28ed6d19e385dd878758b730c9d7a",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 27215,
"upload_time": "2023-10-21T07:19:24",
"upload_time_iso_8601": "2023-10-21T07:19:24.043382Z",
"url": "https://files.pythonhosted.org/packages/28/a9/810aeefb42d26c76b2197ae43d97bb7a0bf1d1bd16f9180844b917a300e1/pg_streamline-1.1.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "5a8894cb388754d03d421d20616466e54585f3e4feb0ca578426428f555338e8",
"md5": "ec6c69e3cbcf8d86d358a05dfbdea8b6",
"sha256": "1d20458d0512dfbaf0d0349063e669906fa195f677867da501d2ae65e12e7ff4"
},
"downloads": -1,
"filename": "pg-streamline-1.1.0.tar.gz",
"has_sig": false,
"md5_digest": "ec6c69e3cbcf8d86d358a05dfbdea8b6",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 17529,
"upload_time": "2023-10-21T07:19:27",
"upload_time_iso_8601": "2023-10-21T07:19:27.222743Z",
"url": "https://files.pythonhosted.org/packages/5a/88/94cb388754d03d421d20616466e54585f3e4feb0ca578426428f555338e8/pg-streamline-1.1.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-10-21 07:19:27",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "shwetabhk",
"github_project": "pg-streamline-py",
"travis_ci": false,
"coveralls": true,
"github_actions": true,
"requirements": [],
"lcname": "pg-streamline"
}
JSON
