.. image:: https://readthedocs.org/projects/unistream/badge/?version=latest
:target: https://unistream.readthedocs.io/en/latest/
:alt: Documentation Status
.. image:: https://github.com/MacHu-GWU/unistream-project/workflows/CI/badge.svg
:target: https://github.com/MacHu-GWU/unistream-project/actions?query=workflow:CI
.. image:: https://codecov.io/gh/MacHu-GWU/unistream-project/branch/main/graph/badge.svg
:target: https://codecov.io/gh/MacHu-GWU/unistream-project
.. image:: https://img.shields.io/pypi/v/unistream.svg
:target: https://pypi.python.org/pypi/unistream
.. image:: https://img.shields.io/pypi/l/unistream.svg
:target: https://pypi.python.org/pypi/unistream
.. image:: https://img.shields.io/pypi/pyversions/unistream.svg
:target: https://pypi.python.org/pypi/unistream
.. image:: https://img.shields.io/badge/Release_History!--None.svg?style=social
:target: https://github.com/MacHu-GWU/unistream-project/blob/main/release-history.rst
.. image:: https://img.shields.io/badge/STAR_Me_on_GitHub!--None.svg?style=social
:target: https://github.com/MacHu-GWU/unistream-project
------
.. image:: https://img.shields.io/badge/Link-Document-blue.svg
:target: https://unistream.readthedocs.io/en/latest/
.. image:: https://img.shields.io/badge/Link-API-blue.svg
:target: https://unistream.readthedocs.io/en/latest/py-modindex.html
.. image:: https://img.shields.io/badge/Link-Install-blue.svg
:target: `install`_
.. image:: https://img.shields.io/badge/Link-GitHub-blue.svg
:target: https://github.com/MacHu-GWU/unistream-project
.. image:: https://img.shields.io/badge/Link-Submit_Issue-blue.svg
:target: https://github.com/MacHu-GWU/unistream-project/issues
.. image:: https://img.shields.io/badge/Link-Request_Feature-blue.svg
:target: https://github.com/MacHu-GWU/unistream-project/issues
.. image:: https://img.shields.io/badge/Link-Download-blue.svg
:target: https://pypi.org/pypi/unistream#files
Welcome to ``unistream`` Documentation
==============================================================================
đź“” See `Full Documentation HERE <https://unistream.readthedocs.io/>`_.
.. image:: https://unistream.readthedocs.io/en/latest/_static/unistream-logo.png
:target: https://unistream.readthedocs.io/
The library at hand provides a powerful abstraction for data producers and consumers—clients responsible for interfacing with stream processing systems. These clients handle the task of sending data to stream processing systems and pulling data from various streams, including but not limited to Apache Kafka, Apache Pulsar, AWS Kinesis, AWS SQS, and AWS CloudWatch logs.
This library offers a comprehensive set of business-critical features out of the box:
1. **Efficient Record Buffering:** It intelligently groups records into micro-batches, optimizing network bandwidth utilization for enhanced performance.
2. **Data Integrity:** To ensure data integrity, the library leverages a local write-ahead log mechanism, mitigating the risk of unexpected errors and data loss during the data transfer process.
3. **Automatic Retrying:** With an integrated automatic retry mechanism using exponential backoff strategies, transient errors are managed seamlessly, contributing to a robust and reliable data transfer process.
4. **Checkpoint Management:** The library automatically handles checkpoints, allowing for the storage of consumption progress and processing status for each record. This feature enhances traceability and fault tolerance, especially in critical business use cases.
.. _install:
Install
------------------------------------------------------------------------------
``unistream`` is released on PyPI, so all you need is to:
.. code-block:: console
$ pip install unistream
To upgrade to latest version:
.. code-block:: console
$ pip install --upgrade unistream
Raw data
{
"_id": null,
"home_page": "https://github.com/MacHu-GWU/unistream-project",
"name": "unistream",
"maintainer": "Sanhe Hu",
"docs_url": null,
"requires_python": ">=3.7",
"maintainer_email": "husanhe@gmail.com",
"keywords": "",
"author": "Sanhe Hu",
"author_email": "husanhe@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/88/ef/7cf2f5ce8060c2f2ec5601e7dcb7cc6486133afd5b6efc16603b8684bce0/unistream-0.1.1.tar.gz",
"platform": "Windows",
"description": "\n.. image:: https://readthedocs.org/projects/unistream/badge/?version=latest\n :target: https://unistream.readthedocs.io/en/latest/\n :alt: Documentation Status\n\n.. image:: https://github.com/MacHu-GWU/unistream-project/workflows/CI/badge.svg\n :target: https://github.com/MacHu-GWU/unistream-project/actions?query=workflow:CI\n\n.. image:: https://codecov.io/gh/MacHu-GWU/unistream-project/branch/main/graph/badge.svg\n :target: https://codecov.io/gh/MacHu-GWU/unistream-project\n\n.. image:: https://img.shields.io/pypi/v/unistream.svg\n :target: https://pypi.python.org/pypi/unistream\n\n.. image:: https://img.shields.io/pypi/l/unistream.svg\n :target: https://pypi.python.org/pypi/unistream\n\n.. image:: https://img.shields.io/pypi/pyversions/unistream.svg\n :target: https://pypi.python.org/pypi/unistream\n\n.. image:: https://img.shields.io/badge/Release_History!--None.svg?style=social\n :target: https://github.com/MacHu-GWU/unistream-project/blob/main/release-history.rst\n\n.. image:: https://img.shields.io/badge/STAR_Me_on_GitHub!--None.svg?style=social\n :target: https://github.com/MacHu-GWU/unistream-project\n\n------\n\n.. image:: https://img.shields.io/badge/Link-Document-blue.svg\n :target: https://unistream.readthedocs.io/en/latest/\n\n.. image:: https://img.shields.io/badge/Link-API-blue.svg\n :target: https://unistream.readthedocs.io/en/latest/py-modindex.html\n\n.. image:: https://img.shields.io/badge/Link-Install-blue.svg\n :target: `install`_\n\n.. image:: https://img.shields.io/badge/Link-GitHub-blue.svg\n :target: https://github.com/MacHu-GWU/unistream-project\n\n.. image:: https://img.shields.io/badge/Link-Submit_Issue-blue.svg\n :target: https://github.com/MacHu-GWU/unistream-project/issues\n\n.. image:: https://img.shields.io/badge/Link-Request_Feature-blue.svg\n :target: https://github.com/MacHu-GWU/unistream-project/issues\n\n.. image:: https://img.shields.io/badge/Link-Download-blue.svg\n :target: https://pypi.org/pypi/unistream#files\n\n\nWelcome to ``unistream`` Documentation\n==============================================================================\n\ud83d\udcd4 See `Full Documentation HERE <https://unistream.readthedocs.io/>`_.\n\n.. image:: https://unistream.readthedocs.io/en/latest/_static/unistream-logo.png\n :target: https://unistream.readthedocs.io/\n\nThe library at hand provides a powerful abstraction for data producers and consumers\u2014clients responsible for interfacing with stream processing systems. These clients handle the task of sending data to stream processing systems and pulling data from various streams, including but not limited to Apache Kafka, Apache Pulsar, AWS Kinesis, AWS SQS, and AWS CloudWatch logs.\n\nThis library offers a comprehensive set of business-critical features out of the box:\n\n1. **Efficient Record Buffering:** It intelligently groups records into micro-batches, optimizing network bandwidth utilization for enhanced performance.\n2. **Data Integrity:** To ensure data integrity, the library leverages a local write-ahead log mechanism, mitigating the risk of unexpected errors and data loss during the data transfer process.\n3. **Automatic Retrying:** With an integrated automatic retry mechanism using exponential backoff strategies, transient errors are managed seamlessly, contributing to a robust and reliable data transfer process.\n4. **Checkpoint Management:** The library automatically handles checkpoints, allowing for the storage of consumption progress and processing status for each record. This feature enhances traceability and fault tolerance, especially in critical business use cases.\n\n\n.. _install:\n\nInstall\n------------------------------------------------------------------------------\n\n``unistream`` is released on PyPI, so all you need is to:\n\n.. code-block:: console\n\n $ pip install unistream\n\nTo upgrade to latest version:\n\n.. code-block:: console\n\n $ pip install --upgrade unistream\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Library for creating stream data producer / consumer client library.",
"version": "0.1.1",
"project_urls": {
"Download": "https://pypi.python.org/pypi/unistream/0.1.1#downloads",
"Homepage": "https://github.com/MacHu-GWU/unistream-project"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "17254470922bb4b86d7049facddc72dce18a4b440fbb86de665ec8344b1a4847",
"md5": "db5063e4c3bef6249ac9122cfe551e06",
"sha256": "445ad076330b848b36f5e6f7e3975a244fa0dab9fb69ea32c26847bebd06060c"
},
"downloads": -1,
"filename": "unistream-0.1.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "db5063e4c3bef6249ac9122cfe551e06",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.7",
"size": 51827,
"upload_time": "2024-01-10T18:29:11",
"upload_time_iso_8601": "2024-01-10T18:29:11.330028Z",
"url": "https://files.pythonhosted.org/packages/17/25/4470922bb4b86d7049facddc72dce18a4b440fbb86de665ec8344b1a4847/unistream-0.1.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "88ef7cf2f5ce8060c2f2ec5601e7dcb7cc6486133afd5b6efc16603b8684bce0",
"md5": "ac68e6a8332df9d549089b524a475c1b",
"sha256": "1e3c524491cfa2639ab1d0acb7b70c38cb19e7df7fada3ce7724778693f1ac86"
},
"downloads": -1,
"filename": "unistream-0.1.1.tar.gz",
"has_sig": false,
"md5_digest": "ac68e6a8332df9d549089b524a475c1b",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.7",
"size": 48473,
"upload_time": "2024-01-10T18:29:13",
"upload_time_iso_8601": "2024-01-10T18:29:13.293857Z",
"url": "https://files.pythonhosted.org/packages/88/ef/7cf2f5ce8060c2f2ec5601e7dcb7cc6486133afd5b6efc16603b8684bce0/unistream-0.1.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-01-10 18:29:13",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "MacHu-GWU",
"github_project": "unistream-project",
"travis_ci": false,
"coveralls": true,
"github_actions": true,
"requirements": [],
"lcname": "unistream"
}
JSON
