pypelined


Namepypelined JSON
Version 0.1.5 PyPI version JSON
download
home_pagehttps://github.com/maxfischer2781/pypelined
Summarystream and pipeline processing service
upload_time2023-10-20 13:59:55
maintainer
docs_urlNone
authorMax Fischer
requires_python
licenseMIT
keywords pipeline service stream pypeline
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            ++++++++++++++++++++++++++++++++++++++++++++++++++
pypelined - stream and pipeline processing service
++++++++++++++++++++++++++++++++++++++++++++++++++

.. image:: https://readthedocs.org/projects/pypelined/badge/?version=latest
    :target: http://pypelined.readthedocs.io/en/latest/?badge=latest
    :alt: Documentation Status

.. image:: https://img.shields.io/github/issues-raw/maxfischer2781/pypelined.svg
   :target: https://github.com/maxfischer2781/pypelined/issues
   :alt: Open Issues

Service and framework for creating and running processing pipelines for data streams, events and chunks.
Pipelines of ``pypelined`` are composed from individual elements using the chainlet_ library.
They are built in Python configuration files, from custom objects or pre-defined plugins.

.. code:: python

    import chainlet
    from pypelined.conf import pipelines

    @chainlet.funclet
    def add_time(chunk):
        chunk['tme'] = time.time()
        return chunk

    process_chain = Socket(10331) >> decode_json() >> stop_if(lambda value: value.get('rcode') == 0) >> \
        add_time() >> Telegraf(address=('localhost', 10332), name='chunky')
    pipelines.append(process_chain)

Once running, ``pypelined`` drives all its processing pipelines in an event driven fashion.

.. _chainlet: http://chainlet.readthedocs.io/en/stable/

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/maxfischer2781/pypelined",
    "name": "pypelined",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "pipeline service stream pypeline",
    "author": "Max Fischer",
    "author_email": "maxfischer2781@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/52/7b/fd7e3ee2e0a228780f73fd169845696eeb7483ccc191329424102795f927/pypelined-0.1.5.tar.gz",
    "platform": null,
    "description": "++++++++++++++++++++++++++++++++++++++++++++++++++\npypelined - stream and pipeline processing service\n++++++++++++++++++++++++++++++++++++++++++++++++++\n\n.. image:: https://readthedocs.org/projects/pypelined/badge/?version=latest\n    :target: http://pypelined.readthedocs.io/en/latest/?badge=latest\n    :alt: Documentation Status\n\n.. image:: https://img.shields.io/github/issues-raw/maxfischer2781/pypelined.svg\n   :target: https://github.com/maxfischer2781/pypelined/issues\n   :alt: Open Issues\n\nService and framework for creating and running processing pipelines for data streams, events and chunks.\nPipelines of ``pypelined`` are composed from individual elements using the chainlet_ library.\nThey are built in Python configuration files, from custom objects or pre-defined plugins.\n\n.. code:: python\n\n    import chainlet\n    from pypelined.conf import pipelines\n\n    @chainlet.funclet\n    def add_time(chunk):\n        chunk['tme'] = time.time()\n        return chunk\n\n    process_chain = Socket(10331) >> decode_json() >> stop_if(lambda value: value.get('rcode') == 0) >> \\\n        add_time() >> Telegraf(address=('localhost', 10332), name='chunky')\n    pipelines.append(process_chain)\n\nOnce running, ``pypelined`` drives all its processing pipelines in an event driven fashion.\n\n.. _chainlet: http://chainlet.readthedocs.io/en/stable/\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "stream and pipeline processing service",
    "version": "0.1.5",
    "project_urls": {
        "Homepage": "https://github.com/maxfischer2781/pypelined"
    },
    "split_keywords": [
        "pipeline",
        "service",
        "stream",
        "pypeline"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "7ff5afed6bfd4a9d8246ffdea3cf02caf0c00e0f4cff6f69b22a745b28caac20",
                "md5": "9f6bcbde38836cb7ff0697afde6b1a58",
                "sha256": "bd862f4fd5da8a9180a78bc9522a334e9d95f90ee9f95fd56cbded442b8f549b"
            },
            "downloads": -1,
            "filename": "pypelined-0.1.5-py2.py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "9f6bcbde38836cb7ff0697afde6b1a58",
            "packagetype": "bdist_wheel",
            "python_version": "py2.py3",
            "requires_python": null,
            "size": 18854,
            "upload_time": "2023-10-20T13:59:54",
            "upload_time_iso_8601": "2023-10-20T13:59:54.088756Z",
            "url": "https://files.pythonhosted.org/packages/7f/f5/afed6bfd4a9d8246ffdea3cf02caf0c00e0f4cff6f69b22a745b28caac20/pypelined-0.1.5-py2.py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "527bfd7e3ee2e0a228780f73fd169845696eeb7483ccc191329424102795f927",
                "md5": "20b0f8aab07c44a1548d630911b1ff93",
                "sha256": "6b2cc3dff0b0d618b880688c62ee88a904be644584b7cf5941909f5eaa094d06"
            },
            "downloads": -1,
            "filename": "pypelined-0.1.5.tar.gz",
            "has_sig": false,
            "md5_digest": "20b0f8aab07c44a1548d630911b1ff93",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 15544,
            "upload_time": "2023-10-20T13:59:55",
            "upload_time_iso_8601": "2023-10-20T13:59:55.803536Z",
            "url": "https://files.pythonhosted.org/packages/52/7b/fd7e3ee2e0a228780f73fd169845696eeb7483ccc191329424102795f927/pypelined-0.1.5.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-10-20 13:59:55",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "maxfischer2781",
    "github_project": "pypelined",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "lcname": "pypelined"
}
        
Elapsed time: 2.42821s