data-syncmaster


Namedata-syncmaster JSON
Version 0.1.5 PyPI version JSON
download
home_pageNone
SummarySyncmaster REST API + Worker
upload_time2024-04-22 13:49:18
maintainerNone
docs_urlNone
authorDataOps.ETL
requires_python<4.0,>=3.11
licenseApache-2.0
keywords syncmaster rest api worker replication
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            .. title

==========
SyncMaster
==========

|Repo Status| |PyPI| |PyPI License| |PyPI Python Version| |Docker image| |Documentation|
|Build Status| |Coverage|  |pre-commit.ci|

.. |Repo Status| image:: https://www.repostatus.org/badges/latest/active.svg
    :target: https://github.com/MobileTeleSystems/syncmaster
.. |PyPI| image:: https://img.shields.io/pypi/v/data-syncmaster
    :target: https://pypi.org/project/data-syncmaster/
.. |PyPI License| image:: https://img.shields.io/pypi/l/data-syncmaster.svg
    :target: https://github.com/MobileTeleSystems/syncmaster/blob/develop/LICENSE.txt
.. |PyPI Python Version| image:: https://img.shields.io/pypi/pyversions/data-syncmaster.svg
    :target: https://badge.fury.io/py/data-syncmaster
.. |Docker image| image:: https://img.shields.io/docker/v/mtsrus/syncmaster-backend?sort=semver&label=docker
    :target: https://hub.docker.com/r/mtsrus/syncmaster-backend
.. |Documentation| image:: https://readthedocs.org/projects/syncmaster/badge/?version=stable
    :target: https://syncmaster.readthedocs.io
.. |Build Status| image:: https://github.com/MobileTeleSystems/syncmaster/workflows/Run%20All%20Tests/badge.svg
    :target: https://github.com/MobileTeleSystems/syncmaster/actions
.. |Coverage| image:: https://codecov.io/gh/MobileTeleSystems/syncmaster/graph/badge.svg?token=ky7UyUxolB
    :target: https://codecov.io/gh/MobileTeleSystems/syncmaster
.. |pre-commit.ci| image:: https://results.pre-commit.ci/badge/github/MobileTeleSystems/syncmaster/develop.svg
    :target: https://results.pre-commit.ci/latest/github/MobileTeleSystems/syncmaster/develop


What is Syncmaster?
-------------------

Syncmaster is as low-code ETL tool for transfering data between databases and file systems.
List of currently supported connections:

* Apache Hive
* Postgres
* Oracle
* HDFS
* S3

Current SyncMaster implementation provides following components:

* REST API
* Celery Worker

Goals
-----

* Make transfering data between databases and file systems as simple as possible
* Provide a lot of builtin connectors to transfer data in heterogeneous environment
* RBAC and multitenancy support

Non-goals
---------

* This is not a backup system
* This is not a CDC solution
* Only batch, no streaming

.. documentation

Documentation
-------------

See https://syncmaster.readthedocs.io

            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "data-syncmaster",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<4.0,>=3.11",
    "maintainer_email": null,
    "keywords": "Syncmaster, REST, API, Worker, Replication",
    "author": "DataOps.ETL",
    "author_email": "onetools@mts.ru",
    "download_url": "https://files.pythonhosted.org/packages/05/37/9d7afd399da4c0fd5e386e921aea2e4cbdd6db26b5325f6c5b3e6e8d7274/data_syncmaster-0.1.5.tar.gz",
    "platform": null,
    "description": ".. title\n\n==========\nSyncMaster\n==========\n\n|Repo Status| |PyPI| |PyPI License| |PyPI Python Version| |Docker image| |Documentation|\n|Build Status| |Coverage|  |pre-commit.ci|\n\n.. |Repo Status| image:: https://www.repostatus.org/badges/latest/active.svg\n    :target: https://github.com/MobileTeleSystems/syncmaster\n.. |PyPI| image:: https://img.shields.io/pypi/v/data-syncmaster\n    :target: https://pypi.org/project/data-syncmaster/\n.. |PyPI License| image:: https://img.shields.io/pypi/l/data-syncmaster.svg\n    :target: https://github.com/MobileTeleSystems/syncmaster/blob/develop/LICENSE.txt\n.. |PyPI Python Version| image:: https://img.shields.io/pypi/pyversions/data-syncmaster.svg\n    :target: https://badge.fury.io/py/data-syncmaster\n.. |Docker image| image:: https://img.shields.io/docker/v/mtsrus/syncmaster-backend?sort=semver&label=docker\n    :target: https://hub.docker.com/r/mtsrus/syncmaster-backend\n.. |Documentation| image:: https://readthedocs.org/projects/syncmaster/badge/?version=stable\n    :target: https://syncmaster.readthedocs.io\n.. |Build Status| image:: https://github.com/MobileTeleSystems/syncmaster/workflows/Run%20All%20Tests/badge.svg\n    :target: https://github.com/MobileTeleSystems/syncmaster/actions\n.. |Coverage| image:: https://codecov.io/gh/MobileTeleSystems/syncmaster/graph/badge.svg?token=ky7UyUxolB\n    :target: https://codecov.io/gh/MobileTeleSystems/syncmaster\n.. |pre-commit.ci| image:: https://results.pre-commit.ci/badge/github/MobileTeleSystems/syncmaster/develop.svg\n    :target: https://results.pre-commit.ci/latest/github/MobileTeleSystems/syncmaster/develop\n\n\nWhat is Syncmaster?\n-------------------\n\nSyncmaster is as low-code ETL tool for transfering data between databases and file systems.\nList of currently supported connections:\n\n* Apache Hive\n* Postgres\n* Oracle\n* HDFS\n* S3\n\nCurrent SyncMaster implementation provides following components:\n\n* REST API\n* Celery Worker\n\nGoals\n-----\n\n* Make transfering data between databases and file systems as simple as possible\n* Provide a lot of builtin connectors to transfer data in heterogeneous environment\n* RBAC and multitenancy support\n\nNon-goals\n---------\n\n* This is not a backup system\n* This is not a CDC solution\n* Only batch, no streaming\n\n.. documentation\n\nDocumentation\n-------------\n\nSee https://syncmaster.readthedocs.io\n",
    "bugtrack_url": null,
    "license": "Apache-2.0",
    "summary": "Syncmaster REST API + Worker",
    "version": "0.1.5",
    "project_urls": {
        "CI/CD": "https://github.com/MobileTeleSystems/syncmaster/actions",
        "Documentation": "https://syncmaster.readthedocs.io",
        "Homepage": "https://github.com/MobileTeleSystems/syncmaster",
        "Source": "https://github.com/MobileTeleSystems/syncmaster",
        "Tracker": "https://github.com/MobileTeleSystems/syncmaster/issues"
    },
    "split_keywords": [
        "syncmaster",
        " rest",
        " api",
        " worker",
        " replication"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "b4409a82ddef17717ecdf0331e0d14dc5ab42b0724efced3c4778a89c3b3825f",
                "md5": "3d0654593c2c12b83b75013feb977447",
                "sha256": "512561bd4ea9e5a6a846976453c0845d6eb60728e5967a5c6a78ace13c553d23"
            },
            "downloads": -1,
            "filename": "data_syncmaster-0.1.5-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "3d0654593c2c12b83b75013feb977447",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<4.0,>=3.11",
            "size": 80298,
            "upload_time": "2024-04-22T13:49:17",
            "upload_time_iso_8601": "2024-04-22T13:49:17.692652Z",
            "url": "https://files.pythonhosted.org/packages/b4/40/9a82ddef17717ecdf0331e0d14dc5ab42b0724efced3c4778a89c3b3825f/data_syncmaster-0.1.5-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "05379d7afd399da4c0fd5e386e921aea2e4cbdd6db26b5325f6c5b3e6e8d7274",
                "md5": "3200c5b697646b1674736cc256c27a00",
                "sha256": "f6c6ef11d37d37b56c42092e5db83e15c7e4299eaf5c7fb1940261b26c51904e"
            },
            "downloads": -1,
            "filename": "data_syncmaster-0.1.5.tar.gz",
            "has_sig": false,
            "md5_digest": "3200c5b697646b1674736cc256c27a00",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<4.0,>=3.11",
            "size": 42223,
            "upload_time": "2024-04-22T13:49:18",
            "upload_time_iso_8601": "2024-04-22T13:49:18.889448Z",
            "url": "https://files.pythonhosted.org/packages/05/37/9d7afd399da4c0fd5e386e921aea2e4cbdd6db26b5325f6c5b3e6e8d7274/data_syncmaster-0.1.5.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-04-22 13:49:18",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "MobileTeleSystems",
    "github_project": "syncmaster",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "data-syncmaster"
}
        
Elapsed time: 0.26215s