.. _readme:
Data.SyncMaster
===============
|Repo Status| |Docker image| |PyPI| |PyPI License| |PyPI Python Version| |Documentation|
|Build Status| |Coverage| |pre-commit.ci|
.. |Repo Status| image:: https://www.repostatus.org/badges/latest/wip.svg
:target: https://www.repostatus.org/#wip
.. |Docker image| image:: https://img.shields.io/docker/v/mtsrus/syncmaster-server?sort=semver&label=docker
:target: https://hub.docker.com/r/mtsrus/syncmaster-server
.. |PyPI| image:: https://img.shields.io/pypi/v/data-syncmaster
:target: https://pypi.org/project/data-syncmaster/
.. |PyPI License| image:: https://img.shields.io/pypi/l/data-syncmaster.svg
:target: https://github.com/MobileTeleSystems/syncmaster/blob/develop/LICENSE.txt
.. |PyPI Python Version| image:: https://img.shields.io/pypi/pyversions/data-syncmaster.svg
:target: https://badge.fury.io/py/data-syncmaster
.. |Documentation| image:: https://readthedocs.org/projects/syncmaster/badge/?version=stable
:target: https://syncmaster.readthedocs.io
.. |Build Status| image:: https://github.com/MobileTeleSystems/syncmaster/workflows/Run%20All%20Tests/badge.svg
:target: https://github.com/MobileTeleSystems/syncmaster/actions
.. |Coverage| image:: https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/
MTSOnGithub/03e73a82ecc4709934540ce8201cc3b4/raw/syncmaster_badge.json
:target: https://github.com/MobileTeleSystems/syncmaster/actions
.. |pre-commit.ci| image:: https://results.pre-commit.ci/badge/github/MobileTeleSystems/syncmaster/develop.svg
:target: https://results.pre-commit.ci/latest/github/MobileTeleSystems/syncmaster/develop
What is Data.SyncMaster?
------------------------
Data.SyncMaster is as low-code ETL tool for transfering data between databases and file systems.
List of currently supported connections:
* Apache Hive
* Clickhouse
* Postgres
* Oracle
* MSSQL
* MySQL
* HDFS
* S3
* FTP
* FTPS
* SFTP
* Samba
* WebDAV
Based on `onETL <https://onetl.readthedocs.io/>`_ and `Apache Spark <https://spark.apache.org/>`_.
**Note**: service is under active development, and is not ready to use.
Goals
-----
* Make transfering data between databases and file systems as simple as possible
* Provide a lot of builtin connectors to transfer data in heterogeneous environment
* RBAC and multitenancy support
Non-goals
---------
* This is not a backup system
* Only batch, no streaming
.. documentation
Documentation
-------------
See https://syncmaster.readthedocs.io
Raw data
{
"_id": null,
"home_page": null,
"name": "data-syncmaster",
"maintainer": null,
"docs_url": null,
"requires_python": "<4.0,>=3.11",
"maintainer_email": null,
"keywords": "Syncmaster, REST, API, Worker, Spark, Transfer, ETL",
"author": "DataOps.ETL",
"author_email": "onetools@mts.ru",
"download_url": "https://files.pythonhosted.org/packages/5d/53/65d5e7ab74f0620488b652def7e206dd872b22ac3cee75810790868ffc53/data_syncmaster-0.2.5.tar.gz",
"platform": null,
"description": ".. _readme:\n\nData.SyncMaster\n===============\n\n|Repo Status| |Docker image| |PyPI| |PyPI License| |PyPI Python Version| |Documentation|\n|Build Status| |Coverage| |pre-commit.ci|\n\n.. |Repo Status| image:: https://www.repostatus.org/badges/latest/wip.svg\n :target: https://www.repostatus.org/#wip\n.. |Docker image| image:: https://img.shields.io/docker/v/mtsrus/syncmaster-server?sort=semver&label=docker\n :target: https://hub.docker.com/r/mtsrus/syncmaster-server\n.. |PyPI| image:: https://img.shields.io/pypi/v/data-syncmaster\n :target: https://pypi.org/project/data-syncmaster/\n.. |PyPI License| image:: https://img.shields.io/pypi/l/data-syncmaster.svg\n :target: https://github.com/MobileTeleSystems/syncmaster/blob/develop/LICENSE.txt\n.. |PyPI Python Version| image:: https://img.shields.io/pypi/pyversions/data-syncmaster.svg\n :target: https://badge.fury.io/py/data-syncmaster\n.. |Documentation| image:: https://readthedocs.org/projects/syncmaster/badge/?version=stable\n :target: https://syncmaster.readthedocs.io\n.. |Build Status| image:: https://github.com/MobileTeleSystems/syncmaster/workflows/Run%20All%20Tests/badge.svg\n :target: https://github.com/MobileTeleSystems/syncmaster/actions\n.. |Coverage| image:: https://img.shields.io/endpoint?url=https://gist.githubusercontent.com/\n MTSOnGithub/03e73a82ecc4709934540ce8201cc3b4/raw/syncmaster_badge.json\n :target: https://github.com/MobileTeleSystems/syncmaster/actions\n.. |pre-commit.ci| image:: https://results.pre-commit.ci/badge/github/MobileTeleSystems/syncmaster/develop.svg\n :target: https://results.pre-commit.ci/latest/github/MobileTeleSystems/syncmaster/develop\n\n\nWhat is Data.SyncMaster?\n------------------------\n\nData.SyncMaster is as low-code ETL tool for transfering data between databases and file systems.\nList of currently supported connections:\n\n* Apache Hive\n* Clickhouse\n* Postgres\n* Oracle\n* MSSQL\n* MySQL\n* HDFS\n* S3\n* FTP\n* FTPS\n* SFTP\n* Samba\n* WebDAV\n\nBased on `onETL <https://onetl.readthedocs.io/>`_ and `Apache Spark <https://spark.apache.org/>`_.\n\n**Note**: service is under active development, and is not ready to use.\n\nGoals\n-----\n\n* Make transfering data between databases and file systems as simple as possible\n* Provide a lot of builtin connectors to transfer data in heterogeneous environment\n* RBAC and multitenancy support\n\nNon-goals\n---------\n\n* This is not a backup system\n* Only batch, no streaming\n\n.. documentation\n\nDocumentation\n-------------\n\nSee https://syncmaster.readthedocs.io\n\n",
"bugtrack_url": null,
"license": "Apache-2.0",
"summary": "Syncmaster REST API + Worker",
"version": "0.2.5",
"project_urls": {
"CI/CD": "https://github.com/MobileTeleSystems/syncmaster/actions",
"Documentation": "https://syncmaster.readthedocs.io",
"Homepage": "https://github.com/MobileTeleSystems/syncmaster",
"Source": "https://github.com/MobileTeleSystems/syncmaster",
"Tracker": "https://github.com/MobileTeleSystems/syncmaster/issues"
},
"split_keywords": [
"syncmaster",
" rest",
" api",
" worker",
" spark",
" transfer",
" etl"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "3af0d9e84ba843f28bb6271298914743ede44799dc02a026ffd3dfc208f66cbd",
"md5": "10dcd79eb5a6d8d43b173bf11422a5c2",
"sha256": "16537c92508bd3eb6647481ba7a6f7e883f035308c414f15754ff812452af193"
},
"downloads": -1,
"filename": "data_syncmaster-0.2.5-py3-none-any.whl",
"has_sig": false,
"md5_digest": "10dcd79eb5a6d8d43b173bf11422a5c2",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4.0,>=3.11",
"size": 179467,
"upload_time": "2025-10-10T09:33:40",
"upload_time_iso_8601": "2025-10-10T09:33:40.822671Z",
"url": "https://files.pythonhosted.org/packages/3a/f0/d9e84ba843f28bb6271298914743ede44799dc02a026ffd3dfc208f66cbd/data_syncmaster-0.2.5-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "5d5365d5e7ab74f0620488b652def7e206dd872b22ac3cee75810790868ffc53",
"md5": "11bd7cf840872f9429bebd87e2446b16",
"sha256": "3110cde99a8e35310b9f6cfd2f4d5314fadb27255f2a972d533bc51f392d5575"
},
"downloads": -1,
"filename": "data_syncmaster-0.2.5.tar.gz",
"has_sig": false,
"md5_digest": "11bd7cf840872f9429bebd87e2446b16",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<4.0,>=3.11",
"size": 83048,
"upload_time": "2025-10-10T09:33:42",
"upload_time_iso_8601": "2025-10-10T09:33:42.522532Z",
"url": "https://files.pythonhosted.org/packages/5d/53/65d5e7ab74f0620488b652def7e206dd872b22ac3cee75810790868ffc53/data_syncmaster-0.2.5.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-10-10 09:33:42",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "MobileTeleSystems",
"github_project": "syncmaster",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "data-syncmaster"
}
JSON
