.. image:: https://readthedocs.org/projects/simpletype/badge/?version=latest
:target: https://simpletype.readthedocs.io/en/latest/
:alt: Documentation Status
.. image:: https://github.com/MacHu-GWU/simpletype-project/actions/workflows/main.yml/badge.svg
:target: https://github.com/MacHu-GWU/simpletype-project/actions?query=workflow:CI
.. image:: https://codecov.io/gh/MacHu-GWU/simpletype-project/branch/main/graph/badge.svg
:target: https://codecov.io/gh/MacHu-GWU/simpletype-project
.. image:: https://img.shields.io/pypi/v/simpletype.svg
:target: https://pypi.python.org/pypi/simpletype
.. image:: https://img.shields.io/pypi/l/simpletype.svg
:target: https://pypi.python.org/pypi/simpletype
.. image:: https://img.shields.io/pypi/pyversions/simpletype.svg
:target: https://pypi.python.org/pypi/simpletype
.. image:: https://img.shields.io/badge/Release_History!--None.svg?style=social
:target: https://github.com/MacHu-GWU/simpletype-project/blob/main/release-history.rst
.. image:: https://img.shields.io/badge/STAR_Me_on_GitHub!--None.svg?style=social
:target: https://github.com/MacHu-GWU/simpletype-project
------
.. image:: https://img.shields.io/badge/Link-Document-blue.svg
:target: https://simpletype.readthedocs.io/en/latest/
.. image:: https://img.shields.io/badge/Link-API-blue.svg
:target: https://simpletype.readthedocs.io/en/latest/py-modindex.html
.. image:: https://img.shields.io/badge/Link-Install-blue.svg
:target: `install`_
.. image:: https://img.shields.io/badge/Link-GitHub-blue.svg
:target: https://github.com/MacHu-GWU/simpletype-project
.. image:: https://img.shields.io/badge/Link-Submit_Issue-blue.svg
:target: https://github.com/MacHu-GWU/simpletype-project/issues
.. image:: https://img.shields.io/badge/Link-Request_Feature-blue.svg
:target: https://github.com/MacHu-GWU/simpletype-project/issues
.. image:: https://img.shields.io/badge/Link-Download-blue.svg
:target: https://pypi.org/pypi/simpletype#files
Welcome to ``simpletype`` Documentation
==============================================================================
.. image:: https://simpletype.readthedocs.io/en/latest/_static/simpletype-logo.png
:target: https://simpletype.readthedocs.io/en/latest/
Simple data type system that let many data type systems talk to each other.
Background
------------------------------------------------------------------------------
In the complex world of data processing, defining multiple schemas for a single data structure is a common yet challenging task. Data engineers and analysts often find themselves caught in a web of repetitive schema definitions across various platforms and tools. This is where **simpletype** comes to the rescue.
The Problem
------------------------------------------------------------------------------
Consider a typical scenario: You're working on a project to export data from Amazon DynamoDB to a Data Lake. For this seemingly straightforward task, you find yourself defining and maintaining multiple schemas:
- JSON Schema
- Pandas Schema
- Polars Schema
- Spark Schema
- AWS Glue Schema
- AWS DynamoDB Schema
Each of these schemas serves a crucial purpose in your data pipeline, but the process of creating and maintaining them is:
- Time-consuming
- Prone to errors
- Difficult to keep synchronized
The Solution
------------------------------------------------------------------------------
simpletype is a powerful Python library designed to eliminate the redundancy and potential errors in multi-schema environments. With simpletype, you can:
1. **Define Once, Use Everywhere**: Create a single, unified schema definition.
2. **Automatic Generation**: Let simpletype automatically generate schemas for all your required data processing systems.
3. **Consistency Guaranteed**: Ensure all your schemas remain in sync, reducing errors and inconsistencies.
4. **Save Time and Effort**: Focus on your data and analytics, not on repetitive schema definitions.
simpletype empowers data professionals to streamline their workflow, enhance productivity, and maintain data integrity across diverse data processing ecosystems.
.. _install:
Install
------------------------------------------------------------------------------
``simpletype`` is released on PyPI, so all you need is to:
.. code-block:: console
$ pip install simpletype
To upgrade to latest version:
.. code-block:: console
$ pip install --upgrade simpletype
Raw data
{
"_id": null,
"home_page": "https://github.com/MacHu-GWU/simpletype-project",
"name": "simpletype",
"maintainer": "Sanhe Hu",
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "husanhe@email.com",
"keywords": null,
"author": "Sanhe Hu",
"author_email": "husanhe@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/73/9a/a8d8892aa7c13d580d0df33b9ea0f7966c0188aa535044f5016dd709cc53/simpletype-0.2.6.tar.gz",
"platform": "Windows",
"description": "\n.. image:: https://readthedocs.org/projects/simpletype/badge/?version=latest\n :target: https://simpletype.readthedocs.io/en/latest/\n :alt: Documentation Status\n\n.. image:: https://github.com/MacHu-GWU/simpletype-project/actions/workflows/main.yml/badge.svg\n :target: https://github.com/MacHu-GWU/simpletype-project/actions?query=workflow:CI\n\n.. image:: https://codecov.io/gh/MacHu-GWU/simpletype-project/branch/main/graph/badge.svg\n :target: https://codecov.io/gh/MacHu-GWU/simpletype-project\n\n.. image:: https://img.shields.io/pypi/v/simpletype.svg\n :target: https://pypi.python.org/pypi/simpletype\n\n.. image:: https://img.shields.io/pypi/l/simpletype.svg\n :target: https://pypi.python.org/pypi/simpletype\n\n.. image:: https://img.shields.io/pypi/pyversions/simpletype.svg\n :target: https://pypi.python.org/pypi/simpletype\n\n.. image:: https://img.shields.io/badge/Release_History!--None.svg?style=social\n :target: https://github.com/MacHu-GWU/simpletype-project/blob/main/release-history.rst\n\n.. image:: https://img.shields.io/badge/STAR_Me_on_GitHub!--None.svg?style=social\n :target: https://github.com/MacHu-GWU/simpletype-project\n\n------\n\n.. image:: https://img.shields.io/badge/Link-Document-blue.svg\n :target: https://simpletype.readthedocs.io/en/latest/\n\n.. image:: https://img.shields.io/badge/Link-API-blue.svg\n :target: https://simpletype.readthedocs.io/en/latest/py-modindex.html\n\n.. image:: https://img.shields.io/badge/Link-Install-blue.svg\n :target: `install`_\n\n.. image:: https://img.shields.io/badge/Link-GitHub-blue.svg\n :target: https://github.com/MacHu-GWU/simpletype-project\n\n.. image:: https://img.shields.io/badge/Link-Submit_Issue-blue.svg\n :target: https://github.com/MacHu-GWU/simpletype-project/issues\n\n.. image:: https://img.shields.io/badge/Link-Request_Feature-blue.svg\n :target: https://github.com/MacHu-GWU/simpletype-project/issues\n\n.. image:: https://img.shields.io/badge/Link-Download-blue.svg\n :target: https://pypi.org/pypi/simpletype#files\n\n\nWelcome to ``simpletype`` Documentation\n==============================================================================\n.. image:: https://simpletype.readthedocs.io/en/latest/_static/simpletype-logo.png\n :target: https://simpletype.readthedocs.io/en/latest/\n\nSimple data type system that let many data type systems talk to each other.\n\n\nBackground\n------------------------------------------------------------------------------\nIn the complex world of data processing, defining multiple schemas for a single data structure is a common yet challenging task. Data engineers and analysts often find themselves caught in a web of repetitive schema definitions across various platforms and tools. This is where **simpletype** comes to the rescue.\n\n\nThe Problem\n------------------------------------------------------------------------------\nConsider a typical scenario: You're working on a project to export data from Amazon DynamoDB to a Data Lake. For this seemingly straightforward task, you find yourself defining and maintaining multiple schemas:\n\n- JSON Schema\n- Pandas Schema\n- Polars Schema\n- Spark Schema\n- AWS Glue Schema\n- AWS DynamoDB Schema\n\nEach of these schemas serves a crucial purpose in your data pipeline, but the process of creating and maintaining them is:\n\n- Time-consuming\n- Prone to errors\n- Difficult to keep synchronized\n\n\nThe Solution\n------------------------------------------------------------------------------\nsimpletype is a powerful Python library designed to eliminate the redundancy and potential errors in multi-schema environments. With simpletype, you can:\n\n1. **Define Once, Use Everywhere**: Create a single, unified schema definition.\n2. **Automatic Generation**: Let simpletype automatically generate schemas for all your required data processing systems.\n3. **Consistency Guaranteed**: Ensure all your schemas remain in sync, reducing errors and inconsistencies.\n4. **Save Time and Effort**: Focus on your data and analytics, not on repetitive schema definitions.\n\nsimpletype empowers data professionals to streamline their workflow, enhance productivity, and maintain data integrity across diverse data processing ecosystems.\n\n\n.. _install:\n\nInstall\n------------------------------------------------------------------------------\n\n``simpletype`` is released on PyPI, so all you need is to:\n\n.. code-block:: console\n\n $ pip install simpletype\n\nTo upgrade to latest version:\n\n.. code-block:: console\n\n $ pip install --upgrade simpletype\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Package short description.",
"version": "0.2.6",
"project_urls": {
"Download": "https://pypi.python.org/pypi/simpletype/0.2.6#downloads",
"Homepage": "https://github.com/MacHu-GWU/simpletype-project"
},
"split_keywords": [],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "51906dd43d3bb8d19f13631f52d750b8affbfa12fe9f39b3d9aa8c93aa79d22f",
"md5": "d23675928bc719665746b6b47c919d9e",
"sha256": "a9f35ea7487a0698f60dfa7be6c0fe4d3801af2b2154530b4dc3853d04922a80"
},
"downloads": -1,
"filename": "simpletype-0.2.6-py3-none-any.whl",
"has_sig": false,
"md5_digest": "d23675928bc719665746b6b47c919d9e",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 14160,
"upload_time": "2024-09-05T14:25:26",
"upload_time_iso_8601": "2024-09-05T14:25:26.387286Z",
"url": "https://files.pythonhosted.org/packages/51/90/6dd43d3bb8d19f13631f52d750b8affbfa12fe9f39b3d9aa8c93aa79d22f/simpletype-0.2.6-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "739aa8d8892aa7c13d580d0df33b9ea0f7966c0188aa535044f5016dd709cc53",
"md5": "10d041b946b46e2742ba12cd2d3ec89c",
"sha256": "63dc118fb2adea2ca906f59d098133d86a4f568bdd39c35136db1d5599294c53"
},
"downloads": -1,
"filename": "simpletype-0.2.6.tar.gz",
"has_sig": false,
"md5_digest": "10d041b946b46e2742ba12cd2d3ec89c",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 20231,
"upload_time": "2024-09-05T14:25:27",
"upload_time_iso_8601": "2024-09-05T14:25:27.695132Z",
"url": "https://files.pythonhosted.org/packages/73/9a/a8d8892aa7c13d580d0df33b9ea0f7966c0188aa535044f5016dd709cc53/simpletype-0.2.6.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-09-05 14:25:27",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "MacHu-GWU",
"github_project": "simpletype-project",
"travis_ci": false,
"coveralls": true,
"github_actions": true,
"requirements": [],
"lcname": "simpletype"
}
JSON
