chungso

Name	chungso JSON
Version	0.1.1 JSON
	download
home_page	https://github.com/kokiri-io/chungso
Summary	S3 staging data (Parquet, JSON) offboarding tool
upload_time	2023-06-11 01:08:41
maintainer
docs_url	None
author	Sammie Bae
requires_python
license	MIT
keywords	parquet s3 gdpr
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            


## File Locations

Local Filesystem
S3

## Currently Supported File Types

- Parquet
    - filters out non-native parquet tables: iceberg, Hudi, delta lake
    - compression types:
        - SNAPPY
        - GZIP
        - LZO
        - BROTLI
        - LZ4
        - ZSTD

## Planned to SUpport File Types:

- ORC
- JSON
    - pyarrow doesnt have a JSON writer. so i'll write a simple wrapper
- CSV
    - must have a header
    - null values have to be handled well

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/kokiri-io/chungso",
    "name": "chungso",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "parquet,s3,GDPR",
    "author": "Sammie Bae",
    "author_email": "baesammie@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/39/01/130d2f133d680c0d652db5e88b0305c2bee56562e2b6cf2835228ed8fc7a/chungso-0.1.1.tar.gz",
    "platform": null,
    "description": "\n\n\n## File Locations\n\nLocal Filesystem\nS3\n\n## Currently Supported File Types\n\n- Parquet\n    - filters out non-native parquet tables: iceberg, Hudi, delta lake\n    - compression types:\n        - SNAPPY\n        - GZIP\n        - LZO\n        - BROTLI\n        - LZ4\n        - ZSTD\n\n## Planned to SUpport File Types:\n\n- ORC\n- JSON\n    - pyarrow doesnt have a JSON writer. so i'll write a simple wrapper\n- CSV\n    - must have a header\n    - null values have to be handled well\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "S3 staging data (Parquet, JSON) offboarding tool",
    "version": "0.1.1",
    "project_urls": {
        "Homepage": "https://github.com/kokiri-io/chungso"
    },
    "split_keywords": [
        "parquet",
        "s3",
        "gdpr"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "3901130d2f133d680c0d652db5e88b0305c2bee56562e2b6cf2835228ed8fc7a",
                "md5": "95dccffea54e2a69bc3c693b737e345e",
                "sha256": "6b16b8eb2de61b64a74bfaec059b55971bc0e97927f96dfd6b48bc903ba58899"
            },
            "downloads": -1,
            "filename": "chungso-0.1.1.tar.gz",
            "has_sig": false,
            "md5_digest": "95dccffea54e2a69bc3c693b737e345e",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 13340,
            "upload_time": "2023-06-11T01:08:41",
            "upload_time_iso_8601": "2023-06-11T01:08:41.476621Z",
            "url": "https://files.pythonhosted.org/packages/39/01/130d2f133d680c0d652db5e88b0305c2bee56562e2b6cf2835228ed8fc7a/chungso-0.1.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-06-11 01:08:41",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "kokiri-io",
    "github_project": "chungso",
    "github_not_found": true,
    "lcname": "chungso"
}