spark-plotting-tools


Namespark-plotting-tools JSON
Version 0.3.0 PyPI version JSON
download
home_pagehttps://github.com/jonaqp/spark_plotting_tools/
Summaryspark_plotting_tools
upload_time2023-07-04 03:25:03
maintainer
docs_urlNone
authorJonathan Quiza
requires_python
license
keywords spark plot
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls. 
            # spark_plottingtools


[![Github License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
[![Updates](https://pyup.io/repos/github/woctezuma/google-colab-transfer/shield.svg)](pyup)
[![Python 3](https://pyup.io/repos/github/woctezuma/google-colab-transfer/python-3-shield.svg)](pyup)
[![Code coverage](https://codecov.io/gh/woctezuma/google-colab-transfer/branch/master/graph/badge.svg)](codecov)




spark_plotting_tools is a Python library that implements for dummy table
## Installation

The code is packaged for PyPI, so that the installation consists in running:
```sh
pip install spark-plotting-tools --user 
```


## Usage

wrapper take Dummy

```sh

from spark_plotting_tools import generated_dummy_table_artifactory
from spark_plotting_tools import generated_dummy_table_datum
import spark_dataframe_tools


Generated Dummy Table Datum
============================================================
path = "fields_pe_datum2.csv"
table_name = "t_kctk_collateralization_atrb"
storage_zone = "master"
sample_parquet = 10
columns_integer_default={}
columns_date_default={"gf_cutoff_date":"2026-01-01"}
columns_string_default={}
columns_decimal_default={"other_concepts_amount":"500.00"}

generated_dummy_table_datum(spark=spark,
                            path=path,
                            table_name=table_name,
                            storage_zone=storage_zone,
                            sample_parquet=sample_parquet,
                            partition_colum=["gf_cutoff_date"],
                            columns_integer_default=columns_integer_default,
                            columns_date_default=columns_date_default,
                            columns_string_default=columns_string_default,
                            columns_decimal_default=columns_decimal_default
                           )
                       



Generated Dummy Table Artifactory
============================================================
path = "lclsupplierspurchases.output.schema"
sample_parquet = 10
columns_integer_default={}
columns_date_default={"gf_cutoff_date":"2026-01-01"}
columns_string_default={}
columns_decimal_default={"other_concepts_amount":"500.00"}


generated_dummy_table_artifactory(spark=spark,
                                  path=path,
                                  sample_parquet=sample_parquet,
                                  columns_integer_default=columns_integer_default,
                                  columns_date_default=columns_date_default,
                                  columns_string_default=columns_string_default,
                                  columns_decimal_default=columns_decimal_default
                                 )










import os, sys
is_windows = sys.platform.startswith('win')
path_directory = os.path.join("DIRECTORY_DUMMY", table_name)
if is_windows:
    path_directory = path_directory.replace("\\", "/")
    

df =  spark.read.parquet(path_directory)
df.show2(10)
  
```



## License

[Apache License 2.0](https://www.dropbox.com/s/8t6xtgk06o3ij61/LICENSE?dl=0).


## New features v1.0

 
## BugFix
- choco install visualcpp-build-tools



## Reference

 - Jonathan Quiza [github](https://github.com/jonaqp).
 - Jonathan Quiza [RumiMLSpark](http://rumi-ml.herokuapp.com/).
 - Jonathan Quiza [linkedin](https://www.linkedin.com/in/jonaqp/).

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/jonaqp/spark_plotting_tools/",
    "name": "spark-plotting-tools",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "spark,plot",
    "author": "Jonathan Quiza",
    "author_email": "jony327@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/fe/ef/e246ef7fa2bb3ca33c9a736b380a037c4b2da0cb33a8fad5e24d0d300914/spark_plotting_tools-0.3.0.tar.gz",
    "platform": null,
    "description": "# spark_plottingtools\r\n\r\n\r\n[![Github License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)\r\n[![Updates](https://pyup.io/repos/github/woctezuma/google-colab-transfer/shield.svg)](pyup)\r\n[![Python 3](https://pyup.io/repos/github/woctezuma/google-colab-transfer/python-3-shield.svg)](pyup)\r\n[![Code coverage](https://codecov.io/gh/woctezuma/google-colab-transfer/branch/master/graph/badge.svg)](codecov)\r\n\r\n\r\n\r\n\r\nspark_plotting_tools is a Python library that implements for dummy table\r\n## Installation\r\n\r\nThe code is packaged for PyPI, so that the installation consists in running:\r\n```sh\r\npip install spark-plotting-tools --user \r\n```\r\n\r\n\r\n## Usage\r\n\r\nwrapper take Dummy\r\n\r\n```sh\r\n\r\nfrom spark_plotting_tools import generated_dummy_table_artifactory\r\nfrom spark_plotting_tools import generated_dummy_table_datum\r\nimport spark_dataframe_tools\r\n\r\n\r\nGenerated Dummy Table Datum\r\n============================================================\r\npath = \"fields_pe_datum2.csv\"\r\ntable_name = \"t_kctk_collateralization_atrb\"\r\nstorage_zone = \"master\"\r\nsample_parquet = 10\r\ncolumns_integer_default={}\r\ncolumns_date_default={\"gf_cutoff_date\":\"2026-01-01\"}\r\ncolumns_string_default={}\r\ncolumns_decimal_default={\"other_concepts_amount\":\"500.00\"}\r\n\r\ngenerated_dummy_table_datum(spark=spark,\r\n                            path=path,\r\n                            table_name=table_name,\r\n                            storage_zone=storage_zone,\r\n                            sample_parquet=sample_parquet,\r\n                            partition_colum=[\"gf_cutoff_date\"],\r\n                            columns_integer_default=columns_integer_default,\r\n                            columns_date_default=columns_date_default,\r\n                            columns_string_default=columns_string_default,\r\n                            columns_decimal_default=columns_decimal_default\r\n                           )\r\n                       \r\n\r\n\r\n\r\nGenerated Dummy Table Artifactory\r\n============================================================\r\npath = \"lclsupplierspurchases.output.schema\"\r\nsample_parquet = 10\r\ncolumns_integer_default={}\r\ncolumns_date_default={\"gf_cutoff_date\":\"2026-01-01\"}\r\ncolumns_string_default={}\r\ncolumns_decimal_default={\"other_concepts_amount\":\"500.00\"}\r\n\r\n\r\ngenerated_dummy_table_artifactory(spark=spark,\r\n                                  path=path,\r\n                                  sample_parquet=sample_parquet,\r\n                                  columns_integer_default=columns_integer_default,\r\n                                  columns_date_default=columns_date_default,\r\n                                  columns_string_default=columns_string_default,\r\n                                  columns_decimal_default=columns_decimal_default\r\n                                 )\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\nimport os, sys\r\nis_windows = sys.platform.startswith('win')\r\npath_directory = os.path.join(\"DIRECTORY_DUMMY\", table_name)\r\nif is_windows:\r\n    path_directory = path_directory.replace(\"\\\\\", \"/\")\r\n    \r\n\r\ndf =  spark.read.parquet(path_directory)\r\ndf.show2(10)\r\n  \r\n```\r\n\r\n\r\n\r\n## License\r\n\r\n[Apache License 2.0](https://www.dropbox.com/s/8t6xtgk06o3ij61/LICENSE?dl=0).\r\n\r\n\r\n## New features v1.0\r\n\r\n \r\n## BugFix\r\n- choco install visualcpp-build-tools\r\n\r\n\r\n\r\n## Reference\r\n\r\n - Jonathan Quiza [github](https://github.com/jonaqp).\r\n - Jonathan Quiza [RumiMLSpark](http://rumi-ml.herokuapp.com/).\r\n - Jonathan Quiza [linkedin](https://www.linkedin.com/in/jonaqp/).\r\n\r\n\r\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "spark_plotting_tools",
    "version": "0.3.0",
    "project_urls": {
        "Download": "https://github.com/jonaqp/spark_plotting_tools/archive/main.zip",
        "Homepage": "https://github.com/jonaqp/spark_plotting_tools/"
    },
    "split_keywords": [
        "spark",
        "plot"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "eeca53f3452c6d9c2874f929714e7764346f4c705452cbe7922d5c4f2c2b1b13",
                "md5": "056077fe199878b1fd834a2bd53e4526",
                "sha256": "ea054db9d6c2de11162a76f6d71419446dc188fda228d55e7ad32aad61c1b0b6"
            },
            "downloads": -1,
            "filename": "spark_plotting_tools-0.3.0-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "056077fe199878b1fd834a2bd53e4526",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 6591,
            "upload_time": "2023-07-04T03:25:02",
            "upload_time_iso_8601": "2023-07-04T03:25:02.000698Z",
            "url": "https://files.pythonhosted.org/packages/ee/ca/53f3452c6d9c2874f929714e7764346f4c705452cbe7922d5c4f2c2b1b13/spark_plotting_tools-0.3.0-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "feefe246ef7fa2bb3ca33c9a736b380a037c4b2da0cb33a8fad5e24d0d300914",
                "md5": "a0f7262949f9233d6a7df196ce1e1839",
                "sha256": "2b0d31f9aaa036a938f8b2cc6c8d6e34b2248e63021e65a8a39e263b383b020f"
            },
            "downloads": -1,
            "filename": "spark_plotting_tools-0.3.0.tar.gz",
            "has_sig": false,
            "md5_digest": "a0f7262949f9233d6a7df196ce1e1839",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 7055,
            "upload_time": "2023-07-04T03:25:03",
            "upload_time_iso_8601": "2023-07-04T03:25:03.745221Z",
            "url": "https://files.pythonhosted.org/packages/fe/ef/e246ef7fa2bb3ca33c9a736b380a037c4b2da0cb33a8fad5e24d0d300914/spark_plotting_tools-0.3.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-07-04 03:25:03",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "jonaqp",
    "github_project": "spark_plotting_tools",
    "github_not_found": true,
    "lcname": "spark-plotting-tools"
}
Jonathan Quiza
Elapsed time: 0.08414s