spark-generated-rules-tools

Name	spark-generated-rules-tools JSON
Version	0.2.8 JSON
	download
home_page	https://github.com/jonaqp/spark_generated_rules_tools/
Summary	spark_generated_rules_tools
upload_time	2023-09-08 11:25:05
maintainer
docs_url	None
author	Jonathan Quiza
requires_python
license
keywords	spark dq rules hammurabies
VCS
bugtrack_url
requirements	No requirements were recorded.
Travis-CI	No Travis.
coveralls test coverage	No coveralls.

            # spark_generated_rules_tools

[![Github License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)
[![Updates](https://pyup.io/repos/github/woctezuma/google-colab-transfer/shield.svg)](pyup)
[![Python 3](https://pyup.io/repos/github/woctezuma/google-colab-transfer/python-3-shield.svg)](pyup)
[![Code coverage](https://codecov.io/gh/woctezuma/google-colab-transfer/branch/master/graph/badge.svg)](codecov)

spark_generated_rules_tools is a Python library that implements quality rules in sandbox

## Installation

The code is packaged for PyPI, so that the installation consists in running:


## Usage

wrapper create hammurabies 

## Sandbox
## Installation
```sh
!yes| pip uninstall spark-generated-rules-tools
```

```sh
pip install spark-generated-rules-tools --user --upgrade
```

## IMPORTS
```sh
import os
import pyspark

from spark_generated_rules_tools import dq_validate_rules

```

## Variables
```sh
user_sandbox="P030772"
```


## Creating Workspace
```sh
dq_path_workspace(user_sandbox=user_sandbox)
```


## Run 
```sh
dq_run_sandbox(spark=spark,
               sc=sc,
               parameter_conf_list=parameter_conf_list,
               url_conf=url_conf)
```



## License

[Apache License 2.0](https://www.dropbox.com/s/8t6xtgk06o3ij61/LICENSE?dl=0).

## New features v1.0

## BugFix

- choco install visualcpp-build-tools

## Reference

- Jonathan Quiza [github](https://github.com/jonaqp).
- Jonathan Quiza [RumiMLSpark](http://rumi-ml.herokuapp.com/).



            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/jonaqp/spark_generated_rules_tools/",
    "name": "spark-generated-rules-tools",
    "maintainer": "",
    "docs_url": null,
    "requires_python": "",
    "maintainer_email": "",
    "keywords": "spark,dq,rules,hammurabies",
    "author": "Jonathan Quiza",
    "author_email": "jony327@gmail.com",
    "download_url": "https://github.com/jonaqp/spark_generated_rules_tools/archive/main.zip",
    "platform": null,
    "description": "# spark_generated_rules_tools\r\n\r\n[![Github License](https://img.shields.io/badge/License-Apache%202.0-blue.svg)](https://opensource.org/licenses/Apache-2.0)\r\n[![Updates](https://pyup.io/repos/github/woctezuma/google-colab-transfer/shield.svg)](pyup)\r\n[![Python 3](https://pyup.io/repos/github/woctezuma/google-colab-transfer/python-3-shield.svg)](pyup)\r\n[![Code coverage](https://codecov.io/gh/woctezuma/google-colab-transfer/branch/master/graph/badge.svg)](codecov)\r\n\r\nspark_generated_rules_tools is a Python library that implements quality rules in sandbox\r\n\r\n## Installation\r\n\r\nThe code is packaged for PyPI, so that the installation consists in running:\r\n\r\n\r\n## Usage\r\n\r\nwrapper create hammurabies \r\n\r\n## Sandbox\r\n## Installation\r\n```sh\r\n!yes| pip uninstall spark-generated-rules-tools\r\n```\r\n\r\n```sh\r\npip install spark-generated-rules-tools --user --upgrade\r\n```\r\n\r\n## IMPORTS\r\n```sh\r\nimport os\r\nimport pyspark\r\n\r\nfrom spark_generated_rules_tools import dq_validate_rules\r\n\r\n```\r\n\r\n## Variables\r\n```sh\r\nuser_sandbox=\"P030772\"\r\n```\r\n\r\n\r\n## Creating Workspace\r\n```sh\r\ndq_path_workspace(user_sandbox=user_sandbox)\r\n```\r\n\r\n\r\n## Run \r\n```sh\r\ndq_run_sandbox(spark=spark,\r\n               sc=sc,\r\n               parameter_conf_list=parameter_conf_list,\r\n               url_conf=url_conf)\r\n```\r\n\r\n\r\n\r\n## License\r\n\r\n[Apache License 2.0](https://www.dropbox.com/s/8t6xtgk06o3ij61/LICENSE?dl=0).\r\n\r\n## New features v1.0\r\n\r\n## BugFix\r\n\r\n- choco install visualcpp-build-tools\r\n\r\n## Reference\r\n\r\n- Jonathan Quiza [github](https://github.com/jonaqp).\r\n- Jonathan Quiza [RumiMLSpark](http://rumi-ml.herokuapp.com/).\r\n\r\n\r\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "spark_generated_rules_tools",
    "version": "0.2.8",
    "project_urls": {
        "Download": "https://github.com/jonaqp/spark_generated_rules_tools/archive/main.zip",
        "Homepage": "https://github.com/jonaqp/spark_generated_rules_tools/"
    },
    "split_keywords": [
        "spark",
        "dq",
        "rules",
        "hammurabies"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "4d336ec5d31ea78e35281538e8ce17491d4ff38e4259eced95efa3f90ebbf870",
                "md5": "580212837f93c01dd63d74321dd4cd31",
                "sha256": "bb0118cca538ff6dd61baad22b57c5f97908c59711c30b81c0a724217b6679e6"
            },
            "downloads": -1,
            "filename": "spark_generated_rules_tools-0.2.8-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "580212837f93c01dd63d74321dd4cd31",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 13265,
            "upload_time": "2023-09-08T11:25:05",
            "upload_time_iso_8601": "2023-09-08T11:25:05.061519Z",
            "url": "https://files.pythonhosted.org/packages/4d/33/6ec5d31ea78e35281538e8ce17491d4ff38e4259eced95efa3f90ebbf870/spark_generated_rules_tools-0.2.8-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-09-08 11:25:05",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "jonaqp",
    "github_project": "spark_generated_rules_tools",
    "github_not_found": true,
    "lcname": "spark-generated-rules-tools"
}