ssb-spark-tools


Namessb-spark-tools JSON
Version 0.1.12 PyPI version JSON
download
home_page
SummaryA collection of data processing Spark functions for the use in Statistics Norway.
upload_time2023-02-01 13:47:00
maintainer
docs_urlNone
authorStatistics Norway
requires_python>=3.8,<3.12
licenseMIT
keywords
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # SSB Spark Tools

> A collection of data processing Spark functions for the use in Statistics Norway (SSB)

[![PyPI version](https://img.shields.io/pypi/v/ssb_spark_tools.svg)](https://pypi.python.org/pypi/ssb_spark_tools/)
[![Status](https://img.shields.io/pypi/status/ssb_spark_tools.svg)](https://pypi.python.org/pypi/ssb_spark_tools/)
[![License](https://img.shields.io/pypi/l/ssb_spark_tools.svg)](https://pypi.python.org/pypi/ssb_spark_tools/)

The SSB Spark Tools Library is a colection of Data processing functions for the use in Data processing in Statistics Norway

## Installation

```python
pip install ssb-spark-tools
```

## Development setup

This repo uses `poetry` for dependency management and publishing to PyPi.
Install poetry as described on the [poetry install page](https://python-poetry.org/docs/#installation).

```
poetry install                 Install required tools for build/dev
poetry run pytest              Run tests
poetry build                   Build dist
poetry publish                 Publish to PyPi
```

### Testing

Run tests for all python distributions using GitHub Actions,
see https://github.com/statisticsnorway/SSB_Spark_tools/actions

## Releasing

_Prerequisites:_
You will need to register accounts on [PyPI](https://pypi.org/account/register/) and [TestPyPI](https://test.pypi.org/account/register/).

Before releasing:

- Make sure you're working on a "new" version number.
- Make sure to update release notes.
- Make sure the GitHub repo has a secret with the name `PYPI_API_TOKEN`
  and contains the PyPi access token.

To release and publish a new version to PyPI:

- Create a new release in the GitHub repo.
- The `Upload Python Package` GitHub Action will start and publish the new version to PyPi.

Manually:

```sh
poetry publish
```

For a dress rehearsal, you can do a test release to the [TestPyPI index](https://test.pypi.org/). TestPyPI is very useful, as you can try all the steps of publishing a package without any consequences if you mess up. Read more about TestPyPI [here](https://packaging.python.org/guides/using-testpypi/).

You should see the new release appearing [here](https://pypi.org/project/ssb-spark-tools/) (it might take a couple of minutes for the index to update).

## Release History

- 0.0.1
  - Initial version with functions as in use on initiaition

## Meta

Statistics Norway – https://github.com/statisticsnorway

Distributed under the MIT license. See `LICENSE` for more information.

<https://github.com/statisticsnorway/SSB_Spark_tools>

## Contributing

1. Fork it (<https://github.com/statisticsnorway/SSB_Spark_tools/fork>)
2. Create your feature branch (`git checkout -b feature/fooBar`)
3. Commit your changes (`git commit -am 'Add some fooBar'`)
4. Push to the branch (`git push origin feature/fooBar`)
5. Create a new Pull Request


            

Raw data

            {
    "_id": null,
    "home_page": "",
    "name": "ssb-spark-tools",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.8,<3.12",
    "maintainer_email": "",
    "keywords": "",
    "author": "Statistics Norway",
    "author_email": "81353974+arneso-ssb@users.noreply.github.com",
    "download_url": "https://files.pythonhosted.org/packages/da/4e/5d6a519692ed2afc9e87cebd1632a03e3841089f9b33cfade3842390d829/ssb_spark_tools-0.1.12.tar.gz",
    "platform": null,
    "description": "# SSB Spark Tools\n\n> A collection of data processing Spark functions for the use in Statistics Norway (SSB)\n\n[![PyPI version](https://img.shields.io/pypi/v/ssb_spark_tools.svg)](https://pypi.python.org/pypi/ssb_spark_tools/)\n[![Status](https://img.shields.io/pypi/status/ssb_spark_tools.svg)](https://pypi.python.org/pypi/ssb_spark_tools/)\n[![License](https://img.shields.io/pypi/l/ssb_spark_tools.svg)](https://pypi.python.org/pypi/ssb_spark_tools/)\n\nThe SSB Spark Tools Library is a colection of Data processing functions for the use in Data processing in Statistics Norway\n\n## Installation\n\n```python\npip install ssb-spark-tools\n```\n\n## Development setup\n\nThis repo uses `poetry` for dependency management and publishing to PyPi.\nInstall poetry as described on the [poetry install page](https://python-poetry.org/docs/#installation).\n\n```\npoetry install                 Install required tools for build/dev\npoetry run pytest              Run tests\npoetry build                   Build dist\npoetry publish                 Publish to PyPi\n```\n\n### Testing\n\nRun tests for all python distributions using GitHub Actions,\nsee https://github.com/statisticsnorway/SSB_Spark_tools/actions\n\n## Releasing\n\n_Prerequisites:_\nYou will need to register accounts on [PyPI](https://pypi.org/account/register/) and [TestPyPI](https://test.pypi.org/account/register/).\n\nBefore releasing:\n\n- Make sure you're working on a \"new\" version number.\n- Make sure to update release notes.\n- Make sure the GitHub repo has a secret with the name `PYPI_API_TOKEN`\n  and contains the PyPi access token.\n\nTo release and publish a new version to PyPI:\n\n- Create a new release in the GitHub repo.\n- The `Upload Python Package` GitHub Action will start and publish the new version to PyPi.\n\nManually:\n\n```sh\npoetry publish\n```\n\nFor a dress rehearsal, you can do a test release to the [TestPyPI index](https://test.pypi.org/). TestPyPI is very useful, as you can try all the steps of publishing a package without any consequences if you mess up. Read more about TestPyPI [here](https://packaging.python.org/guides/using-testpypi/).\n\nYou should see the new release appearing [here](https://pypi.org/project/ssb-spark-tools/) (it might take a couple of minutes for the index to update).\n\n## Release History\n\n- 0.0.1\n  - Initial version with functions as in use on initiaition\n\n## Meta\n\nStatistics Norway \u2013 https://github.com/statisticsnorway\n\nDistributed under the MIT license. See `LICENSE` for more information.\n\n<https://github.com/statisticsnorway/SSB_Spark_tools>\n\n## Contributing\n\n1. Fork it (<https://github.com/statisticsnorway/SSB_Spark_tools/fork>)\n2. Create your feature branch (`git checkout -b feature/fooBar`)\n3. Commit your changes (`git commit -am 'Add some fooBar'`)\n4. Push to the branch (`git push origin feature/fooBar`)\n5. Create a new Pull Request\n\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "A collection of data processing Spark functions for the use in Statistics Norway.",
    "version": "0.1.12",
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "18ad77312e2ca2cf46f91e505b01ec4be7e5c14ac253f7e0a58118dd2322d58c",
                "md5": "682c234345a9bf389f6e1596b6175505",
                "sha256": "10581cb7d0d5ef59f0bf7ec63b571f0aeaa8b07814b56f874caca9793727a110"
            },
            "downloads": -1,
            "filename": "ssb_spark_tools-0.1.12-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "682c234345a9bf389f6e1596b6175505",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8,<3.12",
            "size": 17097,
            "upload_time": "2023-02-01T13:46:59",
            "upload_time_iso_8601": "2023-02-01T13:46:59.831052Z",
            "url": "https://files.pythonhosted.org/packages/18/ad/77312e2ca2cf46f91e505b01ec4be7e5c14ac253f7e0a58118dd2322d58c/ssb_spark_tools-0.1.12-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "da4e5d6a519692ed2afc9e87cebd1632a03e3841089f9b33cfade3842390d829",
                "md5": "73ff80c2aa0159875e37adfdafd24a6c",
                "sha256": "fe8ddbdc68735b412550ffc35cc363467d6dc2d5220c152d61ce4f67e72ce09b"
            },
            "downloads": -1,
            "filename": "ssb_spark_tools-0.1.12.tar.gz",
            "has_sig": false,
            "md5_digest": "73ff80c2aa0159875e37adfdafd24a6c",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8,<3.12",
            "size": 15116,
            "upload_time": "2023-02-01T13:47:00",
            "upload_time_iso_8601": "2023-02-01T13:47:00.948104Z",
            "url": "https://files.pythonhosted.org/packages/da/4e/5d6a519692ed2afc9e87cebd1632a03e3841089f9b33cfade3842390d829/ssb_spark_tools-0.1.12.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-02-01 13:47:00",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "lcname": "ssb-spark-tools"
}
        
Elapsed time: 0.03614s