il-supermarket-parser


Nameil-supermarket-parser JSON
Version 0.0.5 PyPI version JSON
download
home_pagehttps://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers
Summarypython package that process the data dumped by the israeli supermarket
upload_time2024-10-27 09:53:09
maintainerNone
docs_urlNone
authorSefi Erlich
requires_pythonNone
licenseMIT
keywords israel israeli scraper supermarket
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            
Israel Supermarket Parsers: Clients to parser the data published by the supermarkets.
=======================================
This is a parser for ALL the supermarket chains listed in the GOV.IL site.

שקיפות מחירים (השוואת מחירים) - https://www.gov.il/he/departments/legalInfo/cpfta_prices_regulations
הגדרת הקבצים שהיו צריכים להיות זמינים באתרים - https://www.nevo.co.il/law_html/law01/501_131.htm


[![Unit & Integration Tests](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/test-suite.yml/badge.svg?branch=main&event=push)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/test-suite.yml)
[![CodeQL](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/codeql.yml/badge.svg)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/codeql.yml)
[![Pylint](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/pylint.yml/badge.svg)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/pylint.yml)
[![Publish Docker image](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/docker-publish.yml/badge.svg)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/docker-publish.yml)
[![Upload Python Package](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/python-publish.yml/badge.svg)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/python-publish.yml)


## 🤗 Want to support my work?
<p align="center">
    <a href="https://buymeacoffee.com/erlichsefi" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;">
    </a>
</p> 

Got a question?
---------------

You can email me at erlichsefi@gmail.com

If you think you've found a bug:

- Create issue in [issue tracker](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/issues) to see if
  it's already been reported
- Please consider solving the issue by yourself and creating a pull request.

What is il_supermarket_parsers?
-------------

A simple access layer to the data the supermarkets publish.
You can download the data using https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers.

You only need to run the following code to parse all the data currently shared by the supermarkets and was downloaded using the package above.

```python
from il_supermarket_parsers import ConvertingTask

scraper = ConvertingTask(data_folder="dumps")
scraper.run()
```


Quick start
-----------

il_supermarket_parsers can be installed using pip:

    python3 pip install il_supermarket_parsers

If you want to run the latest version of the code, you can install it from the
repo directly:

    python3 -m pip install -U git+https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers.git
    # or if you don't have 'git' installed
    python3 -m pip install -U https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/main
    

Running Docker
-----------

Build yourself:

    docker build -t erlichsefi/israeli-supermarket-parsers --target prod .

or pull the existing image from docker hub:

    docker pull erlichsefi/israeli-supermarket-parsers:latest


Then running it using:


    docker run  -v "./dumps:/usr/src/app/dumps" \
                -v "./outputs:/usr/src/app/outputs" \
                -e ENABLED_PARSERS="BAREKET,YAYNO_BITAN" \
                -e ENABLED_FILE_TYPES="STORE_FILE" \
                -e LIMIT=1 \
                erlichsefi/israeli-supermarket-parsers



Contributing
------------

Help in testing, development, documentation and other tasks is
highly appreciated and useful to the project. There are tasks for
contributors of all experience levels.

If you need help getting started, don't hesitate to contact me.


Development status
------------------

IL SuperMarket Parser is beta software, as far as i see devlopment stoped until new issues will be found.

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers",
    "name": "il-supermarket-parser",
    "maintainer": null,
    "docs_url": null,
    "requires_python": null,
    "maintainer_email": null,
    "keywords": "israel, israeli, scraper, supermarket",
    "author": "Sefi Erlich",
    "author_email": "erlichsefi@gmail.com",
    "download_url": "https://files.pythonhosted.org/packages/60/02/b29ffb05acf9b030dd7fbf1b210d6468dbe1f76d425c800c9f1accb76085/il_supermarket_parser-0.0.5.tar.gz",
    "platform": null,
    "description": "\nIsrael Supermarket Parsers: Clients to parser the data published by the supermarkets.\n=======================================\nThis is a parser for ALL the supermarket chains listed in the GOV.IL site.\n\n\u05e9\u05e7\u05d9\u05e4\u05d5\u05ea \u05de\u05d7\u05d9\u05e8\u05d9\u05dd (\u05d4\u05e9\u05d5\u05d5\u05d0\u05ea \u05de\u05d7\u05d9\u05e8\u05d9\u05dd) - https://www.gov.il/he/departments/legalInfo/cpfta_prices_regulations\n\u05d4\u05d2\u05d3\u05e8\u05ea \u05d4\u05e7\u05d1\u05e6\u05d9\u05dd \u05e9\u05d4\u05d9\u05d5 \u05e6\u05e8\u05d9\u05db\u05d9\u05dd \u05dc\u05d4\u05d9\u05d5\u05ea \u05d6\u05de\u05d9\u05e0\u05d9\u05dd \u05d1\u05d0\u05ea\u05e8\u05d9\u05dd - https://www.nevo.co.il/law_html/law01/501_131.htm\n\n\n[![Unit & Integration Tests](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/test-suite.yml/badge.svg?branch=main&event=push)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/test-suite.yml)\n[![CodeQL](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/codeql.yml/badge.svg)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/codeql.yml)\n[![Pylint](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/pylint.yml/badge.svg)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/pylint.yml)\n[![Publish Docker image](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/docker-publish.yml/badge.svg)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/docker-publish.yml)\n[![Upload Python Package](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/python-publish.yml/badge.svg)](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/actions/workflows/python-publish.yml)\n\n\n## \ud83e\udd17 Want to support my work?\n<p align=\"center\">\n    <a href=\"https://buymeacoffee.com/erlichsefi\" target=\"_blank\"><img src=\"https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png\" alt=\"Buy Me A Coffee\" style=\"height: 60px !important;width: 217px !important;\">\n    </a>\n</p> \n\nGot a question?\n---------------\n\nYou can email me at erlichsefi@gmail.com\n\nIf you think you've found a bug:\n\n- Create issue in [issue tracker](https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/issues) to see if\n  it's already been reported\n- Please consider solving the issue by yourself and creating a pull request.\n\nWhat is il_supermarket_parsers?\n-------------\n\nA simple access layer to the data the supermarkets publish.\nYou can download the data using https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers.\n\nYou only need to run the following code to parse all the data currently shared by the supermarkets and was downloaded using the package above.\n\n```python\nfrom il_supermarket_parsers import ConvertingTask\n\nscraper = ConvertingTask(data_folder=\"dumps\")\nscraper.run()\n```\n\n\nQuick start\n-----------\n\nil_supermarket_parsers can be installed using pip:\n\n    python3 pip install il_supermarket_parsers\n\nIf you want to run the latest version of the code, you can install it from the\nrepo directly:\n\n    python3 -m pip install -U git+https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers.git\n    # or if you don't have 'git' installed\n    python3 -m pip install -U https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers/main\n    \n\nRunning Docker\n-----------\n\nBuild yourself:\n\n    docker build -t erlichsefi/israeli-supermarket-parsers --target prod .\n\nor pull the existing image from docker hub:\n\n    docker pull erlichsefi/israeli-supermarket-parsers:latest\n\n\nThen running it using:\n\n\n    docker run  -v \"./dumps:/usr/src/app/dumps\" \\\n                -v \"./outputs:/usr/src/app/outputs\" \\\n                -e ENABLED_PARSERS=\"BAREKET,YAYNO_BITAN\" \\\n                -e ENABLED_FILE_TYPES=\"STORE_FILE\" \\\n                -e LIMIT=1 \\\n                erlichsefi/israeli-supermarket-parsers\n\n\n\nContributing\n------------\n\nHelp in testing, development, documentation and other tasks is\nhighly appreciated and useful to the project. There are tasks for\ncontributors of all experience levels.\n\nIf you need help getting started, don't hesitate to contact me.\n\n\nDevelopment status\n------------------\n\nIL SuperMarket Parser is beta software, as far as i see devlopment stoped until new issues will be found.\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "python package that process the data dumped by the israeli supermarket",
    "version": "0.0.5",
    "project_urls": {
        "Homepage": "https://github.com/OpenIsraeliSupermarkets/israeli-supermarket-parsers"
    },
    "split_keywords": [
        "israel",
        " israeli",
        " scraper",
        " supermarket"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "5751cb4f28b1a2b050274f35114820677792ade5d5c518df29c1e0c65859a8bf",
                "md5": "d275cd6c3b841d2a97da52078c57a172",
                "sha256": "4f5644bc18bd446206004eff241e83829560613dbddf47887d45f47d655dcbbc"
            },
            "downloads": -1,
            "filename": "il_supermarket_parser-0.0.5-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "d275cd6c3b841d2a97da52078c57a172",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": null,
            "size": 30458,
            "upload_time": "2024-10-27T09:53:08",
            "upload_time_iso_8601": "2024-10-27T09:53:08.089365Z",
            "url": "https://files.pythonhosted.org/packages/57/51/cb4f28b1a2b050274f35114820677792ade5d5c518df29c1e0c65859a8bf/il_supermarket_parser-0.0.5-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "6002b29ffb05acf9b030dd7fbf1b210d6468dbe1f76d425c800c9f1accb76085",
                "md5": "334d84a4a364e4db32b5dbd51a608472",
                "sha256": "95e713d955554ae8d14c2b87018ff1da775efff9dc2fb17caf255f09c6cb7f00"
            },
            "downloads": -1,
            "filename": "il_supermarket_parser-0.0.5.tar.gz",
            "has_sig": false,
            "md5_digest": "334d84a4a364e4db32b5dbd51a608472",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": null,
            "size": 20106,
            "upload_time": "2024-10-27T09:53:09",
            "upload_time_iso_8601": "2024-10-27T09:53:09.786170Z",
            "url": "https://files.pythonhosted.org/packages/60/02/b29ffb05acf9b030dd7fbf1b210d6468dbe1f76d425c800c9f1accb76085/il_supermarket_parser-0.0.5.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-10-27 09:53:09",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "OpenIsraeliSupermarkets",
    "github_project": "israeli-supermarket-parsers",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "requirements": [],
    "lcname": "il-supermarket-parser"
}
        
Elapsed time: 2.91469s