gerapy-item-pipeline


Namegerapy-item-pipeline JSON
Version 0.1.3 PyPI version JSON
download
home_pagehttps://github.com/Gerapy/GerapyItemPipeline
SummaryItem Pipeline Components for Scrapy & Gerapy
upload_time2023-09-20 17:10:08
maintainer
docs_urlNone
authorGermey
requires_python>=3.6.0
licenseMIT
keywords
VCS
bugtrack_url
requirements scrapy pymongo
Travis-CI No Travis.
coveralls test coverage No coveralls.
            
# Gerapy Item Pipeline

This is a package for supporting Item Pipelines in Scrapy, also this
package is a module in [Gerapy](https://github.com/Gerapy/Gerapy).

## Installation

```shell script
pip3 install gerapy-item-pipeline
```

## Usage

These are all kinds of the storage implemented.

### MongoDB

```python
MONGODB_CONNECTION_STRING = 'localhost'
MONGODB_DATABASE_NAME = 'default'
MONGODB_UPSERT = True
MONGODB_COLLECTION_NAME_FIELD = 'mongodb_collection_name'
MONGODB_COLLECTION_NAME_DEFAULT = 'default'
MONGODB_ITEM_PRIMARY_KEY_FIELD = 'primary_key'
MONGODB_ITEM_PRIMARY_KEY_DEFAULT = 'id'
```




            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/Gerapy/GerapyItemPipeline",
    "name": "gerapy-item-pipeline",
    "maintainer": "",
    "docs_url": null,
    "requires_python": ">=3.6.0",
    "maintainer_email": "",
    "keywords": "",
    "author": "Germey",
    "author_email": "cqc@cuiqingcai.com",
    "download_url": "https://files.pythonhosted.org/packages/ef/44/a0ca4167145b4e785461426160875a91a29eb9d090476a3b5b242f3aa10d/gerapy-item-pipeline-0.1.3.tar.gz",
    "platform": null,
    "description": "\n# Gerapy Item Pipeline\n\nThis is a package for supporting Item Pipelines in Scrapy, also this\npackage is a module in [Gerapy](https://github.com/Gerapy/Gerapy).\n\n## Installation\n\n```shell script\npip3 install gerapy-item-pipeline\n```\n\n## Usage\n\nThese are all kinds of the storage implemented.\n\n### MongoDB\n\n```python\nMONGODB_CONNECTION_STRING = 'localhost'\nMONGODB_DATABASE_NAME = 'default'\nMONGODB_UPSERT = True\nMONGODB_COLLECTION_NAME_FIELD = 'mongodb_collection_name'\nMONGODB_COLLECTION_NAME_DEFAULT = 'default'\nMONGODB_ITEM_PRIMARY_KEY_FIELD = 'primary_key'\nMONGODB_ITEM_PRIMARY_KEY_DEFAULT = 'id'\n```\n\n\n\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "Item Pipeline Components for Scrapy & Gerapy",
    "version": "0.1.3",
    "project_urls": {
        "Homepage": "https://github.com/Gerapy/GerapyItemPipeline"
    },
    "split_keywords": [],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "949b2da82a4e4e88f5d5c0e97e2470bde5bae92e220cd70338848ea46e12225e",
                "md5": "9389118d4b4877e131e92c1ffb7e55fb",
                "sha256": "f706c8ef68df34e5f725a920abbad81bec0790daaa6c45eca7de60548e639fae"
            },
            "downloads": -1,
            "filename": "gerapy_item_pipeline-0.1.3-py2.py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "9389118d4b4877e131e92c1ffb7e55fb",
            "packagetype": "bdist_wheel",
            "python_version": "py2.py3",
            "requires_python": ">=3.6.0",
            "size": 3339,
            "upload_time": "2023-09-20T17:10:06",
            "upload_time_iso_8601": "2023-09-20T17:10:06.051277Z",
            "url": "https://files.pythonhosted.org/packages/94/9b/2da82a4e4e88f5d5c0e97e2470bde5bae92e220cd70338848ea46e12225e/gerapy_item_pipeline-0.1.3-py2.py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "ef44a0ca4167145b4e785461426160875a91a29eb9d090476a3b5b242f3aa10d",
                "md5": "29e8c82c2f123d3116d4681c9ba05fa2",
                "sha256": "42070a9550c1b6e19e790b1c745c9c9b9b7eb37ecdafa32cd2fba5d33a598463"
            },
            "downloads": -1,
            "filename": "gerapy-item-pipeline-0.1.3.tar.gz",
            "has_sig": false,
            "md5_digest": "29e8c82c2f123d3116d4681c9ba05fa2",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.6.0",
            "size": 3462,
            "upload_time": "2023-09-20T17:10:08",
            "upload_time_iso_8601": "2023-09-20T17:10:08.030807Z",
            "url": "https://files.pythonhosted.org/packages/ef/44/a0ca4167145b4e785461426160875a91a29eb9d090476a3b5b242f3aa10d/gerapy-item-pipeline-0.1.3.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-09-20 17:10:08",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "Gerapy",
    "github_project": "GerapyItemPipeline",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": false,
    "requirements": [
        {
            "name": "scrapy",
            "specs": [
                [
                    ">=",
                    "2.0.0"
                ]
            ]
        },
        {
            "name": "pymongo",
            "specs": []
        }
    ],
    "lcname": "gerapy-item-pipeline"
}
        
Elapsed time: 0.12738s