| Name | ckanext-harvest-basket JSON |
| Version |
1.3.73
JSON |
| download |
| home_page | None |
| Summary | A bunch of custom harvesters for ckanext-harvest |
| upload_time | 2024-10-24 13:35:27 |
| maintainer | None |
| docs_url | None |
| author | None |
| requires_python | None |
| license | AGPL |
| keywords |
ckan
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
|
The `harvest_basket` extension comes with a few custom **harvesters** for different data portals.
The list of available harvesters, that must be enabled with `ckan.plugins` in your config:
- `dkan_harvester`
- `junar_harvester`
- `socrata_harvester`
- `arcgis_harvester`
This extension also adds some features to extend the basic harvester:
1. Source checkup preview. During the source creation stage the harvester will try to access the remote portal and harvest one dataset to check if it's accessible or not. (TODO: the source checkup interface will be documented soon).
2. Restriction for anonymous users to visit harveser pages
## Installation
To install ckanext-harvest-basket:
1. Activate your CKAN virtual environment, for example:
. /usr/lib/ckan/default/bin/activate
2. Clone the source and install it on the virtualenv
git clone https://github.com/DataShades/ckanext-harvest-basket.git
cd ckanext-harvest-basket
pip install -e .
pip install -r requirements.txt
3. Add `harvest_basket` to the `ckan.plugins` setting in your CKAN
config file (by default the config file is located at
`/etc/ckan/default/ckan.ini`).
4. Restart CKAN. For example if you've deployed CKAN with Apache on Ubuntu:
sudo service apache2 reload
## Config settings
Available config options:
# You can disallow accessing harvester pages for anonymous users.
# (optional, default: 1).
ckanext.harvest_basket.allow_anonymous = 0
## Developer installation
To install ckanext-harvest-basket for development, activate your CKAN virtualenv and
do:
git clone https://github.com/DataShades/ckanext-harvest-basket.git
cd ckanext-harvest-basket
python setup.py develop
pip install -r requirements.txt
## Tests
To run the tests, do:
pytest --ckan-ini=test.ini
## License
[AGPL](https://www.gnu.org/licenses/agpl-3.0.en.html)
Raw data
{
"_id": null,
"home_page": null,
"name": "ckanext-harvest-basket",
"maintainer": null,
"docs_url": null,
"requires_python": null,
"maintainer_email": "DataShades <datashades@linkdigital.com.au>",
"keywords": "CKAN",
"author": null,
"author_email": "DataShades <datashades@linkdigital.com.au>, Sergey Motornyuk <sergey.motornyuk@linkdigital.com.au>, Oleksandr Cherniavskyi <mutantsan@gmail.com>",
"download_url": "https://files.pythonhosted.org/packages/27/2d/f6b9fb758a04b4d59a5c536267befd1938454f88fee4044bf15202a4e131/ckanext_harvest_basket-1.3.73.tar.gz",
"platform": null,
"description": "The `harvest_basket` extension comes with a few custom **harvesters** for different data portals.\nThe list of available harvesters, that must be enabled with `ckan.plugins` in your config:\n- `dkan_harvester`\n- `junar_harvester`\n- `socrata_harvester`\n- `arcgis_harvester`\n\nThis extension also adds some features to extend the basic harvester:\n1. Source checkup preview. During the source creation stage the harvester will try to access the remote portal and harvest one dataset to check if it's accessible or not. (TODO: the source checkup interface will be documented soon).\n2. Restriction for anonymous users to visit harveser pages\n\n## Installation\n\n\nTo install ckanext-harvest-basket:\n\n1. Activate your CKAN virtual environment, for example:\n\n . /usr/lib/ckan/default/bin/activate\n\n2. Clone the source and install it on the virtualenv\n\n git clone https://github.com/DataShades/ckanext-harvest-basket.git\n cd ckanext-harvest-basket\n pip install -e .\n\tpip install -r requirements.txt\n\n3. Add `harvest_basket` to the `ckan.plugins` setting in your CKAN\n config file (by default the config file is located at\n `/etc/ckan/default/ckan.ini`).\n\n4. Restart CKAN. For example if you've deployed CKAN with Apache on Ubuntu:\n\n sudo service apache2 reload\n\n\n## Config settings\nAvailable config options:\n\n\t# You can disallow accessing harvester pages for anonymous users.\n\t# (optional, default: 1).\n\tckanext.harvest_basket.allow_anonymous = 0\n\n\n## Developer installation\n\nTo install ckanext-harvest-basket for development, activate your CKAN virtualenv and\ndo:\n\n git clone https://github.com/DataShades/ckanext-harvest-basket.git\n cd ckanext-harvest-basket\n python setup.py develop\n pip install -r requirements.txt\n\n\n## Tests\n\nTo run the tests, do:\n\n pytest --ckan-ini=test.ini\n\n## License\n\n[AGPL](https://www.gnu.org/licenses/agpl-3.0.en.html)\n",
"bugtrack_url": null,
"license": "AGPL",
"summary": "A bunch of custom harvesters for ckanext-harvest",
"version": "1.3.73",
"project_urls": {
"Homepage": "https://github.com/DataShades/ckanext-harvest-basket"
},
"split_keywords": [
"ckan"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "13b664c501a80621bbd70ccf5835d2458470724c4eaccea447a15b7b0d5eea6d",
"md5": "4543bfafc00574e88ee6c448ebc66c62",
"sha256": "190e1ff1d1db91a4819ee5aa1884d730f2eaf89646018c9211b4d501992f8629"
},
"downloads": -1,
"filename": "ckanext_harvest_basket-1.3.73-py3-none-any.whl",
"has_sig": false,
"md5_digest": "4543bfafc00574e88ee6c448ebc66c62",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 46140,
"upload_time": "2024-10-24T13:35:26",
"upload_time_iso_8601": "2024-10-24T13:35:26.179030Z",
"url": "https://files.pythonhosted.org/packages/13/b6/64c501a80621bbd70ccf5835d2458470724c4eaccea447a15b7b0d5eea6d/ckanext_harvest_basket-1.3.73-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "272df6b9fb758a04b4d59a5c536267befd1938454f88fee4044bf15202a4e131",
"md5": "1c18ed2b9053e4a330a61207d55c0b83",
"sha256": "9e45ffcc50aa9198746d9a4deac351c7e7e7a3b0c0b49ed741abbcbe2dbc08a8"
},
"downloads": -1,
"filename": "ckanext_harvest_basket-1.3.73.tar.gz",
"has_sig": false,
"md5_digest": "1c18ed2b9053e4a330a61207d55c0b83",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 36588,
"upload_time": "2024-10-24T13:35:27",
"upload_time_iso_8601": "2024-10-24T13:35:27.426312Z",
"url": "https://files.pythonhosted.org/packages/27/2d/f6b9fb758a04b4d59a5c536267befd1938454f88fee4044bf15202a4e131/ckanext_harvest_basket-1.3.73.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-10-24 13:35:27",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "DataShades",
"github_project": "ckanext-harvest-basket",
"travis_ci": false,
"coveralls": true,
"github_actions": true,
"requirements": [],
"lcname": "ckanext-harvest-basket"
}
