CKAN
====
`
CKAN integration for uData
Usage
-----
Install the harvester package in you udata environement:
.. code-block:: bash
pip install udata-ckan
The harvester will be automatically available as a backend choice.
Develop
-------
Python dependencies
*******************
Assuming you are in an active virtualenv with `udata` installed and in the current project cloned repository directory, install all dependencies using:
.. code-block:: shell
pip install -e requirements/develop.pip
##CKAN
==== instance
A docker-compose is availbe to start up a CKAN instance if you want to test your harvester on a custom catalog.
Testing
*******
Tests are located into the `tests` folder and be run with:
.. code-block:: shell
inv test
Changelog
=========
3.0.3 (2024-04-16)
------------------
- Update constants imports from `.models` to `.constants` `#250 <https://github.com/opendatateam/udata-ckan/pull/250>`_
3.0.2 (2024-01-25)
------------------
- Use `datetime.utcnow` to make sure to handle utc datetimes `#246 <https://github.com/opendatateam/udata-ckan/pull/246>`_
- Remove `valid_at` on deprecated GeoZones `#248 <https://github.com/opendatateam/udata-ckan/pull/248>`_
3.0.1 (2023-03-17)
------------------
- Use id as remote_id ASAP for better error handling `#239 <https://github.com/opendatateam/udata-ckan/pull/239>`_
- Update mongoDB in CI `#242 <https://github.com/opendatateam/udata-ckan/pull/242>`_
- Refactor tests to mock CKAN results instead of starting a CKAN instance `#245 <https://github.com/opendatateam/udata-ckan/pull/245>`_
- Upgrade CKAN images used in docker-compose `#244 <https://github.com/opendatateam/udata-ckan/pull/244>`_
- Fix resource.published that is not needed anymore `#243 <https://github.com/opendatateam/udata-ckan/pull/243>`_
3.0.0 (2022-11-14)
------------------
- :warning: **Breaking change** Use harvest dynamic field introduced in udata 5 `#227 <https://github.com/opendatateam/udata-ckan/pull/227>`_
2.0.1 (2022-09-01)
------------------
- Replace mongo legacy image in CI `#219 <https://github.com/opendatateam/udata-ckan/pull/219>`_
- Make revision_id optional to match latest CKAN versions `#220 <https://github.com/opendatateam/udata-ckan/pull/220>`_
2.0.0 (2020-03-11)
------------------
- Migrate to python3 🐍 `#110 <https://github.com/opendatateam/udata-ckan/pull/110>`_
1.3.0 (2020-01-06)
------------------
- DKAN support `#129 <https://github.com/opendatateam/udata-ckan/pull/129>`_
1.2.3 (2019-05-29)
------------------
- Always fill extras.remote_url `#103 <https://github.com/opendatateam/udata-ckan/pull/103>`_
1.2.2 (2019-05-24)
------------------
- Max out package_search rows limit `#100 <https://github.com/opendatateam/udata-ckan/pull/98>`_
1.2.1 (2019-05-24)
------------------
- Fix filetype (always remote) `#98 <https://github.com/opendatateam/udata-ckan/pull/98>`_
1.2.0 (2018-10-02)
------------------
- Support both inclusion and exclusion filters `#42 <https://github.com/opendatateam/udata-ckan/pull/42>`_
- Localization support `#43 <https://github.com/opendatateam/udata-ckan/pull/43>`_
- Test the minimum accepted CKAN dataset payload and make the `extras` property optional `#57 <https://github.com/opendatateam/udata-ckan/pull/57>`_
- Improved error handling (support details in JSON responses, also handle raw quoted strings and HTML) `#56 <https://github.com/opendatateam/udata-ckan/pull/56>`_
1.1.1 (2018-06-15)
------------------
- Only store `url` field in `remote_url` extra if this is an URL otherwise store it in `ckan:source` `#30 <https://github.com/opendatateam/udata-ckan/pull/30>`_
- Properly handle geometry errors `#31 <https://github.com/opendatateam/udata-ckan/pull/31>`_
- Improve extras parsing `#32 <https://github.com/opendatateam/udata-ckan/pull/32>`_:
- Skip empty extras
- Parse update frequencies as RDF URI or udata frequency identifier
- Parse `spatial-text` matching a known zone name or slug
- Store unknown `spatial-uri`, `spatial-text` and `frequency` as `ckan:spatial-uri`, `ckan:spatial-text` and `ckan:frequency`
1.1.0 (2018-06-06)
------------------
- Test against a real CKAN instance `#23 <https://github.com/opendatateam/udata-ckan/pull/23>`_
- Allows to filter on Organizations and Tags `#26 <https://github.com/opendatateam/udata-ckan/pull/26>`_
- Register `ckan:` prefixed extras `#28 <https://github.com/opendatateam/udata-ckan/pull/28>`_
1.0.1 (2018-03-13)
------------------
- Fix packaging `#2 <https://github.com/opendatateam/udata-ckan/pull/2>`_
- Make use of `udata pytest plugin <opendatateam/udata#1400>`_ `#3 <https://github.com/opendatateam/udata-ckan/pull/3>`_
- Enable the `ckan` plugin in test (plugin needs to be enabled to use the harvester) `#8 <https://github.com/opendatateam/udata-ckan/pull/8>`_
1.0.0 (2017-10-20)
------------------
- Initial release
Raw data
{
"_id": null,
"home_page": "https://github.com/opendatateam/udata-ckan",
"name": "udata-ckan",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.7",
"maintainer_email": null,
"keywords": "udata harvester CKAN",
"author": "OpenDataTeam",
"author_email": "udata@opendata.team",
"download_url": null,
"platform": null,
"description": "CKAN\n====\n\n`\n\nCKAN integration for uData\n\nUsage\n-----\n\nInstall the harvester package in you udata environement:\n\n.. code-block:: bash\n\n pip install udata-ckan\n \n\n\nThe harvester will be automatically available as a backend choice.\n\nDevelop\n-------\n\nPython dependencies\n*******************\n\nAssuming you are in an active virtualenv with `udata` installed and in the current project cloned repository directory, install all dependencies using:\n\n.. code-block:: shell\n\n pip install -e requirements/develop.pip\n \n\n\n##CKAN\n==== instance\n\nA docker-compose is availbe to start up a CKAN instance if you want to test your harvester on a custom catalog.\n\nTesting\n*******\n\nTests are located into the `tests` folder and be run with:\n\n.. code-block:: shell\n\n inv test\n \n\n\nChangelog\n=========\n\n3.0.3 (2024-04-16)\n------------------\n\n- Update constants imports from `.models` to `.constants` `#250 <https://github.com/opendatateam/udata-ckan/pull/250>`_\n\n3.0.2 (2024-01-25)\n------------------\n\n- Use `datetime.utcnow` to make sure to handle utc datetimes `#246 <https://github.com/opendatateam/udata-ckan/pull/246>`_\n- Remove `valid_at` on deprecated GeoZones `#248 <https://github.com/opendatateam/udata-ckan/pull/248>`_\n\n3.0.1 (2023-03-17)\n------------------\n\n- Use id as remote_id ASAP for better error handling `#239 <https://github.com/opendatateam/udata-ckan/pull/239>`_\n- Update mongoDB in CI `#242 <https://github.com/opendatateam/udata-ckan/pull/242>`_\n- Refactor tests to mock CKAN results instead of starting a CKAN instance `#245 <https://github.com/opendatateam/udata-ckan/pull/245>`_\n- Upgrade CKAN images used in docker-compose `#244 <https://github.com/opendatateam/udata-ckan/pull/244>`_\n- Fix resource.published that is not needed anymore `#243 <https://github.com/opendatateam/udata-ckan/pull/243>`_\n\n3.0.0 (2022-11-14)\n------------------\n\n- :warning: **Breaking change** Use harvest dynamic field introduced in udata 5 `#227 <https://github.com/opendatateam/udata-ckan/pull/227>`_\n\n2.0.1 (2022-09-01)\n------------------\n\n- Replace mongo legacy image in CI `#219 <https://github.com/opendatateam/udata-ckan/pull/219>`_\n- Make revision_id optional to match latest CKAN versions `#220 <https://github.com/opendatateam/udata-ckan/pull/220>`_\n\n2.0.0 (2020-03-11)\n------------------\n\n- Migrate to python3 \ud83d\udc0d `#110 <https://github.com/opendatateam/udata-ckan/pull/110>`_\n\n1.3.0 (2020-01-06)\n------------------\n\n- DKAN support `#129 <https://github.com/opendatateam/udata-ckan/pull/129>`_\n\n1.2.3 (2019-05-29)\n------------------\n\n- Always fill extras.remote_url `#103 <https://github.com/opendatateam/udata-ckan/pull/103>`_\n\n1.2.2 (2019-05-24)\n------------------\n\n- Max out package_search rows limit `#100 <https://github.com/opendatateam/udata-ckan/pull/98>`_\n\n1.2.1 (2019-05-24)\n------------------\n\n- Fix filetype (always remote) `#98 <https://github.com/opendatateam/udata-ckan/pull/98>`_\n\n1.2.0 (2018-10-02)\n------------------\n\n- Support both inclusion and exclusion filters `#42 <https://github.com/opendatateam/udata-ckan/pull/42>`_\n- Localization support `#43 <https://github.com/opendatateam/udata-ckan/pull/43>`_\n- Test the minimum accepted CKAN dataset payload and make the `extras` property optional `#57 <https://github.com/opendatateam/udata-ckan/pull/57>`_\n- Improved error handling (support details in JSON responses, also handle raw quoted strings and HTML) `#56 <https://github.com/opendatateam/udata-ckan/pull/56>`_\n\n1.1.1 (2018-06-15)\n------------------\n\n- Only store `url` field in `remote_url` extra if this is an URL otherwise store it in `ckan:source` `#30 <https://github.com/opendatateam/udata-ckan/pull/30>`_\n- Properly handle geometry errors `#31 <https://github.com/opendatateam/udata-ckan/pull/31>`_\n- Improve extras parsing `#32 <https://github.com/opendatateam/udata-ckan/pull/32>`_:\n - Skip empty extras\n - Parse update frequencies as RDF URI or udata frequency identifier\n - Parse `spatial-text` matching a known zone name or slug\n - Store unknown `spatial-uri`, `spatial-text` and `frequency` as `ckan:spatial-uri`, `ckan:spatial-text` and `ckan:frequency`\n\n1.1.0 (2018-06-06)\n------------------\n\n- Test against a real CKAN instance `#23 <https://github.com/opendatateam/udata-ckan/pull/23>`_\n- Allows to filter on Organizations and Tags `#26 <https://github.com/opendatateam/udata-ckan/pull/26>`_\n- Register `ckan:` prefixed extras `#28 <https://github.com/opendatateam/udata-ckan/pull/28>`_\n\n1.0.1 (2018-03-13)\n------------------\n\n- Fix packaging `#2 <https://github.com/opendatateam/udata-ckan/pull/2>`_\n- Make use of `udata pytest plugin <opendatateam/udata#1400>`_ `#3 <https://github.com/opendatateam/udata-ckan/pull/3>`_\n- Enable the `ckan` plugin in test (plugin needs to be enabled to use the harvester) `#8 <https://github.com/opendatateam/udata-ckan/pull/8>`_\n\n1.0.0 (2017-10-20)\n------------------\n\n- Initial release\n\n",
"bugtrack_url": null,
"license": "AGPL",
"summary": "CKAN integration for udata",
"version": "3.0.3",
"project_urls": {
"Homepage": "https://github.com/opendatateam/udata-ckan"
},
"split_keywords": [
"udata",
"harvester",
"ckan"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "6f502517eebe3f08325e3ee5541f025a98f296e02c2e34453ada2d9140484810",
"md5": "d3bf59303cc8f295a6befa895fa3406b",
"sha256": "3fbb43a2f2d5a4e2046f07d427600ef13e1086d9b5d984870b2a921629df4f45"
},
"downloads": -1,
"filename": "udata_ckan-3.0.3-py2.py3-none-any.whl",
"has_sig": false,
"md5_digest": "d3bf59303cc8f295a6befa895fa3406b",
"packagetype": "bdist_wheel",
"python_version": "py2.py3",
"requires_python": ">=3.7",
"size": 12777,
"upload_time": "2024-04-16T08:39:37",
"upload_time_iso_8601": "2024-04-16T08:39:37.231413Z",
"url": "https://files.pythonhosted.org/packages/6f/50/2517eebe3f08325e3ee5541f025a98f296e02c2e34453ada2d9140484810/udata_ckan-3.0.3-py2.py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-04-16 08:39:37",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "opendatateam",
"github_project": "udata-ckan",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"circle": true,
"lcname": "udata-ckan"
}
JSON
