invenio-indexer


Nameinvenio-indexer JSON
Version 3.0.0 PyPI version JSON
download
home_pagehttps://github.com/inveniosoftware/invenio-indexer
Summary"Record indexer for Invenio."
upload_time2024-12-06 07:31:07
maintainerNone
docs_urlhttps://pythonhosted.org/invenio-indexer/
authorCERN
requires_python>=3.7
licenseMIT
keywords invenio search indexing
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            ..
    This file is part of Invenio.
    Copyright (C) 2016-2018 CERN.

    Invenio is free software; you can redistribute it and/or modify it
    under the terms of the MIT License; see LICENSE file for more details.

=================
 Invenio-Indexer
=================

.. image:: https://img.shields.io/github/license/inveniosoftware/invenio-indexer.svg
        :target: https://github.com/inveniosoftware/invenio-indexer/blob/master/LICENSE

.. image:: https://github.com/inveniosoftware/invenio-indexer/workflows/CI/badge.svg
        :target: https://github.com/inveniosoftware/invenio-indexer/actions?query=workflow%3ACI

.. image:: https://img.shields.io/coveralls/inveniosoftware/invenio-indexer.svg
        :target: https://coveralls.io/r/inveniosoftware/invenio-indexer

.. image:: https://img.shields.io/pypi/v/invenio-indexer.svg
        :target: https://pypi.org/pypi/invenio-indexer


Record indexer for Invenio.

Further documentation is available on
https://invenio-indexer.readthedocs.io/

..
    This file is part of Invenio.
    Copyright (C) 2016-2024 CERN.
    Copyright (C) 2024 Graz University of Technology.

    Invenio is free software; you can redistribute it and/or modify it
    under the terms of the MIT License; see LICENSE file for more details.

Changes
=======

Version 3.0.0 (release 2024-11-29)

- setup: bump major dependencies

Version 2.4.0 (released 2024-10-28)
- config: remove INDEXER_DEFAULT_INDEX default value
- cli: run command accepts a new parameter 'chunk_size'
- ci: remove docker-compose line

Version 2.3.0 (released 2024-03-04)

- indexer: Allow the definition of indices in index_templates, instead of mappings

Version 2.2.1 (released 2023-09-28)

- bulk: make configurable the number of records to be bulk indexed per task

Version 2.2.0 (released 2023-05-25)

- cli: add queue selection options
- tests: remove redis as message backend

Version 2.1.2 (released 2023-05-05)

- Allow passing message queue producer publish arguments via the ``RecordIndexer``
  constructor and the ``INDEXER_MQ_PUBLISH_KWARGS`` config.

Version 2.1.1 (released 2022-10-07)

- Change `schema_to_index` to return only the index and not a tuple with index and
  doc type.

Version 2.1.0 (released 2022-10-03)

- Add support to OpenSearch v2
- Remove `doc_type` param
- Change `record_to_index` to return only the index and not a tuple with index and
  doc type.
- Remove the config var `INDEXER_DEFAULT_DOC_TYPE`

Version 2.0.1 (released 2022-09-26)

- Bump upper pin of invenio-records

Version 2.0.0 (released 2022-09-23)

- Integrate invenio-search v2, add support to OpenSearch
- Require Elasticsearch >= 7.5
- Remove old versions of Elasticsearch mappings
- Breaking: rename kwarg param `es_bulk_kwargs` to `search_bulk_kwargs`

Version 1.2.7 (released 2022-05-17)

- Add exists method to RecordIndexer API class.

Version 1.2.6 (released 2022-05-13)

- Add refresh method to RecordIndexer API class.

Version 1.2.5 (released 2022-05-05)

- Add a config to defined the max number of concurrent consumers
  when bulk indexing.
- Allows to retrieve all registered indexers.

Version 1.2.4 (released 2022-04-26)

- Aligns with best practice from Kombu that producers should also declare
  queues.

Version 1.2.3 (released 2022-04-06)

- Add indexer registry and use it in celery tasks.

Version 1.2.2 (released 2022-03-30)

- Add support for Click v8.1+ and Flask v2.1+.

Version 1.2.1 (released 2021-03-05)

- Remove pytest runner from setup dependencies

Version 1.2.0 (released 2020-09-16)

- Changes delete requests to optimistic concurrency control by providing the
  the version and version_type in delete requests. The previous behavior can
  restored by calling
  ``RecordIndexer().delete(record, version=None, version_type=None)`` instead.

- Adds support for using new-style record dumping controlled via the
  ``Record.enable_jsonref`` flag.

Version 1.1.2 (released 2020-04-28)

- Introduces ``RecordIndexer.record_cls`` for customizing the record class.
- Removes Python 2 support.

Version 1.1.1 (released 2019-11-21)

- Fix bulk action parameters compatibility for Elasticsearch v7.

Version 1.1.0 (released 2019-07-19)

- Add support for Elasticsearch v7.
- Integrate index prefixing.
- Add ``before_record_index.dynamic_connect()`` signal utility for more
  flexible indexer receivers.
- Add ``schema_to_index`` utility from ``invenio-search`` (will be removed in
  next minor version of ``invenio-search``).

Version 1.0.2 (released 2019-05-27)

- Allow Elasticsearch indexing arguments to be modified by subscribing to
  ``before_record_index`` signal.

Version 1.0.1 (released 2018-10-11)

- Allow forwarding arguments from ``RecordIndexer.process_bulk_queue`` to
  ``elasticsearch.helpers.bulk`` calls via the ``es_bulk_kwargs`` parameter.

Version 1.0.0 (released 2018-03-23)

- Initial public release.

            

Raw data

            {
    "_id": null,
    "home_page": "https://github.com/inveniosoftware/invenio-indexer",
    "name": "invenio-indexer",
    "maintainer": null,
    "docs_url": "https://pythonhosted.org/invenio-indexer/",
    "requires_python": ">=3.7",
    "maintainer_email": null,
    "keywords": "invenio search indexing",
    "author": "CERN",
    "author_email": "info@inveniosoftware.org",
    "download_url": "https://files.pythonhosted.org/packages/d9/64/96f9f71f10ded3afda366a465b7c7eda41b22c505b297620d8b6c67f3bac/invenio_indexer-3.0.0.tar.gz",
    "platform": "any",
    "description": "..\n    This file is part of Invenio.\n    Copyright (C) 2016-2018 CERN.\n\n    Invenio is free software; you can redistribute it and/or modify it\n    under the terms of the MIT License; see LICENSE file for more details.\n\n=================\n Invenio-Indexer\n=================\n\n.. image:: https://img.shields.io/github/license/inveniosoftware/invenio-indexer.svg\n        :target: https://github.com/inveniosoftware/invenio-indexer/blob/master/LICENSE\n\n.. image:: https://github.com/inveniosoftware/invenio-indexer/workflows/CI/badge.svg\n        :target: https://github.com/inveniosoftware/invenio-indexer/actions?query=workflow%3ACI\n\n.. image:: https://img.shields.io/coveralls/inveniosoftware/invenio-indexer.svg\n        :target: https://coveralls.io/r/inveniosoftware/invenio-indexer\n\n.. image:: https://img.shields.io/pypi/v/invenio-indexer.svg\n        :target: https://pypi.org/pypi/invenio-indexer\n\n\nRecord indexer for Invenio.\n\nFurther documentation is available on\nhttps://invenio-indexer.readthedocs.io/\n\n..\n    This file is part of Invenio.\n    Copyright (C) 2016-2024 CERN.\n    Copyright (C) 2024 Graz University of Technology.\n\n    Invenio is free software; you can redistribute it and/or modify it\n    under the terms of the MIT License; see LICENSE file for more details.\n\nChanges\n=======\n\nVersion 3.0.0 (release 2024-11-29)\n\n- setup: bump major dependencies\n\nVersion 2.4.0 (released 2024-10-28)\n- config: remove INDEXER_DEFAULT_INDEX default value\n- cli: run command accepts a new parameter 'chunk_size'\n- ci: remove docker-compose line\n\nVersion 2.3.0 (released 2024-03-04)\n\n- indexer: Allow the definition of indices in index_templates, instead of mappings\n\nVersion 2.2.1 (released 2023-09-28)\n\n- bulk: make configurable the number of records to be bulk indexed per task\n\nVersion 2.2.0 (released 2023-05-25)\n\n- cli: add queue selection options\n- tests: remove redis as message backend\n\nVersion 2.1.2 (released 2023-05-05)\n\n- Allow passing message queue producer publish arguments via the ``RecordIndexer``\n  constructor and the ``INDEXER_MQ_PUBLISH_KWARGS`` config.\n\nVersion 2.1.1 (released 2022-10-07)\n\n- Change `schema_to_index` to return only the index and not a tuple with index and\n  doc type.\n\nVersion 2.1.0 (released 2022-10-03)\n\n- Add support to OpenSearch v2\n- Remove `doc_type` param\n- Change `record_to_index` to return only the index and not a tuple with index and\n  doc type.\n- Remove the config var `INDEXER_DEFAULT_DOC_TYPE`\n\nVersion 2.0.1 (released 2022-09-26)\n\n- Bump upper pin of invenio-records\n\nVersion 2.0.0 (released 2022-09-23)\n\n- Integrate invenio-search v2, add support to OpenSearch\n- Require Elasticsearch >= 7.5\n- Remove old versions of Elasticsearch mappings\n- Breaking: rename kwarg param `es_bulk_kwargs` to `search_bulk_kwargs`\n\nVersion 1.2.7 (released 2022-05-17)\n\n- Add exists method to RecordIndexer API class.\n\nVersion 1.2.6 (released 2022-05-13)\n\n- Add refresh method to RecordIndexer API class.\n\nVersion 1.2.5 (released 2022-05-05)\n\n- Add a config to defined the max number of concurrent consumers\n  when bulk indexing.\n- Allows to retrieve all registered indexers.\n\nVersion 1.2.4 (released 2022-04-26)\n\n- Aligns with best practice from Kombu that producers should also declare\n  queues.\n\nVersion 1.2.3 (released 2022-04-06)\n\n- Add indexer registry and use it in celery tasks.\n\nVersion 1.2.2 (released 2022-03-30)\n\n- Add support for Click v8.1+ and Flask v2.1+.\n\nVersion 1.2.1 (released 2021-03-05)\n\n- Remove pytest runner from setup dependencies\n\nVersion 1.2.0 (released 2020-09-16)\n\n- Changes delete requests to optimistic concurrency control by providing the\n  the version and version_type in delete requests. The previous behavior can\n  restored by calling\n  ``RecordIndexer().delete(record, version=None, version_type=None)`` instead.\n\n- Adds support for using new-style record dumping controlled via the\n  ``Record.enable_jsonref`` flag.\n\nVersion 1.1.2 (released 2020-04-28)\n\n- Introduces ``RecordIndexer.record_cls`` for customizing the record class.\n- Removes Python 2 support.\n\nVersion 1.1.1 (released 2019-11-21)\n\n- Fix bulk action parameters compatibility for Elasticsearch v7.\n\nVersion 1.1.0 (released 2019-07-19)\n\n- Add support for Elasticsearch v7.\n- Integrate index prefixing.\n- Add ``before_record_index.dynamic_connect()`` signal utility for more\n  flexible indexer receivers.\n- Add ``schema_to_index`` utility from ``invenio-search`` (will be removed in\n  next minor version of ``invenio-search``).\n\nVersion 1.0.2 (released 2019-05-27)\n\n- Allow Elasticsearch indexing arguments to be modified by subscribing to\n  ``before_record_index`` signal.\n\nVersion 1.0.1 (released 2018-10-11)\n\n- Allow forwarding arguments from ``RecordIndexer.process_bulk_queue`` to\n  ``elasticsearch.helpers.bulk`` calls via the ``es_bulk_kwargs`` parameter.\n\nVersion 1.0.0 (released 2018-03-23)\n\n- Initial public release.\n",
    "bugtrack_url": null,
    "license": "MIT",
    "summary": "\"Record indexer for Invenio.\"",
    "version": "3.0.0",
    "project_urls": {
        "Homepage": "https://github.com/inveniosoftware/invenio-indexer"
    },
    "split_keywords": [
        "invenio",
        "search",
        "indexing"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "11e159622da06c768b6bd75646c181329a48de912f5eaf6473230e368828f8ef",
                "md5": "b59cb2e046d5f7166f0cc79efd80a658",
                "sha256": "6ca6890c11c9143a8329787a6fa0e51a66233db92585774d8e427000a71ea44c"
            },
            "downloads": -1,
            "filename": "invenio_indexer-3.0.0-py2.py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "b59cb2e046d5f7166f0cc79efd80a658",
            "packagetype": "bdist_wheel",
            "python_version": "py2.py3",
            "requires_python": ">=3.7",
            "size": 20626,
            "upload_time": "2024-12-06T07:31:06",
            "upload_time_iso_8601": "2024-12-06T07:31:06.289055Z",
            "url": "https://files.pythonhosted.org/packages/11/e1/59622da06c768b6bd75646c181329a48de912f5eaf6473230e368828f8ef/invenio_indexer-3.0.0-py2.py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "d96496f9f71f10ded3afda366a465b7c7eda41b22c505b297620d8b6c67f3bac",
                "md5": "44411bf8f3073c80d2038b250162e113",
                "sha256": "4c1f1655160573c8abc6a63671d352b89c9ddcc0e8f198976f705f7345c4f37a"
            },
            "downloads": -1,
            "filename": "invenio_indexer-3.0.0.tar.gz",
            "has_sig": false,
            "md5_digest": "44411bf8f3073c80d2038b250162e113",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.7",
            "size": 36480,
            "upload_time": "2024-12-06T07:31:07",
            "upload_time_iso_8601": "2024-12-06T07:31:07.928406Z",
            "url": "https://files.pythonhosted.org/packages/d9/64/96f9f71f10ded3afda366a465b7c7eda41b22c505b297620d8b6c67f3bac/invenio_indexer-3.0.0.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-12-06 07:31:07",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "inveniosoftware",
    "github_project": "invenio-indexer",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "invenio-indexer"
}
        
Elapsed time: 0.50553s