Overview
========
The ZCatalog is Zope's built in search engine. It allows you to categorize
and search all kinds of Zope objects.
It comes with a variety of indexes for different types of data.
Changelog
=========
7.1 (2024-03-21)
----------------
- Add support for Python 3.12.
- Fix TypeError on the Query Report tab.
(`#136 <https://github.com/zopefoundation/Products.ZCatalog/issues/136>`_)
7.0 (2023-03-14)
----------------
- Drop support for Python 2.7, 3.5, 3.6.
- Fix SyntaxError on the Browse tab for DateIndex.
(`#144 <https://github.com/zopefoundation/Products.ZCatalog/issues/144>`_)
6.4 (2022-12-13)
----------------
- Make ``test_getCatalogPlan_partial`` test more stable.
On Mac you would sometimes get a different query plan.
(`#140 <https://github.com/zopefoundation/Products.ZCatalog/issues/140>`_)
6.3 (2022-08-03)
----------------
- Improve performance stability. Fix catalog plan for unused index in a query.
(`#138 <https://github.com/zopefoundation/Products.ZCatalog/pull/138>`_)
- Improve performance stability. Fix catalog plan for not query.
(`#139 <https://github.com/zopefoundation/Products.ZCatalog/pull/139>`_)
6.2 (2022-04-08)
----------------
- Avoid error in search when the parameter received by ``IndexQuery`` is a ``record``.
(`plone/Products.CMFPlone#3007 <https://github.com/plone/Products.CMFPlone/issues/3007>`_)
- Refactored and improved ZMI templates
(`#128 <https://github.com/zopefoundation/Products.ZCatalog/pull/128>`_)
6.1 (2021-11-09)
----------------
- Improve performance of simple ``not`` queries on large catalogs.
(`#124 <https://github.com/zopefoundation/Products.ZCatalog/pull/124>`_)
- Fix case where multiple indexes with similar name separated by ``_``
were interpreted as options.
(`#78 <https://github.com/zopefoundation/Products.ZCatalog/issues/78>`_)
- Fix reversed sorting by multiple index by forcing the
``_sort_iterate_resultset`` sorting method when we have more than one sorting
index.
(`#108 <https://github.com/zopefoundation/Products.ZCatalog/issues/108>`_)
- Add support for Python 3.10.
6.0 (2020-10-08)
----------------
Backwards incompatible changes
++++++++++++++++++++++++++++++
- Remove deprecated ``Products.PluginIndexes.common`` module and ``Products.ZCatalog.Lazy``.
(`#54 <https://github.com/zopefoundation/Products.ZCatalog/issues/54>`_)
- This version is only intend to be used in Zope >= 5.0, although it might
still work on Zope 4.
Features
++++++++
- Add new method ``searchAll`` to perform a search for all documents.
- Add support for Python 3.9.
Changes
+++++++
- Rework request caching to avoid stale cache results in scripts (with
an artificial request).
For details:
`#94 <https://github.com/zopefoundation/Products.ZCatalog/issues/94>`_,
`Plone 5.2 mass migration: bad search results
<https://community.plone.org/t/potential-memory-corruption-during-migration-plone-4-2-5-2/11655/11>`_
Fixes
+++++
- Document ``getAllBrains`` and ``searchAll`` in the interface.
- Update `catalogView.dtml` to changed behavior of empty searches
(`#102 <https://github.com/zopefoundation/Products.ZCatalog/issues/102>`_).
- Fix case where index value is changed to None after previously being indexed.
(`#100 <https://github.com/zopefoundation/Products.ZCatalog/issues/100>`_)
5.1 (2020-04-20)
----------------
- Fix with Python 3.8: Replace deprecated ``time.clock()`` use by
``time.process_time``.
(`#96 <https://github.com/zopefoundation/Products.ZCatalog/issues/96>`_)
- Add support for ``not`` queries in the ``UUIDIndex``
(`#98 <https://github.com/zopefoundation/Products.ZCatalog/issues/98>`_)
5.0.4 (2020-02-11)
------------------
- Fix some ``DocumentTemplate`` imports to prevent DeprecationWarnings
5.0.3 (2020-01-17)
------------------
- Fix exception when viewing `Indexes` tab when Chameleon template
engine is deactivated.
(`#84 <https://github.com/zopefoundation/Products.ZCatalog/issues/84>`_)
5.0.2 (2019-12-06)
------------------
- Fix exception happening when reindexing multiple indexes while having a
progress handler.
(`#89 <https://github.com/zopefoundation/Products.ZCatalog/pull/89>`_)
5.0.1 (2019-06-17)
------------------
- Fix sorting of index overview table in ZMI. Migrated the template from
to zpt.
(`#62 <https://github.com/zopefoundation/Products.ZCatalog/issues/62>`_)
5.0 (2019-05-10)
----------------
Backwards incompatible changes
++++++++++++++++++++++++++++++
- Raise a ``ValueError`` if a query uses invalid index parameters. This
prevents the query from being changed without feedback to the user and
delivering implausible search results.
(`#67 <https://github.com/zopefoundation/Products.ZCatalog/pull/67>`_)
Bug fixes
+++++++++
- Fix rewriting of query to avoid wrong optimization of CompositeIndex.
(`#59 <https://github.com/zopefoundation/Products.ZCatalog/issues/59>`_)
- Consistent use of ``UnIndex._convert`` method to avoid unnecessary
doubling of code.
(`#69 <https://github.com/zopefoundation/Products.ZCatalog/issues/69>`_)
- Fix performance issue of ``valueindexes`` method for catalogs with
many indexed objects
(`#39 <https://github.com/zopefoundation/Products.ZCatalog/issues/39>`_)
- Make sure ``PathIndex._index_object`` removes old index entries
when path of object changes
(`#61 <https://github.com/zopefoundation/Products.ZCatalog/issues/61>`_)
- Code cleanup and completion of TopicIndex according to existing index
methods and properties
(`#65 <https://github.com/zopefoundation/Products.ZCatalog/issues/65>`_)
4.4 (2019-03-08)
----------------
- Make sure WidCode decode handles bytes that were improperly
converted from Python 2 to Python 3.
- Specify supported Python versions using ``python_requires`` in setup.py
(`Zope#481 <https://github.com/zopefoundation/Zope/issues/481>`_)
- Added support for Python 3.8
- Flake8 the code.
4.3 (2019-02-08)
----------------
- Adapt remaining ZMI tabs to Bootstrap
(`#45 <https://github.com/zopefoundation/Products.ZCatalog/issues/45>`_)
- Replace deprecated ``cgi.escape`` with ``html.escape`` for Python 3.
- Fix "invalid escape sequence" warning in Python 3.
4.2 (2018-10-05)
----------------
- Replace ``urllib.quote`` with ``six.moves.urllib.parse.quote``.
Fixes an issue on a ZMI redirect after rebuilding the catalog.
- Adapt the ZMI HTML to the new Bootstrap ZMI.
(`#41 <https://github.com/zopefoundation/Products.ZCatalog/pull/41>`_)
- Fix sorting in _sort_iterate_resultset in Python 3.
(`#42 <https://github.com/zopefoundation/Products.ZCatalog/pull/42>`_)
- Add support for Python 3.7.
- Drop support for Python 3.4.
4.1.1 (2018-07-05)
------------------
- Fix a TypeError on Python 3 when trying to lookup in an OOBTree
a value for a key that has an invalid type.
(`#36 <https://github.com/zopefoundation/Products.ZCatalog/pull/36>`_)
4.1 (2018-03-06)
----------------
- Add new precision property to date and date range indexes.
This lets you index more coarse grained time values instead of the
default one minute based time resolution.
- Add new `getAllBrains` method to the ZCatalog, returning a generator
of brains for all cataloged objects. You can use this if you relied
on `searchResults` returning all brains for empty queries before
version 4.0a2.
- Fix logging issue in KeywordIndex.
4.0.1 (2017-10-10)
------------------
- Fix a bug in the BooleanIndex where documents without an entry in
the index were not being filtered out in all queries.
- More PEP8 compliance.
4.0.0 (2017-05-23)
------------------
- Python 3 compatibility
- Target use with Zope 4: no longer support 2.13.x.
- `five.globalrequest` got merged into Zope2 itself.
- Use aq_inner before aq_parent at some places to safely get the parent.
4.0a3 (2017-02-02)
------------------
- #19: Fix stale cache results after clearing an index.
- Use `@implementer` class decorator.
- Add `__contains__` method to ZCatalogIndexes, fixes zopefoundation/Zope#69.
- Raise BadRequest instead of returning MessageDialog.
4.0a2 (2016-08-28)
------------------
- Move PluginIndexes.common.UnIndex module to PluginIndexes.unindex.
- Remove unused `Products.PluginIndexes.common.ResultList` and
`randid` modules.
- Merge in the ZCTextIndex code.
- Extend IQueryIndex interface to handle operator parsing.
- Add new IQueryIndex interface for indices. This introduces a new
`query_index` method on each index with a simplified contract compared
to `_apply_index`. The responsibility for parsing and skipping the query
has moved into the catalog, and the return value no longer has to be
a tuple of (result, used_attributes), as the later wasn't used by the
catalog.
- Rename `parseIndexRequest` to `IndexQuery` and move it to `ZCatalog.query`.
- Remove unused ZMI icons.
- Remove deprecated Catalog(Path)Awareness modules.
- Remove CatalogSearchArgumentsMap and support for using requests
objects as queries.
- Empty catalog queries now return no results.
- No longer special-case empty strings in catalog queries.
- Add new CompositeIndex index type.
4.0a1 (2016-07-22)
------------------
- Moved `Products.ZCatalog.Lazy` module to `ZTUtils.Lazy`.
- Add configure.zcml with deprecatedManageAddDelete directives.
3.2 (2016-07-18)
----------------
- #12: Add request cache for index results to all UnIndex subclasses.
- Add dependency on `five.globalrequest`.
3.1.2 (2016-07-17)
------------------
- #6, #7, #11: Run ZODB cache garbage collection during queries.
- #13: Deal with threshold value of None in add/delColum.
3.1.1 (2016-07-17)
------------------
- Make index-listing compatible with Zope 4.
- #5: Ignore None values in UnIndex instead of raising a TypeError.
- Add a new getCounter method to indices.
- Update to ZODB 4.0 as direct dependency.
3.1 (2014-11-02)
----------------
- Raise a TypeError when trying to index or lookup `None` in an UnIndex.
This is a required change for BTrees 4.0+ compatibility, which prevents
objects without a clear ordering definition from being inserted in a tree.
- No longer try to insert a None value into a field index in tests.
3.0.2 (2014-03-04)
------------------
- Restore ability for indexes to use extra query params.
See PR #1.
- Change `CatalogPlan.valueindexes` to avoid using a `len()` call on the
result of each index `uniqueValues` method. This was loading entire BTrees
into memory and caused excessive database load on startup.
- Correct `withLengths` argument name on `PathIndex.uniqueValues` to use
plural form, adhering to the interface specification.
- Clarify the `IUniqueValueIndex.uniqueValues` method description and
explicitly mention generators/iterators as potential return values.
The PathIndex was one example returning a generator for some time.
- Adjust `actual_result_count` for sorted queries where the sort index doesn't
contain all the documents. Fixes LP #1237141.
- Restore safeguard for using the `iterate over sort index` case and avoid
it while using limiting at the same time. Fixes LP #1236790.
3.0.1 (2013-10-15)
------------------
- Fix BooleanIndex when index inversion occurs as a result of reindexing
and existing document with the opposite value. Fixes LP #1236354.
3.0 (2013-02-24)
------------------
- Strip white space from name when adding a column or index.
- Forward compatibility for Zope 4 removal of RequestContainer.
- Optimize brain instantiation, by creating underlying record items in a
single step, instead of creation and three update calls.
3.0b1 (2012-07-19)
------------------
- LP #727981: Fix DateIndex ZMI browsing for dates in the first month of a
year.
- Unify Unindex and DateIndex search logic (`_apply_index`) adding `not`
support to DateIndexes.
3.0a2 (2012-04-26)
------------------
- Fixed another issue with preserving score values, when a custom index was
queried first which was neither ILimitedResultIndex aware nor return scores,
and a later index was of the default ZCTextIndex type.
3.0a1 (2012-04-22)
------------------
- Expand query report, to cover details on sort indexes, order and limits.
- As part of each progress handler report, also do an automatic transaction
savepoint, to give the ZODB cache a chance to do garbage collection.
- Added a `threshold` argument to the catalog's `addColumn` and `delColumn`
methods and used it for a progress handler. Also optimized some of their
internals.
- Added support for `sort_on` queries with any number of sort indexes and
differing `sort_order` values. For example:
`{'foo': 'a', 'sort_on': ('foo', 'bar')}`
`{'foo': 'a', 'sort_on': ('foo', 'bar'), 'sort_order': ('', 'reverse')}`
`{'foo': 'a', 'sort_on': ('foo', 'bar', 'baz')}`
- Added support for `not` queries in field and keyword indexes. Both
restrictions of normal queries and range queries are supported, as well as
purely exclusive queries. For example:
`{'foo': {'query': ['a', 'ab'], 'not': 'a'}}`
`{'foo': {'query': 'a', 'range': 'min', 'not': ['a', 'e', 'f']}}`
`{'foo': {'not': ['a', 'b']}}`.
Note that negative filtering on an index still restricts items to those
having a value in the index. So with 10 documents, 5 of them in the `foo`
index with a value of `1`, a query for `not 1` will return no items instead
of the 5 items without a value. You need to index a dummy/default value if
you want to consider all items for a particular index.
- Updated deprecation warnings to point to Zope 4 instead of 2.14.
2.13.22 (2011-11-17)
--------------------
- Added a new `load_from_path` class method to the `PriorityMap`, which allows
one to load a plan from a file, instead of a module via an environment var.
2.13.21 (2011-10-20)
--------------------
- Refactored value index logic. Determine value indexes per catalog instead of
globally. Store value index set in the priority map, so it can be seen in the
ZMI and stored in the module level storage.
- Added support for using ZCatalog as local utility.
This feature requires the optional `five.globalrequest` dependency.
2.13.20 (2011-08-23)
--------------------
- Fixed incorrect calculation of batches in the second half of the result set
in sortResults.
2.13.19 (2011-08-20)
--------------------
- Increase plan precision to 4 digits in its string representation.
2.13.18 (2011-07-29)
--------------------
- In the string representation of a catalog plan, round the times to at most
two digits after the comma.
2.13.17 (2011-07-29)
--------------------
- Put back the `weightedIntersection` optimization but guard against results
with values and do the appropriate fallback to the weighted version.
2.13.16 (2011-07-24)
--------------------
- Restored preserving score values from ZCTextIndex indices.
https://bugs.launchpad.net/zope2/+bug/815469
2.13.15 (2011-06-30)
--------------------
- Fixed undefined variables in BooleanIndex inline migration code.
- Fixed BooleanIndex' items method so the ZMI browse view works.
2.13.14 (2011-05-19)
--------------------
- Fixed addition of two LazyCat's if any of them was already flattened.
- Extend BooleanIndex by making the indexed value variable instead of
hardcoding it to `True`. The indexed value will determine the smaller set
automatically and choose its best value. An inline switch is done once the
indexed value set grows larger than 60% of the total length. 60% was chosen
to avoid constant switching for indexes that have an almost equal
distribution of `True/False`.
- Substitute catalog entry in UUIDIndex error message.
2.13.13 (2011-05-04)
--------------------
- Optimize `Catalog.updateMetadata` avoiding a `self.uids` lookup and removing
inline migration code for converting `self.data` from non-IOBTree types.
- In the path index, don't update data if the value hasn't changed.
2.13.12 (2011-05-02)
--------------------
- Optimize DateRangeIndex for better conflict resolution handling. It always
starts out with storing an IITreeSet of the value instead of special casing
storing an int for a single value. The `single value as int` optimization
should be provided via a separate API to be called periodically outside the
context of a normal request.
- Replaced `weightedIntersection` and `weightedUnion` calls with their
non-weighted version, as we didn't pass in weights.
2.13.11 (2011-05-02)
--------------------
- Fix possible TypeError in `sortResults` method if only b_start but not b_size
has been provided.
- Prevent the new UUIDIndex from acquiring attributes via Acquisition.
2.13.10 (2011-04-21)
--------------------
- Handle `TypeErrors` in the KeywordIndex if an indexed attribute is a method
with required arguments.
- Added reporting of the intersection time of each index' result with the
result set of the other indexes and consider this time to be part of each
index time for prioritizing the index.
- Removed tracking of result length from the query plan. The calculation of the
length of an intermediate index result can itself be expensive.
2.13.9 (2011-04-10)
-------------------
- Added a floor and ceiling value to the date range index. Values outside the
specified range will be interpreted the same way as passing `None`, i.e.
`since the beginning of time` and `until the end of it`. This allows the
index to apply its optimizations, while objects with values outside this
range can still be stored in a normal date index, which omits explicitly
passed in `None` values.
2.13.8 (2011-04-01)
-------------------
- Fixed bug in date range index, which would omit objects exactly matching the
query term if a resultset was provided.
- Fixed the BooleanIndex to not index objects without the cataloged attribute.
2.13.7 (2011-02-15)
-------------------
- Fixed the `DateIndex._unindex` to be of type `IIBTree` instead of `OIBTree`.
It stores document ids as keys, which can only be ints.
2.13.6 (2011-02-10)
-------------------
- Remove docstrings from various methods, as they shouldn't be web-publishable.
2.13.5 (2011-02-05)
-------------------
- Fixed test failures introduced in 2.13.4.
2.13.4 (2011-02-05)
-------------------
- Added a new UUIDIndex, based on the common UnIndex. It behaves like a
FieldIndex, but can only store one document id per value, so there's a 1:1
mapping from value to document id. An error is logged if a different document
id is indexed for an already taken value. The internal data structures are
optimized for this and avoid storing one IITreeSet per value.
- Optimize sorting in presence of batching arguments. If a batch from the end
of the result set is requested, we internally reverse the sorting order and
at the end reverse the lazy sequence again. In a sequence with 100 entries,
if we request the batch with items 80 to 90, we now reverse sort 20 items
(100 to 80), slice of the first ten items and then reverse them. Before we
would had to sort the first 90 items and then slice of the last 10.
- If batching arguments are provided, limit the returned lazy sequence to the
items in the required batch instead of returning leading items falling
outside of the requested batch.
- Fixed inline `IISet` to `IITreeSet` conversion code inside DateRangeIndex'
`_insertForwardIndexEntry` method.
2.13.3 (2011-01-01)
-------------------
- Avoid locale-dependent test condition in `test_length_with_filter`.
2.13.2 (2010-12-31)
-------------------
- Preserve `actual_result_count` on flattening nested LazyCat's.
- Preserve the `actual_result_count` on all lazy return values. This allows
to get proper batching information from catalog results which have been
restricted by `sort_limit`.
- Made sure `actual_result_count` is available on all lazy classes and falls
back to `__len__` if not explicitly provided.
- Optimized length calculation of Lazy classes.
2.13.1 (2010-12-25)
-------------------
- Added automatic sorting limit calculation based on batch arguments. If the
query contains a `b_start` and `b_size` argument and no explicit `sort_limit`
is provided, the sort limit will be calculated as `b_start + b_size`.
- Avoid pre-allocation of marker items in `LazyMap`.
2.13.0 (2010-12-25)
-------------------
- Fix `LazyMap` to avoid unnecessary function calls.
- Released as separate distribution.
Raw data
{
"_id": null,
"home_page": "https://github.com/zopefoundation/Products.ZCatalog",
"name": "Products.ZCatalog",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.7",
"maintainer_email": null,
"keywords": "Zope catalog index search data",
"author": "Zope Foundation and Contributors",
"author_email": "zope-dev@zope.dev",
"download_url": "https://files.pythonhosted.org/packages/96/82/c5900030cdd313c8ee2a0f75f179b309eef6dcd41ec6b49e7d34171c3f79/Products.ZCatalog-7.1.tar.gz",
"platform": null,
"description": "Overview\n========\n\nThe ZCatalog is Zope's built in search engine. It allows you to categorize\nand search all kinds of Zope objects.\n\nIt comes with a variety of indexes for different types of data.\n\nChangelog\n=========\n\n7.1 (2024-03-21)\n----------------\n\n- Add support for Python 3.12.\n\n- Fix TypeError on the Query Report tab.\n (`#136 <https://github.com/zopefoundation/Products.ZCatalog/issues/136>`_)\n\n\n7.0 (2023-03-14)\n----------------\n\n- Drop support for Python 2.7, 3.5, 3.6.\n\n- Fix SyntaxError on the Browse tab for DateIndex.\n (`#144 <https://github.com/zopefoundation/Products.ZCatalog/issues/144>`_)\n\n\n6.4 (2022-12-13)\n----------------\n\n- Make ``test_getCatalogPlan_partial`` test more stable.\n On Mac you would sometimes get a different query plan.\n (`#140 <https://github.com/zopefoundation/Products.ZCatalog/issues/140>`_)\n\n\n6.3 (2022-08-03)\n----------------\n\n- Improve performance stability. Fix catalog plan for unused index in a query.\n (`#138 <https://github.com/zopefoundation/Products.ZCatalog/pull/138>`_)\n\n- Improve performance stability. Fix catalog plan for not query.\n (`#139 <https://github.com/zopefoundation/Products.ZCatalog/pull/139>`_)\n\n\n6.2 (2022-04-08)\n----------------\n\n- Avoid error in search when the parameter received by ``IndexQuery`` is a ``record``.\n (`plone/Products.CMFPlone#3007 <https://github.com/plone/Products.CMFPlone/issues/3007>`_)\n\n- Refactored and improved ZMI templates\n (`#128 <https://github.com/zopefoundation/Products.ZCatalog/pull/128>`_)\n\n\n6.1 (2021-11-09)\n----------------\n\n- Improve performance of simple ``not`` queries on large catalogs.\n (`#124 <https://github.com/zopefoundation/Products.ZCatalog/pull/124>`_)\n\n- Fix case where multiple indexes with similar name separated by ``_``\n were interpreted as options.\n (`#78 <https://github.com/zopefoundation/Products.ZCatalog/issues/78>`_)\n\n- Fix reversed sorting by multiple index by forcing the\n ``_sort_iterate_resultset`` sorting method when we have more than one sorting\n index.\n (`#108 <https://github.com/zopefoundation/Products.ZCatalog/issues/108>`_)\n\n- Add support for Python 3.10.\n\n\n6.0 (2020-10-08)\n----------------\n\nBackwards incompatible changes\n++++++++++++++++++++++++++++++\n\n- Remove deprecated ``Products.PluginIndexes.common`` module and ``Products.ZCatalog.Lazy``.\n (`#54 <https://github.com/zopefoundation/Products.ZCatalog/issues/54>`_)\n\n- This version is only intend to be used in Zope >= 5.0, although it might\n still work on Zope 4.\n\nFeatures\n++++++++\n\n- Add new method ``searchAll`` to perform a search for all documents.\n\n- Add support for Python 3.9.\n\nChanges\n+++++++\n\n- Rework request caching to avoid stale cache results in scripts (with\n an artificial request).\n For details:\n `#94 <https://github.com/zopefoundation/Products.ZCatalog/issues/94>`_,\n `Plone 5.2 mass migration: bad search results\n <https://community.plone.org/t/potential-memory-corruption-during-migration-plone-4-2-5-2/11655/11>`_\n\nFixes\n+++++\n\n- Document ``getAllBrains`` and ``searchAll`` in the interface.\n\n- Update `catalogView.dtml` to changed behavior of empty searches\n (`#102 <https://github.com/zopefoundation/Products.ZCatalog/issues/102>`_).\n\n- Fix case where index value is changed to None after previously being indexed.\n (`#100 <https://github.com/zopefoundation/Products.ZCatalog/issues/100>`_)\n\n\n5.1 (2020-04-20)\n----------------\n\n- Fix with Python 3.8: Replace deprecated ``time.clock()`` use by\n ``time.process_time``.\n (`#96 <https://github.com/zopefoundation/Products.ZCatalog/issues/96>`_)\n\n- Add support for ``not`` queries in the ``UUIDIndex``\n (`#98 <https://github.com/zopefoundation/Products.ZCatalog/issues/98>`_)\n\n5.0.4 (2020-02-11)\n------------------\n\n- Fix some ``DocumentTemplate`` imports to prevent DeprecationWarnings\n\n\n5.0.3 (2020-01-17)\n------------------\n\n- Fix exception when viewing `Indexes` tab when Chameleon template\n engine is deactivated.\n (`#84 <https://github.com/zopefoundation/Products.ZCatalog/issues/84>`_)\n\n\n5.0.2 (2019-12-06)\n------------------\n\n- Fix exception happening when reindexing multiple indexes while having a\n progress handler.\n (`#89 <https://github.com/zopefoundation/Products.ZCatalog/pull/89>`_)\n\n\n5.0.1 (2019-06-17)\n------------------\n\n- Fix sorting of index overview table in ZMI. Migrated the template from\n to zpt.\n (`#62 <https://github.com/zopefoundation/Products.ZCatalog/issues/62>`_)\n\n\n5.0 (2019-05-10)\n----------------\n\nBackwards incompatible changes\n++++++++++++++++++++++++++++++\n\n- Raise a ``ValueError`` if a query uses invalid index parameters. This\n prevents the query from being changed without feedback to the user and\n delivering implausible search results.\n (`#67 <https://github.com/zopefoundation/Products.ZCatalog/pull/67>`_)\n\nBug fixes\n+++++++++\n\n- Fix rewriting of query to avoid wrong optimization of CompositeIndex.\n (`#59 <https://github.com/zopefoundation/Products.ZCatalog/issues/59>`_)\n\n- Consistent use of ``UnIndex._convert`` method to avoid unnecessary\n doubling of code.\n (`#69 <https://github.com/zopefoundation/Products.ZCatalog/issues/69>`_)\n\n- Fix performance issue of ``valueindexes`` method for catalogs with\n many indexed objects\n (`#39 <https://github.com/zopefoundation/Products.ZCatalog/issues/39>`_)\n\n- Make sure ``PathIndex._index_object`` removes old index entries\n when path of object changes\n (`#61 <https://github.com/zopefoundation/Products.ZCatalog/issues/61>`_)\n\n- Code cleanup and completion of TopicIndex according to existing index\n methods and properties\n (`#65 <https://github.com/zopefoundation/Products.ZCatalog/issues/65>`_)\n\n\n4.4 (2019-03-08)\n----------------\n\n- Make sure WidCode decode handles bytes that were improperly\n converted from Python 2 to Python 3.\n\n- Specify supported Python versions using ``python_requires`` in setup.py\n (`Zope#481 <https://github.com/zopefoundation/Zope/issues/481>`_)\n\n- Added support for Python 3.8\n\n- Flake8 the code.\n\n\n4.3 (2019-02-08)\n----------------\n\n- Adapt remaining ZMI tabs to Bootstrap\n (`#45 <https://github.com/zopefoundation/Products.ZCatalog/issues/45>`_)\n\n- Replace deprecated ``cgi.escape`` with ``html.escape`` for Python 3.\n\n- Fix \"invalid escape sequence\" warning in Python 3.\n\n\n4.2 (2018-10-05)\n----------------\n\n- Replace ``urllib.quote`` with ``six.moves.urllib.parse.quote``.\n Fixes an issue on a ZMI redirect after rebuilding the catalog.\n\n- Adapt the ZMI HTML to the new Bootstrap ZMI.\n (`#41 <https://github.com/zopefoundation/Products.ZCatalog/pull/41>`_)\n\n- Fix sorting in _sort_iterate_resultset in Python 3.\n (`#42 <https://github.com/zopefoundation/Products.ZCatalog/pull/42>`_)\n\n- Add support for Python 3.7.\n\n- Drop support for Python 3.4.\n\n\n4.1.1 (2018-07-05)\n------------------\n\n- Fix a TypeError on Python 3 when trying to lookup in an OOBTree\n a value for a key that has an invalid type.\n (`#36 <https://github.com/zopefoundation/Products.ZCatalog/pull/36>`_)\n\n\n4.1 (2018-03-06)\n----------------\n\n- Add new precision property to date and date range indexes.\n This lets you index more coarse grained time values instead of the\n default one minute based time resolution.\n\n- Add new `getAllBrains` method to the ZCatalog, returning a generator\n of brains for all cataloged objects. You can use this if you relied\n on `searchResults` returning all brains for empty queries before\n version 4.0a2.\n\n- Fix logging issue in KeywordIndex.\n\n4.0.1 (2017-10-10)\n------------------\n\n- Fix a bug in the BooleanIndex where documents without an entry in\n the index were not being filtered out in all queries.\n\n- More PEP8 compliance.\n\n4.0.0 (2017-05-23)\n------------------\n\n- Python 3 compatibility\n\n- Target use with Zope 4: no longer support 2.13.x.\n\n- `five.globalrequest` got merged into Zope2 itself.\n\n- Use aq_inner before aq_parent at some places to safely get the parent.\n\n4.0a3 (2017-02-02)\n------------------\n\n- #19: Fix stale cache results after clearing an index.\n\n- Use `@implementer` class decorator.\n\n- Add `__contains__` method to ZCatalogIndexes, fixes zopefoundation/Zope#69.\n\n- Raise BadRequest instead of returning MessageDialog.\n\n4.0a2 (2016-08-28)\n------------------\n\n- Move PluginIndexes.common.UnIndex module to PluginIndexes.unindex.\n\n- Remove unused `Products.PluginIndexes.common.ResultList` and\n `randid` modules.\n\n- Merge in the ZCTextIndex code.\n\n- Extend IQueryIndex interface to handle operator parsing.\n\n- Add new IQueryIndex interface for indices. This introduces a new\n `query_index` method on each index with a simplified contract compared\n to `_apply_index`. The responsibility for parsing and skipping the query\n has moved into the catalog, and the return value no longer has to be\n a tuple of (result, used_attributes), as the later wasn't used by the\n catalog.\n\n- Rename `parseIndexRequest` to `IndexQuery` and move it to `ZCatalog.query`.\n\n- Remove unused ZMI icons.\n\n- Remove deprecated Catalog(Path)Awareness modules.\n\n- Remove CatalogSearchArgumentsMap and support for using requests\n objects as queries.\n\n- Empty catalog queries now return no results.\n\n- No longer special-case empty strings in catalog queries.\n\n- Add new CompositeIndex index type.\n\n4.0a1 (2016-07-22)\n------------------\n\n- Moved `Products.ZCatalog.Lazy` module to `ZTUtils.Lazy`.\n\n- Add configure.zcml with deprecatedManageAddDelete directives.\n\n3.2 (2016-07-18)\n----------------\n\n- #12: Add request cache for index results to all UnIndex subclasses.\n\n- Add dependency on `five.globalrequest`.\n\n3.1.2 (2016-07-17)\n------------------\n\n- #6, #7, #11: Run ZODB cache garbage collection during queries.\n\n- #13: Deal with threshold value of None in add/delColum.\n\n3.1.1 (2016-07-17)\n------------------\n\n- Make index-listing compatible with Zope 4.\n\n- #5: Ignore None values in UnIndex instead of raising a TypeError.\n\n- Add a new getCounter method to indices.\n\n- Update to ZODB 4.0 as direct dependency.\n\n3.1 (2014-11-02)\n----------------\n\n- Raise a TypeError when trying to index or lookup `None` in an UnIndex.\n This is a required change for BTrees 4.0+ compatibility, which prevents\n objects without a clear ordering definition from being inserted in a tree.\n\n- No longer try to insert a None value into a field index in tests.\n\n3.0.2 (2014-03-04)\n------------------\n\n- Restore ability for indexes to use extra query params.\n See PR #1.\n\n- Change `CatalogPlan.valueindexes` to avoid using a `len()` call on the\n result of each index `uniqueValues` method. This was loading entire BTrees\n into memory and caused excessive database load on startup.\n\n- Correct `withLengths` argument name on `PathIndex.uniqueValues` to use\n plural form, adhering to the interface specification.\n\n- Clarify the `IUniqueValueIndex.uniqueValues` method description and\n explicitly mention generators/iterators as potential return values.\n The PathIndex was one example returning a generator for some time.\n\n- Adjust `actual_result_count` for sorted queries where the sort index doesn't\n contain all the documents. Fixes LP #1237141.\n\n- Restore safeguard for using the `iterate over sort index` case and avoid\n it while using limiting at the same time. Fixes LP #1236790.\n\n3.0.1 (2013-10-15)\n------------------\n\n- Fix BooleanIndex when index inversion occurs as a result of reindexing\n and existing document with the opposite value. Fixes LP\u00a0#1236354.\n\n3.0 (2013-02-24)\n------------------\n\n- Strip white space from name when adding a column or index.\n\n- Forward compatibility for Zope 4 removal of RequestContainer.\n\n- Optimize brain instantiation, by creating underlying record items in a\n single step, instead of creation and three update calls.\n\n3.0b1 (2012-07-19)\n------------------\n\n- LP #727981: Fix DateIndex ZMI browsing for dates in the first month of a\n year.\n\n- Unify Unindex and DateIndex search logic (`_apply_index`) adding `not`\n support to DateIndexes.\n\n3.0a2 (2012-04-26)\n------------------\n\n- Fixed another issue with preserving score values, when a custom index was\n queried first which was neither ILimitedResultIndex aware nor return scores,\n and a later index was of the default ZCTextIndex type.\n\n3.0a1 (2012-04-22)\n------------------\n\n- Expand query report, to cover details on sort indexes, order and limits.\n\n- As part of each progress handler report, also do an automatic transaction\n savepoint, to give the ZODB cache a chance to do garbage collection.\n\n- Added a `threshold` argument to the catalog's `addColumn` and `delColumn`\n methods and used it for a progress handler. Also optimized some of their\n internals.\n\n- Added support for `sort_on` queries with any number of sort indexes and\n differing `sort_order` values. For example:\n `{'foo': 'a', 'sort_on': ('foo', 'bar')}`\n `{'foo': 'a', 'sort_on': ('foo', 'bar'), 'sort_order': ('', 'reverse')}`\n `{'foo': 'a', 'sort_on': ('foo', 'bar', 'baz')}`\n\n- Added support for `not` queries in field and keyword indexes. Both\n restrictions of normal queries and range queries are supported, as well as\n purely exclusive queries. For example:\n `{'foo': {'query': ['a', 'ab'], 'not': 'a'}}`\n `{'foo': {'query': 'a', 'range': 'min', 'not': ['a', 'e', 'f']}}`\n `{'foo': {'not': ['a', 'b']}}`.\n Note that negative filtering on an index still restricts items to those\n having a value in the index. So with 10 documents, 5 of them in the `foo`\n index with a value of `1`, a query for `not 1` will return no items instead\n of the 5 items without a value. You need to index a dummy/default value if\n you want to consider all items for a particular index.\n\n- Updated deprecation warnings to point to Zope 4 instead of 2.14.\n\n2.13.22 (2011-11-17)\n--------------------\n\n- Added a new `load_from_path` class method to the `PriorityMap`, which allows\n one to load a plan from a file, instead of a module via an environment var.\n\n2.13.21 (2011-10-20)\n--------------------\n\n- Refactored value index logic. Determine value indexes per catalog instead of\n globally. Store value index set in the priority map, so it can be seen in the\n ZMI and stored in the module level storage.\n\n- Added support for using ZCatalog as local utility.\n This feature requires the optional `five.globalrequest` dependency.\n\n2.13.20 (2011-08-23)\n--------------------\n\n- Fixed incorrect calculation of batches in the second half of the result set\n in sortResults.\n\n2.13.19 (2011-08-20)\n--------------------\n\n- Increase plan precision to 4 digits in its string representation.\n\n2.13.18 (2011-07-29)\n--------------------\n\n- In the string representation of a catalog plan, round the times to at most\n two digits after the comma.\n\n2.13.17 (2011-07-29)\n--------------------\n\n- Put back the `weightedIntersection` optimization but guard against results\n with values and do the appropriate fallback to the weighted version.\n\n2.13.16 (2011-07-24)\n--------------------\n\n- Restored preserving score values from ZCTextIndex indices.\n https://bugs.launchpad.net/zope2/+bug/815469\n\n2.13.15 (2011-06-30)\n--------------------\n\n- Fixed undefined variables in BooleanIndex inline migration code.\n\n- Fixed BooleanIndex' items method so the ZMI browse view works.\n\n2.13.14 (2011-05-19)\n--------------------\n\n- Fixed addition of two LazyCat's if any of them was already flattened.\n\n- Extend BooleanIndex by making the indexed value variable instead of\n hardcoding it to `True`. The indexed value will determine the smaller set\n automatically and choose its best value. An inline switch is done once the\n indexed value set grows larger than 60% of the total length. 60% was chosen\n to avoid constant switching for indexes that have an almost equal\n distribution of `True/False`.\n\n- Substitute catalog entry in UUIDIndex error message.\n\n2.13.13 (2011-05-04)\n--------------------\n\n- Optimize `Catalog.updateMetadata` avoiding a `self.uids` lookup and removing\n inline migration code for converting `self.data` from non-IOBTree types.\n\n- In the path index, don't update data if the value hasn't changed.\n\n2.13.12 (2011-05-02)\n--------------------\n\n- Optimize DateRangeIndex for better conflict resolution handling. It always\n starts out with storing an IITreeSet of the value instead of special casing\n storing an int for a single value. The `single value as int` optimization\n should be provided via a separate API to be called periodically outside the\n context of a normal request.\n\n- Replaced `weightedIntersection` and `weightedUnion` calls with their\n non-weighted version, as we didn't pass in weights.\n\n2.13.11 (2011-05-02)\n--------------------\n\n- Fix possible TypeError in `sortResults` method if only b_start but not b_size\n has been provided.\n\n- Prevent the new UUIDIndex from acquiring attributes via Acquisition.\n\n2.13.10 (2011-04-21)\n--------------------\n\n- Handle `TypeErrors` in the KeywordIndex if an indexed attribute is a method\n with required arguments.\n\n- Added reporting of the intersection time of each index' result with the\n result set of the other indexes and consider this time to be part of each\n index time for prioritizing the index.\n\n- Removed tracking of result length from the query plan. The calculation of the\n length of an intermediate index result can itself be expensive.\n\n2.13.9 (2011-04-10)\n-------------------\n\n- Added a floor and ceiling value to the date range index. Values outside the\n specified range will be interpreted the same way as passing `None`, i.e.\n `since the beginning of time` and `until the end of it`. This allows the\n index to apply its optimizations, while objects with values outside this\n range can still be stored in a normal date index, which omits explicitly\n passed in `None` values.\n\n2.13.8 (2011-04-01)\n-------------------\n\n- Fixed bug in date range index, which would omit objects exactly matching the\n query term if a resultset was provided.\n\n- Fixed the BooleanIndex to not index objects without the cataloged attribute.\n\n2.13.7 (2011-02-15)\n-------------------\n\n- Fixed the `DateIndex._unindex` to be of type `IIBTree` instead of `OIBTree`.\n It stores document ids as keys, which can only be ints.\n\n2.13.6 (2011-02-10)\n-------------------\n\n- Remove docstrings from various methods, as they shouldn't be web-publishable.\n\n2.13.5 (2011-02-05)\n-------------------\n\n- Fixed test failures introduced in 2.13.4.\n\n2.13.4 (2011-02-05)\n-------------------\n\n- Added a new UUIDIndex, based on the common UnIndex. It behaves like a\n FieldIndex, but can only store one document id per value, so there's a 1:1\n mapping from value to document id. An error is logged if a different document\n id is indexed for an already taken value. The internal data structures are\n optimized for this and avoid storing one IITreeSet per value.\n\n- Optimize sorting in presence of batching arguments. If a batch from the end\n of the result set is requested, we internally reverse the sorting order and\n at the end reverse the lazy sequence again. In a sequence with 100 entries,\n if we request the batch with items 80 to 90, we now reverse sort 20 items\n (100 to 80), slice of the first ten items and then reverse them. Before we\n would had to sort the first 90 items and then slice of the last 10.\n\n- If batching arguments are provided, limit the returned lazy sequence to the\n items in the required batch instead of returning leading items falling\n outside of the requested batch.\n\n- Fixed inline `IISet` to `IITreeSet` conversion code inside DateRangeIndex'\n `_insertForwardIndexEntry` method.\n\n2.13.3 (2011-01-01)\n-------------------\n\n- Avoid locale-dependent test condition in `test_length_with_filter`.\n\n2.13.2 (2010-12-31)\n-------------------\n\n- Preserve `actual_result_count` on flattening nested LazyCat's.\n\n- Preserve the `actual_result_count` on all lazy return values. This allows\n to get proper batching information from catalog results which have been\n restricted by `sort_limit`.\n\n- Made sure `actual_result_count` is available on all lazy classes and falls\n back to `__len__` if not explicitly provided.\n\n- Optimized length calculation of Lazy classes.\n\n2.13.1 (2010-12-25)\n-------------------\n\n- Added automatic sorting limit calculation based on batch arguments. If the\n query contains a `b_start` and `b_size` argument and no explicit `sort_limit`\n is provided, the sort limit will be calculated as `b_start + b_size`.\n\n- Avoid pre-allocation of marker items in `LazyMap`.\n\n2.13.0 (2010-12-25)\n-------------------\n\n- Fix `LazyMap` to avoid unnecessary function calls.\n\n- Released as separate distribution.\n",
"bugtrack_url": null,
"license": "ZPL 2.1",
"summary": "Zope's indexing and search solution.",
"version": "7.1",
"project_urls": {
"Homepage": "https://github.com/zopefoundation/Products.ZCatalog",
"Issue Tracker": "https://github.com/zopefoundation/Products.ZCatalog/issues",
"Sources": "https://github.com/zopefoundation/Products.ZCatalog"
},
"split_keywords": [
"zope",
"catalog",
"index",
"search",
"data"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "127d541a4737b73ef1affb7cabf80cffea830e3dd52b76e101826d8bd2e14f7b",
"md5": "3fec600d93d400fbfe3e641ee5181631",
"sha256": "6c8612c4a7500517f47d690f764e554da8aeac097b9b1de511cd9ca401b46245"
},
"downloads": -1,
"filename": "Products.ZCatalog-7.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "3fec600d93d400fbfe3e641ee5181631",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.7",
"size": 230481,
"upload_time": "2024-03-21T07:19:37",
"upload_time_iso_8601": "2024-03-21T07:19:37.594072Z",
"url": "https://files.pythonhosted.org/packages/12/7d/541a4737b73ef1affb7cabf80cffea830e3dd52b76e101826d8bd2e14f7b/Products.ZCatalog-7.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "9682c5900030cdd313c8ee2a0f75f179b309eef6dcd41ec6b49e7d34171c3f79",
"md5": "7297fb8d7d74b835a1c0b0db3d4440e4",
"sha256": "e14088123e1da571c510bfa563b2a8e1738dbf4007bb5883daf0e668e0231ab7"
},
"downloads": -1,
"filename": "Products.ZCatalog-7.1.tar.gz",
"has_sig": false,
"md5_digest": "7297fb8d7d74b835a1c0b0db3d4440e4",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.7",
"size": 183168,
"upload_time": "2024-03-21T07:19:41",
"upload_time_iso_8601": "2024-03-21T07:19:41.432601Z",
"url": "https://files.pythonhosted.org/packages/96/82/c5900030cdd313c8ee2a0f75f179b309eef6dcd41ec6b49e7d34171c3f79/Products.ZCatalog-7.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-03-21 07:19:41",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "zopefoundation",
"github_project": "Products.ZCatalog",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"tox": true,
"lcname": "products.zcatalog"
}
JSON
