# Development moved to ArcticDB GitHub Repository
This repository and project are now in maintenance mode. Development has migrated to [ArcticDB](https://github.com/man-group/ArcticDB).
---
Information on how to set up, install and use Arctic has been moved to [README-arctic.md](README-arctic.md).
## Changelog
### 1.82.1 (2023-10-09)
* Release: #1014 Prepare release 1.82.1
* Bugfix: #1013 Fix serialized tz name for index timezones of dateutil.timezone.tzutc()
* Bugfix: #1013 Fix serialized tz name for single-level index timezones of dateutil.timezone.gettz("UTC")
### 1.82.0 (2023-07-24)
* Release: #1012 version 1.82.0
* Compatibility: update pinning from pandas<1.1, to pandas<2
* Compatibility: update pinning from numpy<1.19 to numpy<2
* Build: specify which version of python/numpy/pandas to test
* Bugfix: #887 #928 resolve import error on pandas.Panel, Panel was removed in pandas 1.0
* Bugfix: fix pandas get_timezone() argument cannot be None
* Bugfix: fix np.float/np.int/np.book depreciations
* Bugfix: fix numpy tostring() is deprecated. Use tobytes() instead.
* Bugfix: numpy.testing.utils is deprecated
* Bugfix: pandas.util.testing is deprecated
* Cleanup: remove async_benchmark
### 1.81.2 (2023-05-11)
* Feature: #1000, #1001, #1002, #1003, #1007, #1008 ArcticDB docs, links etc
* Bugfix: #1009 force CircleCI to install tzlocal==4.2
### 1.81.1 (2023-03-13)
* Feature: #996 release wheel to pypi as well as tar.gz, egg.
### 1.81.0 (2023-03-10)
* Bugfix: #979 fix circleci mongo install
* Feature: #980 get testpack running with mongod 4.4.18
* Bugfix: #985 suppress FutureWarning for Panel import
* Bugfix: #989 VersionStore slow snapshot delete add new index
* Bugfix: #806, #990 DateTimeIndex tz serialization
### 1.80.5 (2022-09-05)
* Feature: #950 remove all traces of python 2.7 and six package
* Feature: #959 add python 3.8 support
* Feature: #962 pin pandas<1.1.0, numpy<1.19.0
### 1.80.4 (2022-01-25)
* Bugfix: #940 fix rows per chunk causing divide by zero
* Feature: #943 check markdown rendering of README.md and CHANGES.md in build
* Bugfix: #946 move test dependencies to tests_require
### 1.80.3 (2022-01-20)
* Feature: #941 use named index for VersionStore to avoid 127 max fully qualified index name
* Bugfix: #935, #936 fixed README.md rendering which was preventing pypi upload
### 1.80.2 (2022-01-10)
* Bugfix: #932 revert serialization-optimization (#909, #910)
### 1.80.1 (2021-12-09)
* Bugfix: #855 use IXSCAN for list\_symbols which speeds up snapshotting (actually #856)
* Bugfix: #926 avoid pathologically slow count_documents() call with pymongo > 3.6.0
### 1.80.0 (2021-10-28)
* Feature: #919 Add CircleCI badge to README.md
* Feature: #917 Add CircleCI build
* Bugfix: #910 Fix column subsetting bug
* Bugfix: #909 Speedup FrameToArray serialiser for ChunkStore by removing intermediate DataFrame construction
* Bugfix: #902 Chunkstore-read-speedup
* Bugfix: #872 Do not spam if not permissioned on cache db
* Bugfix: #874 Pickle protocol 5 not supported in 3.7 and below
* Bugfix: Handle uninitialized cache object
* Feature: #897 Pin numpy 1.18.4
* Feature: #897 Pin pandas 1.0.3
* Bugfix: #881 Fix for issue #815
* Bugfix: #875 Fix flake8 errors
### 1.79.4 (2020-12-01)
* Bugfix: Update code to work with latest version of pandas
* Bugfix: Fix missing column handling in numpy serializer
### 1.79.3 (2019-12-6)
* Bugfix: #832 Bytes to unicode for pd.Series
* Feature: #825 Max BSON size configurable
* Bugfix: #823 Don't retry bulk write errors
* Feature: #802 kwargs passed through to iterators in chunkstore
### 1.79.2 (2019-05-21)
* Feature: Allow list_library caching to be tunable via a settings collection.
* Bugfix: #777: Handle empty columns in dataframes
### 1.79.1 (2019-05-03)
* Bugfix: Pandas convert multiindexes to unicode if flag set.
### 1.79 (2019-05-02)
* Bugfix: #765 Pandas data columns require encoding to convert to unicode.
### 1.78 (2019-05-02)
* Bugfix: Use the default encoding (ascii) instead of bytes for unpickling.
### 1.77 (2019-05-01)
* Bugfix: pypandoc not rendering README correctly for PYPI
* Bugfix: #744 get_info on an empty dataframe raises an exception
* Bugfix: #751 Handle unpickling py2 datetime and other object types with latin1
* Bugfix: #598 Add an option to convert py2 str to py3 str (unicode type) on read.
### 1.74 (2019-02-28)
* Bugfix: #712 Pandas deprecation warning in chunkstore serializer
* BugFix: #670 Lots of pycodestyle fixes
* BugFix: #691 Fix arrays_to_mgr for pandas 0.23.4+
* BugFix: #698 Fix no handler in logging warning
* BugFix: #705 Use sort_index instead of sortlevel\_
* BugFix: #710: Initialize SEGMENT_SHA in versions for writes and appends
* Feature: #669 Experimental initial implementation of async arctic
* Feature: #704 Do not enable sharding by default in BSONStore.
* Feature: #688 Remove Chunkstore check for issue #422
* Feature: #717 Add a best effort cache for list_libraries
* Bugfix: #722 Exception while reading a column from chunkstore with a column missing in the chunk
### 1.73 (2018-11-27)
* Bugfix: #658 Write/append errors for Panel objects from older pandas versions
* Feature: #653 Add version meta-info in arctic module
* Feature: #663 Include arctic numerical version in the metadata of the version document
* Feature: #650 Implemented forward pointers for chunks in VersionStore (modes: enabled/disabled/hybrid)
### 1.72 (2018-11-06)
* Feature: #577 Added implementation for incremental serializer for numpy records
* Bugfix: #648 Fix issue with Timezone aware Pandas types, which don't contain hasobject attribute
### 1.71 (2018-11-05)
* Bugfix: #645 Fix write errors for Pandas DataFrame that has mixed object/string types in multi-index column
### 1.70 (2018-10-30)
* Bugfix: #157 Assure that serialized dataframes remain value-equivalent (e.g. avoid NaN --> 'nan' in mixed string columns)
* Bugfix: #608 Ensure Arctic performs well with MongoDB 3.6 (sorting)
* Bugfix: #629 Column kwarg no longer modified
* Bugfix: #641 DateRange.intersection open/closed range fix
* Feature: #493 Can pass kwargs when calling MongoClient, e.g. for ssl
* Feature: #590 Faster write handler selection for DataFrames with objects
* Feature: #604 Improved handling handling for pickling serialization decidions
### 1.69 (2018-09-12)
* Docs: VersionStore documentation
* Bugfix: Issue #612 ThreadPool should be created by process using it
* Feature: Upsert option on appends in ChunkStore
### 1.68 (2018-08-17)
* Feature: #553 Compatibility with both the new and old LZ4 API
* Feature: #571 Removed the Cython LZ4 code, use the latest python-lz4
* Feature: #557 Threadpool based compression. Speed imrpovement and tuning benchmarks.
* Bugfix: fix tickstore unicode handling, support both unicode and utf-8 arrays
* Bugfix: #591 Fix tickstore reads not returning index with localized timezone
* Feature: #595 add host attribute to VersionedItem.
* Bugfix: #594 Enable sharding on chunkstore
### 1.67.1 (2018-07-11)
* Bugfix: #579 Fix symbol corruption due to restore_version and append
* Bugfix: #584 Fix list_versions for a snapshot after deleting symbols in later versions
### 1.67 (2018-05-24)
* Bugfix: #561 Fix PickleStore read corruption after write_metadata
### 1.66 (2018-05-21)
* Bugfix: #168 Do not allow empty string as a column name
* Bugfix: #483 Remove potential floating point error from datetime_to_ms
* Bugfix: #271 Log when library doesnt exist on delete
* Feature: MetaDataStore: added list_symbols with regexp, as_of and metadata fields matching filters
* Feature: Support for serialization of DataFrames in Pandas 0.23.x
### 1.65 (2018-04-16)
* Bugfix: #534 VersionStore: overwriting a symbol with different dtype (but same data format) does not
raise exceptions anymore
* Bugfix: #531 arctic_prune_versions: clean broken snapshot references before pruning
* Bugfix: setup.py develop in a conda environment on Mac
* Feature: #490 add support to numpy 1.14
### 1.63 (2018-04-06)
* Bugfix: #521 Clang 6.0 compiler support on macOS
* Feature: #510 VersionStore: support multi column in pandas DataFrames
### 1.62 (2018-3-14)
* Bugfix: #517 VersionStore: append does not duplicate data in certain corner cases
* Bugfix: #519 VersionStore: list_symbols speed improvement and fix for memory limit exceed
### 1.61 (2018-3-2)
* Feature: #288 Mapping reads and writes over chunks in chunkstore
* Bugfix: #508 VersionStore: list_symbols and read now always returns latest version
* Bugfix: #512 Improved performance for list_versions
* Bugfix: #515 VersionStore: _prune_previous_versions now retries the cleanup operation
### 1.60 (2018-2-13)
* Bugfix: #503 ChunkStore: speedup check for -1 segments
* Feature: #504 Increasing number of libraries in Arctic to 5000.
### 1.59 (2018-2-6)
* Bugfix: Increase performance of invalid segment check in chunkstore
* Bugfix: #501 Fix the spurious data integrity exceptions at write path, due to moving chunks form the balancer
### 1.58 (2018-1-15)
* Bugfix: #491 roll back the use of frombuffer to fromstring, fixes the read-only ndarray issue
### 1.57 (2018-1-11)
* Feature: #206 String support for tickstore
* Bugfix: #486 improve mongo_retry robustness with failures for version store write/append
### 1.56 (2017-12-21)
* Bugfix: #468 Re-adding compatibility for pandas 0.20.x
* Bugfix: #476 Ensure we re-auth when a new MongoClient is created after fork
### 1.55 (2017-12-14)
* Bugfix: #439 fix cursor timeouts in chunkstore iterator
* Bugfix: #450 fix error in chunkstore delete when chunk range produces empty df
* Bugfix: #442 fix incorrect segment values in multi segment chunks in chunkstore
* Feature: #457 enchances fix for #442 via segment_id_repair tool
* Bugfix: #385 exceptions during quota statistics no longer kill a write
* Feature: PR#161 TickStore.max_date now returns a datetime in the 'local' timezone
* Feature: #425 user defined metadata for tickstore
* Feature: #464 performance improvement by avoiding unnecessary re-authentication
* Bugfix: #250 Added multiprocessing safety, check for initialized MongoClient after fork.
* Feature: #465 Added fast operations for write only metadata and restore symbol to a version
### 1.54 (2017-10-18)
* Bugfix: #440 Fix read empty MultiIndex+tz Series
### 1.53 (2017-10-06)
* Perf: #408 Improve memory performance of version store's serializer
* Bugfix #394 Multi symbol read in chunkstore
* Bugfix: #407 Fix segment issue on appends in chunkstore
* Bugfix: Inconsistent returns on MetadataStore.append
* Bugfix: #412 pandas deprecation and #289 improve exception report in numpy record serializer
* Bugfix: #420 chunkstore ignoring open interval date ranges
* Bugfix: #427 chunkstore metadata not being correctly replaced during symbol overwrite
* Bugfix: #431 chunkstore iterators do not handle multi segment chunks correctly
### 1.51 (2017-08-21)
* Bugfix: #397 Remove calls to deprecated methods in pymongo
* Bugfix: #402 Append to empty DF fails in VersionStore
### 1.50 (2017-08-18)
* Feature: #396 MetadataStore.read now supports as_of argument
* Bugfix: #397 Pin pymongo==3.4.0
### 1.49 (2017-08-02)
* Feature: #392 MetadataStore
* Bugfix: #384 sentinels missing time data on chunk start/ends in ChunkStore
* Bugfix: #382 Remove dependency on cython being pre-installed
* Bugfix: #343 Renaming libraries/collections within a namespace/database
### 1.48 (2017-06-26)
* BugFix: Rollback #363, as it breaks multi-index dataframe
* Bugfix: #372 OSX build improvements
### 1.47 (2017-06-19)
* Feature: Re-introduce #363 `concat` flag, essentially undo-ing 1.45
* BugFix: #377 Fix broken `replace_one` on BSONStore and add `bulk_write`
### 1.46 (2017-06-13)
* Feature: #374 Shard BSONStore on `_id` rather than `symbol`
### 1.45 (2017-06-09)
* BugFix: Rollback #363, which can cause ordering issues on append
### 1.44 (2017-06-08)
* Feature: #364 Expose compressHC from internal arctic LZ4 and remove external LZ4 dependency
* Feature: #363 Appending older data (compare to what's exist in library) will raise. Use `concat=True` to append only the
new bits
* Feature: #371 Expose more functionality in BSONStore
### 1.43 (2017-05-30)
* Bugfix: #350 remove deprecated pandas calls
* Bugfix: #360 version incorrect in empty append in VersionStore
* Feature: #365 add generic BSON store
### 1.42 (2017-05-12)
* Bugfix: #346 fixed daterange subsetting error on very large dateframes in version store
* Bugfix: #351 $size queries can't use indexes, use alternative queries
### 1.41 (2017-04-20)
* Bugfix: #334 Chunk range param with pandas object fails in chunkstore.get_chunk_ranges
* Bugfix: #339 Depending on lz4<=0.8.2 to fix build errors
* Bugfix: #342 fixed compilation errors on Mac OSX
* Bugfix: #344 fixed data corruption problem with concurrent appends
### 1.40 (2017-03-03)
* BugFix: #330 Make Arctic._lock reentrant
### 1.39 (2017-03-03)
* Feature: #329 Add reset() method to Arctic
### 1.38 (2017-02-22)
* Bugfix: #324 Datetime indexes must be sorted in chunkstore
* Feature: #290 improve performance of tickstore column reads
### 1.37 (2017-1-31)
* Bugfix: #300 to_datetime deprecated in pandas, use to_pydatetime instead
* Bugfix: #309 formatting change for DateRange ```__str__```
* Feature: #313 set and read user specified metadata in chunkstore
* Feature: #319 Audit log support in ChunkStor
* Bugfix: #216 Tickstore write fails with named index column
### 1.36 (2016-12-13)
* Feature: Default to hashed based sharding
* Bugfix: retry socket errors during VersionStore snapshot operations
### 1.35 (2016-11-29)
* Bugfix: #296 Cannot compress/decompress empty string
### 1.34 (2016-11-29)
* Feature: #294 Move per-chunk metadata for chunkstore to a separate collection
* Bugfix: #292 Account for metadata size during size chunking in ChunkStore
* Feature: #283 Support for all pandas frequency strings in ChunkStore DateChunker
* Feature: #286 Add has_symbol to ChunkStore and support for partial symbol matching in list_symbols
### 1.33 (2016-11-07)
* Feature: #275 Tuple range object support in DateChunker
* Bugfix: #273 Duplicate columns breaking serializer
* Feature: #267 Tickstore.delete returns deleted data
* Dependency: #266 Remove pytest-dbfixtures in favor of pytest-server-fixtures
### 1.32 (2016-10-25)
* Feature: #260 quota support on Chunkstore
* Bugfix: #259 prevent write of unnamed columns/indexes
* Bugfix: #252 pandas 0.19.0 compatibility fixes
* Bugfix: #249 open ended range reads on data without index fail
* Bugfix: #262 VersionStore.append must check data is written correctly during repack
* Bugfix: #263 Quota: Improve the error message when near soft-quota limit
* Perf: #265 VersionStore.write / append don't aggressively add indexes on each write
### 1.31 (2016-09-29)
* Bugfix: #247 segmentation read fix in chunkstore
* Feature: #243 add get_library_type method
* Bugfix: more cython changes to handle LZ4 errors properly
* Feature: #239 improve chunkstore's get_info method
### 1.30 (2016-09-26)
* Feature: #235 method to return chunk ranges on a symbol in ChunkStore
* Feature: #234 Iterator access to ChunkStore
* Bugfix: #236 Cython not handling errors from LZ4 function calls
### 1.29 (2016-09-20)
* Bugfix: #228 Mongo fail-over during append can leave a Version in an inconsistent state
* Feature: #193 Support for different Chunkers and Serializers by symbol in ChunkStore
* Feature: #220 Raise exception if older version of arctic attempts to read unsupported pickled data
* Feature: #219 and #220 Support for pickling large data (>2GB)
* Feature: #204 Add support for library renaming
* Feature: #209 Upsert capability in ChunkStore's update method
* Feature: #207 Support DatetimeIndexes in DateRange chunker
* Bugfix: #232 Don't raise during VersionStore #append(...) if the previous append failed
### 1.28 (2016-08-16)
* Bugfix: #195 Top level tickstore write with list of dicts now works with timezone aware datetimes
### 1.27 (2016-08-05)
* Bugfix: #187 Compatibility with latest version of pytest-dbfixtures
* Feature: #182 Improve ChunkStore read/write performance
* Feature: #162 Rename API for ChunkStore
* Feature: #186 chunk_range on update
* Bugfix: #189 range delete does not update symbol metadata
### 1.26 (2016-07-20)
* Bugfix: Faster TickStore querying for multiple symbols simultaneously
* Bugfix: TickStore.read now respects `allow_secondary=True`
* Bugfix: #147 Add get_info method to ChunkStore
* Bugfix: Periodically re-cache the library.quota to pick up any changes
* Bugfix: #166 Add index on SHA for ChunkStore
* Bugfix: #169 Dtype mismatch in chunkstore updates
* Feature: #171 allow deleting of values within a date range in ChunkStore
* Bugfix: #172 Fix date range bug when querying dates in the middle of chunks
* Bugfix: #176 Fix overwrite failures in Chunkstore
* Bugfix: #178 - Change how start/end dates are populated in the DB, also fix append so it works as expected.
* Bugfix: #43 - Remove dependency on hardcoded Linux timezone files
### 1.25 (2016-05-23)
* Bugfix: Ensure that Tickstore.write doesn't allow out of order messages
* Bugfix: VersionStore.write now allows writing 'None' as a value
### 1.24 (2016-05-10)
* Bugfix: Backwards compatibility reading/writing documents with previous versions of Arctic
### 1.22 (2016-05-09)
* Bugfix: #109 Ensure stable sort during Arctic read
* Feature: New benchmark suite using ASV
* Bugfix: #129 Fixed an issue where some chunks could get skipped during a multiple-symbol TickStore read
* Bugfix: #135 Fix issue with different datatype returned from pymongo in python3
* Feature: #130 New Chunkstore storage type
### 1.21 (2016-03-08)
* Bugfix: #106 Fix Pandas Panel storage for panels with different dimensions
### 1.20 (2016-02-03)
* Feature: #98 Add initial_image as optional parameter on tickstore write()
* Bugfix: #100 Write error on end field when writing with pandas dataframes
### 1.19 (2016-01-29)
* Feature: Add python 3.3/3.4 support
* Bugfix: #95 Fix raising NoDataFoundException across multiple low level libraries
### 1.18 (2016-01-05)
* Bugfix: #81 Fix broken read of multi-index DataFrame written by old version of Arctic
* Bugfix: #49 Fix strifying tickstore
### 1.17 (2015-12-24)
* Feature: Add timezone suppport to store multi-index dataframes
* Bugfix: Fixed broken sdist releases
### 1.16 (2015-12-15)
* Feature: ArticTransaction now supports non-audited 'transactions': `audit=False`
```
with ArcticTransaction(Arctic('hostname')['some_library'], 'symbol', audit=False) as at:
...
```
This is useful for batch jobs which read-modify-write and don't want to clash with
concurrent writers, and which don't require keeping all versions of a symbol.
### 1.15 (2015-11-25)
* Feature: get_info API added to version_store.
### 1.14 (2015-11-25)
### 1.12 (2015-11-12)
* Bugfix: correct version detection for Pandas >= 0.18.
* Bugfix: retrying connection initialisation in case of an AutoReconnect failure.
### 1.11 (2015-10-29)
* Bugfix: Improve performance of saving multi-index Pandas DataFrames
by 9x
* Bugfix: authenticate should propagate non-OperationFailure exceptions
(e.g. ConnectionFailure) as this might be indicative of socket failures
* Bugfix: return 'deleted' state in VersionStore.list_versions() so that
callers can pick up on the head version being the delete-sentinel.
### 1.10 (2015-10-28)
* Bugfix: VersionStore.read(date_range=...) could do the wrong thing with
TimeZones (which aren't yet supported for date_range slicing.).
### 1.9 (2015-10-06)
* Bugfix: fix authentication race condition when sharing an Arctic
instance between multiple threads.
### 1.8 (2015-09-29)
* Bugfix: compatibility with both 3.0 and pre-3.0 MongoDB for
querying current authentications
### 1.7 (2015-09-18)
* Feature: Add support for reading a subset of a pandas DataFrame
in VersionStore.read by passing in an arctic.date.DateRange
* Bugfix: Reauth against admin if not auth'd against a library a
specific library's DB. Sometimes we appear to miss admin DB auths.
This is to workaround that until we work out what the issue is.
### 1.6 (2015-09-16)
* Feature: Add support for multi-index Bitemporal DataFrame storage.
This allows persisting data and changes within the DataFrame making it
easier to see how old data has been revised over time.
* Bugfix: Ensure we call the error logging hook when exceptions occur
### 1.5 (2015-09-02)
* Always use the primary cluster node for 'has_symbol()', it's safer
### 1.4 (2015-08-19)
* Bugfixes for timezone handling, now ensures use of non-naive datetimes
* Bugfix for tickstore read missing images
### 1.3 (2015-08-011)
* Improvements to command-line control scripts for users and libraries
* Bugfix for pickling top-level Arctic object
### 1.2 (2015-06-29)
* Allow snapshotting a range of versions in the VersionStore, and
snapshot all versions by default.
### 1.1 (2015-06-16)
* Bugfix for backwards-compatible unpickling of bson-encoded data
* Added switch for enabling parallel lz4 compression
### 1.0 (2015-06-14)
* Initial public release
Raw data
{
"_id": null,
"home_page": "https://github.com/man-group/arctic",
"name": "arctic",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "ahl,keyvalue,tickstore,mongo,timeseries",
"author": "Man AHL Technology",
"author_email": "arctic@man.com",
"download_url": "",
"platform": null,
"description": "# Development moved to ArcticDB GitHub Repository\n\nThis repository and project are now in maintenance mode. Development has migrated to [ArcticDB](https://github.com/man-group/ArcticDB).\n\n---\n\nInformation on how to set up, install and use Arctic has been moved to [README-arctic.md](README-arctic.md). \n\n## Changelog\n\n### 1.82.1 (2023-10-09)\n * Release: #1014 Prepare release 1.82.1\n * Bugfix: #1013 Fix serialized tz name for index timezones of dateutil.timezone.tzutc()\n * Bugfix: #1013 Fix serialized tz name for single-level index timezones of dateutil.timezone.gettz(\"UTC\")\n \n### 1.82.0 (2023-07-24)\n * Release: #1012 version 1.82.0\n * Compatibility: update pinning from pandas<1.1, to pandas<2\n * Compatibility: update pinning from numpy<1.19 to numpy<2\n * Build: specify which version of python/numpy/pandas to test\n * Bugfix: #887 #928 resolve import error on pandas.Panel, Panel was removed in pandas 1.0\n * Bugfix: fix pandas get_timezone() argument cannot be None\n * Bugfix: fix np.float/np.int/np.book depreciations\n * Bugfix: fix numpy tostring() is deprecated. Use tobytes() instead.\n * Bugfix: numpy.testing.utils is deprecated\n * Bugfix: pandas.util.testing is deprecated\n * Cleanup: remove async_benchmark\n\n### 1.81.2 (2023-05-11)\n * Feature: #1000, #1001, #1002, #1003, #1007, #1008 ArcticDB docs, links etc\n * Bugfix: #1009 force CircleCI to install tzlocal==4.2\n\n### 1.81.1 (2023-03-13)\n * Feature: #996 release wheel to pypi as well as tar.gz, egg.\n\n### 1.81.0 (2023-03-10)\n * Bugfix: #979 fix circleci mongo install\n * Feature: #980 get testpack running with mongod 4.4.18\n * Bugfix: #985 suppress FutureWarning for Panel import\n * Bugfix: #989 VersionStore slow snapshot delete add new index\n * Bugfix: #806, #990 DateTimeIndex tz serialization\n\n### 1.80.5 (2022-09-05)\n * Feature: #950 remove all traces of python 2.7 and six package\n * Feature: #959 add python 3.8 support\n * Feature: #962 pin pandas<1.1.0, numpy<1.19.0\n\n### 1.80.4 (2022-01-25)\n * Bugfix: #940 fix rows per chunk causing divide by zero\n * Feature: #943 check markdown rendering of README.md and CHANGES.md in build\n * Bugfix: #946 move test dependencies to tests_require\n\n### 1.80.3 (2022-01-20)\n * Feature: #941 use named index for VersionStore to avoid 127 max fully qualified index name\n * Bugfix: #935, #936 fixed README.md rendering which was preventing pypi upload\n\n### 1.80.2 (2022-01-10)\n * Bugfix: #932 revert serialization-optimization (#909, #910)\n\n### 1.80.1 (2021-12-09)\n * Bugfix: #855 use IXSCAN for list\\_symbols which speeds up snapshotting (actually #856)\n * Bugfix: #926 avoid pathologically slow count_documents() call with pymongo > 3.6.0\n\n### 1.80.0 (2021-10-28)\n * Feature: #919 Add CircleCI badge to README.md\n * Feature: #917 Add CircleCI build\n * Bugfix: #910 Fix column subsetting bug\n * Bugfix: #909 Speedup FrameToArray serialiser for ChunkStore by removing intermediate DataFrame construction\n * Bugfix: #902 Chunkstore-read-speedup\n * Bugfix: #872 Do not spam if not permissioned on cache db\n * Bugfix: #874 Pickle protocol 5 not supported in 3.7 and below\n * Bugfix: Handle uninitialized cache object\n * Feature: #897 Pin numpy 1.18.4\n * Feature: #897 Pin pandas 1.0.3\n * Bugfix: #881 Fix for issue #815\n * Bugfix: #875 Fix flake8 errors\n\n### 1.79.4 (2020-12-01)\n * Bugfix: Update code to work with latest version of pandas\n * Bugfix: Fix missing column handling in numpy serializer\n\n### 1.79.3 (2019-12-6)\n * Bugfix: #832 Bytes to unicode for pd.Series\n * Feature: #825 Max BSON size configurable\n * Bugfix: #823 Don't retry bulk write errors\n * Feature: #802 kwargs passed through to iterators in chunkstore\n\n### 1.79.2 (2019-05-21)\n * Feature: Allow list_library caching to be tunable via a settings collection.\n * Bugfix: #777: Handle empty columns in dataframes\n\n### 1.79.1 (2019-05-03)\n * Bugfix: Pandas convert multiindexes to unicode if flag set.\n\n### 1.79 (2019-05-02)\n * Bugfix: #765 Pandas data columns require encoding to convert to unicode.\n\n### 1.78 (2019-05-02)\n * Bugfix: Use the default encoding (ascii) instead of bytes for unpickling.\n\n### 1.77 (2019-05-01)\n * Bugfix: pypandoc not rendering README correctly for PYPI\n * Bugfix: #744 get_info on an empty dataframe raises an exception\n * Bugfix: #751 Handle unpickling py2 datetime and other object types with latin1\n * Bugfix: #598 Add an option to convert py2 str to py3 str (unicode type) on read.\n\n### 1.74 (2019-02-28)\n * Bugfix: #712 Pandas deprecation warning in chunkstore serializer\n * BugFix: #670 Lots of pycodestyle fixes\n * BugFix: #691 Fix arrays_to_mgr for pandas 0.23.4+\n * BugFix: #698 Fix no handler in logging warning\n * BugFix: #705 Use sort_index instead of sortlevel\\_\n * BugFix: #710: Initialize SEGMENT_SHA in versions for writes and appends\n * Feature: #669 Experimental initial implementation of async arctic\n * Feature: #704 Do not enable sharding by default in BSONStore.\n * Feature: #688 Remove Chunkstore check for issue #422\n * Feature: #717 Add a best effort cache for list_libraries\n * Bugfix: #722 Exception while reading a column from chunkstore with a column missing in the chunk\n\n### 1.73 (2018-11-27)\n * Bugfix: #658 Write/append errors for Panel objects from older pandas versions\n * Feature: #653 Add version meta-info in arctic module\n * Feature: #663 Include arctic numerical version in the metadata of the version document\n * Feature: #650 Implemented forward pointers for chunks in VersionStore (modes: enabled/disabled/hybrid)\n\n### 1.72 (2018-11-06)\n * Feature: #577 Added implementation for incremental serializer for numpy records\n * Bugfix: #648 Fix issue with Timezone aware Pandas types, which don't contain hasobject attribute\n\n### 1.71 (2018-11-05)\n * Bugfix: #645 Fix write errors for Pandas DataFrame that has mixed object/string types in multi-index column\n\n### 1.70 (2018-10-30)\n * Bugfix: #157 Assure that serialized dataframes remain value-equivalent (e.g. avoid NaN --> 'nan' in mixed string columns)\n * Bugfix: #608 Ensure Arctic performs well with MongoDB 3.6 (sorting)\n * Bugfix: #629 Column kwarg no longer modified\n * Bugfix: #641 DateRange.intersection open/closed range fix\n * Feature: #493 Can pass kwargs when calling MongoClient, e.g. for ssl\n * Feature: #590 Faster write handler selection for DataFrames with objects \n * Feature: #604 Improved handling handling for pickling serialization decidions\n\n\n### 1.69 (2018-09-12)\n * Docs: VersionStore documentation\n * Bugfix: Issue #612 ThreadPool should be created by process using it\n * Feature: Upsert option on appends in ChunkStore\n\n### 1.68 (2018-08-17)\n * Feature: #553 Compatibility with both the new and old LZ4 API\n * Feature: #571 Removed the Cython LZ4 code, use the latest python-lz4\n * Feature: #557 Threadpool based compression. Speed imrpovement and tuning benchmarks.\n * Bugfix: fix tickstore unicode handling, support both unicode and utf-8 arrays\n * Bugfix: #591 Fix tickstore reads not returning index with localized timezone\n * Feature: #595 add host attribute to VersionedItem.\n * Bugfix: #594 Enable sharding on chunkstore\n\n### 1.67.1 (2018-07-11)\n * Bugfix: #579 Fix symbol corruption due to restore_version and append\n * Bugfix: #584 Fix list_versions for a snapshot after deleting symbols in later versions\n\n### 1.67 (2018-05-24)\n * Bugfix: #561 Fix PickleStore read corruption after write_metadata\n\n### 1.66 (2018-05-21)\n * Bugfix: #168 Do not allow empty string as a column name\n * Bugfix: #483 Remove potential floating point error from datetime_to_ms\n * Bugfix: #271 Log when library doesnt exist on delete\n * Feature: MetaDataStore: added list_symbols with regexp, as_of and metadata fields matching filters\n * Feature: Support for serialization of DataFrames in Pandas 0.23.x\n\n### 1.65 (2018-04-16)\n * Bugfix: #534 VersionStore: overwriting a symbol with different dtype (but same data format) does not\n raise exceptions anymore\n * Bugfix: #531 arctic_prune_versions: clean broken snapshot references before pruning\n * Bugfix: setup.py develop in a conda environment on Mac\n * Feature: #490 add support to numpy 1.14\n\n### 1.63 (2018-04-06)\n * Bugfix: #521 Clang 6.0 compiler support on macOS\n * Feature: #510 VersionStore: support multi column in pandas DataFrames\n\n### 1.62 (2018-3-14)\n * Bugfix: #517 VersionStore: append does not duplicate data in certain corner cases\n * Bugfix: #519 VersionStore: list_symbols speed improvement and fix for memory limit exceed\n\n### 1.61 (2018-3-2)\n * Feature: #288 Mapping reads and writes over chunks in chunkstore\n * Bugfix: #508 VersionStore: list_symbols and read now always returns latest version\n * Bugfix: #512 Improved performance for list_versions\n * Bugfix: #515 VersionStore: _prune_previous_versions now retries the cleanup operation\n\n### 1.60 (2018-2-13)\n * Bugfix: #503 ChunkStore: speedup check for -1 segments\n * Feature: #504 Increasing number of libraries in Arctic to 5000.\n\n### 1.59 (2018-2-6)\n * Bugfix: Increase performance of invalid segment check in chunkstore\n * Bugfix: #501 Fix the spurious data integrity exceptions at write path, due to moving chunks form the balancer\n\n### 1.58 (2018-1-15)\n * Bugfix: #491 roll back the use of frombuffer to fromstring, fixes the read-only ndarray issue\n\n### 1.57 (2018-1-11)\n * Feature: #206 String support for tickstore\n * Bugfix: #486 improve mongo_retry robustness with failures for version store write/append\n\n### 1.56 (2017-12-21)\n * Bugfix: #468 Re-adding compatibility for pandas 0.20.x\n * Bugfix: #476 Ensure we re-auth when a new MongoClient is created after fork\n\n### 1.55 (2017-12-14)\n * Bugfix: #439 fix cursor timeouts in chunkstore iterator\n * Bugfix: #450 fix error in chunkstore delete when chunk range produces empty df\n * Bugfix: #442 fix incorrect segment values in multi segment chunks in chunkstore\n * Feature: #457 enchances fix for #442 via segment_id_repair tool\n * Bugfix: #385 exceptions during quota statistics no longer kill a write\n * Feature: PR#161 TickStore.max_date now returns a datetime in the 'local' timezone\n * Feature: #425 user defined metadata for tickstore\n * Feature: #464 performance improvement by avoiding unnecessary re-authentication\n * Bugfix: #250 Added multiprocessing safety, check for initialized MongoClient after fork.\n * Feature: #465 Added fast operations for write only metadata and restore symbol to a version \n\n### 1.54 (2017-10-18)\n * Bugfix: #440 Fix read empty MultiIndex+tz Series\n\n### 1.53 (2017-10-06)\n * Perf: #408 Improve memory performance of version store's serializer\n * Bugfix #394 Multi symbol read in chunkstore\n * Bugfix: #407 Fix segment issue on appends in chunkstore\n * Bugfix: Inconsistent returns on MetadataStore.append\n * Bugfix: #412 pandas deprecation and #289 improve exception report in numpy record serializer\n * Bugfix: #420 chunkstore ignoring open interval date ranges\n * Bugfix: #427 chunkstore metadata not being correctly replaced during symbol overwrite\n * Bugfix: #431 chunkstore iterators do not handle multi segment chunks correctly\n\n### 1.51 (2017-08-21)\n * Bugfix: #397 Remove calls to deprecated methods in pymongo\n * Bugfix: #402 Append to empty DF fails in VersionStore\n\n### 1.50 (2017-08-18)\n * Feature: #396 MetadataStore.read now supports as_of argument\n * Bugfix: #397 Pin pymongo==3.4.0\n\n### 1.49 (2017-08-02)\n * Feature: #392 MetadataStore\n * Bugfix: #384 sentinels missing time data on chunk start/ends in ChunkStore\n * Bugfix: #382 Remove dependency on cython being pre-installed\n * Bugfix: #343 Renaming libraries/collections within a namespace/database\n \n### 1.48 (2017-06-26)\n * BugFix: Rollback #363, as it breaks multi-index dataframe\n * Bugfix: #372 OSX build improvements\n\n### 1.47 (2017-06-19)\n * Feature: Re-introduce #363 `concat` flag, essentially undo-ing 1.45\n * BugFix: #377 Fix broken `replace_one` on BSONStore and add `bulk_write`\n\n### 1.46 (2017-06-13)\n * Feature: #374 Shard BSONStore on `_id` rather than `symbol`\n\n### 1.45 (2017-06-09)\n * BugFix: Rollback #363, which can cause ordering issues on append\n\n### 1.44 (2017-06-08)\n * Feature: #364 Expose compressHC from internal arctic LZ4 and remove external LZ4 dependency\n * Feature: #363 Appending older data (compare to what's exist in library) will raise. Use `concat=True` to append only the\n new bits\n * Feature: #371 Expose more functionality in BSONStore\n \n### 1.43 (2017-05-30)\n * Bugfix: #350 remove deprecated pandas calls\n * Bugfix: #360 version incorrect in empty append in VersionStore\n * Feature: #365 add generic BSON store\n\n### 1.42 (2017-05-12)\n * Bugfix: #346 fixed daterange subsetting error on very large dateframes in version store\n * Bugfix: #351 $size queries can't use indexes, use alternative queries\n\n### 1.41 (2017-04-20)\n * Bugfix: #334 Chunk range param with pandas object fails in chunkstore.get_chunk_ranges\n * Bugfix: #339 Depending on lz4<=0.8.2 to fix build errors\n * Bugfix: #342 fixed compilation errors on Mac OSX\n * Bugfix: #344 fixed data corruption problem with concurrent appends\n\n### 1.40 (2017-03-03)\n * BugFix: #330 Make Arctic._lock reentrant \n\n### 1.39 (2017-03-03)\n * Feature: #329 Add reset() method to Arctic \n\n### 1.38 (2017-02-22)\n * Bugfix: #324 Datetime indexes must be sorted in chunkstore\n * Feature: #290 improve performance of tickstore column reads\n\n### 1.37 (2017-1-31)\n * Bugfix: #300 to_datetime deprecated in pandas, use to_pydatetime instead\n * Bugfix: #309 formatting change for DateRange ```__str__```\n * Feature: #313 set and read user specified metadata in chunkstore\n * Feature: #319 Audit log support in ChunkStor\n * Bugfix: #216 Tickstore write fails with named index column\n\n\n### 1.36 (2016-12-13)\n \n * Feature: Default to hashed based sharding\n * Bugfix: retry socket errors during VersionStore snapshot operations\n\n### 1.35 (2016-11-29)\n\n * Bugfix: #296 Cannot compress/decompress empty string\n\n### 1.34 (2016-11-29)\n\n * Feature: #294 Move per-chunk metadata for chunkstore to a separate collection\n * Bugfix: #292 Account for metadata size during size chunking in ChunkStore\n * Feature: #283 Support for all pandas frequency strings in ChunkStore DateChunker\n * Feature: #286 Add has_symbol to ChunkStore and support for partial symbol matching in list_symbols\n\n### 1.33 (2016-11-07)\n \n * Feature: #275 Tuple range object support in DateChunker\n * Bugfix: #273 Duplicate columns breaking serializer\n * Feature: #267 Tickstore.delete returns deleted data\n * Dependency: #266 Remove pytest-dbfixtures in favor of pytest-server-fixtures\n\n### 1.32 (2016-10-25)\n \n * Feature: #260 quota support on Chunkstore\n * Bugfix: #259 prevent write of unnamed columns/indexes\n * Bugfix: #252 pandas 0.19.0 compatibility fixes\n * Bugfix: #249 open ended range reads on data without index fail\n * Bugfix: #262 VersionStore.append must check data is written correctly during repack\n * Bugfix: #263 Quota: Improve the error message when near soft-quota limit\n * Perf: #265 VersionStore.write / append don't aggressively add indexes on each write\n \n### 1.31 (2016-09-29)\n \n * Bugfix: #247 segmentation read fix in chunkstore\n * Feature: #243 add get_library_type method\n * Bugfix: more cython changes to handle LZ4 errors properly\n * Feature: #239 improve chunkstore's get_info method\n\n### 1.30 (2016-09-26)\n\n * Feature: #235 method to return chunk ranges on a symbol in ChunkStore\n * Feature: #234 Iterator access to ChunkStore\n * Bugfix: #236 Cython not handling errors from LZ4 function calls\n \n### 1.29 (2016-09-20)\n\n * Bugfix: #228 Mongo fail-over during append can leave a Version in an inconsistent state\n * Feature: #193 Support for different Chunkers and Serializers by symbol in ChunkStore\n * Feature: #220 Raise exception if older version of arctic attempts to read unsupported pickled data\n * Feature: #219 and #220 Support for pickling large data (>2GB)\n * Feature: #204 Add support for library renaming\n * Feature: #209 Upsert capability in ChunkStore's update method\n * Feature: #207 Support DatetimeIndexes in DateRange chunker\n * Bugfix: #232 Don't raise during VersionStore #append(...) if the previous append failed\n\n### 1.28 (2016-08-16)\n\n * Bugfix: #195 Top level tickstore write with list of dicts now works with timezone aware datetimes\n\n### 1.27 (2016-08-05)\n\n * Bugfix: #187 Compatibility with latest version of pytest-dbfixtures\n * Feature: #182 Improve ChunkStore read/write performance\n * Feature: #162 Rename API for ChunkStore\n * Feature: #186 chunk_range on update\n * Bugfix: #189 range delete does not update symbol metadata\n\n### 1.26 (2016-07-20)\n\n * Bugfix: Faster TickStore querying for multiple symbols simultaneously\n * Bugfix: TickStore.read now respects `allow_secondary=True`\n * Bugfix: #147 Add get_info method to ChunkStore\n * Bugfix: Periodically re-cache the library.quota to pick up any changes\n * Bugfix: #166 Add index on SHA for ChunkStore\n * Bugfix: #169 Dtype mismatch in chunkstore updates\n * Feature: #171 allow deleting of values within a date range in ChunkStore\n * Bugfix: #172 Fix date range bug when querying dates in the middle of chunks\n * Bugfix: #176 Fix overwrite failures in Chunkstore\n * Bugfix: #178 - Change how start/end dates are populated in the DB, also fix append so it works as expected.\n * Bugfix: #43 - Remove dependency on hardcoded Linux timezone files\n\n### 1.25 (2016-05-23)\n\n * Bugfix: Ensure that Tickstore.write doesn't allow out of order messages\n * Bugfix: VersionStore.write now allows writing 'None' as a value\n\n### 1.24 (2016-05-10)\n \n * Bugfix: Backwards compatibility reading/writing documents with previous versions of Arctic\n\n### 1.22 (2016-05-09)\n \n * Bugfix: #109 Ensure stable sort during Arctic read\n * Feature: New benchmark suite using ASV\n * Bugfix: #129 Fixed an issue where some chunks could get skipped during a multiple-symbol TickStore read\n * Bugfix: #135 Fix issue with different datatype returned from pymongo in python3\n * Feature: #130 New Chunkstore storage type\n\n### 1.21 (2016-03-08)\n\n * Bugfix: #106 Fix Pandas Panel storage for panels with different dimensions\n\n### 1.20 (2016-02-03)\n\n * Feature: #98 Add initial_image as optional parameter on tickstore write()\n * Bugfix: #100 Write error on end field when writing with pandas dataframes\n\n### 1.19 (2016-01-29)\n\n * Feature: Add python 3.3/3.4 support\n * Bugfix: #95 Fix raising NoDataFoundException across multiple low level libraries\n\n### 1.18 (2016-01-05)\n\n * Bugfix: #81 Fix broken read of multi-index DataFrame written by old version of Arctic\n * Bugfix: #49 Fix strifying tickstore\n\n### 1.17 (2015-12-24)\n\n * Feature: Add timezone suppport to store multi-index dataframes\n * Bugfix: Fixed broken sdist releases\n\n### 1.16 (2015-12-15)\n\n * Feature: ArticTransaction now supports non-audited 'transactions': `audit=False`\n\n```\nwith ArcticTransaction(Arctic('hostname')['some_library'], 'symbol', audit=False) as at:\n...\n```\n\n This is useful for batch jobs which read-modify-write and don't want to clash with\n concurrent writers, and which don't require keeping all versions of a symbol.\n\n### 1.15 (2015-11-25)\n\n * Feature: get_info API added to version_store.\n\n### 1.14 (2015-11-25)\n### 1.12 (2015-11-12)\n\n * Bugfix: correct version detection for Pandas >= 0.18.\n * Bugfix: retrying connection initialisation in case of an AutoReconnect failure.\n\n### 1.11 (2015-10-29)\n\n * Bugfix: Improve performance of saving multi-index Pandas DataFrames\n by 9x\n * Bugfix: authenticate should propagate non-OperationFailure exceptions\n (e.g. ConnectionFailure) as this might be indicative of socket failures\n * Bugfix: return 'deleted' state in VersionStore.list_versions() so that\n callers can pick up on the head version being the delete-sentinel.\n\n### 1.10 (2015-10-28)\n\n * Bugfix: VersionStore.read(date_range=...) could do the wrong thing with\n TimeZones (which aren't yet supported for date_range slicing.).\n\n### 1.9 (2015-10-06)\n\n * Bugfix: fix authentication race condition when sharing an Arctic\n instance between multiple threads.\n\n### 1.8 (2015-09-29)\n\n * Bugfix: compatibility with both 3.0 and pre-3.0 MongoDB for\n querying current authentications\n\n### 1.7 (2015-09-18)\n\n * Feature: Add support for reading a subset of a pandas DataFrame\n in VersionStore.read by passing in an arctic.date.DateRange\n * Bugfix: Reauth against admin if not auth'd against a library a\n specific library's DB. Sometimes we appear to miss admin DB auths.\n This is to workaround that until we work out what the issue is.\n\n### 1.6 (2015-09-16)\n\n * Feature: Add support for multi-index Bitemporal DataFrame storage.\n This allows persisting data and changes within the DataFrame making it\n easier to see how old data has been revised over time.\n * Bugfix: Ensure we call the error logging hook when exceptions occur\n\n### 1.5 (2015-09-02)\n\n * Always use the primary cluster node for 'has_symbol()', it's safer\n\n### 1.4 (2015-08-19)\n\n * Bugfixes for timezone handling, now ensures use of non-naive datetimes\n * Bugfix for tickstore read missing images\n\n### 1.3 (2015-08-011)\n\n * Improvements to command-line control scripts for users and libraries\n * Bugfix for pickling top-level Arctic object\n\n### 1.2 (2015-06-29)\n\n * Allow snapshotting a range of versions in the VersionStore, and\n snapshot all versions by default.\n\n### 1.1 (2015-06-16)\n\n * Bugfix for backwards-compatible unpickling of bson-encoded data\n * Added switch for enabling parallel lz4 compression\n\n### 1.0 (2015-06-14)\n\n * Initial public release\n\n\n",
"bugtrack_url": null,
"license": "GPL",
"summary": "AHL Research Versioned TimeSeries and Tick store",
"version": "1.82.1",
"project_urls": {
"Homepage": "https://github.com/man-group/arctic"
},
"split_keywords": [
"ahl",
"keyvalue",
"tickstore",
"mongo",
"timeseries"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "9dee116d0672878aeca9a8df1b652dd0feaeb0fc9c432e7259a1a2115f7cc4ea",
"md5": "0a792b58bd91b8330b662af8b89297a9",
"sha256": "875258d5fce832440f3e83f9e6e5cf3082bafa76d7735482812a1ecb4360a203"
},
"downloads": -1,
"filename": "arctic-1.82.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "0a792b58bd91b8330b662af8b89297a9",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 138820,
"upload_time": "2023-10-09T16:58:32",
"upload_time_iso_8601": "2023-10-09T16:58:32.116850Z",
"url": "https://files.pythonhosted.org/packages/9d/ee/116d0672878aeca9a8df1b652dd0feaeb0fc9c432e7259a1a2115f7cc4ea/arctic-1.82.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-10-09 16:58:32",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "man-group",
"github_project": "arctic",
"travis_ci": true,
"coveralls": true,
"github_actions": false,
"circle": true,
"lcname": "arctic"
}
JSON
