<p align="center">
<a href="https://github.com/intsights/PyDeduplines">
<img src="https://raw.githubusercontent.com/intsights/PyDeduplines/master/images/logo.png" alt="Logo">
</a>
<h3 align="center">
Python library for a duplicate lines removal written in Rust
</h3>
</p>
[](https://pypi.org/project/PyDeduplines/)
## Table of Contents
- [Table of Contents](#table-of-contents)
- [About The Project](#about-the-project)
- [Built With](#built-with)
- [Performance](#performance)
- [Deduplicating](#deduplicating)
- [Added Lines](#added-lines)
- [Installation](#installation)
- [Documentation](#documentation)
- [Usage](#usage)
- [License](#license)
- [Contact](#contact)
## About The Project
This library is used to manipulate the lines of files. To achieve speed and efficiency, the library is written in Rust.
There are two functions in the library:
- `compute_unique_lines` - This function takes a list of input file paths and an output file path, iterates over the input file paths and writes unique lines to the output file.
- `compute_added_lines` - This function takes three arguments `first_file_path`, `second_file_path` and `output_file_path`, and writes to the output file only lines that appeared in the second file but not in the first.
### Built With
* [pyo3](https://github.com/PyO3/pyo3)
* [crossbeam](https://github.com/crossbeam-rs/crossbeam)
* [ahash](https://github.com/tkaitchuck/aHash)
* [parking_lot](https://github.com/Amanieu/parking_lot)
* [memchr](https://github.com/BurntSushi/memchr)
* [bytecount](https://github.com/llogiq/bytecount)
### Performance
#### Deduplicating
| Library | Function | Time | Peak Memory |
| ------------- | ------------- | ------------- | ------------- |
| [GNU Sort](https://www.gnu.org/software/coreutils/) | sort -u -o output 500mb_one 500mb_two | 37.35s | 8,261mb |
| [PyDeduplines](https://github.com/intsights/PyDeduplines) | compute_unique_lines('./workdir', ['500mb_one', '500mb_two'], 'output', 16) | 4.55s | 685mb |
#### Added Lines
| Library | Function | Time | Peak Memory |
| ------------- | ------------- | ------------- | ------------- |
| [GNU Sort](https://www.gnu.org/software/coreutils/) | comm -1 -3 <(sort 500mb_one) <(sort 500mb_two) > output.txt | 26.53s | 4,132mb |
| [PyDeduplines](https://github.com/intsights/PyDeduplines) | compute_added_lines('./workdir', '500mb_one', '500mb_two', 'output', 16) | 3.95s | 314mb |
### Installation
```sh
pip3 install PyDeduplines
```
## Documentation
```python
def compute_unique_lines(
working_directory: str,
file_paths: typing.List[str],
output_file_path: str,
number_of_splits: int,
number_of_threads: int = 0,
) -> None: ...
```
- `working_directory` - A file path of a directory to work in. Each split file would be created in this directory.
- `file_paths` - A list of strings containing the input file paths to iterate over and to calculate unique values for.
- `output_file_path` - The path where the unique lines will be written.
- `number_of_splits` - This parameter specifies how many smaller splits are to be made from each input file based on the number of splits. The idea behind this library is defined by this parameter. The more splits, the lower the peak memory consumption. Remember that the more splits you have, the more files you have open.
- `number_of_threads` - Number of parallel threads. Using *0* means to use as many cores as possible. The number of threads greater than *1* would cause multiple splits on each input file.
```python
def compute_added_lines(
working_directory: str,
first_file_path: str,
second_file_path: str,
output_file_path: str,
number_of_splits: int,
number_of_threads: int = 0,
) -> None: ...
```
- `working_directory` - A file path of a directory to work in. Each split file would be created in this directory.
- `first_file_path` - A path to the first file to be iterated over.
- `second_file_path` - A file path to iterate over and find lines that do not exist in the first file.
- `output_file_path` - A path to the output file that contains the lines that appeared in the second file but not in the first.
- `number_of_splits` - This parameter specifies how many smaller splits are to be made from each input file based on the number of splits. The idea behind this library is defined by this parameter. The more splits, the lower the peak memory consumption. Remember that the more splits you have, the more files you have open.
- `number_of_threads` - Number of parallel threads. Using *0* means to use as many cores as possible. The number of threads greater than *1* would cause multiple splits on each input file.
## Usage
```python
import pydeduplines
pydeduplines.compute_unique_lines(
working_directory='tmp',
file_paths=[
'500mb_one',
'500mb_two',
],
output_file_path='output',
number_of_splits=4,
)
pydeduplines.compute_added_lines(
working_directory='tmp',
first_file_path='500mb_one',
second_file_path='500mb_two',
output_file_path='output',
number_of_splits=4,
)
```
## License
Distributed under the MIT License. See `LICENSE` for more information.
## Contact
Gal Ben David - gal@intsights.com
Project Link: [https://github.com/intsights/PyDeduplines](https://github.com/intsights/PyDeduplines)
Raw data
{
"_id": null,
"home_page": "https://github.com/intsights/PyDeduplines",
"name": "pydeduplines",
"maintainer": null,
"docs_url": null,
"requires_python": "",
"maintainer_email": null,
"keywords": "unique,lines,rust,pyo3",
"author": "Gal Ben David <gal@intsights.com>",
"author_email": "Gal Ben David <gal@intsights.com>",
"download_url": null,
"platform": null,
"description": "<p align=\"center\">\n <a href=\"https://github.com/intsights/PyDeduplines\">\n <img src=\"https://raw.githubusercontent.com/intsights/PyDeduplines/master/images/logo.png\" alt=\"Logo\">\n </a>\n <h3 align=\"center\">\n Python library for a duplicate lines removal written in Rust\n </h3>\n</p>\n\n\n\n\n\n[](https://pypi.org/project/PyDeduplines/)\n\n## Table of Contents\n\n- [Table of Contents](#table-of-contents)\n- [About The Project](#about-the-project)\n - [Built With](#built-with)\n - [Performance](#performance)\n - [Deduplicating](#deduplicating)\n - [Added Lines](#added-lines)\n - [Installation](#installation)\n- [Documentation](#documentation)\n- [Usage](#usage)\n- [License](#license)\n- [Contact](#contact)\n\n\n## About The Project\n\nThis library is used to manipulate the lines of files. To achieve speed and efficiency, the library is written in Rust.\n\nThere are two functions in the library:\n- `compute_unique_lines` - This function takes a list of input file paths and an output file path, iterates over the input file paths and writes unique lines to the output file.\n- `compute_added_lines` - This function takes three arguments `first_file_path`, `second_file_path` and `output_file_path`, and writes to the output file only lines that appeared in the second file but not in the first.\n\n\n### Built With\n\n* [pyo3](https://github.com/PyO3/pyo3)\n* [crossbeam](https://github.com/crossbeam-rs/crossbeam)\n* [ahash](https://github.com/tkaitchuck/aHash)\n* [parking_lot](https://github.com/Amanieu/parking_lot)\n* [memchr](https://github.com/BurntSushi/memchr)\n* [bytecount](https://github.com/llogiq/bytecount)\n\n\n### Performance\n\n#### Deduplicating\n| Library | Function | Time | Peak Memory |\n| ------------- | ------------- | ------------- | ------------- |\n| [GNU Sort](https://www.gnu.org/software/coreutils/) | sort -u -o output 500mb_one 500mb_two | 37.35s | 8,261mb |\n| [PyDeduplines](https://github.com/intsights/PyDeduplines) | compute_unique_lines('./workdir', ['500mb_one', '500mb_two'], 'output', 16) | 4.55s | 685mb |\n\n#### Added Lines\n| Library | Function | Time | Peak Memory |\n| ------------- | ------------- | ------------- | ------------- |\n| [GNU Sort](https://www.gnu.org/software/coreutils/) | comm -1 -3 <(sort 500mb_one) <(sort 500mb_two) > output.txt | 26.53s | 4,132mb |\n| [PyDeduplines](https://github.com/intsights/PyDeduplines) | compute_added_lines('./workdir', '500mb_one', '500mb_two', 'output', 16) | 3.95s | 314mb |\n\n\n### Installation\n\n```sh\npip3 install PyDeduplines\n```\n\n\n## Documentation\n\n```python\ndef compute_unique_lines(\n working_directory: str,\n file_paths: typing.List[str],\n output_file_path: str,\n number_of_splits: int,\n number_of_threads: int = 0,\n) -> None: ...\n```\n- `working_directory` - A file path of a directory to work in. Each split file would be created in this directory.\n- `file_paths` - A list of strings containing the input file paths to iterate over and to calculate unique values for.\n- `output_file_path` - The path where the unique lines will be written.\n- `number_of_splits` - This parameter specifies how many smaller splits are to be made from each input file based on the number of splits. The idea behind this library is defined by this parameter. The more splits, the lower the peak memory consumption. Remember that the more splits you have, the more files you have open.\n- `number_of_threads` - Number of parallel threads. Using *0* means to use as many cores as possible. The number of threads greater than *1* would cause multiple splits on each input file.\n\n```python\ndef compute_added_lines(\n working_directory: str,\n first_file_path: str,\n second_file_path: str,\n output_file_path: str,\n number_of_splits: int,\n number_of_threads: int = 0,\n) -> None: ...\n```\n- `working_directory` - A file path of a directory to work in. Each split file would be created in this directory.\n- `first_file_path` - A path to the first file to be iterated over.\n- `second_file_path` - A file path to iterate over and find lines that do not exist in the first file.\n- `output_file_path` - A path to the output file that contains the lines that appeared in the second file but not in the first.\n- `number_of_splits` - This parameter specifies how many smaller splits are to be made from each input file based on the number of splits. The idea behind this library is defined by this parameter. The more splits, the lower the peak memory consumption. Remember that the more splits you have, the more files you have open.\n- `number_of_threads` - Number of parallel threads. Using *0* means to use as many cores as possible. The number of threads greater than *1* would cause multiple splits on each input file.\n\n## Usage\n\n```python\nimport pydeduplines\n\n\npydeduplines.compute_unique_lines(\n working_directory='tmp',\n file_paths=[\n '500mb_one',\n '500mb_two',\n ],\n output_file_path='output',\n number_of_splits=4,\n)\n\npydeduplines.compute_added_lines(\n working_directory='tmp',\n first_file_path='500mb_one',\n second_file_path='500mb_two',\n output_file_path='output',\n number_of_splits=4,\n)\n```\n\n\n## License\n\nDistributed under the MIT License. See `LICENSE` for more information.\n\n\n## Contact\n\nGal Ben David - gal@intsights.com\n\nProject Link: [https://github.com/intsights/PyDeduplines](https://github.com/intsights/PyDeduplines)\n\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Python library for a duplicate lines removal written in Rust",
"version": "0.6.0",
"split_keywords": [
"unique",
"lines",
"rust",
"pyo3"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "4e4c14fca0f569e0838160fc8c628f5f5a6b240fa8cffcfe39ff80793736c64b",
"md5": "767133c0f2a6535b1fa0f5856800e924",
"sha256": "005565f39a37e161a6aa8929c300593a714c9055f9763911d009d91f4083678c"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp310-cp310-macosx_10_7_x86_64.whl",
"has_sig": false,
"md5_digest": "767133c0f2a6535b1fa0f5856800e924",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": null,
"size": 204729,
"upload_time": "2023-01-17T11:06:01",
"upload_time_iso_8601": "2023-01-17T11:06:01.223168Z",
"url": "https://files.pythonhosted.org/packages/4e/4c/14fca0f569e0838160fc8c628f5f5a6b240fa8cffcfe39ff80793736c64b/PyDeduplines-0.6.0-cp310-cp310-macosx_10_7_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "c9d0ac214be0d734a5d6f4ec968c04dab346d7e85b3c62a985241147c23339cb",
"md5": "a805b94e8010ff0b7cf061072b008f37",
"sha256": "c2a881329971441ee0be4a3c0abe3df9839aaffb45a5e27a456113ae3d0a5a3c"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "a805b94e8010ff0b7cf061072b008f37",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": null,
"size": 205495,
"upload_time": "2023-01-17T11:04:42",
"upload_time_iso_8601": "2023-01-17T11:04:42.340505Z",
"url": "https://files.pythonhosted.org/packages/c9/d0/ac214be0d734a5d6f4ec968c04dab346d7e85b3c62a985241147c23339cb/PyDeduplines-0.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "85317e870a3e96b899fb873081d37bfffb4eeb3dcfa7e1df6e80c8ce0e594e36",
"md5": "877c2f38f9e27ed6ab4d89655846d957",
"sha256": "d0c379b03e5d8bef51f377c23c413591142bb7c4c5198c163427d1d37609860c"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp310-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "877c2f38f9e27ed6ab4d89655846d957",
"packagetype": "bdist_wheel",
"python_version": "cp310",
"requires_python": null,
"size": 145887,
"upload_time": "2023-01-17T11:05:38",
"upload_time_iso_8601": "2023-01-17T11:05:38.987208Z",
"url": "https://files.pythonhosted.org/packages/85/31/7e870a3e96b899fb873081d37bfffb4eeb3dcfa7e1df6e80c8ce0e594e36/PyDeduplines-0.6.0-cp310-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "e7c645b81e2b281ba52a01e7676fd2b4c9ee9e1ab76165f209655a4e4d7d8932",
"md5": "efbc73b96a4d0efbdb6bcf233f6fc278",
"sha256": "d2d4ec005223c8c384983ce861d5172702378359e2019c47b24cdfde7622c8fb"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp311-cp311-macosx_10_7_x86_64.whl",
"has_sig": false,
"md5_digest": "efbc73b96a4d0efbdb6bcf233f6fc278",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": null,
"size": 204729,
"upload_time": "2023-01-17T11:04:40",
"upload_time_iso_8601": "2023-01-17T11:04:40.554076Z",
"url": "https://files.pythonhosted.org/packages/e7/c6/45b81e2b281ba52a01e7676fd2b4c9ee9e1ab76165f209655a4e4d7d8932/PyDeduplines-0.6.0-cp311-cp311-macosx_10_7_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "1622f98579d8adddeba81a449150858b3b38a20347f17dd51ed027b5009ad296",
"md5": "1f1c7c7347e93da44e1e21406e080b2c",
"sha256": "24a6638b7a6d57e89cb324eb6532efd7dbd1ce0522684ea6bb293ec661f1263a"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "1f1c7c7347e93da44e1e21406e080b2c",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": null,
"size": 205494,
"upload_time": "2023-01-17T11:05:03",
"upload_time_iso_8601": "2023-01-17T11:05:03.163377Z",
"url": "https://files.pythonhosted.org/packages/16/22/f98579d8adddeba81a449150858b3b38a20347f17dd51ed027b5009ad296/PyDeduplines-0.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "bd956074f84f6458f4c0e232ce67e7858ce6973521deb84d2e620d55dceeb1db",
"md5": "49e9281514058ddafea5a64fa084e7ab",
"sha256": "3e2e9784232d9ef971f7aec0f853b3f2ad0c717c3966256dbb0ba51ec74ea9fa"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp311-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "49e9281514058ddafea5a64fa084e7ab",
"packagetype": "bdist_wheel",
"python_version": "cp311",
"requires_python": null,
"size": 145892,
"upload_time": "2023-01-17T11:05:23",
"upload_time_iso_8601": "2023-01-17T11:05:23.104622Z",
"url": "https://files.pythonhosted.org/packages/bd/95/6074f84f6458f4c0e232ce67e7858ce6973521deb84d2e620d55dceeb1db/PyDeduplines-0.6.0-cp311-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "5cca70bd0d31bbf51f5e3120310abe19e0fb5d8092b1f9cfeb99a095b7d570ed",
"md5": "a8af1e0edc1c5cf79dbaba7ab8d07df3",
"sha256": "f23b66748aa553065682f50ff9cdd43b3a63bf6a32e44feb6793aad4ba87485f"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp37-cp37m-macosx_10_7_x86_64.whl",
"has_sig": false,
"md5_digest": "a8af1e0edc1c5cf79dbaba7ab8d07df3",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": null,
"size": 204985,
"upload_time": "2023-01-17T11:04:48",
"upload_time_iso_8601": "2023-01-17T11:04:48.671620Z",
"url": "https://files.pythonhosted.org/packages/5c/ca/70bd0d31bbf51f5e3120310abe19e0fb5d8092b1f9cfeb99a095b7d570ed/PyDeduplines-0.6.0-cp37-cp37m-macosx_10_7_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "5e25ddacfa07e686e1e20c42bc11872ab7580030e177bc410019e03378c3ab10",
"md5": "2bdc98800e8ff7ccb51359f3a943516d",
"sha256": "469f6402bb8fed856637fe3649295a6ae4a089857334acc15c026e4f0a72356f"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "2bdc98800e8ff7ccb51359f3a943516d",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": null,
"size": 205715,
"upload_time": "2023-01-17T11:04:43",
"upload_time_iso_8601": "2023-01-17T11:04:43.411529Z",
"url": "https://files.pythonhosted.org/packages/5e/25/ddacfa07e686e1e20c42bc11872ab7580030e177bc410019e03378c3ab10/PyDeduplines-0.6.0-cp37-cp37m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "7c86b9a0d86e9793b9ffd7d65d244c1e353c015c885a7e5fe90847106ed3f683",
"md5": "a1ff86d4b20a91c1af66951d097b5a56",
"sha256": "19f82279fa7a8d38d74b38f27bdcb20315ef8fbe07d0c9e91144ecc5d6ad741c"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp37-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "a1ff86d4b20a91c1af66951d097b5a56",
"packagetype": "bdist_wheel",
"python_version": "cp37",
"requires_python": null,
"size": 146008,
"upload_time": "2023-01-17T11:05:47",
"upload_time_iso_8601": "2023-01-17T11:05:47.569918Z",
"url": "https://files.pythonhosted.org/packages/7c/86/b9a0d86e9793b9ffd7d65d244c1e353c015c885a7e5fe90847106ed3f683/PyDeduplines-0.6.0-cp37-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "3035acd5661a8f344b40ab7a96df6898031d9f498baf71cd48ded089eb52e104",
"md5": "7602e04ea2aff60005e104b288df33a2",
"sha256": "08edc1dfda7ccd22e2741a8ae3bba98bfda7c3c3a71beca4aa55f5999d0c2d71"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp38-cp38-macosx_10_7_x86_64.whl",
"has_sig": false,
"md5_digest": "7602e04ea2aff60005e104b288df33a2",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": null,
"size": 204965,
"upload_time": "2023-01-17T11:04:59",
"upload_time_iso_8601": "2023-01-17T11:04:59.297043Z",
"url": "https://files.pythonhosted.org/packages/30/35/acd5661a8f344b40ab7a96df6898031d9f498baf71cd48ded089eb52e104/PyDeduplines-0.6.0-cp38-cp38-macosx_10_7_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "b8b5fb5516fec6a34fc9d823cd72904f118b694adb29b3d6ae689cbeeef338aa",
"md5": "4b22e4f10c38d919ab06ba07fb1d93f5",
"sha256": "8473b80ee500be62c0c3ea2413d04db3016b54a11b2c7f1119e761b9da8de525"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "4b22e4f10c38d919ab06ba07fb1d93f5",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": null,
"size": 205654,
"upload_time": "2023-01-17T11:04:49",
"upload_time_iso_8601": "2023-01-17T11:04:49.349754Z",
"url": "https://files.pythonhosted.org/packages/b8/b5/fb5516fec6a34fc9d823cd72904f118b694adb29b3d6ae689cbeeef338aa/PyDeduplines-0.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "6ba8ba0b96fc0150cc61ed999ce3679c570314c4670af96057199f192d6d9207",
"md5": "9c4f547e94a5c1c06e898fe759c26e9a",
"sha256": "856135e747ff4273d55aff962408ef8f8f78632d5a44b9e63059434f0be360b5"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp38-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "9c4f547e94a5c1c06e898fe759c26e9a",
"packagetype": "bdist_wheel",
"python_version": "cp38",
"requires_python": null,
"size": 146105,
"upload_time": "2023-01-17T11:06:41",
"upload_time_iso_8601": "2023-01-17T11:06:41.178332Z",
"url": "https://files.pythonhosted.org/packages/6b/a8/ba0b96fc0150cc61ed999ce3679c570314c4670af96057199f192d6d9207/PyDeduplines-0.6.0-cp38-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "31c4210c7f878471f14e27b7cb59f09502e089802b7b7185436819ce95caf96d",
"md5": "03aa595224056bbe84554021aeafbc14",
"sha256": "1c8a4b989cb01bfbfc90c482cdc6719a00884fd025c54b7f90bca7b1861d217f"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp39-cp39-macosx_10_7_x86_64.whl",
"has_sig": false,
"md5_digest": "03aa595224056bbe84554021aeafbc14",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": null,
"size": 204753,
"upload_time": "2023-01-17T11:04:39",
"upload_time_iso_8601": "2023-01-17T11:04:39.716973Z",
"url": "https://files.pythonhosted.org/packages/31/c4/210c7f878471f14e27b7cb59f09502e089802b7b7185436819ce95caf96d/PyDeduplines-0.6.0-cp39-cp39-macosx_10_7_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "18b2e20426728383650cac7179a65645f0e179fc26ae9b2550684894636c8545",
"md5": "d2f70b7ce9489f96e279a2b631e488f5",
"sha256": "01236dd7f060bb7450fe9b9fc8642e840eee15f61b219e2128b275c37ba3337d"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"has_sig": false,
"md5_digest": "d2f70b7ce9489f96e279a2b631e488f5",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": null,
"size": 205481,
"upload_time": "2023-01-17T11:05:07",
"upload_time_iso_8601": "2023-01-17T11:05:07.811463Z",
"url": "https://files.pythonhosted.org/packages/18/b2/e20426728383650cac7179a65645f0e179fc26ae9b2550684894636c8545/PyDeduplines-0.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "0bcd5d2dc12b7a22ae6cf4f02f236da3fef9fb25b15b7ee2e092a659d35c4208",
"md5": "822a0d78653d8c53f95ca0b55c447912",
"sha256": "86c9b80d5c1daca29794a669cd139b89541b334652d766ecb8ab77fcbe3f867d"
},
"downloads": -1,
"filename": "PyDeduplines-0.6.0-cp39-none-win_amd64.whl",
"has_sig": false,
"md5_digest": "822a0d78653d8c53f95ca0b55c447912",
"packagetype": "bdist_wheel",
"python_version": "cp39",
"requires_python": null,
"size": 145884,
"upload_time": "2023-01-17T11:05:28",
"upload_time_iso_8601": "2023-01-17T11:05:28.983094Z",
"url": "https://files.pythonhosted.org/packages/0b/cd/5d2dc12b7a22ae6cf4f02f236da3fef9fb25b15b7ee2e092a659d35c4208/PyDeduplines-0.6.0-cp39-none-win_amd64.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-01-17 11:06:01",
"github": true,
"gitlab": false,
"bitbucket": false,
"github_user": "intsights",
"github_project": "PyDeduplines",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"lcname": "pydeduplines"
}
JSON
