# bigsort
sort or shuffle big file/stream
## usage
> pip install bigsort
### shell
```shell
bigsort -i readme.md -o sorted.txt # default sort in increase
cat readme.md | bigsort --sortType=d --unique=1 > sorted.txt # sort pipe, order in descend, unique
bigsort -i sorted.txt -c ">" # check order
bigsort -i readme.md --unique=1 | bigsort --sortType=R > sorted.txt # unique and shufle
head -c 100000000 /dev/urandom | python bigsort.py -C=1000 -m=0.999 --sortType=R -T="./" > sorted.txt
wc -l *.py | bigsort -k 1n,2 -b 1 -t " " # sort by key
bigsort -i readme.md -s R -g 10 # get first 10 lines
```
### python
```python
import os
from bigsort import bigsort, sortFile, check
# sort in file
sortFile("cat readme.md","sorted.txt")
check(open("sorted.txt"),"<=")
# sort in pipe
bigsort(os.popen("cat readme.md"),open("sorted.txt",'w'),unique=1,sortType="d")
check(open("sorted.txt"),">")
```
## [custom sort](demo.py)
Raw data
{
"_id": null,
"home_page": "https://github.com/laohur/bigsort",
"name": "bigsort",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.0",
"maintainer_email": "",
"keywords": "bigsort,sort,external sort,big file sort",
"author": "laohur",
"author_email": "laohur@gmail.com",
"download_url": "https://files.pythonhosted.org/packages/09/f3/88fc5bb7cea80a2888d44a2d196b6f40f2d4cfe0389cc105572e42d5ef15/bigsort-0.1.9.tar.gz",
"platform": null,
"description": "# bigsort\r\nsort or shuffle big file/stream\r\n\r\n## usage\r\n> pip install bigsort \r\n\r\n### shell\r\n\r\n```shell\r\nbigsort -i readme.md -o sorted.txt # default sort in increase \r\ncat readme.md | bigsort --sortType=d --unique=1 > sorted.txt # sort pipe, order in descend, unique\r\nbigsort -i sorted.txt -c \">\" # check order\r\nbigsort -i readme.md --unique=1 | bigsort --sortType=R > sorted.txt # unique and shufle \r\nhead -c 100000000 /dev/urandom | python bigsort.py -C=1000 -m=0.999 --sortType=R -T=\"./\" > sorted.txt\r\nwc -l *.py | bigsort -k 1n,2 -b 1 -t \" \" # sort by key\r\nbigsort -i readme.md -s R -g 10 # get first 10 lines\r\n```\r\n\r\n### python\r\n\r\n```python\r\nimport os\r\nfrom bigsort import bigsort, sortFile, check\r\n\r\n# sort in file\r\nsortFile(\"cat readme.md\",\"sorted.txt\")\r\ncheck(open(\"sorted.txt\"),\"<=\")\r\n\r\n# sort in pipe\r\nbigsort(os.popen(\"cat readme.md\"),open(\"sorted.txt\",'w'),unique=1,sortType=\"d\")\r\ncheck(open(\"sorted.txt\"),\">\")\r\n```\r\n\r\n## [custom sort](demo.py)\r\n",
"bugtrack_url": null,
"license": "[Anti-996 License](https: // github.com/996icu/996.ICU/blob/master/LICENSE)",
"summary": "sort big file or streams",
"version": "0.1.9",
"project_urls": {
"Homepage": "https://github.com/laohur/bigsort"
},
"split_keywords": [
"bigsort",
"sort",
"external sort",
"big file sort"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "fae6d155fdb779f1f75d54533c2864de4c2eaa930091598f98a548a93f85718f",
"md5": "9b6ffe212a1b4a5d35580d6b483e8b5e",
"sha256": "89d92ef83ba04564353673364c4a6c4df0ef1e6d5705e7e6fc0b434e0f52888e"
},
"downloads": -1,
"filename": "bigsort-0.1.9-py3-none-any.whl",
"has_sig": false,
"md5_digest": "9b6ffe212a1b4a5d35580d6b483e8b5e",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.0",
"size": 4958,
"upload_time": "2023-12-04T02:01:07",
"upload_time_iso_8601": "2023-12-04T02:01:07.368203Z",
"url": "https://files.pythonhosted.org/packages/fa/e6/d155fdb779f1f75d54533c2864de4c2eaa930091598f98a548a93f85718f/bigsort-0.1.9-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "09f388fc5bb7cea80a2888d44a2d196b6f40f2d4cfe0389cc105572e42d5ef15",
"md5": "bcf10995a97820f2fcf65f1f771cb727",
"sha256": "2157adb7707f191e0869bc1a124c8c94d13a8974d4beda479081467e3d3db630"
},
"downloads": -1,
"filename": "bigsort-0.1.9.tar.gz",
"has_sig": false,
"md5_digest": "bcf10995a97820f2fcf65f1f771cb727",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.0",
"size": 4731,
"upload_time": "2023-12-04T02:01:11",
"upload_time_iso_8601": "2023-12-04T02:01:11.989601Z",
"url": "https://files.pythonhosted.org/packages/09/f3/88fc5bb7cea80a2888d44a2d196b6f40f2d4cfe0389cc105572e42d5ef15/bigsort-0.1.9.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-12-04 02:01:11",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "laohur",
"github_project": "bigsort",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "bigsort"
}