# CATCLI
[](https://github.com/deadc0de6/catcli/actions)
[](http://www.gnu.org/licenses/gpl-3.0)
[](https://codecov.io/gh/deadc0de6/catcli)
[](https://badge.fury.io/py/catcli)
[](https://aur.archlinux.org/packages/catcli-git)
[](https://pypi.python.org/pypi/catcli)
[](https://ko-fi.com/deadc0de6)
*The command line catalog tool for your offline data*
> [!WARNING]
> catcli has been superseded by [gocatcli](https://github.com/deadc0de6/gocatcli/)
> which provides all features of catcli and more...
Did you ever wanted to find back that specific file that should be on one of your
backup DVDs or one of your external hard drives? You usually go through all
of them hoping to find the right one on the first try?
[Catcli](https://github.com/deadc0de6/catcli) indexes external media
in a catalog file and allows to quickly find specific files or even navigate in the
catalog of indexed files while these are not connected to your host.
Features:
* Index any directories in a catalog
* Ability to search for files by name in the catalog
* Ability to navigate through indexed data à la `ls`
* Support for fuse to mount the indexed data as a virtual filesystem
* Handle archive files (zip, tar, ...) and index their content
* Save catalog to json for easy versioning with git
* Command line interface FTW
* Store files and directories sizes
* Store md5 hash of files
* Ability to update the catalog
* Support for `fzf` for finding files
* Tag your different storages with additional information
* Export catalog to CSV
<a href="https://asciinema.org/a/hRE22qbVtBGxOM1yxw2y4fBy8"><img src="https://asciinema.org/a/hRE22qbVtBGxOM1yxw2y4fBy8.png" width="50%" height="50%"></a>
Quick start:
```bash
# install catcli with pip
pip3 install catcli --user
# index a directory in the catalog
catcli index --meta='some description' log /var/log
# display the content
catcli ls -r
# navigate
catcli ls log
# find files/directories named '*log*'
catcli find log
# show directories sizes
catcli du log
```
see [usage](#usage) for specific info
## Why catcli?
[Catcli](https://github.com/deadc0de6/catcli) gives the ability to navigate,
explore and find your files that are stored on external media
(DVDs, hard drives, USB sticks, etc) when those are not connected.
Catcli can just as easily index any arbitrary directories.
See the [examples](#examples) for an overview of the available features.
---
**Table of Contents**
* [Installation](#installation)
* [Usage](#usage)
* [Index data](#index-data)
* [Index archive files](#index-archive-files)
* [Walk indexed files with ls](#walk-indexed-files-with-ls)
* [Find files](#find-files)
* [Mount catalog](#mount-catalog)
* [Display entire hierarchy](#display-entire-hierarchy)
* [Disk usage](#disk-usage)
* [Catalog graph](#catalog-graph)
* [Edit storage](#edit-storage)
* [Update catalog](#update-catalog)
* [CSV format](#csv-format)
* [Examples](#examples)
* [Contribution](#contribution)
* [Thank you](#thank-you)
# Installation
Install from Pypi
```bash
$ pip3 install catcli --user
```
Or from github directly
```bash
$ cd /tmp; git clone https://github.com/deadc0de6/catcli && cd catcli
$ sudo python3 setup.py install
$ catcli --help
```
To work with catcli without installing it, you can do the following
```bash
$ cd /tmp; git clone https://github.com/deadc0de6/catcli && cd catcli
$ pip3 install -r requirements.txt --user
$ python3 -m catcli.catcli --help
```
or install it in a virtualenv
```bash
$ cd /tmp; git clone https://github.com/deadc0de6/catcli && cd catcli
$ virtualenv -p python3 env
$ source env/bin/activate
$ python setup.py install
$ catcli --help
```
Catcli is also available on aur: https://aur.archlinux.org/packages/catcli-git/
# Usage
Each indexed directory is stored in the catalog. Multiple directories can be indexed
and they are all available through the command line interface of catcli.
Five different types of entry are present in a catalog:
* **top node**: this is the root of the hierarchy
* **storage node**: this represents an indexed storage (a DVD, an external
hard drive, an USB drive, some arbitrary directory, etc).
* **dir node**: this is a directory
* **file node**: this is a file
* **archive node**: this is a file contained in an archive (tar, zip, etc)
Following environment variables are supported:
* `CATCLI_CATALOG_PATH`: define the catalog path (`--catalog=<path>`)
* `CATCLI_NO_BANNER`: disable the banner (`--no-banner`)
* `CATCLI_VERBOSE`: enable verbose mode (`--verbose`)
* `CATCLI_FORMAT`: define the output format (`-F --format=<fmt>`)
## Index data
Let's say the DVD or external hard drive that needs to be indexed
is mounted on `/media/mnt`. The following command
will index the entire directory `/media/mnt`
and store that in your catalog under the name `<short-name>`.
```bash
$ catcli index --meta=<some-description> <short-name> /media/mnt
```
If not specified otherwise (with the switch `--catalog`), the catalog is saved in the current
directory under `catcli.catalog`.
The `--meta` switch allows to add any additional information to store along in
the catalog like for example `the blue disk in my office`.
Using the `-a --archive` switch allows to also index archive files as explained
[below](#index-archive-files).
## Index archive files
Catcli is able to index and explore the content of archive files.
Following archive formats are supported: *tar*, *tar.gz*, *tar.xz*, *lzma*, *tar.bz2*, *zip*.
Catcli is also able to find files within indexed archive files.
See the [archive example](#archive-example) for more.
## Walk indexed files with ls
A catalog can be walked using the command `ls` as if the media
is mounted (File/directories separator is `/`).
```bash
$ catcli ls tmp/a/b/c
```
Resulting files can be sorted by size using `-S --sortsize`.
See the [examples](#examples) for more.
## Find files
Files and directories can be found based on their names
using the `find` command.
`Find` support two formats that allow to use `fzf` for
searching:
* `--format=fzf-native`: display the result in native format
* `--format=fzf-csv`: display the result in csv
See the [examples](#examples) for more.
## Mount catalog
The catalog can be mounted with [fuse](https://www.kernel.org/doc/html/next/filesystems/fuse.html)
and navigate like any filesystem.
```bash
$ mkdir /tmp/mnt
$ catcli index -c github .github
$ catcli mount /tmp/mnt
$ ls -laR /tmp/mnt
drwxrwxrwx - user 8 Mar 22:08 github
mnt/github:
.rwxrwxrwx 17 user 19 Oct 2022 FUNDING.yml
drwxrwxrwx - user 2 Mar 10:15 workflows
mnt/github/workflows:
.rwxrwxrwx 691 user 19 Oct 2022 pypi-release.yml
.rwxrwxrwx 635 user 8 Mar 21:08 testing.yml
```
## Display entire hierarchy
The entire catalog can be shown using the `ls -r` command.
Resulting files can be sorted by size using the `-S --sortsize` switch.
See the [examples](#examples) for more.
## Disk usage
You can get the disk usage with the `du` command.
Resulting files can be sorted by size using the `-S --sortsize` switch.
## Catalog graph
The catalog can be exported in a dot file that can be used to
generate a graph of the indexed files.
```bash
$ catcli graph
dot file created under "/tmp/catcli.dot"
create graph with "dot /tmp/catcli.dot -T png -o /tmp/tree.png" (you need graphviz)
$ dot /tmp/catcli.dot -T png -o /tmp/tree.png
```
## Edit storage
Storage entry can be edited with following catcli commands:
* `rename` - rename the storage
* `edit` - edit storage metadata
## Update catalog
The catalog can be updated with the `update` command.
Updates are based on the access time of each of the files and on the
hash checksum if present (catalog was indexed with `-c --hash` and
`update` is called with the switch `-c --hash`).
## CSV format
Results can be printed to CSV using `--format=csv`.
Fields are separated by a comma (`,`) and are quoted with double quotes (`"`).
Each line contains the following fields:
* **name**: the entry name
* **type**: the entry type (file, directory, storage, etc)
* **path**: the entry path
* **size**: the entry size
* **indexed_at**: when this entry was indexed
* **maccess**: the entry modification date/time
* **md5**: the entry checksum (if any)
* **nbfiles**: the number of children (empty for nodes that are not storage or directory)
* **free_space**: free space (empty for not storage nodes)
* **total_space**: total space (empty for not storage nodes)
* **meta**: meta information (empty for not storage nodes)
# Examples
## Simple example
Let's first create some files and directories:
```bash
$ mkdir -p /tmp/test/{a,b,c}
$ echo 'something in files in a' > /tmp/test/a/{1,2,3}
$ echo 'something else in files in b' > /tmp/test/b/{4,5,6}
$ echo 'some bytes' > /tmp/test/c/{7,8,9}
$ tree /tmp/test
/tmp/test
├── a
│ ├── 1
│ ├── 2
│ └── 3
├── b
│ ├── 4
│ ├── 5
│ └── 6
└── c
├── 7
├── 8
└── 9
3 directories, 9 files
```
First this directory is indexed with `catcli` as if it was some kind of
external storage:
```bash
$ catcli index --meta='my test directory' tmptest /tmp/test
```
Catcli creates its catalog file in the current directory as `catcli.catalog`.
Printing the entire catalog as a tree is done with the command `ls -r`
```
$ catcli ls -r
top
└── storage: tmptest (my test directory) (nbfiles:3, free:3.7G/3.7G, date:2019-01-26 19:59:47)
├── a [nbfiles:3, totsize:72]
│ ├── 1 [size:24]
│ ├── 2 [size:24]
│ └── 3 [size:24]
├── b [nbfiles:3, totsize:87]
│ ├── 4 [size:29]
│ ├── 5 [size:29]
│ └── 6 [size:29]
└── c [nbfiles:3, totsize:33]
├── 7 [size:11]
├── 8 [size:11]
└── 9 [size:11]
```
The catalog can be walked with `ls` as if it was a normal directory
```
$ catcli ls
top
- storage: tmptest (my test directory) (nbfiles:3, free:3.7G/3.7G, date:2019-01-26 19:59:47)
$ catcli ls tmptest
storage: tmptest (my test directory) (nbfiles:3, free:3.7G/3.7G, date:2019-01-26 19:59:47)
- a [nbfiles:3, totsize:72]
- b [nbfiles:3, totsize:87]
- c [nbfiles:3, totsize:33]
$ catcli ls tmptest/b
b [nbfiles:3, totsize:87]
- 4 [size:29]
- 5 [size:29]
- 6 [size:29]
```
And files can be found using the command `find`
```bash
$ catcli find 9
c/9 [size:11, storage:tmptest]
```
When using the `-b --script` switch, a one-liner is generated
that allows to handle the found file(s)
```
$ catcli find 9 --script
c/9 [size:11, storage:tmptest]
op=file; source=/media/mnt; $op ${source}/c/9
```
## Archive example
Let's consider a directory containing archive files:
```bash
$ ls -1 /tmp/catcli
catcli-0.3.1
v0.3.1.tar.gz
v0.3.1.zip
```
To enable the indexing of archive contents use
the `-a --archive` switch
```bash
$ catcli index -au some-name /tmp/catcli
```
Then any command can be used to explore the catalog as for normal
files but, by providing the `-a --archive` switch, archive content are displayed.
```bash
$ catcli ls some-name
storage: some-name (free:800G, total:1T)
- catcli-0.3.1 [nbfiles:11, totsize:80.5K]
- v0.3.1.tar.gz [size:24.2K]
- v0.3.1.zip [size:31.2K]
$ catcli ls -r some-name/v0.3.1.zip
v0.3.1.zip [size:31.2K]
$ catcli ls -ar some-name/v0.3.1.zip
v0.3.1.zip [size:31.2K]
├── catcli-0.3.1 [archive:v0.3.1.zip]
│ ├── catcli [archive:v0.3.1.zip]
│ │ ├── __init__.py [archive:v0.3.1.zip]
│ │ ├── catalog.py [archive:v0.3.1.zip]
│ │ ├── catcli.py [archive:v0.3.1.zip]
│ │ ├── logger.py [archive:v0.3.1.zip]
│ │ ├── noder.py [archive:v0.3.1.zip]
│ │ ├── utils.py [archive:v0.3.1.zip]
│ │ └── walker.py [archive:v0.3.1.zip]
│ ├── .gitignore [archive:v0.3.1.zip]
│ ├── LICENSE [archive:v0.3.1.zip]
│ ├── MANIFEST.in [archive:v0.3.1.zip]
│ ├── README.md [archive:v0.3.1.zip]
│ ├── requirements.txt [archive:v0.3.1.zip]
│ ├── setup.cfg [archive:v0.3.1.zip]
│ ├── setup.py [archive:v0.3.1.zip]
│ ├── tests [archive:v0.3.1.zip]
│ │ ├── __init__.py [archive:v0.3.1.zip]
│ │ ├── helpers.py [archive:v0.3.1.zip]
│ │ ├── test_find.py [archive:v0.3.1.zip]
│ │ ├── test_graph.py [archive:v0.3.1.zip]
│ │ ├── test_index.py [archive:v0.3.1.zip]
│ │ ├── test_ls.py [archive:v0.3.1.zip]
│ │ ├── test_rm.py [archive:v0.3.1.zip]
│ │ └── test_tree.py [archive:v0.3.1.zip]
│ ├── tests.sh [archive:v0.3.1.zip]
│ └── .travis.yml [archive:v0.3.1.zip]
└── catcli-0.3.1/ [archive:v0.3.1.zip]
```
# Contribution
If you are having trouble installing or using catcli, open an issue.
If you want to contribute, feel free to do a PR (please follow PEP8).
The `tests.sh` script can be run to check the code.
# Thank you
If you like catcli, [buy me a coffee](https://ko-fi.com/deadc0de6).
# License
This project is licensed under the terms of the GPLv3 license.
Raw data
{
"_id": null,
"home_page": "https://github.com/deadc0de6/catcli",
"name": "catcli",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3",
"maintainer_email": "",
"keywords": "catalog commandline indexer offline",
"author": "deadc0de6",
"author_email": "deadc0de6@foo.bar",
"download_url": "https://files.pythonhosted.org/packages/5e/0c/405029c0795d280c20fcd3523650be7e7ce046432970a9bd653842b0a422/catcli-1.0.tar.gz",
"platform": null,
"description": "# CATCLI\n\n[](https://github.com/deadc0de6/catcli/actions)\n[](http://www.gnu.org/licenses/gpl-3.0)\n[](https://codecov.io/gh/deadc0de6/catcli)\n\n[](https://badge.fury.io/py/catcli)\n[](https://aur.archlinux.org/packages/catcli-git)\n[](https://pypi.python.org/pypi/catcli)\n\n[](https://ko-fi.com/deadc0de6)\n\n*The command line catalog tool for your offline data*\n\n> [!WARNING]\n> catcli has been superseded by [gocatcli](https://github.com/deadc0de6/gocatcli/)\n> which provides all features of catcli and more...\n\nDid you ever wanted to find back that specific file that should be on one of your\nbackup DVDs or one of your external hard drives? You usually go through all\nof them hoping to find the right one on the first try?\n[Catcli](https://github.com/deadc0de6/catcli) indexes external media\nin a catalog file and allows to quickly find specific files or even navigate in the\ncatalog of indexed files while these are not connected to your host.\n\nFeatures:\n\n * Index any directories in a catalog\n * Ability to search for files by name in the catalog\n * Ability to navigate through indexed data \u00e0 la `ls`\n * Support for fuse to mount the indexed data as a virtual filesystem\n * Handle archive files (zip, tar, ...) and index their content\n * Save catalog to json for easy versioning with git\n * Command line interface FTW\n * Store files and directories sizes\n * Store md5 hash of files\n * Ability to update the catalog\n * Support for `fzf` for finding files\n * Tag your different storages with additional information\n * Export catalog to CSV\n\n<a href=\"https://asciinema.org/a/hRE22qbVtBGxOM1yxw2y4fBy8\"><img src=\"https://asciinema.org/a/hRE22qbVtBGxOM1yxw2y4fBy8.png\" width=\"50%\" height=\"50%\"></a>\n\nQuick start:\n\n```bash\n# install catcli with pip\npip3 install catcli --user\n# index a directory in the catalog\ncatcli index --meta='some description' log /var/log\n# display the content\ncatcli ls -r\n# navigate\ncatcli ls log\n# find files/directories named '*log*'\ncatcli find log\n# show directories sizes\ncatcli du log\n```\n\nsee [usage](#usage) for specific info\n\n## Why catcli?\n\n[Catcli](https://github.com/deadc0de6/catcli) gives the ability to navigate,\nexplore and find your files that are stored on external media\n(DVDs, hard drives, USB sticks, etc) when those are not connected.\nCatcli can just as easily index any arbitrary directories.\n\nSee the [examples](#examples) for an overview of the available features.\n\n---\n\n**Table of Contents**\n\n* [Installation](#installation)\n* [Usage](#usage)\n\n * [Index data](#index-data)\n * [Index archive files](#index-archive-files)\n * [Walk indexed files with ls](#walk-indexed-files-with-ls)\n * [Find files](#find-files)\n * [Mount catalog](#mount-catalog)\n * [Display entire hierarchy](#display-entire-hierarchy)\n * [Disk usage](#disk-usage)\n * [Catalog graph](#catalog-graph)\n * [Edit storage](#edit-storage)\n * [Update catalog](#update-catalog)\n * [CSV format](#csv-format)\n\n* [Examples](#examples)\n* [Contribution](#contribution)\n* [Thank you](#thank-you)\n\n# Installation\n\nInstall from Pypi\n```bash\n$ pip3 install catcli --user\n```\n\nOr from github directly\n```bash\n$ cd /tmp; git clone https://github.com/deadc0de6/catcli && cd catcli\n$ sudo python3 setup.py install\n$ catcli --help\n```\n\nTo work with catcli without installing it, you can do the following\n```bash\n$ cd /tmp; git clone https://github.com/deadc0de6/catcli && cd catcli\n$ pip3 install -r requirements.txt --user\n$ python3 -m catcli.catcli --help\n```\n\nor install it in a virtualenv\n```bash\n$ cd /tmp; git clone https://github.com/deadc0de6/catcli && cd catcli\n$ virtualenv -p python3 env\n$ source env/bin/activate\n$ python setup.py install\n$ catcli --help\n```\n\nCatcli is also available on aur: https://aur.archlinux.org/packages/catcli-git/\n\n# Usage\n\nEach indexed directory is stored in the catalog. Multiple directories can be indexed\nand they are all available through the command line interface of catcli.\n\nFive different types of entry are present in a catalog:\n\n * **top node**: this is the root of the hierarchy\n * **storage node**: this represents an indexed storage (a DVD, an external\n hard drive, an USB drive, some arbitrary directory, etc).\n * **dir node**: this is a directory\n * **file node**: this is a file\n * **archive node**: this is a file contained in an archive (tar, zip, etc)\n\nFollowing environment variables are supported:\n\n* `CATCLI_CATALOG_PATH`: define the catalog path (`--catalog=<path>`)\n* `CATCLI_NO_BANNER`: disable the banner (`--no-banner`)\n* `CATCLI_VERBOSE`: enable verbose mode (`--verbose`)\n* `CATCLI_FORMAT`: define the output format (`-F --format=<fmt>`)\n\n## Index data\n\nLet's say the DVD or external hard drive that needs to be indexed\nis mounted on `/media/mnt`. The following command\nwill index the entire directory `/media/mnt`\nand store that in your catalog under the name `<short-name>`.\n\n```bash\n$ catcli index --meta=<some-description> <short-name> /media/mnt\n```\n\nIf not specified otherwise (with the switch `--catalog`), the catalog is saved in the current\ndirectory under `catcli.catalog`.\n\nThe `--meta` switch allows to add any additional information to store along in\nthe catalog like for example `the blue disk in my office`.\n\nUsing the `-a --archive` switch allows to also index archive files as explained\n[below](#index-archive-files).\n\n## Index archive files\n\nCatcli is able to index and explore the content of archive files.\nFollowing archive formats are supported: *tar*, *tar.gz*, *tar.xz*, *lzma*, *tar.bz2*, *zip*.\nCatcli is also able to find files within indexed archive files.\n\nSee the [archive example](#archive-example) for more.\n\n## Walk indexed files with ls\n\nA catalog can be walked using the command `ls` as if the media\nis mounted (File/directories separator is `/`).\n\n```bash\n$ catcli ls tmp/a/b/c\n```\n\nResulting files can be sorted by size using `-S --sortsize`.\nSee the [examples](#examples) for more.\n\n## Find files\n\nFiles and directories can be found based on their names\nusing the `find` command.\n\n`Find` support two formats that allow to use `fzf` for\nsearching:\n\n* `--format=fzf-native`: display the result in native format\n* `--format=fzf-csv`: display the result in csv\n\nSee the [examples](#examples) for more.\n\n## Mount catalog\n\nThe catalog can be mounted with [fuse](https://www.kernel.org/doc/html/next/filesystems/fuse.html)\nand navigate like any filesystem.\n\n```bash\n$ mkdir /tmp/mnt\n$ catcli index -c github .github\n$ catcli mount /tmp/mnt\n$ ls -laR /tmp/mnt\ndrwxrwxrwx - user 8 Mar 22:08 github\n\nmnt/github:\n.rwxrwxrwx 17 user 19 Oct 2022 FUNDING.yml\ndrwxrwxrwx - user 2 Mar 10:15 workflows\n\nmnt/github/workflows:\n.rwxrwxrwx 691 user 19 Oct 2022 pypi-release.yml\n.rwxrwxrwx 635 user 8 Mar 21:08 testing.yml\n```\n\n## Display entire hierarchy\n\nThe entire catalog can be shown using the `ls -r` command.\nResulting files can be sorted by size using the `-S --sortsize` switch.\n\nSee the [examples](#examples) for more.\n\n## Disk usage\n\nYou can get the disk usage with the `du` command.\nResulting files can be sorted by size using the `-S --sortsize` switch.\n\n## Catalog graph\n\nThe catalog can be exported in a dot file that can be used to\ngenerate a graph of the indexed files.\n\n```bash\n$ catcli graph\ndot file created under \"/tmp/catcli.dot\"\ncreate graph with \"dot /tmp/catcli.dot -T png -o /tmp/tree.png\" (you need graphviz)\n$ dot /tmp/catcli.dot -T png -o /tmp/tree.png\n```\n\n## Edit storage\n\nStorage entry can be edited with following catcli commands:\n\n* `rename` - rename the storage\n* `edit` - edit storage metadata\n\n## Update catalog\n\nThe catalog can be updated with the `update` command.\nUpdates are based on the access time of each of the files and on the\nhash checksum if present (catalog was indexed with `-c --hash` and\n`update` is called with the switch `-c --hash`).\n\n## CSV format\n\nResults can be printed to CSV using `--format=csv`.\nFields are separated by a comma (`,`) and are quoted with double quotes (`\"`).\n\nEach line contains the following fields:\n\n* **name**: the entry name\n* **type**: the entry type (file, directory, storage, etc)\n* **path**: the entry path\n* **size**: the entry size\n* **indexed_at**: when this entry was indexed\n* **maccess**: the entry modification date/time\n* **md5**: the entry checksum (if any)\n* **nbfiles**: the number of children (empty for nodes that are not storage or directory)\n* **free_space**: free space (empty for not storage nodes)\n* **total_space**: total space (empty for not storage nodes)\n* **meta**: meta information (empty for not storage nodes)\n\n# Examples\n\n## Simple example\n\nLet's first create some files and directories:\n\n```bash\n$ mkdir -p /tmp/test/{a,b,c}\n$ echo 'something in files in a' > /tmp/test/a/{1,2,3}\n$ echo 'something else in files in b' > /tmp/test/b/{4,5,6}\n$ echo 'some bytes' > /tmp/test/c/{7,8,9}\n$ tree /tmp/test\n/tmp/test\n\u251c\u2500\u2500 a\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 1\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 2\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 3\n\u251c\u2500\u2500 b\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 4\n\u2502\u00a0\u00a0 \u251c\u2500\u2500 5\n\u2502\u00a0\u00a0 \u2514\u2500\u2500 6\n\u2514\u2500\u2500 c\n \u251c\u2500\u2500 7\n \u251c\u2500\u2500 8\n \u2514\u2500\u2500 9\n\n3 directories, 9 files\n```\n\nFirst this directory is indexed with `catcli` as if it was some kind of\nexternal storage:\n\n```bash\n$ catcli index --meta='my test directory' tmptest /tmp/test\n```\n\nCatcli creates its catalog file in the current directory as `catcli.catalog`.\n\nPrinting the entire catalog as a tree is done with the command `ls -r`\n\n```\n$ catcli ls -r\ntop\n\u2514\u2500\u2500 storage: tmptest (my test directory) (nbfiles:3, free:3.7G/3.7G, date:2019-01-26 19:59:47)\n \u251c\u2500\u2500 a [nbfiles:3, totsize:72]\n \u2502 \u251c\u2500\u2500 1 [size:24]\n \u2502 \u251c\u2500\u2500 2 [size:24]\n \u2502 \u2514\u2500\u2500 3 [size:24]\n \u251c\u2500\u2500 b [nbfiles:3, totsize:87]\n \u2502 \u251c\u2500\u2500 4 [size:29]\n \u2502 \u251c\u2500\u2500 5 [size:29]\n \u2502 \u2514\u2500\u2500 6 [size:29]\n \u2514\u2500\u2500 c [nbfiles:3, totsize:33]\n \u251c\u2500\u2500 7 [size:11]\n \u251c\u2500\u2500 8 [size:11]\n \u2514\u2500\u2500 9 [size:11]\n```\n\nThe catalog can be walked with `ls` as if it was a normal directory\n\n```\n$ catcli ls\ntop\n- storage: tmptest (my test directory) (nbfiles:3, free:3.7G/3.7G, date:2019-01-26 19:59:47)\n\n$ catcli ls tmptest\nstorage: tmptest (my test directory) (nbfiles:3, free:3.7G/3.7G, date:2019-01-26 19:59:47)\n- a [nbfiles:3, totsize:72]\n- b [nbfiles:3, totsize:87]\n- c [nbfiles:3, totsize:33]\n\n$ catcli ls tmptest/b\nb [nbfiles:3, totsize:87]\n- 4 [size:29]\n- 5 [size:29]\n- 6 [size:29]\n```\n\nAnd files can be found using the command `find`\n\n```bash\n$ catcli find 9\n\nc/9 [size:11, storage:tmptest]\n```\n\nWhen using the `-b --script` switch, a one-liner is generated\nthat allows to handle the found file(s)\n\n```\n$ catcli find 9 --script\n\nc/9 [size:11, storage:tmptest]\nop=file; source=/media/mnt; $op ${source}/c/9\n```\n\n## Archive example\n\nLet's consider a directory containing archive files:\n\n```bash\n$ ls -1 /tmp/catcli\ncatcli-0.3.1\nv0.3.1.tar.gz\nv0.3.1.zip\n```\n\nTo enable the indexing of archive contents use\nthe `-a --archive` switch\n\n```bash\n$ catcli index -au some-name /tmp/catcli\n```\n\nThen any command can be used to explore the catalog as for normal\nfiles but, by providing the `-a --archive` switch, archive content are displayed.\n\n```bash\n$ catcli ls some-name\n\n storage: some-name (free:800G, total:1T)\n - catcli-0.3.1 [nbfiles:11, totsize:80.5K]\n - v0.3.1.tar.gz [size:24.2K]\n - v0.3.1.zip [size:31.2K]\n\n$ catcli ls -r some-name/v0.3.1.zip\n\n v0.3.1.zip [size:31.2K]\n\n$ catcli ls -ar some-name/v0.3.1.zip\n\n v0.3.1.zip [size:31.2K]\n \u251c\u2500\u2500 catcli-0.3.1 [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 catcli [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 __init__.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 catalog.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 catcli.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 logger.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 noder.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 utils.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u2514\u2500\u2500 walker.py [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 .gitignore [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 LICENSE [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 MANIFEST.in [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 README.md [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 requirements.txt [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 setup.cfg [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 setup.py [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 tests [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 __init__.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 helpers.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 test_find.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 test_graph.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 test_index.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 test_ls.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u251c\u2500\u2500 test_rm.py [archive:v0.3.1.zip]\n \u2502 \u2502 \u2514\u2500\u2500 test_tree.py [archive:v0.3.1.zip]\n \u2502 \u251c\u2500\u2500 tests.sh [archive:v0.3.1.zip]\n \u2502 \u2514\u2500\u2500 .travis.yml [archive:v0.3.1.zip]\n \u2514\u2500\u2500 catcli-0.3.1/ [archive:v0.3.1.zip]\n```\n\n# Contribution\n\nIf you are having trouble installing or using catcli, open an issue.\n\nIf you want to contribute, feel free to do a PR (please follow PEP8).\n\nThe `tests.sh` script can be run to check the code.\n\n# Thank you\n\nIf you like catcli, [buy me a coffee](https://ko-fi.com/deadc0de6).\n\n# License\n\nThis project is licensed under the terms of the GPLv3 license.\n\n\n\n",
"bugtrack_url": null,
"license": "GPLv3",
"summary": "The command line catalog tool for your offline data",
"version": "1.0",
"project_urls": {
"Download": "https://github.com/deadc0de6/catcli/archive/v1.0.tar.gz",
"Homepage": "https://github.com/deadc0de6/catcli"
},
"split_keywords": [
"catalog",
"commandline",
"indexer",
"offline"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "8e3587fd210fae2efac7949186108dd1ec497f2e44c56ad92d8b0c9a996dd511",
"md5": "e081f33b09161fbc21c5305b3f3ae5a9",
"sha256": "0373c9e6484d8c82431a2d57698ec1c0bd48283c984b8b2acd352fcdf3bba153"
},
"downloads": -1,
"filename": "catcli-1.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "e081f33b09161fbc21c5305b3f3ae5a9",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3",
"size": 41746,
"upload_time": "2024-02-17T20:49:53",
"upload_time_iso_8601": "2024-02-17T20:49:53.910623Z",
"url": "https://files.pythonhosted.org/packages/8e/35/87fd210fae2efac7949186108dd1ec497f2e44c56ad92d8b0c9a996dd511/catcli-1.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "5e0c405029c0795d280c20fcd3523650be7e7ce046432970a9bd653842b0a422",
"md5": "8928bfeb3f28edd8e001f419bfe6370f",
"sha256": "213934e95ce003635748a06ed15c9ad33587b06674887a46c0c0e3ff1411a5e7"
},
"downloads": -1,
"filename": "catcli-1.0.tar.gz",
"has_sig": false,
"md5_digest": "8928bfeb3f28edd8e001f419bfe6370f",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3",
"size": 42806,
"upload_time": "2024-02-17T20:49:55",
"upload_time_iso_8601": "2024-02-17T20:49:55.518627Z",
"url": "https://files.pythonhosted.org/packages/5e/0c/405029c0795d280c20fcd3523650be7e7ce046432970a9bd653842b0a422/catcli-1.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-02-17 20:49:55",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "deadc0de6",
"github_project": "catcli",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"requirements": [],
"lcname": "catcli"
}
JSON
