In development -
[TODO](https://github.com/search?q=repo%3Aclorteau%2Farch-wiki-search%20TODO&type=code)s
## Read and search Archwiki and other wikis, online or offline, in HTML, markdown or text, on the desktop or the terminal ##
*💡The idea is to always have access to your important wikis, even when things are so FUBAR there's no graphical environment or internet, in an easy to read way, and also to reduce the load on the wiki hoster themselves since users would be using their own cache most of the time.*
It caches what you access +1 level of links if needed on the fly while you have a network connection, and accesses the cache when you're offline or the cache needs a refresh. It can also simplify the pages on the fly and export and import caches for out-of-band sharing or inclusion in an install media.
There's no option to cache a whole wiki at once, in order to, you know, *not* DDOS them. So what will be available offline will be what you already accessed online manually, or that you imported with --merge prior.
For instance, start it with:
`$ arch-wiki-search "installation guide"`
> [!NOTE]
> As of today (2025-08-27) this is early development and the default wiki is \'archwiki\' because this started as a quick python script for me to load archwiki whenever needed. This tool is meant to read any useful wiki.
> [!TIP]
> The option --wiki has a number of pre-defined wikis and you\'re invited to add your own through this [templated bug request](https://github.com/clorteau/arch-wiki-search/issues/new?template=new-wiki.md)
For instance:
`$ arch-wiki-search --wiki=wikipedia --conv=txt "MIT license"`
[TODO: screenshots/webms]
From there, it will:
- Spin its own little local web server that will send you the pages you request, while getting them either from:
+ Its own saved copy
+ The server
- Therefore if you're offline and you already visited this when on-line, you will not see a difference 🤞
- Save/refresh the cached copy
- Search for the most appropriate available browser to load for your environment, such as 'elinks' if you're on SSH for instance, or the user's defined default browser if there's a desktop environment, and call it
- If a graphical environment is available and PyQT is installed, spawn a 📚 notification area icon where you can access the wiki directly
You can elso export and import whole caches for off-band sharing or inclusion in an install media for instance.
More details in `--help`.
This is all Python using common libraries and is a proper PyPI package itself, so it's compatible Linux (all distros), MacOS and Windows and available through all these through PyPI - again, despite the name.
### Installation ###
#### Arch Linux and derivatives through AUR ####
```bash
$ yay -S arch-wiki-search
```
#### Anywhere through PyPI ####
```bash
$ pipx install arch-wiki-search
```
### Help ###
```bash
$ usage: arch-wiki-search [-h]
[-w {archwiki,discovery,fedorawiki,freebsdwiki,gentoowiki,manjarowiki,pythonwiki,slackdocs,wikipedia}]
[-u URL] [-s SEARCHSTRING] [-c {raw,clean,basic,md,txt}] [--offline]
[--refresh] [-v] [-x] [-m MERGE] [-ni] [--clear] [-d]
[search]
Read and search Archwiki and other wikis, online or offline, in HTML, markdown or text, on the desktop or the terminal
Examples:
🡪 $ arch-wiki-search "installation guide"
🡪 $ arch-wiki-search --wiki=wikipedia --conv=txt "MIT license"
positional arguments:
search string to search (ex: "installation guide")
options:
-h, --help show this help message and exit
-w, --wiki {archwiki,discovery,fedorawiki,freebsdwiki,gentoowiki,manjarowiki,pythonwiki,slackdocs,wikipedia}
Load a known wiki by name (ex: --wiki=wikipedia) [Default: archwiki]
-u, --url URL URL of wiki to browse (ex: https://fr.wikipedia.org, https://wiki.freebsd.org)
-s, --searchstring SEARCHSTRING
alternative search string (ex: "/wiki/Special:Search?go=Go&search=", "/FrontPage?action=fullsearch&value=")
-c, --conv {raw,clean,basic,md,txt}
conversion mode:
raw: no conversion (but still remove binaries)
clean: convert to cleaner HTML (remove styles and scripts)
basic: convert to basic HTML
md: convert to markdown
txt: convert to plain text
[Default: 'raw' in graphical environment, 'basic' otherwise]
--offline, --test Don't try to go online, only use cached copy if it exists
--refresh Force going online and refresh the cache
-v, --version Print version number and exit
-x, --export Export cache as .zip file
-m, --merge MERGE Import and merge cache from a zip file created with --export
-ni, --noicon Don't show the 📚 notification area icon - only <ctrl+c> will stop
--clear Clear cache and exit
-d, --debug
Options -u and -s overwrite the corresponding url or searchstring provided by -w
Options -u and -s overwrite the corresponding url or searchstring provided by -w
Known wiki names and their url/searchstring pairs are read from a 'wikis.yaml' file in '$(pwd)' and '{$HOME}/.config/arch-wiki-search'
Github: 🌐https://github.com/clorteau/arch-wiki-search
Request to add new wiki: 🌐https://github.com/clorteau/arch-wiki-search/issues/new?template=new-wiki.md
```
Raw data
{
"_id": null,
"home_page": null,
"name": "arch-wiki-search",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": null,
"keywords": "arch, python, wiki",
"author": null,
"author_email": "Clem Lorteau <spam@lorteau.fr>",
"download_url": "https://files.pythonhosted.org/packages/f4/ec/12b107c2938bcb1c5b8563abd17a35d63dc20608c3842042c91b07094dbc/arch_wiki_search-20250829.tar.gz",
"platform": null,
"description": "In development - \n[TODO](https://github.com/search?q=repo%3Aclorteau%2Farch-wiki-search%20TODO&type=code)s\n\n\n\n## Read and search Archwiki and other wikis, online or offline, in HTML, markdown or text, on the desktop or the terminal ##\n\n*\ud83d\udca1The idea is to always have access to your important wikis, even when things are so FUBAR there's no graphical environment or internet, in an easy to read way, and also to reduce the load on the wiki hoster themselves since users would be using their own cache most of the time.*\n\nIt caches what you access +1 level of links if needed on the fly while you have a network connection, and accesses the cache when you're offline or the cache needs a refresh. It can also simplify the pages on the fly and export and import caches for out-of-band sharing or inclusion in an install media. \n\nThere's no option to cache a whole wiki at once, in order to, you know, *not* DDOS them. So what will be available offline will be what you already accessed online manually, or that you imported with --merge prior.\n\nFor instance, start it with:\n\n`$ arch-wiki-search \"installation guide\"`\n\n> [!NOTE]\n> As of today (2025-08-27) this is early development and the default wiki is \\'archwiki\\' because this started as a quick python script for me to load archwiki whenever needed. This tool is meant to read any useful wiki.\n\n> [!TIP]\n> The option --wiki has a number of pre-defined wikis and you\\'re invited to add your own through this [templated bug request](https://github.com/clorteau/arch-wiki-search/issues/new?template=new-wiki.md)\n\nFor instance:\n\n`$ arch-wiki-search --wiki=wikipedia --conv=txt \"MIT license\"`\n\n[TODO: screenshots/webms]\n \nFrom there, it will:\n- Spin its own little local web server that will send you the pages you request, while getting them either from:\n\t+ Its own saved copy\n\t+ The server\n- Therefore if you're offline and you already visited this when on-line, you will not see a difference \ud83e\udd1e\n- Save/refresh the cached copy\n- Search for the most appropriate available browser to load for your environment, such as 'elinks' if you're on SSH for instance, or the user's defined default browser if there's a desktop environment, and call it\n- If a graphical environment is available and PyQT is installed, spawn a \ud83d\udcda notification area icon where you can access the wiki directly\n\nYou can elso export and import whole caches for off-band sharing or inclusion in an install media for instance.\n\nMore details in `--help`.\n\nThis is all Python using common libraries and is a proper PyPI package itself, so it's compatible Linux (all distros), MacOS and Windows and available through all these through PyPI - again, despite the name. \n\n### Installation ###\n\n#### Arch Linux and derivatives through AUR ####\n```bash\n$ yay -S arch-wiki-search\n```\n\n#### Anywhere through PyPI ####\n```bash\n$ pipx install arch-wiki-search\n```\n\n\n### Help ###\n```bash\n$ usage: arch-wiki-search [-h]\n [-w {archwiki,discovery,fedorawiki,freebsdwiki,gentoowiki,manjarowiki,pythonwiki,slackdocs,wikipedia}]\n [-u URL] [-s SEARCHSTRING] [-c {raw,clean,basic,md,txt}] [--offline]\n [--refresh] [-v] [-x] [-m MERGE] [-ni] [--clear] [-d]\n [search]\n\nRead and search Archwiki and other wikis, online or offline, in HTML, markdown or text, on the desktop or the terminal \n\nExamples:\n \ud83e\udc6a $ arch-wiki-search \"installation guide\"\n \ud83e\udc6a $ arch-wiki-search --wiki=wikipedia --conv=txt \"MIT license\"\n\npositional arguments:\n search string to search (ex: \"installation guide\")\n\noptions:\n -h, --help show this help message and exit\n -w, --wiki {archwiki,discovery,fedorawiki,freebsdwiki,gentoowiki,manjarowiki,pythonwiki,slackdocs,wikipedia}\n Load a known wiki by name (ex: --wiki=wikipedia) [Default: archwiki]\n -u, --url URL URL of wiki to browse (ex: https://fr.wikipedia.org, https://wiki.freebsd.org)\n -s, --searchstring SEARCHSTRING\n alternative search string (ex: \"/wiki/Special:Search?go=Go&search=\", \"/FrontPage?action=fullsearch&value=\")\n -c, --conv {raw,clean,basic,md,txt}\n conversion mode:\n raw: no conversion (but still remove binaries)\n clean: convert to cleaner HTML (remove styles and scripts)\n basic: convert to basic HTML\n md: convert to markdown\n txt: convert to plain text\n [Default: 'raw' in graphical environment, 'basic' otherwise]\n --offline, --test Don't try to go online, only use cached copy if it exists\n --refresh Force going online and refresh the cache\n -v, --version Print version number and exit\n -x, --export Export cache as .zip file\n -m, --merge MERGE Import and merge cache from a zip file created with --export\n -ni, --noicon Don't show the \ud83d\udcda notification area icon - only <ctrl+c> will stop\n --clear Clear cache and exit\n -d, --debug\n\nOptions -u and -s overwrite the corresponding url or searchstring provided by -w\n\n\nOptions -u and -s overwrite the corresponding url or searchstring provided by -w\nKnown wiki names and their url/searchstring pairs are read from a 'wikis.yaml' file in '$(pwd)' and '{$HOME}/.config/arch-wiki-search'\nGithub: \ud83c\udf10https://github.com/clorteau/arch-wiki-search\nRequest to add new wiki: \ud83c\udf10https://github.com/clorteau/arch-wiki-search/issues/new?template=new-wiki.md\n```\n",
"bugtrack_url": null,
"license": null,
"summary": "Read and search Archwiki and other wikis, online or offline, on the desktop or the terminal",
"version": "20250829",
"project_urls": {
"Homepage": "https://github.com/clorteau/arch-wiki-search",
"Issues": "https://github.com/clorteau/arch-wiki-search/issues"
},
"split_keywords": [
"arch",
" python",
" wiki"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "a53ee4a492acfba8e7a02a25cd6775d4b81d96697047c01ff746cfbb289213ac",
"md5": "240c387e8eab58f8778550db5dab99d8",
"sha256": "ccfc9c7071b0516762e513616d4292b98d16f3715fc020e73903d262d3700d5b"
},
"downloads": -1,
"filename": "arch_wiki_search-20250829-py3-none-any.whl",
"has_sig": false,
"md5_digest": "240c387e8eab58f8778550db5dab99d8",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6",
"size": 22127,
"upload_time": "2025-08-29T23:50:42",
"upload_time_iso_8601": "2025-08-29T23:50:42.850311Z",
"url": "https://files.pythonhosted.org/packages/a5/3e/e4a492acfba8e7a02a25cd6775d4b81d96697047c01ff746cfbb289213ac/arch_wiki_search-20250829-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "f4ec12b107c2938bcb1c5b8563abd17a35d63dc20608c3842042c91b07094dbc",
"md5": "8826e529766727225033227742894c9c",
"sha256": "4fa329c27ea5fe8b4a0b931eddb1912e279ea266bcb06f7bd7d421abebc70a54"
},
"downloads": -1,
"filename": "arch_wiki_search-20250829.tar.gz",
"has_sig": false,
"md5_digest": "8826e529766727225033227742894c9c",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6",
"size": 18803,
"upload_time": "2025-08-29T23:50:44",
"upload_time_iso_8601": "2025-08-29T23:50:44.118632Z",
"url": "https://files.pythonhosted.org/packages/f4/ec/12b107c2938bcb1c5b8563abd17a35d63dc20608c3842042c91b07094dbc/arch_wiki_search-20250829.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-08-29 23:50:44",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "clorteau",
"github_project": "arch-wiki-search",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"requirements": [
{
"name": "aiohttp_client_cache",
"specs": []
},
{
"name": "aiofiles",
"specs": []
},
{
"name": "aiosqlite",
"specs": []
},
{
"name": "aiodns",
"specs": []
},
{
"name": "aiohttp",
"specs": []
},
{
"name": "lxml_html_clean",
"specs": []
},
{
"name": "beautifulsoup4",
"specs": []
},
{
"name": "html5lib",
"specs": []
},
{
"name": "pyyaml",
"specs": []
},
{
"name": "markdownify",
"specs": []
},
{
"name": "markdown",
"specs": []
},
{
"name": "pyqt6",
"specs": []
},
{
"name": "textual",
"specs": []
}
],
"lcname": "arch-wiki-search"
}
JSON
