| Name | pacpush JSON |
| Version |
3.2.2
JSON |
| download |
| home_page | |
| Summary | Utility to push an Arch host's package and AUR caches to other hosts |
| upload_time | 2023-10-22 21:51:53 |
| maintainer | |
| docs_url | None |
| author | |
| requires_python | >=3.8 |
| license | GPLv3 |
| keywords |
pacman
pacserve
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
## PACPUSH
[](https://aur.archlinux.org/packages/pacpush/)
[](https://pypi.org/project/pacpush/)
[pacpush](http://github.com/bulletmark/pacpush) is a simple command line
utility which Arch Linux users can use to manually push `pacman` and AUR
helper Arch Linux package updates to other machines to avoid having to
download them more than once via the web.
My use case follows as a good example of what this utility is for.
I update my main Arch PC and my Arch laptop every day using
[`yay`](https://github.com/Jguer/yay). Previously, I would update either
both machines in parallel, or one before the other. So both machines
would download the package lists from the web, then download and install
the out of date system packages, then download, build, and install all
out of date AUR packages. This takes quite some time, particularly on a
slow internet connection, and it is inefficient to be downloading and
building most packages twice for the same architecture machines.
Using `pacpush`, I now update my PC first then after that update has
finished I run `pacpush lt` on my PC to update `lt` directly via my
local LAN. Pacpush pushes the updated package lists, then queries `lt`
to work out which packages `lt` has out of date (including AUR
packages), then pushes all the system and AUR packages that it has which
`lt` needs.
After running `pacpush`, I run a [`yay`](https://github.com/Jguer/yay)
update on `lt` and it completes very quickly because `lt` only needs to
download the system and AUR packages my PC did not have. I typically use
very similar system and AUR packages on both machines so typically `lt`
doesn't need to download or build any updated AUR packages at all.
Obviously this only works for machines of the same architecture, i.e.
compatible package files, so `pacpush` checks for this before pushing any
files.
You need to have root ssh access to the remote machines for `pacpush` to
work. See the [SSH AND KEY CONFIGURATION](#ssh-and-key-configuration)
section below on how best to set this up.
If you specify multiple hosts then the program will update them in
parallel. You can limit, or increase, the number of parallel updates
using the `-p/--parallel-count` option. Update messages are output in a
unique color for each host.
Note that `pacpush` should work with any AUR helper so long as you set
`--aur-build-dir` appropriately in your configuration file, see the
[CONFIGURATION FILE](#configuration-file) section below for details.
The latest version and documentation is available at
https://github.com/bulletmark/pacpush.
## COMPARISION TO PACSERVE
To solve this problem, I originally started using
[pacserve](https://aur.archlinux.org/packages/pacserve/) which is what
is usually recommended for this use case. However pacserve does not sync
the package lists nor does it do anything about AUR packages which is
particularly unfortunate because AUR package downloads often include
huge source and other files and can require long build times. Since
`pacpush` pushes the entire AUR directory for each required package, the
second machine benefits by typically not having to download or rebuild
any updated AUR packages at all.
## INSTALLATION
Just install [_pacpush from the
AUR_](https://aur.archlinux.org/packages/pacpush/) to the local and
remote hosts.
Note pacpush is also available [on
PyPI](https://pypi.org/project/pacpush/) if you prefer so just ensure
that [`pipx`](https://pypa.github.io/pipx/) is installed then type the
following to install on each machine. Requires Python 3.7 or later.
```
$ pipx install pacpush
```
To upgrade:
```
$ pipx upgrade pacpush
```
## SSH AND KEY CONFIGURATION
You run `pacpush` directly on the command line as your normal user, not
as root and not using `sudo` explicitly. You specify as arguments the
host, or hosts, you want to update. The utility will re-invoke itself
using `sudo` and will push the required package updates.
You need to set up root ssh access from your host machine to the remote
machine[s] for this to work. For security and convenience, it is
essential to use an ssh key. The following procedure copies your
personal public ssh key to the remote root account. Your first need to
set up your own personal ssh key pair of course, see Google for that
part.
On a remote host to which you want to `pacpush` (assuming you have
already set up personal ssh access to that host):
```bash
$ sudo mkdir -p /root/.ssh
$ sudo chmod 700 /root/.ssh
$ sudo cp ~/.ssh/authorized_keys /root/.ssh
# Possibly remove any keys you don't want root to allow if you have
# more than one:
$ sudoedit /root/.ssh/authorized_keys
```
Note that the `sudo` invoked by `pacpush` on itself when you run it as
your normal user passes on `$SSH_AUTH_SOCK` so that the remote root ssh
session authenticates against your personal ssh key.
For rsync/ssh configuration convenience, `rsync` and `ssh` commands run
by root are specified with your personal user's ssh configuration file
`~/.ssh/config` if it exists (unless you specify an explicit
`--ssh-config-file` for pacpush usage as described in the next section).
Note `rsync` and `ssh` commands run on behalf of root user explicitly
specify target `root@host` so that any `User` specification in your
personal ssh configuration for any host is ignored.
## CONFIGURATION FILE
:warning: __From pacpush version 3 onwards, the format of the
`~/.config/pacpush/pacpush.conf` file has changed
from [YAML](https://yaml.org/) to a simple text file where you
specify any of the pacpush [startup options](#usage).__
You can add default options to a personal configuration file
`~/.config/pacpush/pacpush.conf`. If that file exists then each line of
options will be concatenated and automatically prepended to your
`pacpush` command line arguments. Comments in the file (i.e. starting
with a `#`) are ignored. Type `pacpush -h` to see all [supported
options](#usage). The configuration file is read for the invoking user
only on the local host client machine. The configuration file is ignored
on any remote machine you are pushing to (because all required options
are passed from the client).
You may want to change the `--aur-build-dir` setting which is the
location of your AUR helpers download/build directory. This is the
directory from which AUR packages are rsync'd from the local host to
remote hosts. `--aur-build-dir` can be set to a single directory string,
or a list of directories by inserting a "`;`" between multiple directory
names. Ensure that `--aur-build-dir` is set to, or at least contains,
the build directory your AUR helper uses. Directories which don't exist
are ignored.
**Example Settings**
AUR Helper | Build directory setting
---------- | -----------------------
`yay` | `--aur-build-dir ~/.cache/yay`.
`paru` | `--aur-build-dir ~/.cache/paru/clone`.
The default configuration is to sync many of the common AUR helper
directories that exist on your host machine. See the default
`--aur-build-dir` directories listed by `pacpush -h`. Pacpush will sync
packages in each `--aur-build-dir` directory which exists, and is
pending an update. E.g. if you were using trizen some time ago, and am
now using yay instead, then you could keep this default setting and just
do a `rm -rf ~/.cache/trizen` because pacpush ignores `--aur-build-dir`
directories which don't exist. Or you could just set `--aur-build-dir
~/.cache/yay` in your `~/.config/pacpush/pacpush.conf` which is the
slightly more efficient approach.
You can also create and specify a custom
[`--ssh-config-file`](https://linux.die.net/man/5/ssh_config) file. This
allows you to specify ssh settings for pacpush use, either globally, or
for each host. See [`man
ssh_config`](https://linux.die.net/man/5/ssh_config) for details on how
to specify ssh (including per host) settings. If the specified
`--ssh-config-file` path is relative then it is taken to be relative to
`~/.config/pacpush/`.
Any of the options specified in the next [Usage](#usage) section can be
specified in `~/.config/pacpush/pacpush.conf`.
## USAGE
Type `pacpush -h` to view the usage summary:
```
usage: pacpush [-h] [-b AUR_BUILD_DIR] [-n] [-m] [-p PARALLEL_COUNT] [-u]
[-s] [-a] [-C] [-N] [-M] [-F SSH_CONFIG_FILE] [-V] [-d]
[hosts ...]
Utility to push this Arch hosts system and AUR package caches to other host[s]
to avoid those other hosts having to download the same new package lists and
updated packages, at least for shared common packages. Requires root ssh
access to other hosts (it is easier with an auth key).
positional arguments:
hosts hosts to update
options:
-h, --help show this help message and exit
-b AUR_BUILD_DIR, --aur-build-dir AUR_BUILD_DIR
AUR build directory[s]. Can specify one, or multiple
directories separated by ";". Default is "~/.cache/yay
;~/.cache/paru/clone;~/.cache/trizen;~/.cache/pikaur/a
ur_repos;~/.cache/aurman". Non-existent directories
are ignored.
-n, --dryrun dry run only
-m, --no-machcheck do not check machine type compatibility
-p PARALLEL_COUNT, --parallel-count PARALLEL_COUNT
max number of hosts to update in parallel. Default is
10.
-u, --updates just report all installed packages with updates
pending, including AUR packages
-s, --sys-only only sync/report system packages, not AUR
-a, --aur-only only sync/report AUR packages, not system
-C, --no-color do not color output messages
-N, --no-color-invert
do not invert color on error/priority messages
-M, --mirrorlist also sync mirrorlist file
-F SSH_CONFIG_FILE, --ssh-config-file SSH_CONFIG_FILE
ssh configuration file to use. Default is
"~/.ssh/config" (if it exists).
-V, --version show pacpush version
-d, --debug output debug messages
Note you can set default starting options in
$HOME/.config/pacpush/pacpush.conf.
```
## LICENSE
Copyright (C) 2017 Mark Blakeney. This program is distributed under the
terms of the GNU General Public License.
This program is free software: you can redistribute it and/or modify it
under the terms of the GNU General Public License as published by the
Free Software Foundation, either version 3 of the License, or any later
version.
This program is distributed in the hope that it will be useful, but
WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General
Public License at <http://www.gnu.org/licenses/> for more details.
<!-- vim: se ai syn=markdown: -->
Raw data
{
"_id": null,
"home_page": "",
"name": "pacpush",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": "",
"keywords": "pacman,pacserve",
"author": "",
"author_email": "Mark Blakeney <mark.blakeney@bullet-systems.net>",
"download_url": "https://files.pythonhosted.org/packages/2c/6c/d6e992d0cb4662004811a17b0b49308d8e81b252da33e586d17196b38e2e/pacpush-3.2.2.tar.gz",
"platform": null,
"description": "## PACPUSH\n[](https://aur.archlinux.org/packages/pacpush/)\n[](https://pypi.org/project/pacpush/)\n\n[pacpush](http://github.com/bulletmark/pacpush) is a simple command line\nutility which Arch Linux users can use to manually push `pacman` and AUR\nhelper Arch Linux package updates to other machines to avoid having to\ndownload them more than once via the web.\n\nMy use case follows as a good example of what this utility is for.\n\nI update my main Arch PC and my Arch laptop every day using\n[`yay`](https://github.com/Jguer/yay). Previously, I would update either\nboth machines in parallel, or one before the other. So both machines\nwould download the package lists from the web, then download and install\nthe out of date system packages, then download, build, and install all\nout of date AUR packages. This takes quite some time, particularly on a\nslow internet connection, and it is inefficient to be downloading and\nbuilding most packages twice for the same architecture machines.\n\nUsing `pacpush`, I now update my PC first then after that update has\nfinished I run `pacpush lt` on my PC to update `lt` directly via my\nlocal LAN. Pacpush pushes the updated package lists, then queries `lt`\nto work out which packages `lt` has out of date (including AUR\npackages), then pushes all the system and AUR packages that it has which\n`lt` needs.\n\nAfter running `pacpush`, I run a [`yay`](https://github.com/Jguer/yay)\nupdate on `lt` and it completes very quickly because `lt` only needs to\ndownload the system and AUR packages my PC did not have. I typically use\nvery similar system and AUR packages on both machines so typically `lt`\ndoesn't need to download or build any updated AUR packages at all.\n\nObviously this only works for machines of the same architecture, i.e.\ncompatible package files, so `pacpush` checks for this before pushing any\nfiles.\n\nYou need to have root ssh access to the remote machines for `pacpush` to\nwork. See the [SSH AND KEY CONFIGURATION](#ssh-and-key-configuration)\nsection below on how best to set this up.\n\nIf you specify multiple hosts then the program will update them in\nparallel. You can limit, or increase, the number of parallel updates\nusing the `-p/--parallel-count` option. Update messages are output in a\nunique color for each host.\n\nNote that `pacpush` should work with any AUR helper so long as you set\n`--aur-build-dir` appropriately in your configuration file, see the\n[CONFIGURATION FILE](#configuration-file) section below for details.\n\nThe latest version and documentation is available at\nhttps://github.com/bulletmark/pacpush.\n\n## COMPARISION TO PACSERVE\n\nTo solve this problem, I originally started using\n[pacserve](https://aur.archlinux.org/packages/pacserve/) which is what\nis usually recommended for this use case. However pacserve does not sync\nthe package lists nor does it do anything about AUR packages which is\nparticularly unfortunate because AUR package downloads often include\nhuge source and other files and can require long build times. Since\n`pacpush` pushes the entire AUR directory for each required package, the\nsecond machine benefits by typically not having to download or rebuild\nany updated AUR packages at all.\n\n## INSTALLATION\n\nJust install [_pacpush from the\nAUR_](https://aur.archlinux.org/packages/pacpush/) to the local and\nremote hosts.\n\nNote pacpush is also available [on\nPyPI](https://pypi.org/project/pacpush/) if you prefer so just ensure\nthat [`pipx`](https://pypa.github.io/pipx/) is installed then type the\nfollowing to install on each machine. Requires Python 3.7 or later.\n\n```\n$ pipx install pacpush\n```\n\nTo upgrade:\n\n```\n$ pipx upgrade pacpush\n```\n\n## SSH AND KEY CONFIGURATION\n\nYou run `pacpush` directly on the command line as your normal user, not\nas root and not using `sudo` explicitly. You specify as arguments the\nhost, or hosts, you want to update. The utility will re-invoke itself\nusing `sudo` and will push the required package updates.\n\nYou need to set up root ssh access from your host machine to the remote\nmachine[s] for this to work. For security and convenience, it is\nessential to use an ssh key. The following procedure copies your\npersonal public ssh key to the remote root account. Your first need to\nset up your own personal ssh key pair of course, see Google for that\npart.\n\nOn a remote host to which you want to `pacpush` (assuming you have\nalready set up personal ssh access to that host):\n\n```bash\n$ sudo mkdir -p /root/.ssh\n$ sudo chmod 700 /root/.ssh\n$ sudo cp ~/.ssh/authorized_keys /root/.ssh\n\n# Possibly remove any keys you don't want root to allow if you have\n# more than one:\n$ sudoedit /root/.ssh/authorized_keys\n```\n\nNote that the `sudo` invoked by `pacpush` on itself when you run it as\nyour normal user passes on `$SSH_AUTH_SOCK` so that the remote root ssh\nsession authenticates against your personal ssh key.\n\nFor rsync/ssh configuration convenience, `rsync` and `ssh` commands run\nby root are specified with your personal user's ssh configuration file\n`~/.ssh/config` if it exists (unless you specify an explicit\n`--ssh-config-file` for pacpush usage as described in the next section).\nNote `rsync` and `ssh` commands run on behalf of root user explicitly\nspecify target `root@host` so that any `User` specification in your\npersonal ssh configuration for any host is ignored.\n\n## CONFIGURATION FILE\n\n:warning: __From pacpush version 3 onwards, the format of the\n`~/.config/pacpush/pacpush.conf` file has changed\nfrom [YAML](https://yaml.org/) to a simple text file where you\nspecify any of the pacpush [startup options](#usage).__\n\nYou can add default options to a personal configuration file\n`~/.config/pacpush/pacpush.conf`. If that file exists then each line of\noptions will be concatenated and automatically prepended to your\n`pacpush` command line arguments. Comments in the file (i.e. starting\nwith a `#`) are ignored. Type `pacpush -h` to see all [supported\noptions](#usage). The configuration file is read for the invoking user\nonly on the local host client machine. The configuration file is ignored\non any remote machine you are pushing to (because all required options\nare passed from the client).\n\nYou may want to change the `--aur-build-dir` setting which is the\nlocation of your AUR helpers download/build directory. This is the\ndirectory from which AUR packages are rsync'd from the local host to\nremote hosts. `--aur-build-dir` can be set to a single directory string,\nor a list of directories by inserting a \"`;`\" between multiple directory\nnames. Ensure that `--aur-build-dir` is set to, or at least contains,\nthe build directory your AUR helper uses. Directories which don't exist\nare ignored.\n\n**Example Settings**\n\nAUR Helper | Build directory setting\n---------- | -----------------------\n`yay` | `--aur-build-dir ~/.cache/yay`.\n`paru` | `--aur-build-dir ~/.cache/paru/clone`.\n\nThe default configuration is to sync many of the common AUR helper\ndirectories that exist on your host machine. See the default\n`--aur-build-dir` directories listed by `pacpush -h`. Pacpush will sync\npackages in each `--aur-build-dir` directory which exists, and is\npending an update. E.g. if you were using trizen some time ago, and am\nnow using yay instead, then you could keep this default setting and just\ndo a `rm -rf ~/.cache/trizen` because pacpush ignores `--aur-build-dir`\ndirectories which don't exist. Or you could just set `--aur-build-dir\n~/.cache/yay` in your `~/.config/pacpush/pacpush.conf` which is the\nslightly more efficient approach.\n\nYou can also create and specify a custom\n[`--ssh-config-file`](https://linux.die.net/man/5/ssh_config) file. This\nallows you to specify ssh settings for pacpush use, either globally, or\nfor each host. See [`man\nssh_config`](https://linux.die.net/man/5/ssh_config) for details on how\nto specify ssh (including per host) settings. If the specified\n`--ssh-config-file` path is relative then it is taken to be relative to\n`~/.config/pacpush/`.\n\nAny of the options specified in the next [Usage](#usage) section can be\nspecified in `~/.config/pacpush/pacpush.conf`.\n\n## USAGE\n\nType `pacpush -h` to view the usage summary:\n\n```\nusage: pacpush [-h] [-b AUR_BUILD_DIR] [-n] [-m] [-p PARALLEL_COUNT] [-u]\n [-s] [-a] [-C] [-N] [-M] [-F SSH_CONFIG_FILE] [-V] [-d]\n [hosts ...]\n\nUtility to push this Arch hosts system and AUR package caches to other host[s]\nto avoid those other hosts having to download the same new package lists and\nupdated packages, at least for shared common packages. Requires root ssh\naccess to other hosts (it is easier with an auth key).\n\npositional arguments:\n hosts hosts to update\n\noptions:\n -h, --help show this help message and exit\n -b AUR_BUILD_DIR, --aur-build-dir AUR_BUILD_DIR\n AUR build directory[s]. Can specify one, or multiple\n directories separated by \";\". Default is \"~/.cache/yay\n ;~/.cache/paru/clone;~/.cache/trizen;~/.cache/pikaur/a\n ur_repos;~/.cache/aurman\". Non-existent directories\n are ignored.\n -n, --dryrun dry run only\n -m, --no-machcheck do not check machine type compatibility\n -p PARALLEL_COUNT, --parallel-count PARALLEL_COUNT\n max number of hosts to update in parallel. Default is\n 10.\n -u, --updates just report all installed packages with updates\n pending, including AUR packages\n -s, --sys-only only sync/report system packages, not AUR\n -a, --aur-only only sync/report AUR packages, not system\n -C, --no-color do not color output messages\n -N, --no-color-invert\n do not invert color on error/priority messages\n -M, --mirrorlist also sync mirrorlist file\n -F SSH_CONFIG_FILE, --ssh-config-file SSH_CONFIG_FILE\n ssh configuration file to use. Default is\n \"~/.ssh/config\" (if it exists).\n -V, --version show pacpush version\n -d, --debug output debug messages\n\nNote you can set default starting options in\n$HOME/.config/pacpush/pacpush.conf.\n```\n\n## LICENSE\n\nCopyright (C) 2017 Mark Blakeney. This program is distributed under the\nterms of the GNU General Public License.\nThis program is free software: you can redistribute it and/or modify it\nunder the terms of the GNU General Public License as published by the\nFree Software Foundation, either version 3 of the License, or any later\nversion.\nThis program is distributed in the hope that it will be useful, but\nWITHOUT ANY WARRANTY; without even the implied warranty of\nMERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General\nPublic License at <http://www.gnu.org/licenses/> for more details.\n\n<!-- vim: se ai syn=markdown: -->\n",
"bugtrack_url": null,
"license": "GPLv3",
"summary": "Utility to push an Arch host's package and AUR caches to other hosts",
"version": "3.2.2",
"project_urls": {
"Homepage": "https://github.com/bulletmark/pacpush"
},
"split_keywords": [
"pacman",
"pacserve"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "e63f9fd8ef26ac6912fa133196a6a6ee1718e5de8bc53e8f52ec804ca3db965e",
"md5": "10e6b1f4138cdf11305c2d9329f610fa",
"sha256": "abe2b69c55ffd1eb211755849d3ed96db4995dc6295853bddf0fd70d3ec22ecc"
},
"downloads": -1,
"filename": "pacpush-3.2.2-py3-none-any.whl",
"has_sig": false,
"md5_digest": "10e6b1f4138cdf11305c2d9329f610fa",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 10401,
"upload_time": "2023-10-22T21:51:52",
"upload_time_iso_8601": "2023-10-22T21:51:52.267255Z",
"url": "https://files.pythonhosted.org/packages/e6/3f/9fd8ef26ac6912fa133196a6a6ee1718e5de8bc53e8f52ec804ca3db965e/pacpush-3.2.2-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "2c6cd6e992d0cb4662004811a17b0b49308d8e81b252da33e586d17196b38e2e",
"md5": "9ba9d6e1ef85ddaa44679970ee1e6f75",
"sha256": "9f6a7915e3d714a0c925308d6ddbddeceb73ae8b36d838b3e2e771ff626da438"
},
"downloads": -1,
"filename": "pacpush-3.2.2.tar.gz",
"has_sig": false,
"md5_digest": "9ba9d6e1ef85ddaa44679970ee1e6f75",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 10609,
"upload_time": "2023-10-22T21:51:53",
"upload_time_iso_8601": "2023-10-22T21:51:53.981976Z",
"url": "https://files.pythonhosted.org/packages/2c/6c/d6e992d0cb4662004811a17b0b49308d8e81b252da33e586d17196b38e2e/pacpush-3.2.2.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-10-22 21:51:53",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "bulletmark",
"github_project": "pacpush",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"lcname": "pacpush"
}
