| Name | shlib JSON |
| Version |
1.6
JSON |
| download |
| home_page | |
| Summary | shell library |
| upload_time | 2023-05-18 18:16:57 |
| maintainer | |
| docs_url | None |
| author | Ken Kundert |
| requires_python | >=3.6 |
| license | |
| keywords |
shlib
shell
shell utilities
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
|
| coveralls test coverage |
|
ShLib — Shell Library
=====================
.. image:: https://pepy.tech/badge/shlib/month
:target: https://pepy.tech/project/shlib
.. image:: https://github.com/KenKundert/shlib/actions/workflows/build.yaml/badge.svg
:target: https://github.com/KenKundert/shlib/actions/workflows/build.yaml
.. image:: https://img.shields.io/coveralls/KenKundert/shlib.svg
:target: https://coveralls.io/r/KenKundert/shlib
.. image:: https://img.shields.io/pypi/v/shlib.svg
:target: https://pypi.python.org/pypi/shlib
.. image:: https://img.shields.io/pypi/pyversions/shlib.svg
:target: https://pypi.python.org/pypi/shlib/
:Author: Ken Kundert
:Version: 1.6
:Released: 2023-05-18
A light-weight package with few dependencies that allows users to do
shell-script like things relatively easily in Python. Is a natural complement to
the pathlib library. Pathlib does pretty much what you would like to do with
a single path; shlib does similar things with many paths at once. For example,
with pathlib you can remove (unlink) a single file, but with shlib you can
remove many files at once. Furthermore, most of the features of pathlib are
implemented as pathlib methods, so you must convert your strings to paths before
you can use them. ShLib is equally comfortable with strings as with paths.
Writing programs that substantially interact with the file system can be
surprisingly painful in Python because the code that is used to do so is spread
over many packages and those packages are not very compatible with each other
nor do they follow the conventions of the corresponding shell commands.
This package, shlib, attempts to address those issues by providing one package
that combines the commonly used utilities for interacting with the filesystem
that follows the conventions used by the corresponding shell commands.
It consists of replacements for some very common Unix utilities that interact
with the filesystem, such as cp, mv, rm, ln, mkdir, and cd. These tend to be
less fussy than their command line counter parts. For example, rm deletes both
files and directories without distinction and will not complain if the file or
directory does not exist. Similarly mkdir will create any child directories
needed and will not complain if the directory already exists.
Finally, it provides several ways to run external programs.
Each feature is designed to allow you to express your desires simply and
efficiently without worrying too much about exceptions.
Most of the functions in this package take paths to files or directories. Those
paths may be specified either as strings or pathlib paths. Many of the functions
accept multiple paths, and those can be specified either as an array or as
individual arguments. Several of the functions return either a path or
a collection of paths. These paths are returned as pathlib paths.
Installation
------------
Use 'pip3 install shlib' to install. Requires Python3.6 or better.
System Utility Functions
------------------------
Copy (cp)
~~~~~~~~~
Copy files or directories::
cp(src, ..., dest)
or::
cp([src, ...], dest)
Copy all source items, whether they be files or directories to dest. If there is
more than one src item, then dest must be a directory and the copies will be
placed in that directory. The src arguments may be strings, pathlib paths, or
collections of strings and paths. The dest must be a string or path.
Example:
.. code-block:: python
>>> from shlib import *
>>> testdir = 'testdir'
>>> rm(testdir)
>>> mkdir(testdir)
>>> files = cartesian_product(testdir, ['f1', 'f2'])
>>> touch(files)
>>> dirs = cartesian_product(testdir, ['d1', 'd2'])
>>> mkdir(dirs)
>>> print(sorted(str(e) for e in ls(testdir)))
['testdir/d1', 'testdir/d2', 'testdir/f1', 'testdir/f2']
>>> cp('testdir/f1', 'testdir/f4')
>>> print(sorted(str(f) for f in lsf(testdir)))
['testdir/f1', 'testdir/f2', 'testdir/f4']
>>> dest1 = to_path(testdir, 'dest1')
>>> mkdir(dest1)
>>> cp(files, dest1)
>>> print(sorted(str(f) for f in lsf(dest1)))
['testdir/dest1/f1', 'testdir/dest1/f2']
>>> cp(dirs, dest1)
>>> print(sorted(str(d) for d in lsd(dest1)))
['testdir/dest1/d1', 'testdir/dest1/d2']
>>> f1, f2 = tuple(files)
>>> dest2 = to_path(testdir, 'dest2')
>>> mkdir(dest2)
>>> cp(f1, f2, dest2)
>>> print(sorted(str(f) for f in lsf(dest2)))
['testdir/dest2/f1', 'testdir/dest2/f2']
>>> dest3 = to_path(testdir, 'dest3')
>>> mkdir(dest3)
>>> cp([f1, f2], dest3)
>>> print(sorted(str(f) for f in lsf(dest3)))
['testdir/dest3/f1', 'testdir/dest3/f2']
Move (mv)
~~~~~~~~~
Move files or directories::
mv(src, ..., dest)
Move all source items, whether they be files or directories to dest. If there is
more than one src item, then dest must be a directory and everything will be
placed in that directory. The src arguments may be strings or lists of strings.
The dest must be a string.
.. code-block:: python
>>> from shlib import *
>>> testdir = 'testdir'
>>> rm(testdir)
>>> mkdir(testdir)
>>> files = cartesian_product(testdir, ['f1', 'f2'])
>>> touch(files)
>>> dirs = cartesian_product(testdir, ['d1', 'd2'])
>>> mkdir(dirs)
>>> print(sorted(str(e) for e in ls(testdir)))
['testdir/d1', 'testdir/d2', 'testdir/f1', 'testdir/f2']
>>> dest = to_path(testdir, 'dest')
>>> mkdir(dest)
>>> mv(files, dest) # move a list of files
>>> print(sorted(str(f) for f in lsf(dest)))
['testdir/dest/f1', 'testdir/dest/f2']
>>> mv(dirs, dest) # move a list of directories
>>> print(sorted(str(d) for d in lsd(dest)))
['testdir/dest/d1', 'testdir/dest/d2']
Remove (rm)
~~~~~~~~~~~
Remove files or directories::
rm(path, ...)
Delete all files and directories given as arguments. Does not complain if any of
the items do not exist. Each argument must be either a string or a list of
strings.
.. code-block:: python
>>> print(sorted(str(e) for e in ls(testdir)))
['testdir/dest']
>>> print(sorted(str(e) for e in ls(dest)))
['testdir/dest/d1', 'testdir/dest/d2', 'testdir/dest/f1', 'testdir/dest/f2']
>>> rm(lsf(dest))
>>> print(sorted(str(e) for e in ls(dest)))
['testdir/dest/d1', 'testdir/dest/d2']
>>> rm(dest)
>>> print(sorted(str(e) for e in ls(testdir)))
[]
>>> rm(testdir)
Link (ln)
~~~~~~~~~~~
Create a symbolic link::
ln(src, link)
Creates a symbolic link *link* that points to *src*. Each argument must be
either a string.
Make File (touch)
~~~~~~~~~~~~~~~~~
Create a new empty file or update the timestamp on an existing file::
touch(path, ...)
Each argument must be either a string or a list of strings.
Make Directory (mkdir)
~~~~~~~~~~~~~~~~~~~~~~
Create an empty directory::
mkdir(path, ...)
For each argument it creates a directory and any needed parent directories.
Returns without complaint if the directory already exists. Each argument must be
either a string or a list of strings.
Change Directory (cd)
~~~~~~~~~~~~~~~~~~~~~
Change to an existing directory::
cd(path)
Makes path the current working directory.
May also be used in a *with* block::
with cd(path):
cwd()
The working directory returns to its original value upon leaving the *with*
block.
Current Working Directory (cwd)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Returns the current working directory::
path = cwd()
Mount and Unmount a Filesystem (mount)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Mount a filesystem with::
mount(path)
Then unmount it with::
umount(path)
You can test to determine if a filesystem is mounted with::
is_mounted(path)
May also be used in a *with* block::
with mount(path):
cp(path/data, '.')
The filesystem is unmounted upon leaving the *with* block.
List Directory (ls, lsd, lsf)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
List a directory::
ls(path, ... [<kwargs>])
lsd(path, ... [<kwargs>])
lsf(path, ... [<kwargs>])
The first form returns a list of all items found in a directory. The second
returns only the directories, and the third returns only the files.
One or more paths may be specified using unnamed arguments. The paths may be
strings or pathlib paths, or collections of those. If no paths are not given,
the current working directory is assumed.
The remaining arguments must be specified as keyword arguments.
::
select=<glob-str>
If *select* is specified, an item is returned only if it matches the given
pattern. Using '\*\*' in *select* enables a recursive walk through a directory
and all its subdirectories. Using '\*\*' alone returns only directories whereas
'\*\*/\*' returns files and directories.
::
reject=<glob-str>
If *reject* is specified, an item is not returned if it matches the given
pattern.
::
only={'file','dir'}
If *only* is specified, it may be either 'file' or 'dir', in which case only
items of the corresponding type are returned.
::
hidden=<bool>
The value of hidden is a boolean that indicates whether items that begin with
'.' are included in the output. If hidden is not specified, hidden items are not
included unless *select* begins with '.'.
Examples::
pyfiles = lsf(select='*.py')
subdirs = lsd()
tmp_mutt = lsf('/tmp/', select='mutt-*')
File Permissions
~~~~~~~~~~~~~~~~
Change the file permissiongs of a file, or files, or directory, or directories::
chmod(mode, path)
where *mode* is a three digit octal number.
You may read the permissions of a file or directory using::
mode = getmod(path)
Paths
-----
to_path
~~~~~~~
Create a path from a collection of path segments::
p = to_path(seg, ...)
The segments are combined to form a path. Expands a leading ~. Returns a pathlib
path. It is generally not necessary to apply to_path() to paths being given to
the shlib functions, but using it gives you access to all of the various pathlib
methods for the path.
.. code-block:: python
>>> path = to_path('A', 'b', '3')
>>> str(path)
'A/b/3'
*to_path* returns a Path object that has been extended from the standard Python
pathlib Path object. Specifically, it includes the following methods::
p.is_readable() — return True if path exists and is readable
p.is_writable() — return True if path exists and is writable
p.is_executable() — return True if path exists and is executable
p.is_hidden() — return True if path exists and is hidden (name starts with .)
p.is_newer() — return True if path exists and is newer than argument
p.path_from() — differs from relative_to() in that returned path will not start with ..
p.sans_ext() — return full path without the extension
See `extended_pathlib <https://github.com/KenKundert/extended_pathlib>`_ for
more information.
Leaves
~~~~~~
Recursively descend into a directory yielding paths to all of the files it
contains. Normally hidden files are excluded unless the *hidden* argument is
True. OSErrors found during the scan are ignored unless the *report* argument
is specified, and if specified it must be a function that takes one argument,
the exception raised by the error.
Cartesian Product
~~~~~~~~~~~~~~~~~
Create a list of paths by combining from path segments in all combinations::
cartesian_product(seg, ...)
Like with to_path(), the components are combined to form a path, but in this
case each component may be a list. The results is the various components are
combined in a Cartesian product to form a list. For example:
.. code-block:: python
>>> paths = cartesian_product(['A', 'B'], ['a', 'b'], ['1', '2'])
>>> for p in paths:
... print(p)
A/a/1
A/a/2
A/b/1
A/b/2
B/a/1
B/a/2
B/b/1
B/b/2
Brace Expand
~~~~~~~~~~~~
Create a list of paths using Bash-like brace expansion::
brace_expand(pattern)
.. code-block:: python
>>> paths = brace_expand('python{2.{5..7},3.{2..6}}')
>>> for p in sorted(str(p) for p in paths):
... print(p)
python2.5
python2.6
python2.7
python3.2
python3.3
python3.4
python3.5
python3.6
Executing Programs
------------------
The following classes and functions are used to execute external programs from
within Python.
Command (Cmd)
~~~~~~~~~~~~~
A class that runs an external program::
Cmd(cmd[, modes][, env][, encoding][, log][, option_args])
*cmd* may be a list or a string.
*mode* is a string that specifies various options. The options are specified
using a single letter, with upper case enabling the option and lower case
disabling it:
| S, s: Use, or do not use, a shell
| O, o: Capture, or do not capture, stdout
| E, e: Capture, or do not capture, stderr
| M, m: Merge, or do not merge, stderr into stdout (M overrides E, e)
| W, w: Wait, or do not wait, for command to terminate before proceeding
If a letter corresponding to a particular option is not specified, the default
is used for that option. In addition, one of the following may be given, and it
must be given last
| ``*``: accept any output status code
| N: accept any output status code equal to or less than N
| M,N,...: accept status codes M, N, ...
If you do not specify the status code behavior, only 0 is accepted as normal
termination, all other codes will be treated as errors. An exception is raised
if exit status is not acceptable. By default an *OSError* is raised, however if
the *use_inform* preference is true, then *inform.Error* is used. In this case
the error includes attributes that can be used to access the *stdout*, *stderr*,
*status*, *cmd*, and *msg*.
*env* is a dictionary of environment variable and their values.
*encoding* is used on the input and output streams when converting them to and
from strings.
*log* specifies whether details about the command should be sent to log file.
May be True, False, or None. If None, then behavior is set by *log_cmd*
preference. Use of *log* requires that *Inform* package be installed.
*option_args* is used when rendering command to logfile, it indicates how many
arguments each option takes. This only occurs when *use_inform* preference is
true and *Inform* package is installed.
For example, to run diff you might use::
>>> import sys, textwrap
>>> ref = textwrap.dedent('''
... line1
... line2
... line3
... ''').strip()
>>> test = textwrap.dedent('''
... line1
... line2
... ''').strip()
>>> ref_bytes_written = to_path('./REF').write_text(ref)
>>> test_bytes_written = to_path('./TEST').write_text(test)
>>> cat = Cmd(['cat', 'TEST'], 'sOeW')
>>> cat.run()
0
>>> print(cat.stdout)
line1
line2
>>> diff = Cmd('diff TEST REF', 'sOEW1')
>>> status = diff.run()
>>> status
1
Use of *O* in the modes allows access to stdout, which is needed to access the
differences. Specifying *E* also allows access to stderr, which in this case is
helpful in case something goes wrong because it allows the error handler to
access the error message generated by diff. Specifying *W* indicates that run()
should block until diff completes. This is also necessary for you to be able to
capture either stdout or stderr. Specifying 1 indicates that either 0 or 1 are
valid output status codes; any other code output by diff would be treated as an
error.
If you do not indicate that stdout or stderr should be captured, those streams
remain connected to your TTY. You can specify a string to the run() method,
which is fed to the program through stdin. If you don't specify anything the
stdin stream for the program also remains connected to the TTY.
If you indicate that run() should return immediately without out waiting for the
program to exit, then you can use the wait() and kill() methods to manage the
execution. For example::
diff = Cmd(['gvim', '-d', lfile, rfile], 'w')
diff.run()
try:
status = diff.wait()
except KeyboardInterrupt:
diff.kill()
Casting the object to a string returns the command itself::
>>> print(str(cat))
cat TEST
If you call run(), then you should either specify 'W' as the wait mode, or you
should call the wait() method. If you do not, then any string you specified as
stdin is not applied. If your intention is to kick off a process and not wait
for it to finish, you should use start() instead. It also allows you to specify
a string to pass to stdin, however you cannot access stdout, stderr, or the exit
status. If you specify the 'O' or 'E' modes when using start(), those outputs
are simply discarded. This is a useful way of discarding uninteresting
diagnostics from the program you are calling.
*Cmd* also provides the *render* method, which converts the command to a string.
It takes the same optional arguments as does *render_command*.
Run
~~~
*Run* subclasses *Cmd*. It basically constructs the process and then immediately
calls the run() method. It takes the same arguments as Cmd, but an additional
argument that allows you to specify stdin for the process::
Run(cmd[, modes][, stdin][, env][, encoding])
Run expect you to wait for the process to end, either by specify the 'W' mode,
or by calling wait(). For example::
>>> echo = Run('cat > helloworld', 'SoeW', 'hello world')
>>> echo.status
0
>>> echo = Run(['echo', 'helloworld'], 'sOew')
>>> echo.wait()
0
>>> print(echo.stdout.strip())
helloworld
Start
~~~~~
Start also subclasses Cmd. It is similar to Run in that it immediately executes
the command, but it differs in that it does not expect you to wait for the
command to terminate. You may specify stdin to the command if you wish, but
since you are not waiting for the command to terminate you cannot access stdout,
stderr or the exit status. Effectively, Start() kicks off the process and then
ignores it. You may pass wait or accept in the mode string, but they are
ignored. If you select either stdout or stderr to be captured, then are wired to
/dev/null, meaning that the selected output is swallowed and discarded.
::
>>> cat = Start('cat helloworld', 'sOe')
which
~~~~~
Given a name, a path, and a collection of read, write, or execute flags, this
function returns the locations along the path where a file or directory can be
found with matching flags::
which(name, path=None, flags=os.X_OK)
By default the path is specified by the PATH environment variable and the flags
check whether you have execute permission.
render_command
~~~~~~~~~~~~~~
Render a command to a string::
render_command(cmd[, option_args][, width])
Converts the command to a string. The formatting is such that you should be
able to feed the result directly to a shell and have command execute properly.
*cmd* is the command to render. It may be a string or a list of strings.
*option_args* is a dictionary. The keys are options accepted by the command and
the value is the number of arguments for that option. If an option is not
found, it is assumed to have 0 arguments.
*width* specifies how long the string must be before it is broken into multiple
lines. If length of resulting line would be width or less, return as a
single line, otherwise place each argument and option on separate line.
If the command is rendered as multiple lines, each argument and option is placed
on a separate line, while keeping argument to options on the same line as the
option. Placing each option and argument on its own line allows complicated
commands with long arguments to be displayed cleanly.
For example::
>>> args = {'--dux': 2, '-d': 2, '--tux': 1}
>>> print(render_command('bux --dux a b -d c d --tux e f g h', args))
bux --dux a b -d c d --tux e f g h
>>> print(render_command('bux --dux a b -d c d --tux e f g h', args, width=0))
bux \
--dux a b \
-d c d \
--tux e \
f \
g \
h
set_prefs
~~~~~~~~~
Used to set preferences that affect the *Cmd* class. The preferences are given
as keyword arguments.
*use_inform* indicates that the *Inform* exception *Error* should be raised if
the exit status from a command is not acceptable. If this not given or is False,
an OSError is raised instead. Use of this preference requires that *Inform* be
available. If *use_inform* is True, then inform.Error() is used by *Cmd* and
its subclasses (*Run* and *Start*).
*log_cmd* specifies that the command and its exit status should be written to
the *Inform* log file. Use of this preference requires that *Inform* be
available.
Error Reporting with Inform
~~~~~~~~~~~~~~~~~~~~~~~~~~~
The *Cmd* class and its subclasses (*Run* and *Start*) raise an `Inform
<https://inform.readthedocs.io>`_ Error if the *use_inform* preference was
specified. This allows for rich error reporting. In particular, the command,
exit status, stdout and stderr are all returned with the exception and are
available to insert into an error message. For example::
>> from shlib import Run, set_prefs
>> from inform import Error
>> set_prefs(use_inform=True)
>> try:
.. c = Run('sort words', 'sOEW0')
.. except Error as e:
.. e.report(template=(
.. '"{cmd}" exits with status {status}.\n {stderr}',
.. '"{cmd}" exits with status {status}.',
.. ))
error: "sort words" exits with status 2.
sort: cannot read: words: No such file or directory.
If command returns a non-zero exit status, an exception is raised and one of two
error messages are printed. The first is printed if *stderr* is not empty, and
the second is printed if it is.
Most other functions raise an OSError upon an error. You can use *Inform* to
convert this exception into a reasonable error message::
>> from inform import fatal, os_error
>>
>> try:
.. cp(from, to)
.. except OSError as e:
.. fatal(os_error(e))
Raw data
{
"_id": null,
"home_page": "",
"name": "shlib",
"maintainer": "",
"docs_url": null,
"requires_python": ">=3.6",
"maintainer_email": "",
"keywords": "shlib,shell,shell utilities",
"author": "Ken Kundert",
"author_email": "shlib@nurdletech.com",
"download_url": "https://files.pythonhosted.org/packages/3c/ff/e5f3f459b5c177baee587b9fab5df9c176171fc6e9bf7552f4d79432f695/shlib-1.6.tar.gz",
"platform": null,
"description": "ShLib \u2014 Shell Library\n=====================\n\n.. image:: https://pepy.tech/badge/shlib/month\n :target: https://pepy.tech/project/shlib\n\n.. image:: https://github.com/KenKundert/shlib/actions/workflows/build.yaml/badge.svg\n :target: https://github.com/KenKundert/shlib/actions/workflows/build.yaml\n\n\n.. image:: https://img.shields.io/coveralls/KenKundert/shlib.svg\n :target: https://coveralls.io/r/KenKundert/shlib\n\n.. image:: https://img.shields.io/pypi/v/shlib.svg\n :target: https://pypi.python.org/pypi/shlib\n\n.. image:: https://img.shields.io/pypi/pyversions/shlib.svg\n :target: https://pypi.python.org/pypi/shlib/\n\n:Author: Ken Kundert\n:Version: 1.6\n:Released: 2023-05-18\n\nA light-weight package with few dependencies that allows users to do \nshell-script like things relatively easily in Python. Is a natural complement to \nthe pathlib library. Pathlib does pretty much what you would like to do with \na single path; shlib does similar things with many paths at once. For example, \nwith pathlib you can remove (unlink) a single file, but with shlib you can \nremove many files at once. Furthermore, most of the features of pathlib are \nimplemented as pathlib methods, so you must convert your strings to paths before \nyou can use them. ShLib is equally comfortable with strings as with paths.\n\nWriting programs that substantially interact with the file system can be \nsurprisingly painful in Python because the code that is used to do so is spread \nover many packages and those packages are not very compatible with each other \nnor do they follow the conventions of the corresponding shell commands.\n\nThis package, shlib, attempts to address those issues by providing one package \nthat combines the commonly used utilities for interacting with the filesystem \nthat follows the conventions used by the corresponding shell commands. \n\nIt consists of replacements for some very common Unix utilities that interact \nwith the filesystem, such as cp, mv, rm, ln, mkdir, and cd. These tend to be \nless fussy than their command line counter parts. For example, rm deletes both \nfiles and directories without distinction and will not complain if the file or \ndirectory does not exist. Similarly mkdir will create any child directories \nneeded and will not complain if the directory already exists.\n\nFinally, it provides several ways to run external programs.\n\nEach feature is designed to allow you to express your desires simply and \nefficiently without worrying too much about exceptions.\n\nMost of the functions in this package take paths to files or directories. Those \npaths may be specified either as strings or pathlib paths. Many of the functions \naccept multiple paths, and those can be specified either as an array or as \nindividual arguments. Several of the functions return either a path or \na collection of paths. These paths are returned as pathlib paths.\n\n\nInstallation\n------------\n\nUse 'pip3 install shlib' to install. Requires Python3.6 or better.\n\n\nSystem Utility Functions\n------------------------\n\nCopy (cp)\n~~~~~~~~~\n\nCopy files or directories::\n\n cp(src, ..., dest)\n\nor::\n\n cp([src, ...], dest)\n\nCopy all source items, whether they be files or directories to dest. If there is \nmore than one src item, then dest must be a directory and the copies will be \nplaced in that directory. The src arguments may be strings, pathlib paths, or \ncollections of strings and paths. The dest must be a string or path.\n\nExample:\n\n.. code-block:: python\n\n >>> from shlib import *\n >>> testdir = 'testdir'\n >>> rm(testdir)\n >>> mkdir(testdir)\n >>> files = cartesian_product(testdir, ['f1', 'f2'])\n >>> touch(files)\n >>> dirs = cartesian_product(testdir, ['d1', 'd2'])\n >>> mkdir(dirs)\n >>> print(sorted(str(e) for e in ls(testdir)))\n ['testdir/d1', 'testdir/d2', 'testdir/f1', 'testdir/f2']\n\n >>> cp('testdir/f1', 'testdir/f4')\n >>> print(sorted(str(f) for f in lsf(testdir)))\n ['testdir/f1', 'testdir/f2', 'testdir/f4']\n\n >>> dest1 = to_path(testdir, 'dest1')\n >>> mkdir(dest1)\n >>> cp(files, dest1)\n >>> print(sorted(str(f) for f in lsf(dest1)))\n ['testdir/dest1/f1', 'testdir/dest1/f2']\n\n >>> cp(dirs, dest1)\n >>> print(sorted(str(d) for d in lsd(dest1)))\n ['testdir/dest1/d1', 'testdir/dest1/d2']\n\n >>> f1, f2 = tuple(files)\n >>> dest2 = to_path(testdir, 'dest2')\n >>> mkdir(dest2)\n >>> cp(f1, f2, dest2)\n >>> print(sorted(str(f) for f in lsf(dest2)))\n ['testdir/dest2/f1', 'testdir/dest2/f2']\n\n >>> dest3 = to_path(testdir, 'dest3')\n >>> mkdir(dest3)\n >>> cp([f1, f2], dest3)\n >>> print(sorted(str(f) for f in lsf(dest3)))\n ['testdir/dest3/f1', 'testdir/dest3/f2']\n\n\nMove (mv)\n~~~~~~~~~\n\nMove files or directories::\n\n mv(src, ..., dest)\n\nMove all source items, whether they be files or directories to dest. If there is \nmore than one src item, then dest must be a directory and everything will be \nplaced in that directory. The src arguments may be strings or lists of strings. \nThe dest must be a string.\n\n.. code-block:: python\n\n >>> from shlib import *\n >>> testdir = 'testdir'\n >>> rm(testdir)\n >>> mkdir(testdir)\n >>> files = cartesian_product(testdir, ['f1', 'f2'])\n >>> touch(files)\n >>> dirs = cartesian_product(testdir, ['d1', 'd2'])\n >>> mkdir(dirs)\n >>> print(sorted(str(e) for e in ls(testdir)))\n ['testdir/d1', 'testdir/d2', 'testdir/f1', 'testdir/f2']\n\n >>> dest = to_path(testdir, 'dest')\n >>> mkdir(dest)\n >>> mv(files, dest) # move a list of files\n >>> print(sorted(str(f) for f in lsf(dest)))\n ['testdir/dest/f1', 'testdir/dest/f2']\n\n >>> mv(dirs, dest) # move a list of directories\n >>> print(sorted(str(d) for d in lsd(dest)))\n ['testdir/dest/d1', 'testdir/dest/d2']\n\n\nRemove (rm)\n~~~~~~~~~~~\n\nRemove files or directories::\n\n rm(path, ...)\n\nDelete all files and directories given as arguments. Does not complain if any of \nthe items do not exist. Each argument must be either a string or a list of \nstrings.\n\n.. code-block:: python\n\n >>> print(sorted(str(e) for e in ls(testdir)))\n ['testdir/dest']\n\n >>> print(sorted(str(e) for e in ls(dest)))\n ['testdir/dest/d1', 'testdir/dest/d2', 'testdir/dest/f1', 'testdir/dest/f2']\n\n >>> rm(lsf(dest))\n >>> print(sorted(str(e) for e in ls(dest)))\n ['testdir/dest/d1', 'testdir/dest/d2']\n\n >>> rm(dest)\n >>> print(sorted(str(e) for e in ls(testdir)))\n []\n\n >>> rm(testdir)\n\n\nLink (ln)\n~~~~~~~~~~~\n\nCreate a symbolic link::\n\n ln(src, link)\n\nCreates a symbolic link *link* that points to *src*. Each argument must be \neither a string.\n\n\nMake File (touch)\n~~~~~~~~~~~~~~~~~\n\nCreate a new empty file or update the timestamp on an existing file::\n\n touch(path, ...)\n\nEach argument must be either a string or a list of strings.\n\n\nMake Directory (mkdir)\n~~~~~~~~~~~~~~~~~~~~~~\n\nCreate an empty directory::\n\n mkdir(path, ...)\n\nFor each argument it creates a directory and any needed parent directories. \nReturns without complaint if the directory already exists. Each argument must be \neither a string or a list of strings.\n\n\nChange Directory (cd)\n~~~~~~~~~~~~~~~~~~~~~\n\nChange to an existing directory::\n\n cd(path)\n\nMakes path the current working directory.\n\nMay also be used in a *with* block::\n\n with cd(path):\n cwd()\n\nThe working directory returns to its original value upon leaving the *with* \nblock.\n\n\nCurrent Working Directory (cwd)\n~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\n\nReturns the current working directory::\n\n path = cwd()\n\n\nMount and Unmount a Filesystem (mount)\n~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\n\nMount a filesystem with::\n\n mount(path)\n\nThen unmount it with::\n\n umount(path)\n\nYou can test to determine if a filesystem is mounted with::\n\n is_mounted(path)\n\nMay also be used in a *with* block::\n\n with mount(path):\n cp(path/data, '.')\n\nThe filesystem is unmounted upon leaving the *with* block.\n\n\nList Directory (ls, lsd, lsf)\n~~~~~~~~~~~~~~~~~~~~~~~~~~~~~\n\nList a directory::\n\n ls(path, ... [<kwargs>])\n lsd(path, ... [<kwargs>])\n lsf(path, ... [<kwargs>])\n\nThe first form returns a list of all items found in a directory. The second \nreturns only the directories, and the third returns only the files.\n\nOne or more paths may be specified using unnamed arguments. The paths may be \nstrings or pathlib paths, or collections of those. If no paths are not given, \nthe current working directory is assumed.\n\nThe remaining arguments must be specified as keyword arguments.\n\n::\n\n select=<glob-str>\n\nIf *select* is specified, an item is returned only if it matches the given \npattern. Using '\\*\\*' in *select* enables a recursive walk through a directory \nand all its subdirectories. Using '\\*\\*' alone returns only directories whereas \n'\\*\\*/\\*' returns files and directories.\n\n::\n\n reject=<glob-str>\n\nIf *reject* is specified, an item is not returned if it matches the given \npattern.\n\n::\n\n only={'file','dir'}\n\n\nIf *only* is specified, it may be either 'file' or 'dir', in which case only \nitems of the corresponding type are returned.\n\n::\n\n hidden=<bool>\n\nThe value of hidden is a boolean that indicates whether items that begin with \n'.' are included in the output. If hidden is not specified, hidden items are not \nincluded unless *select* begins with '.'.\n\nExamples::\n\n pyfiles = lsf(select='*.py')\n subdirs = lsd()\n tmp_mutt = lsf('/tmp/', select='mutt-*')\n\n\nFile Permissions\n~~~~~~~~~~~~~~~~\n\nChange the file permissiongs of a file, or files, or directory, or directories::\n\n chmod(mode, path)\n\nwhere *mode* is a three digit octal number.\n\nYou may read the permissions of a file or directory using::\n\n mode = getmod(path)\n\n\nPaths\n-----\n\nto_path\n~~~~~~~\n\nCreate a path from a collection of path segments::\n\n p = to_path(seg, ...)\n\nThe segments are combined to form a path. Expands a leading ~. Returns a pathlib \npath. It is generally not necessary to apply to_path() to paths being given to \nthe shlib functions, but using it gives you access to all of the various pathlib \nmethods for the path.\n\n.. code-block:: python\n\n >>> path = to_path('A', 'b', '3')\n >>> str(path)\n 'A/b/3'\n\n*to_path* returns a Path object that has been extended from the standard Python \npathlib Path object. Specifically, it includes the following methods::\n\n p.is_readable() \u2014 return True if path exists and is readable\n p.is_writable() \u2014 return True if path exists and is writable\n p.is_executable() \u2014 return True if path exists and is executable\n p.is_hidden() \u2014 return True if path exists and is hidden (name starts with .)\n p.is_newer() \u2014 return True if path exists and is newer than argument\n p.path_from() \u2014 differs from relative_to() in that returned path will not start with ..\n p.sans_ext() \u2014 return full path without the extension\n\nSee `extended_pathlib <https://github.com/KenKundert/extended_pathlib>`_ for \nmore information.\n\n\nLeaves\n~~~~~~\n\nRecursively descend into a directory yielding paths to all of the files it \ncontains. Normally hidden files are excluded unless the *hidden* argument is \nTrue. OSErrors found during the scan are ignored unless the *report* argument \nis specified, and if specified it must be a function that takes one argument, \nthe exception raised by the error.\n\n\nCartesian Product\n~~~~~~~~~~~~~~~~~\n\nCreate a list of paths by combining from path segments in all combinations::\n\n cartesian_product(seg, ...)\n\nLike with to_path(), the components are combined to form a path, but in this \ncase each component may be a list. The results is the various components are \ncombined in a Cartesian product to form a list. For example:\n\n.. code-block:: python\n\n >>> paths = cartesian_product(['A', 'B'], ['a', 'b'], ['1', '2'])\n >>> for p in paths:\n ... print(p)\n A/a/1\n A/a/2\n A/b/1\n A/b/2\n B/a/1\n B/a/2\n B/b/1\n B/b/2\n\n\nBrace Expand\n~~~~~~~~~~~~\n\nCreate a list of paths using Bash-like brace expansion::\n\n brace_expand(pattern)\n\n.. code-block:: python\n\n >>> paths = brace_expand('python{2.{5..7},3.{2..6}}')\n\n >>> for p in sorted(str(p) for p in paths):\n ... print(p)\n python2.5\n python2.6\n python2.7\n python3.2\n python3.3\n python3.4\n python3.5\n python3.6\n\n\nExecuting Programs\n------------------\n\nThe following classes and functions are used to execute external programs from \nwithin Python.\n\nCommand (Cmd)\n~~~~~~~~~~~~~\n\nA class that runs an external program::\n\n Cmd(cmd[, modes][, env][, encoding][, log][, option_args])\n\n*cmd* may be a list or a string.\n*mode* is a string that specifies various options. The options are specified \nusing a single letter, with upper case enabling the option and lower case \ndisabling it:\n\n | S, s: Use, or do not use, a shell\n | O, o: Capture, or do not capture, stdout\n | E, e: Capture, or do not capture, stderr\n | M, m: Merge, or do not merge, stderr into stdout (M overrides E, e)\n | W, w: Wait, or do not wait, for command to terminate before proceeding\n\nIf a letter corresponding to a particular option is not specified, the default \nis used for that option. In addition, one of the following may be given, and it \nmust be given last\n\n | ``*``: accept any output status code\n | N: accept any output status code equal to or less than N\n | M,N,...: accept status codes M, N, ...\n\nIf you do not specify the status code behavior, only 0 is accepted as normal \ntermination, all other codes will be treated as errors. An exception is raised \nif exit status is not acceptable. By default an *OSError* is raised, however if \nthe *use_inform* preference is true, then *inform.Error* is used. In this case \nthe error includes attributes that can be used to access the *stdout*, *stderr*, \n*status*, *cmd*, and *msg*.\n\n*env* is a dictionary of environment variable and their values.\n\n*encoding* is used on the input and output streams when converting them to and\nfrom strings.\n\n*log* specifies whether details about the command should be sent to log file.\nMay be True, False, or None. If None, then behavior is set by *log_cmd*\npreference. Use of *log* requires that *Inform* package be installed.\n\n*option_args* is used when rendering command to logfile, it indicates how many\narguments each option takes. This only occurs when *use_inform* preference is \ntrue and *Inform* package is installed.\n\nFor example, to run diff you might use::\n\n >>> import sys, textwrap\n >>> ref = textwrap.dedent('''\n ... line1\n ... line2\n ... line3\n ... ''').strip()\n >>> test = textwrap.dedent('''\n ... line1\n ... line2\n ... ''').strip()\n\n >>> ref_bytes_written = to_path('./REF').write_text(ref)\n >>> test_bytes_written = to_path('./TEST').write_text(test)\n\n >>> cat = Cmd(['cat', 'TEST'], 'sOeW')\n >>> cat.run()\n 0\n\n >>> print(cat.stdout)\n line1\n line2\n\n >>> diff = Cmd('diff TEST REF', 'sOEW1')\n >>> status = diff.run()\n >>> status\n 1\n\nUse of *O* in the modes allows access to stdout, which is needed to access the \ndifferences. Specifying *E* also allows access to stderr, which in this case is \nhelpful in case something goes wrong because it allows the error handler to \naccess the error message generated by diff. Specifying *W* indicates that run() \nshould block until diff completes. This is also necessary for you to be able to \ncapture either stdout or stderr. Specifying 1 indicates that either 0 or 1 are \nvalid output status codes; any other code output by diff would be treated as an \nerror.\n\nIf you do not indicate that stdout or stderr should be captured, those streams \nremain connected to your TTY. You can specify a string to the run() method, \nwhich is fed to the program through stdin. If you don't specify anything the \nstdin stream for the program also remains connected to the TTY.\n\nIf you indicate that run() should return immediately without out waiting for the \nprogram to exit, then you can use the wait() and kill() methods to manage the \nexecution. For example::\n\n diff = Cmd(['gvim', '-d', lfile, rfile], 'w')\n diff.run()\n try:\n status = diff.wait()\n except KeyboardInterrupt:\n diff.kill()\n\nCasting the object to a string returns the command itself::\n\n >>> print(str(cat))\n cat TEST\n\nIf you call run(), then you should either specify 'W' as the wait mode, or you \nshould call the wait() method. If you do not, then any string you specified as \nstdin is not applied. If your intention is to kick off a process and not wait \nfor it to finish, you should use start() instead. It also allows you to specify \na string to pass to stdin, however you cannot access stdout, stderr, or the exit \nstatus. If you specify the 'O' or 'E' modes when using start(), those outputs \nare simply discarded. This is a useful way of discarding uninteresting \ndiagnostics from the program you are calling.\n\n*Cmd* also provides the *render* method, which converts the command to a string. \nIt takes the same optional arguments as does *render_command*.\n\n\nRun\n~~~\n\n*Run* subclasses *Cmd*. It basically constructs the process and then immediately \ncalls the run() method. It takes the same arguments as Cmd, but an additional \nargument that allows you to specify stdin for the process::\n\n Run(cmd[, modes][, stdin][, env][, encoding])\n\nRun expect you to wait for the process to end, either by specify the 'W' mode, \nor by calling wait(). For example::\n\n >>> echo = Run('cat > helloworld', 'SoeW', 'hello world')\n >>> echo.status\n 0\n\n >>> echo = Run(['echo', 'helloworld'], 'sOew')\n >>> echo.wait()\n 0\n\n >>> print(echo.stdout.strip())\n helloworld\n\n\nStart\n~~~~~\n\nStart also subclasses Cmd. It is similar to Run in that it immediately executes \nthe command, but it differs in that it does not expect you to wait for the \ncommand to terminate. You may specify stdin to the command if you wish, but \nsince you are not waiting for the command to terminate you cannot access stdout, \nstderr or the exit status. Effectively, Start() kicks off the process and then \nignores it. You may pass wait or accept in the mode string, but they are \nignored. If you select either stdout or stderr to be captured, then are wired to \n/dev/null, meaning that the selected output is swallowed and discarded.\n\n::\n\n >>> cat = Start('cat helloworld', 'sOe')\n\n\nwhich\n~~~~~\n\nGiven a name, a path, and a collection of read, write, or execute flags, this \nfunction returns the locations along the path where a file or directory can be \nfound with matching flags::\n\n which(name, path=None, flags=os.X_OK)\n\nBy default the path is specified by the PATH environment variable and the flags \ncheck whether you have execute permission.\n\n\nrender_command\n~~~~~~~~~~~~~~\n\nRender a command to a string::\n\n render_command(cmd[, option_args][, width])\n\nConverts the command to a string. The formatting is such that you should be \nable to feed the result directly to a shell and have command execute properly.\n\n*cmd* is the command to render. It may be a string or a list of strings.\n\n*option_args* is a dictionary. The keys are options accepted by the command and \nthe value is the number of arguments for that option. If an option is not \nfound, it is assumed to have 0 arguments.\n\n*width* specifies how long the string must be before it is broken into multiple \nlines. If length of resulting line would be width or less, return as a\nsingle line, otherwise place each argument and option on separate line.\n\nIf the command is rendered as multiple lines, each argument and option is placed \non a separate line, while keeping argument to options on the same line as the \noption. Placing each option and argument on its own line allows complicated \ncommands with long arguments to be displayed cleanly.\n\nFor example::\n\n >>> args = {'--dux': 2, '-d': 2, '--tux': 1}\n >>> print(render_command('bux --dux a b -d c d --tux e f g h', args))\n bux --dux a b -d c d --tux e f g h\n\n >>> print(render_command('bux --dux a b -d c d --tux e f g h', args, width=0))\n bux \\\n --dux a b \\\n -d c d \\\n --tux e \\\n f \\\n g \\\n h\n\n\nset_prefs\n~~~~~~~~~\n\nUsed to set preferences that affect the *Cmd* class. The preferences are given \nas keyword arguments.\n\n*use_inform* indicates that the *Inform* exception *Error* should be raised if \nthe exit status from a command is not acceptable. If this not given or is False, \nan OSError is raised instead. Use of this preference requires that *Inform* be \navailable. If *use_inform* is True, then inform.Error() is used by *Cmd* and \nits subclasses (*Run* and *Start*).\n\n*log_cmd* specifies that the command and its exit status should be written to \nthe *Inform* log file. Use of this preference requires that *Inform* be \navailable.\n\n\nError Reporting with Inform\n~~~~~~~~~~~~~~~~~~~~~~~~~~~\n\nThe *Cmd* class and its subclasses (*Run* and *Start*) raise an `Inform \n<https://inform.readthedocs.io>`_ Error if the *use_inform* preference was \nspecified. This allows for rich error reporting. In particular, the command, \nexit status, stdout and stderr are all returned with the exception and are \navailable to insert into an error message. For example::\n\n >> from shlib import Run, set_prefs\n >> from inform import Error\n\n >> set_prefs(use_inform=True)\n\n >> try:\n .. c = Run('sort words', 'sOEW0')\n .. except Error as e:\n .. e.report(template=(\n .. '\"{cmd}\" exits with status {status}.\\n {stderr}',\n .. '\"{cmd}\" exits with status {status}.',\n .. ))\n error: \"sort words\" exits with status 2.\n sort: cannot read: words: No such file or directory.\n\nIf command returns a non-zero exit status, an exception is raised and one of two \nerror messages are printed. The first is printed if *stderr* is not empty, and \nthe second is printed if it is.\n\nMost other functions raise an OSError upon an error. You can use *Inform* to \nconvert this exception into a reasonable error message::\n\n >> from inform import fatal, os_error\n >>\n >> try:\n .. cp(from, to)\n .. except OSError as e:\n .. fatal(os_error(e))\n\n",
"bugtrack_url": null,
"license": "",
"summary": "shell library",
"version": "1.6",
"project_urls": {
"documentation": "https://github.com/kenkundert/shlib",
"homepage": "https://github.com/kenkundert/shlib",
"repository": "https://github.com/kenkundert/shlib"
},
"split_keywords": [
"shlib",
"shell",
"shell utilities"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "4582fc46c15fbe52cb75634fea7abf2c7abfe9c7a5602c22cde3a3269def83f2",
"md5": "444e04ed7981eddc8b1b4acf4ce9e437",
"sha256": "dafe41c76f50d5d7168195c4413acf3ec7c0573789688037fd7ef0dc50d42eba"
},
"downloads": -1,
"filename": "shlib-1.6-py3-none-any.whl",
"has_sig": false,
"md5_digest": "444e04ed7981eddc8b1b4acf4ce9e437",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.6",
"size": 19052,
"upload_time": "2023-05-18T18:16:55",
"upload_time_iso_8601": "2023-05-18T18:16:55.003265Z",
"url": "https://files.pythonhosted.org/packages/45/82/fc46c15fbe52cb75634fea7abf2c7abfe9c7a5602c22cde3a3269def83f2/shlib-1.6-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "3cffe5f3f459b5c177baee587b9fab5df9c176171fc6e9bf7552f4d79432f695",
"md5": "e01428c4c3c2367835f80588ce7f85c1",
"sha256": "dea03d1c73b76026bcb256751f0ca1d1402b8ed9a1863041b20b169ada543557"
},
"downloads": -1,
"filename": "shlib-1.6.tar.gz",
"has_sig": false,
"md5_digest": "e01428c4c3c2367835f80588ce7f85c1",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.6",
"size": 23875,
"upload_time": "2023-05-18T18:16:57",
"upload_time_iso_8601": "2023-05-18T18:16:57.575377Z",
"url": "https://files.pythonhosted.org/packages/3c/ff/e5f3f459b5c177baee587b9fab5df9c176171fc6e9bf7552f4d79432f695/shlib-1.6.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-05-18 18:16:57",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "kenkundert",
"github_project": "shlib",
"travis_ci": true,
"coveralls": true,
"github_actions": true,
"tox": true,
"lcname": "shlib"
}
