===============
powermole/lib
===============
This package contains building blocks to make an encrypted connection via one or more intermediate hosts possible.
The underlying foundation is SSH with the ProxyJump directive enabled.
This package also contains modules that provides a variety of services.
For simplicity, all modules are designed in a functional manner.
The power of SSH is harnessed by the *transferagent.py* and *tunnel.py* modules.
These modules are responsible for copying the Agent (*agent.py*) to the destination host and setting up tunneling.
Once tunneling is established, the Agent is executed by the Bootstrap Agent (*bootstrapagent.py*) by utilizing the stdin of Tunnel.
The Instructor (*instructor.py*) is responsible for starting and stopping services provided by the Agent.
These services includes: redirection of internet traffic (TOR mode), copying files (FILE option), and issuing commands (COMMAND option).
For port forwarding (FOR mode), the program simply relies on SSH itself.
The Instructor communicates with the Agent by sending JSON messages over the forwarded connection provided by Tunnel.
The Agent also responds to heartbeats send by localhost to check if connection is still intact.
Use the package **powermolecli** or **powermolegui** to interact with this library.
How it works
============
Terminology
-----------
* **Tunnel** is an established connection from localhost to the target destination host through intermediate hosts (called gateways).
* **Agent** is a python module running on the target destination host. It performs various functions.
* **Instructor** sends instructions to the *Agent* by utilizing a forwarded connection provided by *Tunnel*.
The program uses ssh to connect to the last host via one or more intermediaries.
.. image:: ../img/illustration_how_it_works__1.png
Through port forwarding, the program can communicate with the agent on the last host.
.. image:: ../img/illustration_how_it_works__2.png
The Instructor in conjunction with the Agent provides two modes:
* TOR mode
* The target destination host acts as an exit node (in TOR terminology).
* FOR(warding) mode
* Connections are forwarded to the target destination host.
Regardless which mode is enabled, several options are presented when the tunnel is established:
* COMMAND
* This option provides a rudimentary terminal interface to provide access to OS services on the target destination host.
* TRANSFER
* This options allows selected files to be transferred to the target destination host.
See `cli <https://github.com/yutanicorp/powermolecli>`_ or `gui <https://github.com/yutanicorp/powermolegui>`_ packages for implementation.
Development Workflow
====================
The workflow supports the following steps
* lint
* test
* build
* document
* upload
* graph
These actions are supported out of the box by the corresponding scripts under _CI/scripts directory with sane defaults based on best practices.
Sourcing setup_aliases.ps1 for windows powershell or setup_aliases.sh in bash on Mac or Linux will provide with handy aliases for the shell of all those commands prepended with an underscore.
The bootstrap script creates a .venv directory inside the project directory hosting the virtual environment. It uses pipenv for that.
It is called by all other scripts before they do anything. So one could simple start by calling _lint and that would set up everything before it tried to actually lint the project
Once the code is ready to be delivered the _tag script should be called accepting one of three arguments, patch, minor, major following the semantic versioning scheme.
So for the initial delivery one would call
$ _tag --minor
which would bump the version of the project to 0.1.0 tag it in git and do a push and also ask for the change and automagically update HISTORY.rst with the version and the change provided.
So the full workflow after git is initialized is:
* repeat as necessary (of course it could be test - code - lint :) )
* code
* lint
* test
* commit and push
* develop more through the code-lint-test cycle
* tag (with the appropriate argument)
* build
* upload (if you want to host your package in pypi)
* document (of course this could be run at any point)
Important Information
=====================
This template is based on pipenv. In order to be compatible with requirements.txt so the actual created package can be used by any part of the existing python ecosystem some hacks were needed.
So when building a package out of this **do not** simple call
$ python setup.py sdist
**as this will produce an unusable artifact with files missing.**
Instead use the provided build and upload scripts that create all the necessary files in the artifact.
Documentation
=============
* Documentation: https://powermolelib.readthedocs.org/en/latest
Contributing
============
Please read `CONTRIBUTING.md <https://gist.github.com/PurpleBooth/b24679402957c63ec426>`_ for details on our code of conduct, and the process for submitting pull requests to us.
Authors
=======
* **Vincent Schouten** - *Initial work* - `LINK <https://github.com/powermolelib>`_
See also the list of `contributors <https://github.com/your/project/contributors>`_ who participated in this project.
License
=======
This project is licensed under the MIT License - see the `LICENSE.md <LICENSE.md>`_ file for details
Acknowledgments
===============
* Costas Tyfoxylos
* MisterDaneel (developer of pysoxy)
History
-------
0.0.1 (13-05-2020)
---------------------
* First code creation
0.1.0 (13-05-2020)
------------------
* First commit
0.1.1 (13-05-2020)
------------------
* <None>
0.1.2 (15-05-2020)
------------------
* Add debug mode, refactor logging
1.0.0 (16-05-2020)
------------------
* Add parameter in tunnel.py to accept group of ports
1.0.1 (16-05-2020)
------------------
* Add method to periodically purge buffer
2.0.0 (16-05-2020)
------------------
* Refactor class responsible for instructing the Agent, refactor method responsible for transferring the Agent
2.0.1 (04-07-2020)
------------------
* <None>
2.1.0 (04-07-2020)
------------------
* Fix bug to make program work with 1 intermediary hosts
2.2.0 (04-07-2020)
------------------
* Fix bug to make program work with >1 intermediary hosts
2.2.1 (31-10-2020)
------------------
* Fix bug to work with IPv6 addresses on macOS, add higher timeout for establishing SSH connections, bump dependency
3.0.0 (26-03-2021)
------------------
* Add PLAIN mode, add COMMAND and TRANSFER options, add code to collect authenticated hosts
3.0.1 (30-03-2021)
------------------
* Refactor method responsible for sending commands
3.0.2 (11-04-2021)
------------------
* Refactor socket server and data protocol code, add new module
3.1.0 (26-04-2021)
------------------
* Refactor bootstrapagent.py to make robust
3.1.1 (17-05-2021)
------------------
* Refactor SOCKS code for readability
3.1.2 (17-05-2021)
------------------
* Add support for Python interpreter >3.7
3.2.0 (25-05-2021)
------------------
* Add parameter in transferagent.py, refactor and fix SOCKS code, refactor (API) parameters, add docstrings
3.3.0 (01-06-2021)
------------------
* Add feature to set heartbeat interval, refactor SOCKS code
3.3.1 (06-06-2021)
------------------
* Fix bug to avoid crashing when unable to connect, reword paragraph in README, reword commit messages in HISTORY.RST, reword list of keywords for PyPi
3.3.2 (02-12-2021)
------------------
* Fix bug responsible for crashing powermole during transfer Agent
3.4.0 (19-12-2021)
------------------
* Refactor heartbeat code and JSON validation schemas
3.4.1 (19-12-2021)
------------------
* Fix error handling when sending of files fails
3.4.2 (26-12-2021)
------------------
* Reword email address and fix sending files containing spaces
3.4.3 (28-12-2022)
------------------
* Fix security vulnerability in 3rd party package
3.4.4 (19-02-2023)
------------------
* Fix development workflow
3.4.5 (30-03-2023)
------------------
* Fix security vulnerability, add Python version check
3.4.6 (14-06-2023)
------------------
* Document paragraph about terminology
3.4.7 (27-08-2023)
------------------
* Add Read The Docs configuration file v2, Bump dependencies
3.4.8 (28-01-2024)
------------------
* Bump 3rd party package to fix security vulnerability, update template with newer Python version
Raw data
{
"_id": null,
"home_page": "https://github.com/yutanicorp/powermolelib",
"name": "powermolelib",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "powermole powermolelib ssh proxyjump hosts forwarding tor privacy",
"author": "Vincent Schouten",
"author_email": "powermole@protonmail.com",
"download_url": "https://files.pythonhosted.org/packages/76/84/8228a9a40711f8a86e851cddf177830e5318f2ffb6d0875d6ce30c7eb83b/powermolelib-3.4.8.tar.gz",
"platform": null,
"description": "===============\npowermole/lib\n===============\n\nThis package contains building blocks to make an encrypted connection via one or more intermediate hosts possible.\nThe underlying foundation is SSH with the ProxyJump directive enabled.\nThis package also contains modules that provides a variety of services.\nFor simplicity, all modules are designed in a functional manner.\n\nThe power of SSH is harnessed by the *transferagent.py* and *tunnel.py* modules.\nThese modules are responsible for copying the Agent (*agent.py*) to the destination host and setting up tunneling.\nOnce tunneling is established, the Agent is executed by the Bootstrap Agent (*bootstrapagent.py*) by utilizing the stdin of Tunnel.\nThe Instructor (*instructor.py*) is responsible for starting and stopping services provided by the Agent.\nThese services includes: redirection of internet traffic (TOR mode), copying files (FILE option), and issuing commands (COMMAND option).\nFor port forwarding (FOR mode), the program simply relies on SSH itself.\nThe Instructor communicates with the Agent by sending JSON messages over the forwarded connection provided by Tunnel.\nThe Agent also responds to heartbeats send by localhost to check if connection is still intact.\n\nUse the package **powermolecli** or **powermolegui** to interact with this library.\n\n\nHow it works\n============\n\nTerminology\n-----------\n* **Tunnel** is an established connection from localhost to the target destination host through intermediate hosts (called gateways).\n* **Agent** is a python module running on the target destination host. It performs various functions.\n* **Instructor** sends instructions to the *Agent* by utilizing a forwarded connection provided by *Tunnel*.\n\nThe program uses ssh to connect to the last host via one or more intermediaries.\n\n.. image:: ../img/illustration_how_it_works__1.png\n\n\nThrough port forwarding, the program can communicate with the agent on the last host.\n\n.. image:: ../img/illustration_how_it_works__2.png\n\nThe Instructor in conjunction with the Agent provides two modes:\n\n* TOR mode\n\n * The target destination host acts as an exit node (in TOR terminology).\n\n* FOR(warding) mode\n\n * Connections are forwarded to the target destination host.\n\n\nRegardless which mode is enabled, several options are presented when the tunnel is established:\n\n* COMMAND\n\n * This option provides a rudimentary terminal interface to provide access to OS services on the target destination host.\n\n* TRANSFER\n\n * This options allows selected files to be transferred to the target destination host.\n\n\nSee `cli <https://github.com/yutanicorp/powermolecli>`_ or `gui <https://github.com/yutanicorp/powermolegui>`_ packages for implementation.\n\n\nDevelopment Workflow\n====================\n\nThe workflow supports the following steps\n\n * lint\n * test\n * build\n * document\n * upload\n * graph\n\nThese actions are supported out of the box by the corresponding scripts under _CI/scripts directory with sane defaults based on best practices.\nSourcing setup_aliases.ps1 for windows powershell or setup_aliases.sh in bash on Mac or Linux will provide with handy aliases for the shell of all those commands prepended with an underscore.\n\nThe bootstrap script creates a .venv directory inside the project directory hosting the virtual environment. It uses pipenv for that.\nIt is called by all other scripts before they do anything. So one could simple start by calling _lint and that would set up everything before it tried to actually lint the project\n\nOnce the code is ready to be delivered the _tag script should be called accepting one of three arguments, patch, minor, major following the semantic versioning scheme.\nSo for the initial delivery one would call\n\n $ _tag --minor\n\nwhich would bump the version of the project to 0.1.0 tag it in git and do a push and also ask for the change and automagically update HISTORY.rst with the version and the change provided.\n\n\nSo the full workflow after git is initialized is:\n\n * repeat as necessary (of course it could be test - code - lint :) )\n * code\n * lint\n * test\n * commit and push\n * develop more through the code-lint-test cycle\n * tag (with the appropriate argument)\n * build\n * upload (if you want to host your package in pypi)\n * document (of course this could be run at any point)\n\n\nImportant Information\n=====================\n\nThis template is based on pipenv. In order to be compatible with requirements.txt so the actual created package can be used by any part of the existing python ecosystem some hacks were needed.\nSo when building a package out of this **do not** simple call\n\n $ python setup.py sdist\n\n**as this will produce an unusable artifact with files missing.**\nInstead use the provided build and upload scripts that create all the necessary files in the artifact.\n\n\nDocumentation\n=============\n\n* Documentation: https://powermolelib.readthedocs.org/en/latest\n\n\nContributing\n============\n\nPlease read `CONTRIBUTING.md <https://gist.github.com/PurpleBooth/b24679402957c63ec426>`_ for details on our code of conduct, and the process for submitting pull requests to us.\n\n\nAuthors\n=======\n\n* **Vincent Schouten** - *Initial work* - `LINK <https://github.com/powermolelib>`_\n\nSee also the list of `contributors <https://github.com/your/project/contributors>`_ who participated in this project.\n\n\nLicense\n=======\n\nThis project is licensed under the MIT License - see the `LICENSE.md <LICENSE.md>`_ file for details\n\n\nAcknowledgments\n===============\n\n* Costas Tyfoxylos\n* MisterDaneel (developer of pysoxy)\n\n\n\n\n\nHistory\n-------\n\n0.0.1 (13-05-2020)\n---------------------\n\n* First code creation\n\n\n0.1.0 (13-05-2020)\n------------------\n\n* First commit\n\n\n0.1.1 (13-05-2020)\n------------------\n\n* <None>\n\n\n0.1.2 (15-05-2020)\n------------------\n\n* Add debug mode, refactor logging\n\n\n1.0.0 (16-05-2020)\n------------------\n\n* Add parameter in tunnel.py to accept group of ports\n\n\n1.0.1 (16-05-2020)\n------------------\n\n* Add method to periodically purge buffer\n\n\n2.0.0 (16-05-2020)\n------------------\n\n* Refactor class responsible for instructing the Agent, refactor method responsible for transferring the Agent\n\n\n2.0.1 (04-07-2020)\n------------------\n\n* <None>\n\n\n2.1.0 (04-07-2020)\n------------------\n\n* Fix bug to make program work with 1 intermediary hosts\n\n\n2.2.0 (04-07-2020)\n------------------\n\n* Fix bug to make program work with >1 intermediary hosts\n\n\n2.2.1 (31-10-2020)\n------------------\n\n* Fix bug to work with IPv6 addresses on macOS, add higher timeout for establishing SSH connections, bump dependency\n\n\n3.0.0 (26-03-2021)\n------------------\n\n* Add PLAIN mode, add COMMAND and TRANSFER options, add code to collect authenticated hosts\n\n\n3.0.1 (30-03-2021)\n------------------\n\n* Refactor method responsible for sending commands\n\n\n3.0.2 (11-04-2021)\n------------------\n\n* Refactor socket server and data protocol code, add new module\n\n\n3.1.0 (26-04-2021)\n------------------\n\n* Refactor bootstrapagent.py to make robust\n\n\n3.1.1 (17-05-2021)\n------------------\n\n* Refactor SOCKS code for readability\n\n\n3.1.2 (17-05-2021)\n------------------\n\n* Add support for Python interpreter >3.7\n\n\n3.2.0 (25-05-2021)\n------------------\n\n* Add parameter in transferagent.py, refactor and fix SOCKS code, refactor (API) parameters, add docstrings\n\n\n3.3.0 (01-06-2021)\n------------------\n\n* Add feature to set heartbeat interval, refactor SOCKS code\n\n\n3.3.1 (06-06-2021)\n------------------\n\n* Fix bug to avoid crashing when unable to connect, reword paragraph in README, reword commit messages in HISTORY.RST, reword list of keywords for PyPi\n\n\n3.3.2 (02-12-2021)\n------------------\n\n* Fix bug responsible for crashing powermole during transfer Agent\n\n\n3.4.0 (19-12-2021)\n------------------\n\n* Refactor heartbeat code and JSON validation schemas\n\n\n3.4.1 (19-12-2021)\n------------------\n\n* Fix error handling when sending of files fails\n\n\n3.4.2 (26-12-2021)\n------------------\n\n* Reword email address and fix sending files containing spaces\n\n\n3.4.3 (28-12-2022)\n------------------\n\n* Fix security vulnerability in 3rd party package\n\n\n3.4.4 (19-02-2023)\n------------------\n\n* Fix development workflow\n\n\n3.4.5 (30-03-2023)\n------------------\n\n* Fix security vulnerability, add Python version check\n\n\n3.4.6 (14-06-2023)\n------------------\n\n* Document paragraph about terminology\n\n\n3.4.7 (27-08-2023)\n------------------\n\n* Add Read The Docs configuration file v2, Bump dependencies\n\n\n3.4.8 (28-01-2024)\n------------------\n\n* Bump 3rd party package to fix security vulnerability, update template with newer Python version\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "a library that is responsible of modeling objects to connect to another host via one or more intermediaries, offering a variety of modes (FOR and TOR) and options (TRANSFER and COMMAND)",
"version": "3.4.8",
"project_urls": {
"Homepage": "https://github.com/yutanicorp/powermolelib"
},
"split_keywords": [
"powermole",
"powermolelib",
"ssh",
"proxyjump",
"hosts",
"forwarding",
"tor",
"privacy"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "76848228a9a40711f8a86e851cddf177830e5318f2ffb6d0875d6ce30c7eb83b",
"md5": "750d3b1d73d07a8e2b3a09b6198c2c83",
"sha256": "4cf955242bbfcd2ca719a339ffc8b507d470d2cd5436a75cf2fee97fce43e4f2"
},
"downloads": -1,
"filename": "powermolelib-3.4.8.tar.gz",
"has_sig": false,
"md5_digest": "750d3b1d73d07a8e2b3a09b6198c2c83",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 100782,
"upload_time": "2024-01-28T19:04:19",
"upload_time_iso_8601": "2024-01-28T19:04:19.129852Z",
"url": "https://files.pythonhosted.org/packages/76/84/8228a9a40711f8a86e851cddf177830e5318f2ffb6d0875d6ce30c7eb83b/powermolelib-3.4.8.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-01-28 19:04:19",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "yutanicorp",
"github_project": "powermolelib",
"travis_ci": false,
"coveralls": false,
"github_actions": false,
"requirements": [],
"tox": true,
"lcname": "powermolelib"
}
JSON
