farssh


Namefarssh JSON
Version 0.5 PyPI version JSON
download
home_pageNone
SummarySecure on-demand connections into AWS VPCs
upload_time2024-11-24 12:28:48
maintainerNone
docs_urlNone
authorNone
requires_python>=3.8
licenseBSD 2-clause
keywords aws mysql postgresql proxy rds ssh tunnel vpc
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            ## FarSSH

FarSSH provides secure on-demand connections into AWS VPCs.

You can easily connect to in-VPC resources like RDS and OpenSearch endpoints, using tools installed on your local machine.

FarSSH features a SOCKS proxy mode, enabling your browser to be "in" the target VPC; this works both for accessing VPC
resources and as a quick way to tunnel all your browser traffic, so your browser's connections will
appear to come from this AWS region's public IP addresses (like a VPN).

FarSSH integrates with the `psql` and `mysql` command line clients for easy database access.

Resources are deployed in *your* AWS account; there is no third party / no external service involved. AWS charges apply,
at roughly $0.01 per hour (billed per second) per active client; no charges when no client is active.


## Usage

### SQL Client Mode

To launch a `psql` or `mysql` client directly to one of your RDS databases (instance or cluster), simply:
```
farssh psql [-U username] [database_name]
```

For MySQL / MariaDB:
```
farssh mysql -p [-u username] [database_name]
```

When not specified, username and database_name will be taken from the RDS configuration (master username and the
initial database).

If only one matching RDS database is available, it will automatically be selected. If there are multiple databases,
use `--identifier` to select one; otherwise, a list of available databases will be shown.

### Tunnel mode

Forward a local port to your VPC like this:
```
farssh tunnel 5432 pg-cluster.cluster-foo.eu-central-1.rds.amazonaws.com
```

Then connect to the local port 5432 on your machine, e.g. just using `psql -h localhost` in another shell, or your favorite GUI client.

Remember to terminate the FarSSH session using `^C` when done.

### Proxy mode

Simply run
```
farssh proxy
```

Then configure your browser to use a SOCKS proxy on `localhost`, port 1080.

Remember to terminate the FarSSH session using `^C` when done.

### SSH mode

If you just need a shell inside your VPC, run
```
farssh ssh
```

### Additional Arguments

The `psql`, `mysql` and `ssh` commands can be used with additional arguments that will be passed to the client, so you
could do something like `farssh ssh -- /sbin/ip address` or `farssh psql -- -c "select foo from bar"`.


## Installation

### Requirements

 * The target VPC needs to have a public subnet
   * note that the connection target (FarSSH tunnel mode) can be in a private subnet, or, via VPC peering, even
     in a different VPC
 * For the client machine:
   * local AWS configuration (appropriate credentials / profiles configured etc.)
   * Python 3
   * [AWS SDK for Python](https://boto3.amazonaws.com/v1/documentation/api/latest/guide/quickstart.html), aka `boto3`
   * OpenSSH `ssh` client
   * The `psql` / `mysql` command line utilities if you want to use the respective mode

### Deploy configuration on AWS

Use this [Cloudformation quick-create link](https://console.aws.amazon.com/cloudformation/home#/stacks/create/review?templateURL=https://farssh.s3.amazonaws.com/cloudformation/farssh.yaml&stackName=farssh-default) to deploy necessary
resources in the target environment.

For Subnets, be sure to select one or more *public* subnets, i.e. that are connected to an Internet Gateway.

Make sure you have selected the correct region! For a list of created resources,
see below.

**NOTE: If you intend to use IPv6, please read below, before continuing**

**NOTE: If Cloudformation fails to create the stack with this error ...**
```
Unable to assume the service linked role. Please verify that the ECS service linked role exists.
```
... then please delete the stack from Cloudformation and simply retry from the quick-create link above.
That role is automatically created by AWS on first-ever ECS usage, but the cluster creation fails anyway. If
you know how to properly fix this in Cloudformation, please let me know.


### Allow connections from FarSSH

Adjust your existing Security Groups to allow inbound connections from the FarSSH Security Group.

For example, to allow tunnel connections to your RDS instance, modify a corresponding RDS instance Security Group:
* Edit *inbound rules*
* Type: PostgreSQL (or MySQL or ...)
* Source: custom: security group `farssh-default`

### Install the FarSSH client

The FarSSH client is available in the Python Package Index, so you can simply use `pip` to install and update:

```
pip install farssh
```

FarSSH will use the target AWS account, region and credentials from the local AWS configuration, e.g. your configuration in `~/.aws`,
your `AWS_PROFILE` and `AWS_REGION` environment variables etc.

**Note:** Make sure that your local environment uses the same AWS account and region that you deployed the
Cloudformation template to.

That's it. For usage, see above.


### Updating

To update the FarSSH Cloudformation template, select the FarSSH stack in the Cloudformation console, hit
"Update" and replace the template using this S3 url: `https://farssh.s3.amazonaws.com/cloudformation/farssh.yaml`

To update FarSSH settings, update the stack with the "Use current template" option.


## IPv6 Support

Given that AWS now charges for any use of public IPv4 addresses, it's important to use IPv6 when possible.

FarSSH supports IPv6 both on the AWS side and on the client.

### Client Side

Run the client with the option `-6` (or `--ipv6`) to make it connect to the FarSSH ECS task via IPv6. The
client will fail when the FarSSH ECS task does not have an IPv6 address.

### Server Side (ECS)

IPv6 for the FarSSH ECS task is a bit more complicated, as we need to work around several IPv6 potholes in AWS.

To allow IPv6 connections from the client, you only need to make sure that the configured public subnets have IPv6 configured.
Fargate tasks will automatically get an IPv6 address. If that doesn't work out of the box, double-check the ECS [`dualStackIPv6` setting](https://docs.aws.amazon.com/AmazonECS/latest/developerguide/ecs-account-settings.html).

But an ECS task also needs some IP connectivity to pull the image and to send logs to Cloudwatch. If you have neither VPC endpoints
nor NAT in your VPC, this will cause the ECS task to fail when a FarSSH client uses IPv6.

The Cloudformation template has some knobs for this:

The easy fix is to set `ForcePublicIpv4` to `true` in the Cloudformation stack; FarSSH will then always
request a public IPv4 address, even when a clients connects via IPv6. With the public IPv4 address, everything works.

Alternatively, to fully avoid using public IPv4 addresses, change these options during the Cloudformation setup:

- set `ImageUri` to the `docker.io` address (the AWS ECR does not support IPv6)
- disable the `awslogs` driver (Cloudwatch Logs does not support IPv6)


## How it works

FarSSH is basically a wrapper around an OpenSSH server and your local OpenSSH client. The latter does the
actual work of tunneling (local port forwarding, parameter `-L`) and proxying (SOCKS proxy, parameter `-D`).

FarSSH consists of three rather simple components to glue it together. Here's a highly professional
architecture diagram:

![farssh architecture painting](https://pbs.twimg.com/media/Fz776zoWIAI6f89?format=png&name=900x900)

### Container image

FarSSH publishes a container image in AWS Public ECR at `public.ecr.aws/apparentorder/farssh`. This is
a tiny Alpine-based image that only runs an SSH server. There is also a background process that will
terminate the task if there are no active connections.

The same image is also published to Dockerhub at `docker.io/apparentorder/farssh`, because Dockerhub
supports IPv6 and AWS Public ECR does not. Using Dockerhub over IPv4 might result in pull errors due
to rate limit though.

### Resources in the target environment

The Cloudformation template creates the following resources so FarSSH tasks can be run in the target
environment:

  * IAM roles for the ECS task (TaskRole and ExecutionRole)
  * ECS resources: cluster `farssh`, task definition `farssh-default`
  * SSM Parameters `/farssh/*`
  * Security Group `farssh-default`

### Client

The "client" pulls a few parameters from SSM Parameter Store
and then starts an ECS Task with the FarSSH image. The FarSSH task will be available after a few seconds.

The client will then start an `ssh` session to the public IP address of the FarSSH task.

Key pairs are generated locally for both the client connection and the FarSSH task's SSH host key, and
the SSH client will "strictly" check the expected host key.

### Caveats

* Currently, FarSSH can be deployed to only one VPC per region per account (deploying multiple times to
  different regions works fine)


## Future ideas

* Support for multiple VPCs per region
* Optionally use some kind of "reverse SSH", so the FarSSH task does not need a public IP address
* Enable using existing ECS clusters (possibly including EC2-based)
* Only half-way through building this I realized that I could have built the same thing for an
  ad-hoc VPN endpoint instead of an SSH server; I have yet to think through what kind of sense
  that could make
* Properly tag the public ECR image(s) so it can be coupled with released versions

 
  
## Motivation

To my knowledge, all alternative options use [time-based billing](https://tty.neveragain.de/2021/06/29/timeless-services.html),
meaning that you pay a base fee for having them around, even if you're not using them at all.
For example, while AWS ClientVPN does charge per connection hour, it also charges you just for
being associated to your VPC.

AWS recently announced [EC2 Instance Connect Endpoints](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/connect-using-eice.html)
which absolutely solve this problem, even without additional charges. For a few days after release, this
allowed to make arbitrary TCP connections (e.g. to your RDS instance's port 5432!).

Unfortunately, AWS decided that while this works great and allows most customer to get rid of jump hosts
once and for all, it's just too easy. As it stands today, it's artificially limited to target ports 22 (ssh)
and 3389 (RDP). This move also influenced this project's name: While "FarSSH" is a play on "Fargate" and "SSH",
it shall be pronounced "farce" – because this project shouldn't have to exist.



## Contact

For bug reports, pull requests and other issues please use Github.

For everything else:

I'm (still) trying to get used to X/Twitter as [@apparentorder](https://twitter.com/apparentorder). DMs are open.
You can also try legacy message delivery to apparentorder@neveragain.de.


            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "farssh",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": null,
    "keywords": "aws, mysql, postgresql, proxy, rds, ssh, tunnel, vpc",
    "author": null,
    "author_email": "\"@apparentorder\" <apparentorder@neveragain.de>",
    "download_url": "https://files.pythonhosted.org/packages/53/79/a3d0b6f3d9dda0ee473375dbf3defd6ee2622dca00530d5669e6fed0eab4/farssh-0.5.tar.gz",
    "platform": null,
    "description": "## FarSSH\n\nFarSSH provides secure on-demand connections into AWS VPCs.\n\nYou can easily connect to in-VPC resources like RDS and OpenSearch endpoints, using tools installed on your local machine.\n\nFarSSH features a SOCKS proxy mode, enabling your browser to be \"in\" the target VPC; this works both for accessing VPC\nresources and as a quick way to tunnel all your browser traffic, so your browser's connections will\nappear to come from this AWS region's public IP addresses (like a VPN).\n\nFarSSH integrates with the `psql` and `mysql` command line clients for easy database access.\n\nResources are deployed in *your* AWS account; there is no third party / no external service involved. AWS charges apply,\nat roughly $0.01 per hour (billed per second) per active client; no charges when no client is active.\n\n\n## Usage\n\n### SQL Client Mode\n\nTo launch a `psql` or `mysql` client directly to one of your RDS databases (instance or cluster), simply:\n```\nfarssh psql [-U username] [database_name]\n```\n\nFor MySQL / MariaDB:\n```\nfarssh mysql -p [-u username] [database_name]\n```\n\nWhen not specified, username and database_name will be taken from the RDS configuration (master username and the\ninitial database).\n\nIf only one matching RDS database is available, it will automatically be selected. If there are multiple databases,\nuse `--identifier` to select one; otherwise, a list of available databases will be shown.\n\n### Tunnel mode\n\nForward a local port to your VPC like this:\n```\nfarssh tunnel 5432 pg-cluster.cluster-foo.eu-central-1.rds.amazonaws.com\n```\n\nThen connect to the local port 5432 on your machine, e.g. just using `psql -h localhost` in another shell, or your favorite GUI client.\n\nRemember to terminate the FarSSH session using `^C` when done.\n\n### Proxy mode\n\nSimply run\n```\nfarssh proxy\n```\n\nThen configure your browser to use a SOCKS proxy on `localhost`, port 1080.\n\nRemember to terminate the FarSSH session using `^C` when done.\n\n### SSH mode\n\nIf you just need a shell inside your VPC, run\n```\nfarssh ssh\n```\n\n### Additional Arguments\n\nThe `psql`, `mysql` and `ssh` commands can be used with additional arguments that will be passed to the client, so you\ncould do something like `farssh ssh -- /sbin/ip address` or `farssh psql -- -c \"select foo from bar\"`.\n\n\n## Installation\n\n### Requirements\n\n * The target VPC needs to have a public subnet\n   * note that the connection target (FarSSH tunnel mode) can be in a private subnet, or, via VPC peering, even\n     in a different VPC\n * For the client machine:\n   * local AWS configuration (appropriate credentials / profiles configured etc.)\n   * Python 3\n   * [AWS SDK for Python](https://boto3.amazonaws.com/v1/documentation/api/latest/guide/quickstart.html), aka `boto3`\n   * OpenSSH `ssh` client\n   * The `psql` / `mysql` command line utilities if you want to use the respective mode\n\n### Deploy configuration on AWS\n\nUse this [Cloudformation quick-create link](https://console.aws.amazon.com/cloudformation/home#/stacks/create/review?templateURL=https://farssh.s3.amazonaws.com/cloudformation/farssh.yaml&stackName=farssh-default) to deploy necessary\nresources in the target environment.\n\nFor Subnets, be sure to select one or more *public* subnets, i.e. that are connected to an Internet Gateway.\n\nMake sure you have selected the correct region! For a list of created resources,\nsee below.\n\n**NOTE: If you intend to use IPv6, please read below, before continuing**\n\n**NOTE: If Cloudformation fails to create the stack with this error ...**\n```\nUnable to assume the service linked role. Please verify that the ECS service linked role exists.\n```\n... then please delete the stack from Cloudformation and simply retry from the quick-create link above.\nThat role is automatically created by AWS on first-ever ECS usage, but the cluster creation fails anyway. If\nyou know how to properly fix this in Cloudformation, please let me know.\n\n\n### Allow connections from FarSSH\n\nAdjust your existing Security Groups to allow inbound connections from the FarSSH Security Group.\n\nFor example, to allow tunnel connections to your RDS instance, modify a corresponding RDS instance Security Group:\n* Edit *inbound rules*\n* Type: PostgreSQL (or MySQL or ...)\n* Source: custom: security group `farssh-default`\n\n### Install the FarSSH client\n\nThe FarSSH client is available in the Python Package Index, so you can simply use `pip` to install and update:\n\n```\npip install farssh\n```\n\nFarSSH will use the target AWS account, region and credentials from the local AWS configuration, e.g. your configuration in `~/.aws`,\nyour `AWS_PROFILE` and `AWS_REGION` environment variables etc.\n\n**Note:** Make sure that your local environment uses the same AWS account and region that you deployed the\nCloudformation template to.\n\nThat's it. For usage, see above.\n\n\n### Updating\n\nTo update the FarSSH Cloudformation template, select the FarSSH stack in the Cloudformation console, hit\n\"Update\" and replace the template using this S3 url: `https://farssh.s3.amazonaws.com/cloudformation/farssh.yaml`\n\nTo update FarSSH settings, update the stack with the \"Use current template\" option.\n\n\n## IPv6 Support\n\nGiven that AWS now charges for any use of public IPv4 addresses, it's important to use IPv6 when possible.\n\nFarSSH supports IPv6 both on the AWS side and on the client.\n\n### Client Side\n\nRun the client with the option `-6` (or `--ipv6`) to make it connect to the FarSSH ECS task via IPv6. The\nclient will fail when the FarSSH ECS task does not have an IPv6 address.\n\n### Server Side (ECS)\n\nIPv6 for the FarSSH ECS task is a bit more complicated, as we need to work around several IPv6 potholes in AWS.\n\nTo allow IPv6 connections from the client, you only need to make sure that the configured public subnets have IPv6 configured.\nFargate tasks will automatically get an IPv6 address. If that doesn't work out of the box, double-check the ECS [`dualStackIPv6` setting](https://docs.aws.amazon.com/AmazonECS/latest/developerguide/ecs-account-settings.html).\n\nBut an ECS task also needs some IP connectivity to pull the image and to send logs to Cloudwatch. If you have neither VPC endpoints\nnor NAT in your VPC, this will cause the ECS task to fail when a FarSSH client uses IPv6.\n\nThe Cloudformation template has some knobs for this:\n\nThe easy fix is to set `ForcePublicIpv4` to `true` in the Cloudformation stack; FarSSH will then always\nrequest a public IPv4 address, even when a clients connects via IPv6. With the public IPv4 address, everything works.\n\nAlternatively, to fully avoid using public IPv4 addresses, change these options during the Cloudformation setup:\n\n- set `ImageUri` to the `docker.io` address (the AWS ECR does not support IPv6)\n- disable the `awslogs` driver (Cloudwatch Logs does not support IPv6)\n\n\n## How it works\n\nFarSSH is basically a wrapper around an OpenSSH server and your local OpenSSH client. The latter does the\nactual work of tunneling (local port forwarding, parameter `-L`) and proxying (SOCKS proxy, parameter `-D`).\n\nFarSSH consists of three rather simple components to glue it together. Here's a highly professional\narchitecture diagram:\n\n![farssh architecture painting](https://pbs.twimg.com/media/Fz776zoWIAI6f89?format=png&name=900x900)\n\n### Container image\n\nFarSSH publishes a container image in AWS Public ECR at `public.ecr.aws/apparentorder/farssh`. This is\na tiny Alpine-based image that only runs an SSH server. There is also a background process that will\nterminate the task if there are no active connections.\n\nThe same image is also published to Dockerhub at `docker.io/apparentorder/farssh`, because Dockerhub\nsupports IPv6 and AWS Public ECR does not. Using Dockerhub over IPv4 might result in pull errors due\nto rate limit though.\n\n### Resources in the target environment\n\nThe Cloudformation template creates the following resources so FarSSH tasks can be run in the target\nenvironment:\n\n  * IAM roles for the ECS task (TaskRole and ExecutionRole)\n  * ECS resources: cluster `farssh`, task definition `farssh-default`\n  * SSM Parameters `/farssh/*`\n  * Security Group `farssh-default`\n\n### Client\n\nThe \"client\" pulls a few parameters from SSM Parameter Store\nand then starts an ECS Task with the FarSSH image. The FarSSH task will be available after a few seconds.\n\nThe client will then start an `ssh` session to the public IP address of the FarSSH task.\n\nKey pairs are generated locally for both the client connection and the FarSSH task's SSH host key, and\nthe SSH client will \"strictly\" check the expected host key.\n\n### Caveats\n\n* Currently, FarSSH can be deployed to only one VPC per region per account (deploying multiple times to\n  different regions works fine)\n\n\n## Future ideas\n\n* Support for multiple VPCs per region\n* Optionally use some kind of \"reverse SSH\", so the FarSSH task does not need a public IP address\n* Enable using existing ECS clusters (possibly including EC2-based)\n* Only half-way through building this I realized that I could have built the same thing for an\n  ad-hoc VPN endpoint instead of an SSH server; I have yet to think through what kind of sense\n  that could make\n* Properly tag the public ECR image(s) so it can be coupled with released versions\n\n \n  \n## Motivation\n\nTo my knowledge, all alternative options use [time-based billing](https://tty.neveragain.de/2021/06/29/timeless-services.html),\nmeaning that you pay a base fee for having them around, even if you're not using them at all.\nFor example, while AWS ClientVPN does charge per connection hour, it also charges you just for\nbeing associated to your VPC.\n\nAWS recently announced [EC2 Instance Connect Endpoints](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/connect-using-eice.html)\nwhich absolutely solve this problem, even without additional charges. For a few days after release, this\nallowed to make arbitrary TCP connections (e.g. to your RDS instance's port 5432!).\n\nUnfortunately, AWS decided that while this works great and allows most customer to get rid of jump hosts\nonce and for all, it's just too easy. As it stands today, it's artificially limited to target ports 22 (ssh)\nand 3389 (RDP). This move also influenced this project's name: While \"FarSSH\" is a play on \"Fargate\" and \"SSH\",\nit shall be pronounced \"farce\" \u2013 because this project shouldn't have to exist.\n\n\n\n## Contact\n\nFor bug reports, pull requests and other issues please use Github.\n\nFor everything else:\n\nI'm (still) trying to get used to X/Twitter as [@apparentorder](https://twitter.com/apparentorder). DMs are open.\nYou can also try legacy message delivery to apparentorder@neveragain.de.\n\n",
    "bugtrack_url": null,
    "license": "BSD 2-clause",
    "summary": "Secure on-demand connections into AWS VPCs",
    "version": "0.5",
    "project_urls": {
        "Homepage": "https://github.com/apparentorder/farssh"
    },
    "split_keywords": [
        "aws",
        " mysql",
        " postgresql",
        " proxy",
        " rds",
        " ssh",
        " tunnel",
        " vpc"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c9cee4ecd31276e4d345a383b5914bda86e1ec0ac66913d416d0705101e44e0d",
                "md5": "71e6388cf8391a2539fe38718654c388",
                "sha256": "ab04c1c6e136f899e03ea3805c396dcec9b28bb7afa248309da4dc9c6a9ae01a"
            },
            "downloads": -1,
            "filename": "farssh-0.5-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "71e6388cf8391a2539fe38718654c388",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8",
            "size": 12279,
            "upload_time": "2024-11-24T12:28:47",
            "upload_time_iso_8601": "2024-11-24T12:28:47.095683Z",
            "url": "https://files.pythonhosted.org/packages/c9/ce/e4ecd31276e4d345a383b5914bda86e1ec0ac66913d416d0705101e44e0d/farssh-0.5-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "5379a3d0b6f3d9dda0ee473375dbf3defd6ee2622dca00530d5669e6fed0eab4",
                "md5": "dd5889fb329d995fefbacffea9629fe3",
                "sha256": "5c074da03f72e29ce7d79a410fd48622d046347dc0dc552023d5375967567e19"
            },
            "downloads": -1,
            "filename": "farssh-0.5.tar.gz",
            "has_sig": false,
            "md5_digest": "dd5889fb329d995fefbacffea9629fe3",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 10185,
            "upload_time": "2024-11-24T12:28:48",
            "upload_time_iso_8601": "2024-11-24T12:28:48.699160Z",
            "url": "https://files.pythonhosted.org/packages/53/79/a3d0b6f3d9dda0ee473375dbf3defd6ee2622dca00530d5669e6fed0eab4/farssh-0.5.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-11-24 12:28:48",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "apparentorder",
    "github_project": "farssh",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "lcname": "farssh"
}
        
Elapsed time: 2.51292s