# pastepwn - Paste-Scraping Python Framework
[](https://travis-ci.com/d-Rickyy-b/pastepwn)
[](https://badge.fury.io/py/pastepwn)
[](https://coveralls.io/github/d-Rickyy-b/pastepwn?branch=master)
[](https://www.codacy.com/manual/d-Rickyy-b/pastepwn?utm_source=github.com&utm_medium=referral&utm_content=d-Rickyy-b/pastepwn&utm_campaign=Badge_Grade)
[Pastebin](https://pastebin.com) is a very helpful tool to store or rather share ascii encoded data online. In the world of OSINT, pastebin is being used by [researchers all around the world](https://www.troyhunt.com/introducing-paste-searches-and/) to retrieve e.g. leaked account data, in order to find indicators about security breaches.
*Pastepwn* is a framework to scrape pastes and scan them for certain indicators. There are several analyzers and actions to be used out-of-the-box, but it is also easily extensible - you can create your own analyzers and actions on the fly.
**Please note:** This framework is **not** to be used for illegal actions. It can be used for querying public Pastebin pastes for e.g. your username or email address in order to increase your own security.
### ⚠️ Important note
In April 2020 Pastebin [disabled access to their scraping API](https://twitter.com/rnd_infosec_guy/status/1248310762227093509) for a short period of time. At first people weren't able to access the scraping API in any way, but later on they re-enabled access to the API setup page. But since then it isn't possible to scrape "text" pastes. Only pastes with any kind of syntax set. That reduces the amount of pastes to a minimum, which reduced the usefulness of this tool.
### Setting up pastepwn
To use the pastepwn framework you need to follow these simple steps:
1) **Make sure** to have a [Pastebin premium](https://pastebin.com/pro) account!
2) Install pastepwn via pip (`pip3 install pastepwn`)¹
3) Create a file (e.g. `main.py`) in your project root, where you put your code in²
4) Fill that file with content - add analyzers and actions. Check the [example](https://github.com/d-Rickyy-b/pastepwn/tree/master/examples/example.py) implementation.
¹ Note that pastepwn **only works with python3.6 or above**
² *(If you want to store all pastes, make sure to set up a `mongodb`, `mysql` or `sqlite` instance)*
### Behind a proxy
There are 2 ways to use this tool behind a proxy:
- Define the following environment variables: `HTTP_PROXY`, `HTTPS_PROXY`, `NO_PROXY`.
- When initializing the PastePwn object, use the `proxies` argument. `proxies` is a dict as defined in [requests' documentation](http://docs.python-requests.org/en/master/user/advanced/#proxies).
### Troubleshooting
If you are having troubles, check out the [wiki pages](https://github.com/d-Rickyy-b/pastepwn/wiki) first.
If your question/issue is not resolved there, feel free to [create an issue](https://github.com/d-Rickyy-b/pastepwn/issues/new/choose) or [contact me on Telegram](https://t.me/d_Rickyy_b).
### Roadmap and ToDos
Check the [bug tracker](https://github.com/d-Rickyy-b/pastepwn/issues) on GitHub to get an up-to-date status about features and ToDos.
- REST API for querying paste data (will be another project)
- Add a helpful wiki with instructions and examples
Raw data
{
"_id": null,
"home_page": "https://github.com/d-Rickyy-b/pastepwn",
"name": "pastepwn",
"maintainer": "",
"docs_url": null,
"requires_python": "",
"maintainer_email": "",
"keywords": "python pastebin scraping osint framework",
"author": "d-Rickyy-b",
"author_email": "pastepwn@rico-j.de",
"download_url": "https://files.pythonhosted.org/packages/37/27/8d6926847641757737b864bf00ab824f9a364311319b4236033406abfedc/pastepwn-2.1.0.tar.gz",
"platform": null,
"description": "\n\n\n# pastepwn - Paste-Scraping Python Framework\n[](https://travis-ci.com/d-Rickyy-b/pastepwn)\n[](https://badge.fury.io/py/pastepwn)\n[](https://coveralls.io/github/d-Rickyy-b/pastepwn?branch=master)\n[](https://www.codacy.com/manual/d-Rickyy-b/pastepwn?utm_source=github.com&utm_medium=referral&utm_content=d-Rickyy-b/pastepwn&utm_campaign=Badge_Grade)\n\n[Pastebin](https://pastebin.com) is a very helpful tool to store or rather share ascii encoded data online. In the world of OSINT, pastebin is being used by [researchers all around the world](https://www.troyhunt.com/introducing-paste-searches-and/) to retrieve e.g. leaked account data, in order to find indicators about security breaches.\n\n*Pastepwn* is a framework to scrape pastes and scan them for certain indicators. There are several analyzers and actions to be used out-of-the-box, but it is also easily extensible - you can create your own analyzers and actions on the fly.\n\n**Please note:** This framework is **not** to be used for illegal actions. It can be used for querying public Pastebin pastes for e.g. your username or email address in order to increase your own security.\n\n### \u26a0\ufe0f Important note\nIn April 2020 Pastebin [disabled access to their scraping API](https://twitter.com/rnd_infosec_guy/status/1248310762227093509) for a short period of time. At first people weren't able to access the scraping API in any way, but later on they re-enabled access to the API setup page. But since then it isn't possible to scrape \"text\" pastes. Only pastes with any kind of syntax set. That reduces the amount of pastes to a minimum, which reduced the usefulness of this tool.\n\n### Setting up pastepwn\n\nTo use the pastepwn framework you need to follow these simple steps:\n\n1) **Make sure** to have a [Pastebin premium](https://pastebin.com/pro) account!\n2) Install pastepwn via pip (`pip3 install pastepwn`)\u00b9\n3) Create a file (e.g. `main.py`) in your project root, where you put your code in\u00b2\n4) Fill that file with content - add analyzers and actions. Check the [example](https://github.com/d-Rickyy-b/pastepwn/tree/master/examples/example.py) implementation.\n\n\u00b9 Note that pastepwn **only works with python3.6 or above** \n\u00b2 *(If you want to store all pastes, make sure to set up a `mongodb`, `mysql` or `sqlite` instance)*\n\n### Behind a proxy\n\nThere are 2 ways to use this tool behind a proxy:\n\n- Define the following environment variables: `HTTP_PROXY`, `HTTPS_PROXY`, `NO_PROXY`.\n- When initializing the PastePwn object, use the `proxies` argument. `proxies` is a dict as defined in [requests' documentation](http://docs.python-requests.org/en/master/user/advanced/#proxies).\n\n### Troubleshooting\nIf you are having troubles, check out the [wiki pages](https://github.com/d-Rickyy-b/pastepwn/wiki) first.\nIf your question/issue is not resolved there, feel free to [create an issue](https://github.com/d-Rickyy-b/pastepwn/issues/new/choose) or [contact me on Telegram](https://t.me/d_Rickyy_b).\n\n### Roadmap and ToDos\nCheck the [bug tracker](https://github.com/d-Rickyy-b/pastepwn/issues) on GitHub to get an up-to-date status about features and ToDos.\n\n- REST API for querying paste data (will be another project)\n- Add a helpful wiki with instructions and examples\n",
"bugtrack_url": null,
"license": "MIT",
"summary": "Python framework to scrape PasteBin pastes and analyze them",
"version": "2.1.0",
"split_keywords": [
"python",
"pastebin",
"scraping",
"osint",
"framework"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "5c72a5600bc3d69508d7aa9959a4474c2a084347048febb6fdca254ec12f5c73",
"md5": "391d0fb7038094ec9f588174ebd5ad4e",
"sha256": "0e373f7fe9f060e148caf8034352e92566bc4b0d639fe9082053542b1847cf73"
},
"downloads": -1,
"filename": "pastepwn-2.1.0-py3-none-any.whl",
"has_sig": false,
"md5_digest": "391d0fb7038094ec9f588174ebd5ad4e",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": null,
"size": 123817,
"upload_time": "2023-04-01T19:37:32",
"upload_time_iso_8601": "2023-04-01T19:37:32.972289Z",
"url": "https://files.pythonhosted.org/packages/5c/72/a5600bc3d69508d7aa9959a4474c2a084347048febb6fdca254ec12f5c73/pastepwn-2.1.0-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "37278d6926847641757737b864bf00ab824f9a364311319b4236033406abfedc",
"md5": "4153130a62d76857b0cb0479a9868f3c",
"sha256": "f596da9e2bad04db6fe5ee7d4d19bd27f14bcb2324579529d11cab8468d4bc30"
},
"downloads": -1,
"filename": "pastepwn-2.1.0.tar.gz",
"has_sig": false,
"md5_digest": "4153130a62d76857b0cb0479a9868f3c",
"packagetype": "sdist",
"python_version": "source",
"requires_python": null,
"size": 68266,
"upload_time": "2023-04-01T19:37:34",
"upload_time_iso_8601": "2023-04-01T19:37:34.515452Z",
"url": "https://files.pythonhosted.org/packages/37/27/8d6926847641757737b864bf00ab824f9a364311319b4236033406abfedc/pastepwn-2.1.0.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2023-04-01 19:37:34",
"github": true,
"gitlab": false,
"bitbucket": false,
"github_user": "d-Rickyy-b",
"github_project": "pastepwn",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"requirements": [],
"lcname": "pastepwn"
}
JSON
