# Klaytn ETL
Klaytn ETL lets you convert Klaytn blockchain data into convenient formats like JSONs, CSVs and relational databases.
This is a fork of [Ethereum ETL](https://github.com/blockchain-etl/ethereum-etl).
[Full documentation available here](http://klaytn-etl.readthedocs.io/).
***Notice: Klaytn ETL is still on the beta version. However, CLIs are all functional.***
## Quickstart
Install Klaytn ETL:
```bash
pip3 install klaytn-etl-cli
```
Export blocks and transactions
```bash
> klaytnetl export_blocks_and_transactions --start-block 0 --end-block 5000 \
--blocks-output blocks.json --transactions-output transactions.json
```
Export ERC20 and ERC721 transfers
```bash
> klaytnetl export_token_transfers --start-block 0 --end-block 5000 \
--output token_transfers.json
```
Export traces
```bash
> klaytnetl export_traces --start-block 0 --end-block 5000 \
--output traces.json
```
Find other commands [here](klaytnetl/cli/__init__.py).
For the latest version, check out the repo and call
```bash
> pip3 install -e .
> python3 klaytnetl.py
```
### Running in Docker
1. Install Docker https://docs.docker.com/install/
2. Build a docker image
```bash
> docker build -t klaytn-etl:latest .
> docker image ls
```
3. Run a container out of the image
```bash
> docker run -v $HOME/output:/klaytn-etl/output klaytn-etl:latest export_all -s 0 -e 5499999 -b 100000
> docker run -v $HOME/output:/klaytn-etl/output klaytn-etl:latest export_all -s 2018-01-01 -e 2018-01-01
```
Raw data
{
"_id": null,
"home_page": "https://github.com/klaytn/klaytn-etl",
"name": "klaytn-etl-cli",
"maintainer": null,
"docs_url": null,
"requires_python": "<4,>=3.7.2",
"maintainer_email": null,
"keywords": "klaytn, etl, batch",
"author": "Yongchan Hong",
"author_email": "chan.hong@krustuniverse.com",
"download_url": null,
"platform": null,
"description": "# Klaytn ETL\n\nKlaytn ETL lets you convert Klaytn blockchain data into convenient formats like JSONs, CSVs and relational databases.\nThis is a fork of [Ethereum ETL](https://github.com/blockchain-etl/ethereum-etl).\n\n[Full documentation available here](http://klaytn-etl.readthedocs.io/).\n\n***Notice: Klaytn ETL is still on the beta version. However, CLIs are all functional.***\n\n## Quickstart\nInstall Klaytn ETL:\n\n```bash\npip3 install klaytn-etl-cli\n```\n\nExport blocks and transactions\n\n```bash\n> klaytnetl export_blocks_and_transactions --start-block 0 --end-block 5000 \\\n--blocks-output blocks.json --transactions-output transactions.json\n```\n\nExport ERC20 and ERC721 transfers\n\n```bash\n> klaytnetl export_token_transfers --start-block 0 --end-block 5000 \\\n--output token_transfers.json\n```\n\nExport traces\n\n```bash\n> klaytnetl export_traces --start-block 0 --end-block 5000 \\\n--output traces.json\n```\n\nFind other commands [here](klaytnetl/cli/__init__.py).\n\nFor the latest version, check out the repo and call \n```bash\n> pip3 install -e . \n> python3 klaytnetl.py\n```\n\n### Running in Docker\n\n1. Install Docker https://docs.docker.com/install/\n\n2. Build a docker image\n ```bash\n > docker build -t klaytn-etl:latest .\n > docker image ls\n ```\n\n3. Run a container out of the image\n ```bash\n > docker run -v $HOME/output:/klaytn-etl/output klaytn-etl:latest export_all -s 0 -e 5499999 -b 100000\n > docker run -v $HOME/output:/klaytn-etl/output klaytn-etl:latest export_all -s 2018-01-01 -e 2018-01-01\n ```\n",
"bugtrack_url": null,
"license": null,
"summary": "Tools for exporting Klaytn blockchain data to JSON",
"version": "0.3.8",
"project_urls": {
"Bug Reports": "https://github.com/klaytn/klaytn-etl/issues",
"Homepage": "https://github.com/klaytn/klaytn-etl",
"Source": "https://github.com/klaytn/klaytn-etl/tree/klaytn-etl"
},
"split_keywords": [
"klaytn",
" etl",
" batch"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "bc1484b6748f6ac7fda9089619b7f438f1ef456ca50c43f952efde15546ebaca",
"md5": "f7cb0cf03759a1afe86d3add4b2f03a0",
"sha256": "5280a38df229581cb915be519eecc96574f4d30353827bfc380ca88d46e683d3"
},
"downloads": -1,
"filename": "klaytn_etl_cli-0.3.8-py3-none-any.whl",
"has_sig": false,
"md5_digest": "f7cb0cf03759a1afe86d3add4b2f03a0",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<4,>=3.7.2",
"size": 251244,
"upload_time": "2024-09-30T07:00:13",
"upload_time_iso_8601": "2024-09-30T07:00:13.456281Z",
"url": "https://files.pythonhosted.org/packages/bc/14/84b6748f6ac7fda9089619b7f438f1ef456ca50c43f952efde15546ebaca/klaytn_etl_cli-0.3.8-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-09-30 07:00:13",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "klaytn",
"github_project": "klaytn-etl",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"requirements": [
{
"name": "web3",
"specs": [
[
">=",
"5.29"
],
[
"<=",
"5.30"
]
]
},
{
"name": "eth-rlp",
"specs": [
[
"<",
"0.3"
]
]
},
{
"name": "eth-utils",
"specs": [
[
"==",
"1.10"
]
]
},
{
"name": "eth-abi",
"specs": [
[
"==",
"2.1.1"
]
]
},
{
"name": "python-dateutil",
"specs": [
[
"<",
"3"
],
[
">=",
"2.8.0"
]
]
},
{
"name": "click",
"specs": [
[
"==",
"8.0.4"
]
]
},
{
"name": "ethereum-dasm",
"specs": [
[
"==",
"0.1.4"
]
]
},
{
"name": "pytz",
"specs": [
[
"==",
"2022.1"
]
]
},
{
"name": "base58",
"specs": []
},
{
"name": "requests",
"specs": []
},
{
"name": "boto3",
"specs": []
},
{
"name": "google-cloud-storage",
"specs": []
},
{
"name": "mkdocs",
"specs": [
[
">=",
"1.3"
]
]
}
],
"lcname": "klaytn-etl-cli"
}