Name | tap-ex1 JSON |
Version |
0.0.1
JSON |
| download |
home_page | None |
Summary | `tap-ex1` is a Singer tap for Ex1, built with the Meltano Singer SDK. |
upload_time | 2024-06-20 15:23:35 |
maintainer | None |
docs_url | None |
author | Sajjad Goudarzi |
requires_python | >=3.8 |
license | Apache-2.0 |
keywords |
elt
ex1
|
VCS |
|
bugtrack_url |
|
requirements |
No requirements were recorded.
|
Travis-CI |
No Travis.
|
coveralls test coverage |
No coveralls.
|
# dummyjson tap-ex1
`tap-ex1` is a Singer tap for dummyjson.com (It is a exercise :)
Built with the [Meltano Tap SDK](https://sdk.meltano.com) for Singer Taps.
<!--
Developer TODO: Update the below as needed to correctly describe the install procedure. For instance, if you do not have a PyPi repo, or if you want users to directly install from your git repo, you can modify this step as appropriate.
## Installation
Install from PyPi:
```bash
pipx install tap-ex1
```
Install from GitHub:
```bash
pipx install git+https://github.com/ORG_NAME/tap-ex1.git@main
```
-->
## Configuration
### Accepted Config Options
<!--
Developer TODO: Provide a list of config options accepted by the tap.
This section can be created by copy-pasting the CLI output from:
```
tap-ex1 --about --format=markdown
```
-->
A full list of supported settings and capabilities for this
tap is available by running:
```bash
tap-ex1 --about
```
### Configure using environment variables
This Singer tap will automatically import any environment variables within the working directory's
`.env` if the `--config=ENV` is provided, such that config values will be considered if a matching
environment variable is set either in the terminal context or in the `.env` file.
### Source Authentication and Authorization
<!--
Developer TODO: If your tap requires special access on the source system, or any special authentication requirements, provide those here.
-->
## Usage
You can easily run `tap-ex1` by itself or in a pipeline using [Meltano](https://meltano.com/).
### Executing the Tap Directly
```bash
tap-ex1 --version
tap-ex1 --help
tap-ex1 --config CONFIG --discover > ./catalog.json
```
## Developer Resources
Follow these instructions to contribute to this project.
### Initialize your Development Environment
```bash
pipx install poetry
poetry install
```
### Create and Run Tests
Create tests within the `tests` subfolder and
then run:
```bash
poetry run pytest
```
You can also test the `tap-ex1` CLI interface directly using `poetry run`:
```bash
poetry run tap-ex1 --help
```
### Testing with [Meltano](https://www.meltano.com)
_**Note:** This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios._
<!--
Developer TODO:
Your project comes with a custom `meltano.yml` project file already created. Open the `meltano.yml` and follow any "TODO" items listed in
the file.
-->
Next, install Meltano (if you haven't already) and any needed plugins:
```bash
# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-ex1
meltano install
```
Now you can test and orchestrate using Meltano:
```bash
# Test invocation:
meltano invoke tap-ex1 --version
# OR run a test `elt` pipeline:
meltano elt tap-ex1 target-jsonl
```
### SDK Dev Guide
See the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the SDK to
develop your own taps and targets.
###
docker build -t ex1-tap-img -f Dockerfile.meltano .
docker run --volume $(pwd)/output:/app/output ex1-tap-img
docker run --volume $(pwd)/output:/app/output ex1-tap-img run tap-ex1 target-csv
docker build -t ex1-fastapi-img -f Dockerfile.fastapi .
docker run -p 8001:8000 ex1-fastapi-img
docker run -p 8001:8000 ex1-fastapi-img uvicorn run_api:app --host 0.0.0.0 --port 8000
docker run astro_067921/airflow:latest ls
docker run --volume $(pwd)/output:/app/output sajjadgoudarzi/vicev-ex1-meltano:latest
Raw data
{
"_id": null,
"home_page": null,
"name": "tap-ex1",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.8",
"maintainer_email": null,
"keywords": "ELT, Ex1",
"author": "Sajjad Goudarzi",
"author_email": "firstname.lastname@example.com",
"download_url": "https://files.pythonhosted.org/packages/cf/3a/5739ecbad72b8d8904cb781253ceae0864372191f42cb26c0f6f2676a971/tap_ex1-0.0.1.tar.gz",
"platform": null,
"description": "# dummyjson tap-ex1 \n\n`tap-ex1` is a Singer tap for dummyjson.com (It is a exercise :)\n\nBuilt with the [Meltano Tap SDK](https://sdk.meltano.com) for Singer Taps.\n\n<!--\n\nDeveloper TODO: Update the below as needed to correctly describe the install procedure. For instance, if you do not have a PyPi repo, or if you want users to directly install from your git repo, you can modify this step as appropriate.\n\n## Installation\n\nInstall from PyPi:\n\n```bash\npipx install tap-ex1\n```\n\nInstall from GitHub:\n\n```bash\npipx install git+https://github.com/ORG_NAME/tap-ex1.git@main\n```\n\n-->\n\n## Configuration\n\n### Accepted Config Options\n\n<!--\nDeveloper TODO: Provide a list of config options accepted by the tap.\n\nThis section can be created by copy-pasting the CLI output from:\n\n```\ntap-ex1 --about --format=markdown\n```\n-->\n\nA full list of supported settings and capabilities for this\ntap is available by running:\n\n```bash\ntap-ex1 --about\n```\n\n### Configure using environment variables\n\nThis Singer tap will automatically import any environment variables within the working directory's\n`.env` if the `--config=ENV` is provided, such that config values will be considered if a matching\nenvironment variable is set either in the terminal context or in the `.env` file.\n\n### Source Authentication and Authorization\n\n<!--\nDeveloper TODO: If your tap requires special access on the source system, or any special authentication requirements, provide those here.\n-->\n\n## Usage\n\nYou can easily run `tap-ex1` by itself or in a pipeline using [Meltano](https://meltano.com/).\n\n### Executing the Tap Directly\n\n```bash\ntap-ex1 --version\ntap-ex1 --help\ntap-ex1 --config CONFIG --discover > ./catalog.json\n```\n\n## Developer Resources\n\nFollow these instructions to contribute to this project.\n\n### Initialize your Development Environment\n\n```bash\npipx install poetry\npoetry install\n```\n\n### Create and Run Tests\n\nCreate tests within the `tests` subfolder and\n then run:\n\n```bash\npoetry run pytest\n```\n\nYou can also test the `tap-ex1` CLI interface directly using `poetry run`:\n\n```bash\npoetry run tap-ex1 --help\n```\n\n### Testing with [Meltano](https://www.meltano.com)\n\n_**Note:** This tap will work in any Singer environment and does not require Meltano.\nExamples here are for convenience and to streamline end-to-end orchestration scenarios._\n\n<!--\nDeveloper TODO:\nYour project comes with a custom `meltano.yml` project file already created. Open the `meltano.yml` and follow any \"TODO\" items listed in\nthe file.\n-->\n\nNext, install Meltano (if you haven't already) and any needed plugins:\n\n```bash\n# Install meltano\npipx install meltano\n# Initialize meltano within this directory\ncd tap-ex1\nmeltano install\n```\n\nNow you can test and orchestrate using Meltano:\n\n```bash\n# Test invocation:\nmeltano invoke tap-ex1 --version\n# OR run a test `elt` pipeline:\nmeltano elt tap-ex1 target-jsonl\n```\n\n### SDK Dev Guide\n\nSee the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the SDK to\ndevelop your own taps and targets.\n\n###\n\ndocker build -t ex1-tap-img -f Dockerfile.meltano .\ndocker run --volume $(pwd)/output:/app/output ex1-tap-img\ndocker run --volume $(pwd)/output:/app/output ex1-tap-img run tap-ex1 target-csv\n\n\ndocker build -t ex1-fastapi-img -f Dockerfile.fastapi .\ndocker run -p 8001:8000 ex1-fastapi-img\ndocker run -p 8001:8000 ex1-fastapi-img uvicorn run_api:app --host 0.0.0.0 --port 8000\n\n\ndocker run astro_067921/airflow:latest ls\n\ndocker run --volume $(pwd)/output:/app/output sajjadgoudarzi/vicev-ex1-meltano:latest",
"bugtrack_url": null,
"license": "Apache-2.0",
"summary": "`tap-ex1` is a Singer tap for Ex1, built with the Meltano Singer SDK.",
"version": "0.0.1",
"project_urls": null,
"split_keywords": [
"elt",
" ex1"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "877d7cb2cba6873e52e82e8081db557d928b4a0ba900a47111318367df2fdb3a",
"md5": "5cd1f851573bafe96c5e7e7712df22e1",
"sha256": "4ef096b905b7c5ddb7e37ce2e6be6cc6602d4d3b21babd611a840ea1dea17635"
},
"downloads": -1,
"filename": "tap_ex1-0.0.1-py3-none-any.whl",
"has_sig": false,
"md5_digest": "5cd1f851573bafe96c5e7e7712df22e1",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.8",
"size": 11366,
"upload_time": "2024-06-20T15:23:33",
"upload_time_iso_8601": "2024-06-20T15:23:33.482144Z",
"url": "https://files.pythonhosted.org/packages/87/7d/7cb2cba6873e52e82e8081db557d928b4a0ba900a47111318367df2fdb3a/tap_ex1-0.0.1-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "cf3a5739ecbad72b8d8904cb781253ceae0864372191f42cb26c0f6f2676a971",
"md5": "c2ba3b5151f71c341c70a86cb7d70cfd",
"sha256": "9032795e9928bd7ed8b484a1459f68bf8c355ef313c4365348e797e85e984de0"
},
"downloads": -1,
"filename": "tap_ex1-0.0.1.tar.gz",
"has_sig": false,
"md5_digest": "c2ba3b5151f71c341c70a86cb7d70cfd",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.8",
"size": 9905,
"upload_time": "2024-06-20T15:23:35",
"upload_time_iso_8601": "2024-06-20T15:23:35.479009Z",
"url": "https://files.pythonhosted.org/packages/cf/3a/5739ecbad72b8d8904cb781253ceae0864372191f42cb26c0f6f2676a971/tap_ex1-0.0.1.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-06-20 15:23:35",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "tap-ex1"
}