tap-ex1


Nametap-ex1 JSON
Version 0.0.1 PyPI version JSON
download
home_pageNone
Summary`tap-ex1` is a Singer tap for Ex1, built with the Meltano Singer SDK.
upload_time2024-06-20 15:23:35
maintainerNone
docs_urlNone
authorSajjad Goudarzi
requires_python>=3.8
licenseApache-2.0
keywords elt ex1
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # dummyjson tap-ex1 

`tap-ex1` is a Singer tap for dummyjson.com (It is a exercise :)

Built with the [Meltano Tap SDK](https://sdk.meltano.com) for Singer Taps.

<!--

Developer TODO: Update the below as needed to correctly describe the install procedure. For instance, if you do not have a PyPi repo, or if you want users to directly install from your git repo, you can modify this step as appropriate.

## Installation

Install from PyPi:

```bash
pipx install tap-ex1
```

Install from GitHub:

```bash
pipx install git+https://github.com/ORG_NAME/tap-ex1.git@main
```

-->

## Configuration

### Accepted Config Options

<!--
Developer TODO: Provide a list of config options accepted by the tap.

This section can be created by copy-pasting the CLI output from:

```
tap-ex1 --about --format=markdown
```
-->

A full list of supported settings and capabilities for this
tap is available by running:

```bash
tap-ex1 --about
```

### Configure using environment variables

This Singer tap will automatically import any environment variables within the working directory's
`.env` if the `--config=ENV` is provided, such that config values will be considered if a matching
environment variable is set either in the terminal context or in the `.env` file.

### Source Authentication and Authorization

<!--
Developer TODO: If your tap requires special access on the source system, or any special authentication requirements, provide those here.
-->

## Usage

You can easily run `tap-ex1` by itself or in a pipeline using [Meltano](https://meltano.com/).

### Executing the Tap Directly

```bash
tap-ex1 --version
tap-ex1 --help
tap-ex1 --config CONFIG --discover > ./catalog.json
```

## Developer Resources

Follow these instructions to contribute to this project.

### Initialize your Development Environment

```bash
pipx install poetry
poetry install
```

### Create and Run Tests

Create tests within the `tests` subfolder and
  then run:

```bash
poetry run pytest
```

You can also test the `tap-ex1` CLI interface directly using `poetry run`:

```bash
poetry run tap-ex1 --help
```

### Testing with [Meltano](https://www.meltano.com)

_**Note:** This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios._

<!--
Developer TODO:
Your project comes with a custom `meltano.yml` project file already created. Open the `meltano.yml` and follow any "TODO" items listed in
the file.
-->

Next, install Meltano (if you haven't already) and any needed plugins:

```bash
# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-ex1
meltano install
```

Now you can test and orchestrate using Meltano:

```bash
# Test invocation:
meltano invoke tap-ex1 --version
# OR run a test `elt` pipeline:
meltano elt tap-ex1 target-jsonl
```

### SDK Dev Guide

See the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the SDK to
develop your own taps and targets.

###

docker build -t ex1-tap-img -f Dockerfile.meltano .
docker run --volume $(pwd)/output:/app/output ex1-tap-img
docker run --volume $(pwd)/output:/app/output ex1-tap-img run tap-ex1 target-csv


docker build -t ex1-fastapi-img -f Dockerfile.fastapi .
docker run -p 8001:8000 ex1-fastapi-img
docker run -p 8001:8000 ex1-fastapi-img uvicorn run_api:app --host 0.0.0.0 --port 8000


docker run astro_067921/airflow:latest ls

docker run --volume $(pwd)/output:/app/output sajjadgoudarzi/vicev-ex1-meltano:latest
            

Raw data

            {
    "_id": null,
    "home_page": null,
    "name": "tap-ex1",
    "maintainer": null,
    "docs_url": null,
    "requires_python": ">=3.8",
    "maintainer_email": null,
    "keywords": "ELT, Ex1",
    "author": "Sajjad Goudarzi",
    "author_email": "firstname.lastname@example.com",
    "download_url": "https://files.pythonhosted.org/packages/cf/3a/5739ecbad72b8d8904cb781253ceae0864372191f42cb26c0f6f2676a971/tap_ex1-0.0.1.tar.gz",
    "platform": null,
    "description": "# dummyjson tap-ex1 \n\n`tap-ex1` is a Singer tap for dummyjson.com (It is a exercise :)\n\nBuilt with the [Meltano Tap SDK](https://sdk.meltano.com) for Singer Taps.\n\n<!--\n\nDeveloper TODO: Update the below as needed to correctly describe the install procedure. For instance, if you do not have a PyPi repo, or if you want users to directly install from your git repo, you can modify this step as appropriate.\n\n## Installation\n\nInstall from PyPi:\n\n```bash\npipx install tap-ex1\n```\n\nInstall from GitHub:\n\n```bash\npipx install git+https://github.com/ORG_NAME/tap-ex1.git@main\n```\n\n-->\n\n## Configuration\n\n### Accepted Config Options\n\n<!--\nDeveloper TODO: Provide a list of config options accepted by the tap.\n\nThis section can be created by copy-pasting the CLI output from:\n\n```\ntap-ex1 --about --format=markdown\n```\n-->\n\nA full list of supported settings and capabilities for this\ntap is available by running:\n\n```bash\ntap-ex1 --about\n```\n\n### Configure using environment variables\n\nThis Singer tap will automatically import any environment variables within the working directory's\n`.env` if the `--config=ENV` is provided, such that config values will be considered if a matching\nenvironment variable is set either in the terminal context or in the `.env` file.\n\n### Source Authentication and Authorization\n\n<!--\nDeveloper TODO: If your tap requires special access on the source system, or any special authentication requirements, provide those here.\n-->\n\n## Usage\n\nYou can easily run `tap-ex1` by itself or in a pipeline using [Meltano](https://meltano.com/).\n\n### Executing the Tap Directly\n\n```bash\ntap-ex1 --version\ntap-ex1 --help\ntap-ex1 --config CONFIG --discover > ./catalog.json\n```\n\n## Developer Resources\n\nFollow these instructions to contribute to this project.\n\n### Initialize your Development Environment\n\n```bash\npipx install poetry\npoetry install\n```\n\n### Create and Run Tests\n\nCreate tests within the `tests` subfolder and\n  then run:\n\n```bash\npoetry run pytest\n```\n\nYou can also test the `tap-ex1` CLI interface directly using `poetry run`:\n\n```bash\npoetry run tap-ex1 --help\n```\n\n### Testing with [Meltano](https://www.meltano.com)\n\n_**Note:** This tap will work in any Singer environment and does not require Meltano.\nExamples here are for convenience and to streamline end-to-end orchestration scenarios._\n\n<!--\nDeveloper TODO:\nYour project comes with a custom `meltano.yml` project file already created. Open the `meltano.yml` and follow any \"TODO\" items listed in\nthe file.\n-->\n\nNext, install Meltano (if you haven't already) and any needed plugins:\n\n```bash\n# Install meltano\npipx install meltano\n# Initialize meltano within this directory\ncd tap-ex1\nmeltano install\n```\n\nNow you can test and orchestrate using Meltano:\n\n```bash\n# Test invocation:\nmeltano invoke tap-ex1 --version\n# OR run a test `elt` pipeline:\nmeltano elt tap-ex1 target-jsonl\n```\n\n### SDK Dev Guide\n\nSee the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the SDK to\ndevelop your own taps and targets.\n\n###\n\ndocker build -t ex1-tap-img -f Dockerfile.meltano .\ndocker run --volume $(pwd)/output:/app/output ex1-tap-img\ndocker run --volume $(pwd)/output:/app/output ex1-tap-img run tap-ex1 target-csv\n\n\ndocker build -t ex1-fastapi-img -f Dockerfile.fastapi .\ndocker run -p 8001:8000 ex1-fastapi-img\ndocker run -p 8001:8000 ex1-fastapi-img uvicorn run_api:app --host 0.0.0.0 --port 8000\n\n\ndocker run astro_067921/airflow:latest ls\n\ndocker run --volume $(pwd)/output:/app/output sajjadgoudarzi/vicev-ex1-meltano:latest",
    "bugtrack_url": null,
    "license": "Apache-2.0",
    "summary": "`tap-ex1` is a Singer tap for Ex1, built with the Meltano Singer SDK.",
    "version": "0.0.1",
    "project_urls": null,
    "split_keywords": [
        "elt",
        " ex1"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "877d7cb2cba6873e52e82e8081db557d928b4a0ba900a47111318367df2fdb3a",
                "md5": "5cd1f851573bafe96c5e7e7712df22e1",
                "sha256": "4ef096b905b7c5ddb7e37ce2e6be6cc6602d4d3b21babd611a840ea1dea17635"
            },
            "downloads": -1,
            "filename": "tap_ex1-0.0.1-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "5cd1f851573bafe96c5e7e7712df22e1",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.8",
            "size": 11366,
            "upload_time": "2024-06-20T15:23:33",
            "upload_time_iso_8601": "2024-06-20T15:23:33.482144Z",
            "url": "https://files.pythonhosted.org/packages/87/7d/7cb2cba6873e52e82e8081db557d928b4a0ba900a47111318367df2fdb3a/tap_ex1-0.0.1-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "cf3a5739ecbad72b8d8904cb781253ceae0864372191f42cb26c0f6f2676a971",
                "md5": "c2ba3b5151f71c341c70a86cb7d70cfd",
                "sha256": "9032795e9928bd7ed8b484a1459f68bf8c355ef313c4365348e797e85e984de0"
            },
            "downloads": -1,
            "filename": "tap_ex1-0.0.1.tar.gz",
            "has_sig": false,
            "md5_digest": "c2ba3b5151f71c341c70a86cb7d70cfd",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.8",
            "size": 9905,
            "upload_time": "2024-06-20T15:23:35",
            "upload_time_iso_8601": "2024-06-20T15:23:35.479009Z",
            "url": "https://files.pythonhosted.org/packages/cf/3a/5739ecbad72b8d8904cb781253ceae0864372191f42cb26c0f6f2676a971/tap_ex1-0.0.1.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-06-20 15:23:35",
    "github": false,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "lcname": "tap-ex1"
}
        
Elapsed time: 0.29623s