| Name | meltanolabs-tap-snowflake JSON |
| Version |
0.0.24
JSON |
| download |
| home_page | None |
| Summary | `tap-snowflake` is a Singer tap for Snowflake, built with the Meltano SDK for Singer Taps. |
| upload_time | 2024-03-19 23:06:03 |
| maintainer | None |
| docs_url | None |
| author | Meltano Team |
| requires_python | <3.12,>=3.7.1 |
| license | Apache 2.0 |
| keywords |
elt
snowflake
|
| VCS |
|
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# tap-snowflake
`tap-snowflake` is a Singer tap for Snowflake.
Built with the [Meltano Tap SDK](https://sdk.meltano.com) for Singer Taps.
## Installation
```bash
pipx install git+https://github.com/MeltanoLabs/tap-snowflake.git
```
## Configuration
### Accepted Config Options
A full list of supported settings and capabilities for this
tap is available by running:
```bash
tap-snowflake --about
```
### Configure using environment variables
This Singer tap will automatically import any environment variables within the working directory's
`.env` if the `--config=ENV` is provided, such that config values will be considered if a matching
environment variable is set either in the terminal context or in the `.env` file.
### Source Authentication and Authorization
Standard `username` and `password` auth is supported.
### Enabling Batch Messaging
This tap is built using the Meltano SDK and therefore supports a `BATCH` [message type](https://sdk.meltano.com/en/latest/batch.html), in
addition to the `RECORD` messages of the Singer spec. This can be enabled either by adding the following to your `config.json`:
```json
{
// ...
"batch_config": {
"encoding": {
"format": "jsonl",
"compression": "gzip"
},
"storage": {
"root": "file://tests/core/resources",
"prefix": "test-batch"
}
}
}
```
or its equivalent to your `meltano.yml`
```yaml
config:
plugins:
extractors:
- name: tap-snowflake
config:
batch_config:
encoding:
format: jsonl
compression: gzip
storage:
root: "file://tests/core/resources"
prefix: test-batch
```
**Note:** This variant of `tap-snowflake` does not yet support the `INCREMENTAL` replication strategy in `BATCH` mode. Follow [here](https://github.com/meltano/sdk/issues/976#issuecomment-1257848119) for updates.
## Usage
You can easily run `tap-snowflake` by itself or in a pipeline using [Meltano](https://meltano.com/).
### Executing the Tap Directly
```bash
tap-snowflake --version
tap-snowflake --help
tap-snowflake --config CONFIG --discover > ./catalog.json
```
## Developer Resources
### Initialize your Development Environment
```bash
pipx install poetry
poetry install
```
### Create and Run Tests
Create tests within the `tap_snowflake/tests` subfolder and
then run:
```bash
poetry run pytest
```
You can also test the `tap-snowflake` CLI interface directly using `poetry run`:
```bash
poetry run tap-snowflake --help
```
### Testing with [Meltano](https://www.meltano.com)
_**Note:** This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios._
Your project comes with a custom `meltano.yml` project file already created. Open the `meltano.yml` and follow any _"TODO"_ items listed in
the file.
Next, install Meltano (if you haven't already) and any needed plugins:
```bash
# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-snowflake
meltano install
```
Now you can test and orchestrate using Meltano:
```bash
# Test invocation:
meltano invoke tap-snowflake --version
# OR run a test `elt` pipeline:
meltano elt tap-snowflake target-jsonl
```
### SDK Dev Guide
See the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the SDK to
develop your own taps and targets.
Raw data
{
"_id": null,
"home_page": null,
"name": "meltanolabs-tap-snowflake",
"maintainer": null,
"docs_url": null,
"requires_python": "<3.12,>=3.7.1",
"maintainer_email": null,
"keywords": "ELT, Snowflake",
"author": "Meltano Team",
"author_email": "hello@meltano.com",
"download_url": "https://files.pythonhosted.org/packages/bb/6d/d294ee14d99c3f2fa12c88604d816e3c0fc43828675d5e649d5424e5b271/meltanolabs_tap_snowflake-0.0.24.tar.gz",
"platform": null,
"description": "# tap-snowflake\n\n`tap-snowflake` is a Singer tap for Snowflake.\n\nBuilt with the [Meltano Tap SDK](https://sdk.meltano.com) for Singer Taps.\n\n## Installation\n\n```bash\npipx install git+https://github.com/MeltanoLabs/tap-snowflake.git\n```\n\n## Configuration\n\n### Accepted Config Options\n\nA full list of supported settings and capabilities for this\ntap is available by running:\n\n```bash\ntap-snowflake --about\n```\n\n### Configure using environment variables\n\nThis Singer tap will automatically import any environment variables within the working directory's\n`.env` if the `--config=ENV` is provided, such that config values will be considered if a matching\nenvironment variable is set either in the terminal context or in the `.env` file.\n\n### Source Authentication and Authorization\n\nStandard `username` and `password` auth is supported.\n\n### Enabling Batch Messaging\n\nThis tap is built using the Meltano SDK and therefore supports a `BATCH` [message type](https://sdk.meltano.com/en/latest/batch.html), in\naddition to the `RECORD` messages of the Singer spec. This can be enabled either by adding the following to your `config.json`:\n\n```json\n{\n // ...\n \"batch_config\": {\n \"encoding\": {\n \"format\": \"jsonl\",\n \"compression\": \"gzip\"\n },\n \"storage\": {\n \"root\": \"file://tests/core/resources\",\n \"prefix\": \"test-batch\"\n }\n }\n}\n```\n\nor its equivalent to your `meltano.yml`\n\n```yaml\nconfig:\n plugins:\n extractors:\n - name: tap-snowflake\n config:\n batch_config:\n encoding:\n format: jsonl\n compression: gzip\n storage:\n root: \"file://tests/core/resources\"\n prefix: test-batch\n```\n\n**Note:** This variant of `tap-snowflake` does not yet support the `INCREMENTAL` replication strategy in `BATCH` mode. Follow [here](https://github.com/meltano/sdk/issues/976#issuecomment-1257848119) for updates.\n\n## Usage\n\nYou can easily run `tap-snowflake` by itself or in a pipeline using [Meltano](https://meltano.com/).\n\n### Executing the Tap Directly\n\n```bash\ntap-snowflake --version\ntap-snowflake --help\ntap-snowflake --config CONFIG --discover > ./catalog.json\n```\n\n## Developer Resources\n\n### Initialize your Development Environment\n\n```bash\npipx install poetry\npoetry install\n```\n\n### Create and Run Tests\n\nCreate tests within the `tap_snowflake/tests` subfolder and\nthen run:\n\n```bash\npoetry run pytest\n```\n\nYou can also test the `tap-snowflake` CLI interface directly using `poetry run`:\n\n```bash\npoetry run tap-snowflake --help\n```\n\n### Testing with [Meltano](https://www.meltano.com)\n\n_**Note:** This tap will work in any Singer environment and does not require Meltano.\nExamples here are for convenience and to streamline end-to-end orchestration scenarios._\n\nYour project comes with a custom `meltano.yml` project file already created. Open the `meltano.yml` and follow any _\"TODO\"_ items listed in\nthe file.\n\nNext, install Meltano (if you haven't already) and any needed plugins:\n\n```bash\n# Install meltano\npipx install meltano\n# Initialize meltano within this directory\ncd tap-snowflake\nmeltano install\n```\n\nNow you can test and orchestrate using Meltano:\n\n```bash\n# Test invocation:\nmeltano invoke tap-snowflake --version\n# OR run a test `elt` pipeline:\nmeltano elt tap-snowflake target-jsonl\n```\n\n### SDK Dev Guide\n\nSee the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the SDK to\ndevelop your own taps and targets.\n\n",
"bugtrack_url": null,
"license": "Apache 2.0",
"summary": "`tap-snowflake` is a Singer tap for Snowflake, built with the Meltano SDK for Singer Taps.",
"version": "0.0.24",
"project_urls": null,
"split_keywords": [
"elt",
" snowflake"
],
"urls": [
{
"comment_text": "",
"digests": {
"blake2b_256": "d9f444cfd1b2e39a3dc5751783753065c7d2159cbb3b3da37fa52e009d830f24",
"md5": "76e1f57093aa933075a574530c92e474",
"sha256": "089385f3dacd7b4a5e3ee2ec949e01cda820dc06b3f86f7a681ed3ca2f031262"
},
"downloads": -1,
"filename": "meltanolabs_tap_snowflake-0.0.24-py3-none-any.whl",
"has_sig": false,
"md5_digest": "76e1f57093aa933075a574530c92e474",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": "<3.12,>=3.7.1",
"size": 10975,
"upload_time": "2024-03-19T23:06:02",
"upload_time_iso_8601": "2024-03-19T23:06:02.269578Z",
"url": "https://files.pythonhosted.org/packages/d9/f4/44cfd1b2e39a3dc5751783753065c7d2159cbb3b3da37fa52e009d830f24/meltanolabs_tap_snowflake-0.0.24-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": "",
"digests": {
"blake2b_256": "bb6dd294ee14d99c3f2fa12c88604d816e3c0fc43828675d5e649d5424e5b271",
"md5": "1543d61aa03814c50e273e54e102d036",
"sha256": "a804db727b012deb2b9adccba62aecf8a55e67136816e63fa23b00597a04084f"
},
"downloads": -1,
"filename": "meltanolabs_tap_snowflake-0.0.24.tar.gz",
"has_sig": false,
"md5_digest": "1543d61aa03814c50e273e54e102d036",
"packagetype": "sdist",
"python_version": "source",
"requires_python": "<3.12,>=3.7.1",
"size": 10884,
"upload_time": "2024-03-19T23:06:03",
"upload_time_iso_8601": "2024-03-19T23:06:03.516135Z",
"url": "https://files.pythonhosted.org/packages/bb/6d/d294ee14d99c3f2fa12c88604d816e3c0fc43828675d5e649d5424e5b271/meltanolabs_tap_snowflake-0.0.24.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2024-03-19 23:06:03",
"github": false,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"lcname": "meltanolabs-tap-snowflake"
}
