| Name | tap-stackexchange JSON |
| Version |
0.0.10
JSON |
| download |
| home_page | None |
| Summary | Singer tap for StackExchange, built with the Meltano SDK for Singer Taps. |
| upload_time | 2025-10-22 00:51:07 |
| maintainer | None |
| docs_url | None |
| author | None |
| requires_python | >=3.10 |
| license | None |
| keywords |
elt
stackexchange
meltano
singer-io
|
| VCS |
 |
| bugtrack_url |
|
| requirements |
No requirements were recorded.
|
| Travis-CI |
No Travis.
|
| coveralls test coverage |
No coveralls.
|
# `tap-stackexchange`
[](https://github.com/MeltanoLabs/tap-stackexchange/actions/workflows/test.yml)
Singer tap for the StackExchange API.
Built with the [Meltano SDK](https://sdk.meltano.com) for Singer Taps and Targets.
## Capabilities
* `sync`
* `catalog`
* `state`
* `discover`
## Settings
| Setting | Required | Default | Description |
|:----------|:--------:|:-------:|:------------|
| key | False | None | Pass this to receive a higher request quota |
| site | False | stackoverflow.com | StackExchange site |
| tags | False | None | Question tags |
| start_date| False | None | The earliest record date to sync |
A full list of supported settings and capabilities is available by running: `tap-stackexchange --about`
## Custom filter
The StackExchange API supports a number of [custom filters](https://api.stackexchange.com/docs/filters) that can be used to
include or exclude certain fields from the response objects. This application has a baked-in filter with the following
parameters:
- `include`
| Parameter | Description |
|:-------------------------|:-----------------------------------------|
| `question.comment_count` | The number of comments on the question |
| `tag.last_activity_date` | The date of the last activity on the tag |
- `unsafe=false`
### Update the baked-in filter
To update the baked-in filter, edit the `FILTER_ID` constant in `tap_stackexchange/tap.py`.
To generate a new filter, use the _Try It_ button on the [StackExchange API documentation](https://api.stackexchange.com/docs/create-filter), using the baked-in filter as the `base` parameter.
### Use a custom filter
To use a custom filter, set the `filter` setting to the filter ID. Note that if you use a custom filter, you will need to
use a custom catalog that includes the fields you want to sync. That is you will need to
1. Write the default catalog to a file: `tap-stackexchange --discover > catalog.json`
2. Edit the catalog file to include the fields not included by the default API filter
3. Run the tap with the custom catalog: `tap-stackexchange --config config.json --catalog catalog.json`
## Installation
```bash
pipx install git+https://github.com/edgarrmondragon/tap-stackexchange.git
```
### Source Authentication and Authorization
Register a [new application on Stack Apps](https://stackapps.com/apps/oauth/register) and copy the generated `key`.
## Usage
You can easily run `tap-stackexchange` by itself or in a pipeline using [Meltano](https://meltano.com/).
### Executing the Tap Directly
```bash
tap-stackexchange --version
tap-stackexchange --help
tap-stackexchange --config CONFIG --discover > ./catalog.json
```
### Initialize your Development Environment
```bash
pipx install poetry
poetry install
```
<!--
### Create and Run Tests
Create tests within the `tap_stackexchange/tests` subfolder and
then run:
```bash
poetry run pytest
```
You can also test the `tap-stackexchange` CLI interface directly using `poetry run`:
```bash
poetry run tap-stackexchange --help
```
-->
### Testing with [Meltano](https://www.meltano.com)
_**Note:** This tap will work in any Singer environment and does not require Meltano.
Examples here are for convenience and to streamline end-to-end orchestration scenarios._
Your project comes with a custom `meltano.yml` project file already created. Open the `meltano.yml` and follow any _"TODO"_ items listed in
the file.
Next, install Meltano (if you haven't already) and any needed plugins:
```bash
# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-stackexchange
meltano install
```
Now you can test and orchestrate using Meltano:
```bash
# Test invocation:
meltano invoke tap-stackexchange --version
# OR run a test `elt` pipeline:
meltano elt tap-stackexchange target-sqlite --job_id=stackexchange-sqlite
# Runtime configuration
TAP_STACKEXCHANGE__LOAD_SCHEMA=dragon_ball_gt \
TAP_STACKEXCHANGE_SITE=anime \
TAP_STACKEXCHANGE_TAGS='["dragon-ball-gt"]' \
meltano elt tap-stackexchange target-sqlite
```
### SDK Dev Guide
See the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the SDK to
develop your own taps and targets.
Raw data
{
"_id": null,
"home_page": null,
"name": "tap-stackexchange",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.10",
"maintainer_email": null,
"keywords": "ELT, StackExchange, meltano, singer-io",
"author": null,
"author_email": "Edgar Ram\u00edrez-Mondrag\u00f3n <edgarrm358@gmail.com>",
"download_url": "https://files.pythonhosted.org/packages/38/e9/e8b055af7a8bb9ff93a2e5d5fb8100860e1938965d11509c511e69d74309/tap_stackexchange-0.0.10.tar.gz",
"platform": null,
"description": "# `tap-stackexchange`\n\n[](https://github.com/MeltanoLabs/tap-stackexchange/actions/workflows/test.yml)\n\nSinger tap for the StackExchange API.\n\nBuilt with the [Meltano SDK](https://sdk.meltano.com) for Singer Taps and Targets.\n\n## Capabilities\n\n* `sync`\n* `catalog`\n* `state`\n* `discover`\n\n## Settings\n\n| Setting | Required | Default | Description |\n|:----------|:--------:|:-------:|:------------|\n| key | False | None | Pass this to receive a higher request quota |\n| site | False | stackoverflow.com | StackExchange site |\n| tags | False | None | Question tags |\n| start_date| False | None | The earliest record date to sync |\n\nA full list of supported settings and capabilities is available by running: `tap-stackexchange --about`\n\n## Custom filter\n\nThe StackExchange API supports a number of [custom filters](https://api.stackexchange.com/docs/filters) that can be used to\ninclude or exclude certain fields from the response objects. This application has a baked-in filter with the following\nparameters:\n\n- `include`\n\n | Parameter | Description |\n |:-------------------------|:-----------------------------------------|\n | `question.comment_count` | The number of comments on the question |\n | `tag.last_activity_date` | The date of the last activity on the tag |\n\n- `unsafe=false`\n\n### Update the baked-in filter\n\nTo update the baked-in filter, edit the `FILTER_ID` constant in `tap_stackexchange/tap.py`.\n\nTo generate a new filter, use the _Try It_ button on the [StackExchange API documentation](https://api.stackexchange.com/docs/create-filter), using the baked-in filter as the `base` parameter.\n\n### Use a custom filter\n\nTo use a custom filter, set the `filter` setting to the filter ID. Note that if you use a custom filter, you will need to\nuse a custom catalog that includes the fields you want to sync. That is you will need to\n\n1. Write the default catalog to a file: `tap-stackexchange --discover > catalog.json`\n2. Edit the catalog file to include the fields not included by the default API filter\n3. Run the tap with the custom catalog: `tap-stackexchange --config config.json --catalog catalog.json`\n\n## Installation\n\n```bash\npipx install git+https://github.com/edgarrmondragon/tap-stackexchange.git\n```\n\n### Source Authentication and Authorization\n\nRegister a [new application on Stack Apps](https://stackapps.com/apps/oauth/register) and copy the generated `key`.\n\n## Usage\n\nYou can easily run `tap-stackexchange` by itself or in a pipeline using [Meltano](https://meltano.com/).\n\n### Executing the Tap Directly\n\n```bash\ntap-stackexchange --version\ntap-stackexchange --help\ntap-stackexchange --config CONFIG --discover > ./catalog.json\n```\n\n### Initialize your Development Environment\n\n```bash\npipx install poetry\npoetry install\n```\n\n<!--\n### Create and Run Tests\n\nCreate tests within the `tap_stackexchange/tests` subfolder and\n then run:\n\n```bash\npoetry run pytest\n```\n\nYou can also test the `tap-stackexchange` CLI interface directly using `poetry run`:\n\n```bash\npoetry run tap-stackexchange --help\n```\n-->\n\n### Testing with [Meltano](https://www.meltano.com)\n\n_**Note:** This tap will work in any Singer environment and does not require Meltano.\nExamples here are for convenience and to streamline end-to-end orchestration scenarios._\n\nYour project comes with a custom `meltano.yml` project file already created. Open the `meltano.yml` and follow any _\"TODO\"_ items listed in\nthe file.\n\nNext, install Meltano (if you haven't already) and any needed plugins:\n\n```bash\n# Install meltano\npipx install meltano\n# Initialize meltano within this directory\ncd tap-stackexchange\nmeltano install\n```\n\nNow you can test and orchestrate using Meltano:\n\n```bash\n# Test invocation:\nmeltano invoke tap-stackexchange --version\n\n# OR run a test `elt` pipeline:\nmeltano elt tap-stackexchange target-sqlite --job_id=stackexchange-sqlite\n\n# Runtime configuration\nTAP_STACKEXCHANGE__LOAD_SCHEMA=dragon_ball_gt \\\nTAP_STACKEXCHANGE_SITE=anime \\\nTAP_STACKEXCHANGE_TAGS='[\"dragon-ball-gt\"]' \\\nmeltano elt tap-stackexchange target-sqlite\n```\n\n### SDK Dev Guide\n\nSee the [dev guide](https://sdk.meltano.com/en/latest/dev_guide.html) for more instructions on how to use the SDK to\ndevelop your own taps and targets.\n",
"bugtrack_url": null,
"license": null,
"summary": "Singer tap for StackExchange, built with the Meltano SDK for Singer Taps.",
"version": "0.0.10",
"project_urls": {
"Documentation": "https://github.com/MeltanoLabs/tap-stackexchange/blob/main/README.md",
"Homepage": "https://github.com/MeltanoLabs/tap-stackexchange",
"Repository": "https://github.com/MeltanoLabs/tap-stackexchange"
},
"split_keywords": [
"elt",
" stackexchange",
" meltano",
" singer-io"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "3194f680b763a465bb36149bfdf9004c8278c05758c02950fbcaa1f17859d04b",
"md5": "a565e9cac6dc338c2a9c8ebf18962a62",
"sha256": "f6758233e12d8705eda3e58c17653c868aa998bbaf8280aebb2698fea7fd1e5e"
},
"downloads": -1,
"filename": "tap_stackexchange-0.0.10-py3-none-any.whl",
"has_sig": false,
"md5_digest": "a565e9cac6dc338c2a9c8ebf18962a62",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.10",
"size": 12667,
"upload_time": "2025-10-22T00:51:05",
"upload_time_iso_8601": "2025-10-22T00:51:05.662271Z",
"url": "https://files.pythonhosted.org/packages/31/94/f680b763a465bb36149bfdf9004c8278c05758c02950fbcaa1f17859d04b/tap_stackexchange-0.0.10-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "38e9e8b055af7a8bb9ff93a2e5d5fb8100860e1938965d11509c511e69d74309",
"md5": "1c5da106ccbe998735dfbc3055a7e184",
"sha256": "61118074d77471820b5cb6b5be507cff36b528e27a11b73cb75be101bb5e536b"
},
"downloads": -1,
"filename": "tap_stackexchange-0.0.10.tar.gz",
"has_sig": false,
"md5_digest": "1c5da106ccbe998735dfbc3055a7e184",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.10",
"size": 85514,
"upload_time": "2025-10-22T00:51:07",
"upload_time_iso_8601": "2025-10-22T00:51:07.290621Z",
"url": "https://files.pythonhosted.org/packages/38/e9/e8b055af7a8bb9ff93a2e5d5fb8100860e1938965d11509c511e69d74309/tap_stackexchange-0.0.10.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-10-22 00:51:07",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "MeltanoLabs",
"github_project": "tap-stackexchange",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"tox": true,
"lcname": "tap-stackexchange"
}
