tap-clickup


Nametap-clickup JSON
Version 0.0.21 PyPI version JSON
download
home_pagehttps://autoidm.com
Summarytap-clickup is a Singer tap for ClickUp by AutoIDM
upload_time2023-07-17 20:33:38
maintainerAutoIDM
docs_urlNone
authorAutoIDM
requires_python>=3.7.1,<3.12
license
keywords autoidm auto idm tap-clickup clickup tap singer sdk
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # `tap-clickup` 
[![PyPI Version](https://img.shields.io/pypi/v/tap-clickup?color=blue)](https://pypi.org/project/tap-clickup)
[![Python Versions](https://img.shields.io/pypi/pyversions/tap-clickup)](https://pypi.org/project/tap-clickup)
[![PyPI download month](https://img.shields.io/pypi/dm/tap-clickup.svg?color=blue)](https://pypi.python.org/pypi/tap-clickup/)
[![Build and Tests](https://github.com/AutoIDM/tap-clickup/actions/workflows/ci.yml/badge.svg?branch=main&color=blue)](https://github.com/AutoIDM/tap-clickup/actions)

`tap-clickup` is a Singer tap for ClickUp.
Tap was created by [AutoIDM](https://autoidm.com) only because multiple community members came together to get this tap created. Check AutoIDM out for tap/target creation, maintenace, support, and more!

<a href="https://autoidm.com"><img alt="AutoIDM" src="./images/autoidm.png" width="250"></a>

# Sponsors
This tap is only available due to the amazing folks who pitched together to make this happen.

<a href="https://www.trek10.com"><img alt="trek10" src="./images/trek10.png" width="250"></a>

Note that some sponsors may not be listed here. 

Want to become a sponsor? Reach out to us at [autoidm.com](https://autoidm.com)


## Capabilities

* `catalog`
* `state`
* `discover`
* `about`
* `stream-maps`
* `schema-flattening`

## Settings

| Setting             | Required | Default | Description |
|:--------------------|:--------:|:-------:|:------------|
| api_token           | True     | None    | Example: 'pk_12345 |
| stream_maps         | False    | None    | Config object for stream maps capability. |
| stream_map_config   | False    | None    | User-defined config values to be used within map expressions. |
| flattening_enabled  | False    | None    | 'True' to enable schema flattening and automatically expand nested properties. |
| flattening_max_depth| False    | None    | The max depth to flatten schemas. |

A full list of supported settings and capabilities is available by running: `tap-clickup --about`

### Getting an API Token

1. Login at https://app.clickup.com/
1. Click your icon at the bottom left of the screen
1. Click My Settings
1. Click Apps (Bottom leftish of screen under the My Apps sub section)
1. At the top of the screen is an API Token. This can be used in the api_token location. 
    * This is a personal token, it's fine to use a personal token as this tap is only for the business that's using the data. 

## Clickup Table Schemas
Note that the most up to date information is located in tap_clickup/streams.py. We will try to keep these docs updated

### Teams
- Table name: team
- Description: Teams Data, each user can be in multiple teams
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Teams](https://jsapi.apiary.io/apis/clickup20/reference/0/teams/get-teams.html)

### Spaces
- Table name: space
- Description: Each team has multiple spaces
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Spaces](https://jsapi.apiary.io/apis/clickup20/reference/0/spaces.html)

### Time Entries
- Table name: time_entries
- Description: All time entries are pulled for every team. Currently only pulls the last 30 days of time_entries see https://github.com/AutoIDM/tap-clickup/issues/134 for an issue addressing this!
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Time Entries](https://jsapi.apiary.io/apis/clickup20/reference/0/time-tracking-legacy/get-time-entries-within-a-date-range.html)

### Folders
- Table name: folder
- Description: Each space can have multiple folders
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Folders](https://jsapi.apiary.io/apis/clickup20/reference/0/folders.html)

### Folder Lists
- Table name: folder_list
- Description: Each Folder can have multiple lists
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation:[Folder Lists](https://jsapi.apiary.io/apis/clickup20/reference/0/lists/get-lists.html)


### Folderless Lists
- Table name: folderless_list
- Description: Some lists do not exist in a folder
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Folderless Lists](https://jsapi.apiary.io/apis/clickup20/reference/0/lists/get-folderless-lists.html)

### Task Templates
- Table name: task_template
- Description: Tasks can be templated for any reason you can imagine!
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): updated_at
- Link to API endpoint documentation: [Task Templates](https://jsapi.apiary.io/apis/clickup20/reference/0/task-templates/get-task-templates.html)

### Goals
- Table name: goal 
- Description: Teams can set goals for themselves
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Goals](https://jsapi.apiary.io/apis/clickup20/reference/0/goals/get-goals.html)

### Tags
- Table name: tag
- Description: Each space can have multiple tags
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Tags](https://jsapi.apiary.io/apis/clickup20/reference/0/tags/get-space-tags.html)

### Shared Hierarchy
- Table name: shared_hierarchy
- Description: Returns all resources you have access to where you don't have access to its parent. For example, if you have a access to a shared task, but don't have access to its parent list, it will come back in this request.
- Primary key column(s): (No primary key column)
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Shared Hierarchy](https://jsapi.apiary.io/apis/clickup20/reference/0/shared-hierarchy/shared-hierarchy.html)

### Custom Fields from Folderless Lists
- Table name: folderless_customfield
- Description: Each Folderless lists can have custom fields associated with them
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Custom Field](https://jsapi.apiary.io/apis/clickup20/reference/0/custom-fields/get-accessible-custom-fields.html)

### Custom Field from Folder Lists
- Table name: folder_customfield
- Description: Each Foldere list can have custom fields associated with them
- Primary key column(s):  id
- Replicated fully or incrementally: Full
- Bookmark column(s): N/A
- Link to API endpoint documentation: [Custom Field](https://jsapi.apiary.io/apis/clickup20/reference/0/custom-fields/get-accessible-custom-fields.html)

### Tasks
- Table name: tasks
- Description: Some tasks do not sit under folders. This comes from the folderless_list endpoint
- Primary key column(s):  id
- Replicated fully or incrementally: Incremental
- Bookmark column(s): date_updated. Note that the api endpoint date_updated_gt is great than or equal to, not just greater than. 
- Link to API endpoint documentation: [Get Tasks](https://jsapi.apiary.io/apis/clickup20/reference/0/tasks/get-filtered-team-tasks.html)

## Other Info

* Dates are returned in UNIX time 
* API Limiting uses [X-RateLimit headers](https://tools.ietf.org/id/draft-polli-ratelimit-headers-00.html)

## Installation

```bash
pipx install tap-clickup
```

## Usage

You can easily run `tap-clickup` by itself or in a pipeline using [Meltano](https://meltano.com/).

### Executing the Tap Directly

```bash
tap-clickup --version
tap-clickup --help
tap-clickup --config CONFIG --discover > ./catalog.json
```

## Developer Resources

### Schema Debugging
We are waiting on https://gitlab.com/meltano/sdk/-/issues/299 to get fixed as we make usage of refs in our json schema. Until then we parse the schemas in client.py 

Sometimes it's useful to debug how the refs are being resolved. To do that there's a script inside of ./schema-parser , README in that directory describes how to run the parser 

Not worry about making this super fool proof as we expect the SDK to release some kind of fix for this

### Initialize your Development Environment

```bash
pipx install poetry
poetry install
```

### Create and Run Tests

Create tests within the `tap_clickup/tests` subfolder and
  then run:

```bash
poetry run pytest
```

You can also test the `tap-clickup` CLI interface directly using `poetry run`:

```bash
poetry run tap-clickup --help
```

### Testing with [Meltano](https://www.meltano.com)

_**Note:** This tap will work in any Singer environment and does not require Meltano.

Install Meltano (if you haven't already) and any needed plugins:

```bash
# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-clickup
meltano install
```

Now you can test and orchestrate using Meltano:

```bash
# Test invocation:
meltano invoke tap-clickup --version
# OR run a test `elt` pipeline:
meltano elt tap-clickup target-jsonl
```

### SDK

Built with the [Meltano SDK](https://sdk.meltano.com) for Singer Taps and Targets.


            

Raw data

            {
    "_id": null,
    "home_page": "https://autoidm.com",
    "name": "tap-clickup",
    "maintainer": "AutoIDM",
    "docs_url": null,
    "requires_python": ">=3.7.1,<3.12",
    "maintainer_email": "",
    "keywords": "AutoIDM,Auto IDM,tap-clickup,clickup,tap,singer,sdk",
    "author": "AutoIDM",
    "author_email": "",
    "download_url": "https://files.pythonhosted.org/packages/f4/47/550a5c96b5c38cbce1c47563c43d1c79361fd127dc5a584797b57e7bf1fb/tap_clickup-0.0.21.tar.gz",
    "platform": null,
    "description": "# `tap-clickup` \n[![PyPI Version](https://img.shields.io/pypi/v/tap-clickup?color=blue)](https://pypi.org/project/tap-clickup)\n[![Python Versions](https://img.shields.io/pypi/pyversions/tap-clickup)](https://pypi.org/project/tap-clickup)\n[![PyPI download month](https://img.shields.io/pypi/dm/tap-clickup.svg?color=blue)](https://pypi.python.org/pypi/tap-clickup/)\n[![Build and Tests](https://github.com/AutoIDM/tap-clickup/actions/workflows/ci.yml/badge.svg?branch=main&color=blue)](https://github.com/AutoIDM/tap-clickup/actions)\n\n`tap-clickup` is a Singer tap for ClickUp.\nTap was created by [AutoIDM](https://autoidm.com) only because multiple community members came together to get this tap created. Check AutoIDM out for tap/target creation, maintenace, support, and more!\n\n<a href=\"https://autoidm.com\"><img alt=\"AutoIDM\" src=\"./images/autoidm.png\" width=\"250\"></a>\n\n# Sponsors\nThis tap is only available due to the amazing folks who pitched together to make this happen.\n\n<a href=\"https://www.trek10.com\"><img alt=\"trek10\" src=\"./images/trek10.png\" width=\"250\"></a>\n\nNote that some sponsors may not be listed here. \n\nWant to become a sponsor? Reach out to us at [autoidm.com](https://autoidm.com)\n\n\n## Capabilities\n\n* `catalog`\n* `state`\n* `discover`\n* `about`\n* `stream-maps`\n* `schema-flattening`\n\n## Settings\n\n| Setting             | Required | Default | Description |\n|:--------------------|:--------:|:-------:|:------------|\n| api_token           | True     | None    | Example: 'pk_12345 |\n| stream_maps         | False    | None    | Config object for stream maps capability. |\n| stream_map_config   | False    | None    | User-defined config values to be used within map expressions. |\n| flattening_enabled  | False    | None    | 'True' to enable schema flattening and automatically expand nested properties. |\n| flattening_max_depth| False    | None    | The max depth to flatten schemas. |\n\nA full list of supported settings and capabilities is available by running: `tap-clickup --about`\n\n### Getting an API Token\n\n1. Login at https://app.clickup.com/\n1. Click your icon at the bottom left of the screen\n1. Click My Settings\n1. Click Apps (Bottom leftish of screen under the My Apps sub section)\n1. At the top of the screen is an API Token. This can be used in the api_token location. \n    * This is a personal token, it's fine to use a personal token as this tap is only for the business that's using the data. \n\n## Clickup Table Schemas\nNote that the most up to date information is located in tap_clickup/streams.py. We will try to keep these docs updated\n\n### Teams\n- Table name: team\n- Description: Teams Data, each user can be in multiple teams\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Teams](https://jsapi.apiary.io/apis/clickup20/reference/0/teams/get-teams.html)\n\n### Spaces\n- Table name: space\n- Description: Each team has multiple spaces\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Spaces](https://jsapi.apiary.io/apis/clickup20/reference/0/spaces.html)\n\n### Time Entries\n- Table name: time_entries\n- Description: All time entries are pulled for every team. Currently only pulls the last 30 days of time_entries see https://github.com/AutoIDM/tap-clickup/issues/134 for an issue addressing this!\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Time Entries](https://jsapi.apiary.io/apis/clickup20/reference/0/time-tracking-legacy/get-time-entries-within-a-date-range.html)\n\n### Folders\n- Table name: folder\n- Description: Each space can have multiple folders\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Folders](https://jsapi.apiary.io/apis/clickup20/reference/0/folders.html)\n\n### Folder Lists\n- Table name: folder_list\n- Description: Each Folder can have multiple lists\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation:[Folder Lists](https://jsapi.apiary.io/apis/clickup20/reference/0/lists/get-lists.html)\n\n\n### Folderless Lists\n- Table name: folderless_list\n- Description: Some lists do not exist in a folder\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Folderless Lists](https://jsapi.apiary.io/apis/clickup20/reference/0/lists/get-folderless-lists.html)\n\n### Task Templates\n- Table name: task_template\n- Description: Tasks can be templated for any reason you can imagine!\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): updated_at\n- Link to API endpoint documentation: [Task Templates](https://jsapi.apiary.io/apis/clickup20/reference/0/task-templates/get-task-templates.html)\n\n### Goals\n- Table name: goal \n- Description: Teams can set goals for themselves\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Goals](https://jsapi.apiary.io/apis/clickup20/reference/0/goals/get-goals.html)\n\n### Tags\n- Table name: tag\n- Description: Each space can have multiple tags\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Tags](https://jsapi.apiary.io/apis/clickup20/reference/0/tags/get-space-tags.html)\n\n### Shared Hierarchy\n- Table name: shared_hierarchy\n- Description: Returns all resources you have access to where you don't have access to its parent. For example, if you have a access to a shared task, but don't have access to its parent list, it will come back in this request.\n- Primary key column(s): (No primary key column)\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Shared Hierarchy](https://jsapi.apiary.io/apis/clickup20/reference/0/shared-hierarchy/shared-hierarchy.html)\n\n### Custom Fields from Folderless Lists\n- Table name: folderless_customfield\n- Description: Each Folderless lists can have custom fields associated with them\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Custom Field](https://jsapi.apiary.io/apis/clickup20/reference/0/custom-fields/get-accessible-custom-fields.html)\n\n### Custom Field from Folder Lists\n- Table name: folder_customfield\n- Description: Each Foldere list can have custom fields associated with them\n- Primary key column(s):  id\n- Replicated fully or incrementally: Full\n- Bookmark column(s): N/A\n- Link to API endpoint documentation: [Custom Field](https://jsapi.apiary.io/apis/clickup20/reference/0/custom-fields/get-accessible-custom-fields.html)\n\n### Tasks\n- Table name: tasks\n- Description: Some tasks do not sit under folders. This comes from the folderless_list endpoint\n- Primary key column(s):  id\n- Replicated fully or incrementally: Incremental\n- Bookmark column(s): date_updated. Note that the api endpoint date_updated_gt is great than or equal to, not just greater than. \n- Link to API endpoint documentation: [Get Tasks](https://jsapi.apiary.io/apis/clickup20/reference/0/tasks/get-filtered-team-tasks.html)\n\n## Other Info\n\n* Dates are returned in UNIX time \n* API Limiting uses [X-RateLimit headers](https://tools.ietf.org/id/draft-polli-ratelimit-headers-00.html)\n\n## Installation\n\n```bash\npipx install tap-clickup\n```\n\n## Usage\n\nYou can easily run `tap-clickup` by itself or in a pipeline using [Meltano](https://meltano.com/).\n\n### Executing the Tap Directly\n\n```bash\ntap-clickup --version\ntap-clickup --help\ntap-clickup --config CONFIG --discover > ./catalog.json\n```\n\n## Developer Resources\n\n### Schema Debugging\nWe are waiting on https://gitlab.com/meltano/sdk/-/issues/299 to get fixed as we make usage of refs in our json schema. Until then we parse the schemas in client.py \n\nSometimes it's useful to debug how the refs are being resolved. To do that there's a script inside of ./schema-parser , README in that directory describes how to run the parser \n\nNot worry about making this super fool proof as we expect the SDK to release some kind of fix for this\n\n### Initialize your Development Environment\n\n```bash\npipx install poetry\npoetry install\n```\n\n### Create and Run Tests\n\nCreate tests within the `tap_clickup/tests` subfolder and\n  then run:\n\n```bash\npoetry run pytest\n```\n\nYou can also test the `tap-clickup` CLI interface directly using `poetry run`:\n\n```bash\npoetry run tap-clickup --help\n```\n\n### Testing with [Meltano](https://www.meltano.com)\n\n_**Note:** This tap will work in any Singer environment and does not require Meltano.\n\nInstall Meltano (if you haven't already) and any needed plugins:\n\n```bash\n# Install meltano\npipx install meltano\n# Initialize meltano within this directory\ncd tap-clickup\nmeltano install\n```\n\nNow you can test and orchestrate using Meltano:\n\n```bash\n# Test invocation:\nmeltano invoke tap-clickup --version\n# OR run a test `elt` pipeline:\nmeltano elt tap-clickup target-jsonl\n```\n\n### SDK\n\nBuilt with the [Meltano SDK](https://sdk.meltano.com) for Singer Taps and Targets.\n\n",
    "bugtrack_url": null,
    "license": "",
    "summary": "tap-clickup is a Singer tap for ClickUp by AutoIDM",
    "version": "0.0.21",
    "project_urls": {
        "Documentation": "https://github.com/AutoIDM/tap-clickup",
        "Homepage": "https://autoidm.com",
        "Issues": "https://github.com/AutoIDM/tap-clickup/issues",
        "LinkedIn": "https://www.linkedin.com/company/68741135",
        "Repository": "https://github.com/AutoIDM/tap-clickup",
        "Twitter": "https://twitter.com/AutoIDM",
        "Youtube": "https://www.youtube.com/channel/UCk4lfv8fZ4rMlYzw9N_FM0g"
    },
    "split_keywords": [
        "autoidm",
        "auto idm",
        "tap-clickup",
        "clickup",
        "tap",
        "singer",
        "sdk"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "4d9d03f50940a2eaf853effa0a60792c6023e349e2817117014cd9503c1cc804",
                "md5": "d10b3a69e3a664d7d57cb1f7ba0a50d1",
                "sha256": "58f8d3ff34fbfb2d9d157b9d7643d764d94b58362c574105cbe89097405c5977"
            },
            "downloads": -1,
            "filename": "tap_clickup-0.0.21-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "d10b3a69e3a664d7d57cb1f7ba0a50d1",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": ">=3.7.1,<3.12",
            "size": 25256,
            "upload_time": "2023-07-17T20:33:36",
            "upload_time_iso_8601": "2023-07-17T20:33:36.956240Z",
            "url": "https://files.pythonhosted.org/packages/4d/9d/03f50940a2eaf853effa0a60792c6023e349e2817117014cd9503c1cc804/tap_clickup-0.0.21-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "f447550a5c96b5c38cbce1c47563c43d1c79361fd127dc5a584797b57e7bf1fb",
                "md5": "252efe8de8641a7a9f91921762cbd220",
                "sha256": "fbbbccd1ccdb9694c90135affd7a6e31a8a47831be3ae5ab1fc7421e50926e55"
            },
            "downloads": -1,
            "filename": "tap_clickup-0.0.21.tar.gz",
            "has_sig": false,
            "md5_digest": "252efe8de8641a7a9f91921762cbd220",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": ">=3.7.1,<3.12",
            "size": 18558,
            "upload_time": "2023-07-17T20:33:38",
            "upload_time_iso_8601": "2023-07-17T20:33:38.622724Z",
            "url": "https://files.pythonhosted.org/packages/f4/47/550a5c96b5c38cbce1c47563c43d1c79361fd127dc5a584797b57e7bf1fb/tap_clickup-0.0.21.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2023-07-17 20:33:38",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "AutoIDM",
    "github_project": "tap-clickup",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "tox": true,
    "lcname": "tap-clickup"
}
        
Elapsed time: 0.10723s