dbt_coves


Namedbt_coves JSON
Version 1.8.3 PyPI version JSON
download
home_pagehttps://datacoves.com
SummaryCLI tool for dbt users adopting analytics engineering best practices.
upload_time2024-07-17 20:33:56
maintainerNone
docs_urlNone
authorDatacoves
requires_python<3.12,>=3.8.1
licenseApache 2.0
keywords data engineering analytics engineering dbt etl data modelling
VCS
bugtrack_url
requirements No requirements were recorded.
Travis-CI No Travis.
coveralls test coverage No coveralls.
            # dbt-coves

## Brought to you by your friends at Datacoves

<picture>
  <source media="(prefers-color-scheme: dark)" srcset="images/datacoves-dark.png">
  <img alt="Datacoves" src="images/datacoves-light.png" width="150">
</picture>

The Datacoves platform helps enterprises overcome their data delivery challenges quickly using dbt and Airflow, implementing best practices from the start without the need for multiple vendors or costly consultants.

Hosted VS Code, dbt-core, SqlFluff, and Airflow, find out more at [Datacoves.com](https://datacoves.com/product).

## Overview

[![image](https://cdn.loom.com/sessions/thumbnails/7d5341f5d5b149ed8895fe1187e338c5-with-play.gif)](https://www.loom.com/share/7d5341f5d5b149ed8895fe1187e338c5)

## Table of contents

- [Introduction](#introduction)
- [Installation](#installation)
- [Usage](#usage)
- [Contributing](#contributing)

## Introduction

dbt-coves is a CLI tool that automates and simplifies development and release tasks for [dbt](https://www.getdbt.com).

In addition to other functions listed below, dbt-coves generates dbt sources, staging models and property(yml) files by analyzing information from the data warehouse and creating the necessary files (sql and yml). It can even generate Airflow DAGs based on YML input.

Finally, dbt-coves includes functionality to bootstrap a dbt project and to extract and load configurations from data-replication providers.

## Installation

```console
pip install dbt-coves
```

We recommend using [python
virtualenvs](https://docs.python.org/3/tutorial/venv.html) and create
one separate environment per project.

#### Supported dbt versions

| Version | Status           |
| ------- | ---------------- |
| \< 1.0  | ❌ Not supported |
| >= 1.0  | ✅ Tested        |

From `dbt-coves` 1.4.0 onwards, our major and minor versions match those of [dbt-core](https://github.com/dbt-labs/dbt-core).
This means we release a new major/minor version once it's dbt-core equivalent is tested.
Patch suffix (1.4.X) is exclusive to our continuous development and does not reflect a version match with dbt.

#### Supported dbt adapters

| Feature                           | Snowflake | Redshift  | BigQuery  |
| --------------------------------- | --------- | --------- | --------- |
| source model (sql) generation     | ✅ Tested | ✅ Tested | ✅ Tested |
| model properties (yml) generation | ✅ Tested | ✅ Tested | ✅ Tested |

**NOTE:** Other database adapters may work, although we have not tested them. Feel free to try them and let us know so we can update the table above.

## Usage

dbt-coves, supports the following functions:

- [dbt](docs/commands/dbt/): run dbt commands in CI and Airflow environments.
- [extract and load](docs/commands/extract%20and%20load/): save and restore your configuration from:
  - [Airbyte](docs/commands/extract%20and%20load/airbyte)
  - [Fivetran](docs/commands/extract%20and%20load/fivetran)
- [generate](docs/commands/generate/):
  - [airflow dags](docs/commands/generate/airflow%20dags/): generate Airflow DAGs from YML files.
  - [dbt docs](docs/commands/generate/docs/): generate dbt docs by merging production catalog.json, useful in combination with [dbt-checkpoint](https://github.com/dbt-checkpoint/dbt-checkpoint) and when using Slim CI
  - [dbt sources](docs/commands/generate/sources/): generate the dbt source configuration as well as the initial dbt staging model(s) and their corresponding property(yml) files.
  - [dbt properties](docs/commands/generate/properties/): generate and/or update the properties(yml) file for a given dbt model(sql) file.
  - [metadata](docs/commands/generate/metadata/): generate metadata extract(CSV file) that can be used to collect column types and descriptions and then provided as input inthe the `generate sources` or `generate properties` command
  - [templates](docs/commands/generate/templates/): generate the dbt-coves templates that dbt-coves utilizes with other dbt-coves commands
- [setup](docs/commands/setup/): used configure different components of a dbt project.

For a complete list of options, run:

```console
dbt-coves -h
dbt-coves <command> -h
```

## Contributing

If you're interested in contributing to the development of dbt-coves, please refer to the [Contributing Guidelines](contributing.md). This document outlines the process for submitting bug reports, feature requests, and code contributions.

# Metrics

[![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)](https://github.com/datacoves/dbt-coves/graphs/commit-activity)
[![PyPI version
fury.io](https://badge.fury.io/py/dbt-coves.svg)](https://pypi.python.org/pypi/dbt-coves/)
[![Code
Style](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/ambv/black)
[![Imports:
python](https://img.shields.io/badge/python-3.8%20%7C%203.9-blue)](https://img.shields.io/badge/python-3.8%20%7C%203.9-blue)
[![Build](https://github.com/datacoves/dbt-coves/actions/workflows/main_ci.yml/badge.svg)](https://github.com/datacoves/dbt-coves/actions/workflows/main_ci.yml/badge.svg)

<!-- [![codecov](https://codecov.io/gh/datacoves/dbt-coves/branch/main/graph/badge.svg?token=JB0E0LZDW1)](https://codecov.io/gh/datacoves/dbt-coves) -->

[![Maintainability](https://api.codeclimate.com/v1/badges/1e6a887de605ef8e0eca/maintainability)](https://codeclimate.com/github/datacoves/dbt-coves/maintainability)
[![Downloads](https://pepy.tech/badge/dbt-coves)](https://pepy.tech/project/dbt-coves)

            

Raw data

            {
    "_id": null,
    "home_page": "https://datacoves.com",
    "name": "dbt_coves",
    "maintainer": null,
    "docs_url": null,
    "requires_python": "<3.12,>=3.8.1",
    "maintainer_email": null,
    "keywords": "data engineering, analytics engineering, dbt, ETL, data modelling",
    "author": "Datacoves",
    "author_email": "hello@datacoves.com",
    "download_url": "https://files.pythonhosted.org/packages/8a/a6/4582793ed9c4c8c88e4fb644e0115b08c5deae822aa24d7bae1227603cd6/dbt_coves-1.8.3.tar.gz",
    "platform": null,
    "description": "# dbt-coves\n\n## Brought to you by your friends at Datacoves\n\n<picture>\n  <source media=\"(prefers-color-scheme: dark)\" srcset=\"images/datacoves-dark.png\">\n  <img alt=\"Datacoves\" src=\"images/datacoves-light.png\" width=\"150\">\n</picture>\n\nThe Datacoves platform helps enterprises overcome their data delivery challenges quickly using dbt and Airflow, implementing best practices from the start without the need for multiple vendors or costly consultants.\n\nHosted VS Code, dbt-core, SqlFluff, and Airflow, find out more at [Datacoves.com](https://datacoves.com/product).\n\n## Overview\n\n[![image](https://cdn.loom.com/sessions/thumbnails/7d5341f5d5b149ed8895fe1187e338c5-with-play.gif)](https://www.loom.com/share/7d5341f5d5b149ed8895fe1187e338c5)\n\n## Table of contents\n\n- [Introduction](#introduction)\n- [Installation](#installation)\n- [Usage](#usage)\n- [Contributing](#contributing)\n\n## Introduction\n\ndbt-coves is a CLI tool that automates and simplifies development and release tasks for [dbt](https://www.getdbt.com).\n\nIn addition to other functions listed below, dbt-coves generates dbt sources, staging models and property(yml) files by analyzing information from the data warehouse and creating the necessary files (sql and yml). It can even generate Airflow DAGs based on YML input.\n\nFinally, dbt-coves includes functionality to bootstrap a dbt project and to extract and load configurations from data-replication providers.\n\n## Installation\n\n```console\npip install dbt-coves\n```\n\nWe recommend using [python\nvirtualenvs](https://docs.python.org/3/tutorial/venv.html) and create\none separate environment per project.\n\n#### Supported dbt versions\n\n| Version | Status           |\n| ------- | ---------------- |\n| \\< 1.0  | \u274c Not supported |\n| >= 1.0  | \u2705 Tested        |\n\nFrom `dbt-coves` 1.4.0 onwards, our major and minor versions match those of [dbt-core](https://github.com/dbt-labs/dbt-core).\nThis means we release a new major/minor version once it's dbt-core equivalent is tested.\nPatch suffix (1.4.X) is exclusive to our continuous development and does not reflect a version match with dbt.\n\n#### Supported dbt adapters\n\n| Feature                           | Snowflake | Redshift  | BigQuery  |\n| --------------------------------- | --------- | --------- | --------- |\n| source model (sql) generation     | \u2705 Tested | \u2705 Tested | \u2705 Tested |\n| model properties (yml) generation | \u2705 Tested | \u2705 Tested | \u2705 Tested |\n\n**NOTE:** Other database adapters may work, although we have not tested them. Feel free to try them and let us know so we can update the table above.\n\n## Usage\n\ndbt-coves, supports the following functions:\n\n- [dbt](docs/commands/dbt/): run dbt commands in CI and Airflow environments.\n- [extract and load](docs/commands/extract%20and%20load/): save and restore your configuration from:\n  - [Airbyte](docs/commands/extract%20and%20load/airbyte)\n  - [Fivetran](docs/commands/extract%20and%20load/fivetran)\n- [generate](docs/commands/generate/):\n  - [airflow dags](docs/commands/generate/airflow%20dags/): generate Airflow DAGs from YML files.\n  - [dbt docs](docs/commands/generate/docs/): generate dbt docs by merging production catalog.json, useful in combination with [dbt-checkpoint](https://github.com/dbt-checkpoint/dbt-checkpoint) and when using Slim CI\n  - [dbt sources](docs/commands/generate/sources/): generate the dbt source configuration as well as the initial dbt staging model(s) and their corresponding property(yml) files.\n  - [dbt properties](docs/commands/generate/properties/): generate and/or update the properties(yml) file for a given dbt model(sql) file.\n  - [metadata](docs/commands/generate/metadata/): generate metadata extract(CSV file) that can be used to collect column types and descriptions and then provided as input inthe the `generate sources` or `generate properties` command\n  - [templates](docs/commands/generate/templates/): generate the dbt-coves templates that dbt-coves utilizes with other dbt-coves commands\n- [setup](docs/commands/setup/): used configure different components of a dbt project.\n\nFor a complete list of options, run:\n\n```console\ndbt-coves -h\ndbt-coves <command> -h\n```\n\n## Contributing\n\nIf you're interested in contributing to the development of dbt-coves, please refer to the [Contributing Guidelines](contributing.md). This document outlines the process for submitting bug reports, feature requests, and code contributions.\n\n# Metrics\n\n[![Maintenance](https://img.shields.io/badge/Maintained%3F-yes-green.svg)](https://github.com/datacoves/dbt-coves/graphs/commit-activity)\n[![PyPI version\nfury.io](https://badge.fury.io/py/dbt-coves.svg)](https://pypi.python.org/pypi/dbt-coves/)\n[![Code\nStyle](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/ambv/black)\n[![Imports:\npython](https://img.shields.io/badge/python-3.8%20%7C%203.9-blue)](https://img.shields.io/badge/python-3.8%20%7C%203.9-blue)\n[![Build](https://github.com/datacoves/dbt-coves/actions/workflows/main_ci.yml/badge.svg)](https://github.com/datacoves/dbt-coves/actions/workflows/main_ci.yml/badge.svg)\n\n<!-- [![codecov](https://codecov.io/gh/datacoves/dbt-coves/branch/main/graph/badge.svg?token=JB0E0LZDW1)](https://codecov.io/gh/datacoves/dbt-coves) -->\n\n[![Maintainability](https://api.codeclimate.com/v1/badges/1e6a887de605ef8e0eca/maintainability)](https://codeclimate.com/github/datacoves/dbt-coves/maintainability)\n[![Downloads](https://pepy.tech/badge/dbt-coves)](https://pepy.tech/project/dbt-coves)\n",
    "bugtrack_url": null,
    "license": "Apache 2.0",
    "summary": "CLI tool for dbt users adopting analytics engineering best practices.",
    "version": "1.8.3",
    "project_urls": {
        "Documentation": "https://github.com/datacoves/dbt-coves/blob/main/README.md",
        "Homepage": "https://datacoves.com",
        "Repository": "https://github.com/datacoves/dbt-coves"
    },
    "split_keywords": [
        "data engineering",
        " analytics engineering",
        " dbt",
        " etl",
        " data modelling"
    ],
    "urls": [
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "c7f703560795f8e1e2522280f5a18b88d3fe5e0cec74c8219011f99bd89babf1",
                "md5": "6e9eaf2d2d74aabc1192363f8a40de7b",
                "sha256": "fecfaf41e5d5f6839d66481c20fb31bf6a95b1c442be53b7ce325bb2f3877b5b"
            },
            "downloads": -1,
            "filename": "dbt_coves-1.8.3-py3-none-any.whl",
            "has_sig": false,
            "md5_digest": "6e9eaf2d2d74aabc1192363f8a40de7b",
            "packagetype": "bdist_wheel",
            "python_version": "py3",
            "requires_python": "<3.12,>=3.8.1",
            "size": 94324,
            "upload_time": "2024-07-17T20:33:50",
            "upload_time_iso_8601": "2024-07-17T20:33:50.609043Z",
            "url": "https://files.pythonhosted.org/packages/c7/f7/03560795f8e1e2522280f5a18b88d3fe5e0cec74c8219011f99bd89babf1/dbt_coves-1.8.3-py3-none-any.whl",
            "yanked": false,
            "yanked_reason": null
        },
        {
            "comment_text": "",
            "digests": {
                "blake2b_256": "8aa64582793ed9c4c8c88e4fb644e0115b08c5deae822aa24d7bae1227603cd6",
                "md5": "bb064a69c2d6f9aedf8332617a7ad2d0",
                "sha256": "e4512f9f5931a5dd289b4f88830bcb6e612f42bebaed59d9d23258228e0a8adb"
            },
            "downloads": -1,
            "filename": "dbt_coves-1.8.3.tar.gz",
            "has_sig": false,
            "md5_digest": "bb064a69c2d6f9aedf8332617a7ad2d0",
            "packagetype": "sdist",
            "python_version": "source",
            "requires_python": "<3.12,>=3.8.1",
            "size": 71815,
            "upload_time": "2024-07-17T20:33:56",
            "upload_time_iso_8601": "2024-07-17T20:33:56.488667Z",
            "url": "https://files.pythonhosted.org/packages/8a/a6/4582793ed9c4c8c88e4fb644e0115b08c5deae822aa24d7bae1227603cd6/dbt_coves-1.8.3.tar.gz",
            "yanked": false,
            "yanked_reason": null
        }
    ],
    "upload_time": "2024-07-17 20:33:56",
    "github": true,
    "gitlab": false,
    "bitbucket": false,
    "codeberg": false,
    "github_user": "datacoves",
    "github_project": "dbt-coves",
    "travis_ci": false,
    "coveralls": false,
    "github_actions": true,
    "tox": true,
    "lcname": "dbt_coves"
}
        
Elapsed time: 0.31622s