# dbt-risingwave
A [RisingWave](https://github.com/risingwavelabs/risingwave)
adapter plugin for [dbt](https://www.getdbt.com/).
**RisingWave** is a cloud-native streaming database that uses SQL as the interface language. It is designed to reduce the complexity and cost of building real-time applications. https://www.risingwave.com
**dbt** enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications. [Use dbt for data transformations in RisingWave](https://docs.risingwave.com/docs/current/use-dbt/)
## Getting started
The package has not been published to PyPI, please install it via git.
1. Install `dbt-risingwave`
``` shell
python3 -m pip install dbt-risingwave
```
2. Get `RisingWave` running
Please follow [this](https://www.risingwave.dev/docs/current/get-started/) guide to set up a functional RisingWave instance.
3. Configure the `dbt` profile file
The profile file is located in `~/.dbt/profiles.yml`. Here's an example of how to use it with RisingWave.
```yaml
default:
outputs:
dev:
type: risingwave
host: 127.0.0.1
user: root
pass: ""
dbname: dev
port: 4566
schema: public
target: dev
```
4. Run `dbt debug` to check whether the configuration is correct.
## Models
The dbt models for managing data transformations in RisingWave are similar to typical dbt sql models. The main differences are the materializations. We customized the materializations to fit the data processing model of RisingWave.
| Materializations | INFO |
| ---------------------- | --------------------- |
| materialized_view | Create a materialized view. This materialization corresponds to the incremental one in dbt. To use this materialization, add {{ config(materialized='materialized_view') }} to your model SQL files. **NEW: Supports zero downtime rebuilds using ALTER MATERIALIZED VIEW SWAP syntax when both model config has zero_downtime={'enabled': true} AND --vars 'zero_downtime: true' is provided (requires RisingWave v2.2+).** |
| materializedview | (Deprecated) only for backward compatibility, use `materialized_view` instead. **Zero downtime rebuilds are not supported - please migrate to `materialized_view` to use this feature.** |
| ephemeral | This materialization uses common table expressions in RisingWave under the hood. To use this materialization, add {{ config(materialized='ephemeral') }} to your model SQL files. |
| table | Create a table. To use this materialization, add {{ config(materialized='table') }} to your model SQL files. |
| view | Create a view. To use this materialization, add {{ config(materialized='view') }} to your model SQL files. |
| incremental | Use `materialized_view` instead if possible, since RisingWave is designed to use a materialized view to manage data transformation in an incremental way. From v1.7.3, dbt-risingwave supports `incremental` model to give users better control of when to update their model. This model will update the table in a batch way incrementally. |
| source | Define a source {{ config(materialized='source') }}. You need to provide your create source statement as a whole in this model. |
| table_with_connector | Define a table with a connector {{ config(materialized='table_with_connector') }}. You need to provide your create table with connector statement as a whole in this model. Because dbt `table` has its own semantics, RisingWave uses `table_with_connector` to distinguish itself from it. The connector is optional if you just want to define a table without anything connector. |
| sink | Define a sink {{ config(materialized='sink') }}. You need to provide your create sink statement as a whole in this model. |
To learn how to use, you can check RisingWave's official example [dbt_rw_nexmark](https://github.com/risingwavelabs/dbt_rw_nexmark).
## Zero Downtime Materialized View Rebuilds
**NEW FEATURE**: dbt-risingwave now supports zero downtime rebuilds for materialized views when SQL definitions change. This feature:
- Uses RisingWave's `ALTER MATERIALIZED VIEW SWAP` syntax for atomic updates
- **Requires RisingWave v2.2 or later** - the `ALTER MATERIALIZED VIEW SWAP` syntax is only available in RisingWave v2.2+
- **Dual-layer safety** - requires both model config `zero_downtime={'enabled': true}` AND runtime flag `--vars 'zero_downtime: true'`
- Maintains service availability during model updates when enabled
- Provides runtime control over when zero downtime rebuilds are used
For detailed documentation, see [ZERO_DOWNTIME_MV_README.md](ZERO_DOWNTIME_MV_README.md).
## DBT RUN behavior
- `dbt run`: only create new models (if not exists) without dropping any models.
- `dbt run --full-refresh`: drop models and create the new ones. This command can make sure your streaming pipelines are consistent with what you define in dbt models.
## Graph operators
[Graph operators](https://docs.getdbt.com/reference/node-selection/graph-operators) is useful when you want to only recreate a subset of your models.
```sh
dbt run --select "my_model+" # select my_model and all children
dbt run --select "+my_model" # select my_model and all parents
dbt run --select "+my_model+" # select my_model, and all of its parents and children
```
## Tests
All items below have been tested against the latest RisingWave daily build version.
- [x] Offical example [jaffle_shop](https://github.com/dbt-labs/jaffle_shop) is tested.
- [x] RisingWave offical example [dbt_rw_nexmark](https://github.com/risingwavelabs/dbt_rw_nexmark) is tested.
Raw data
{
"_id": null,
"home_page": "https://github.com/risingwavelabs/dbt-risingwave",
"name": "dbt-risingwave",
"maintainer": null,
"docs_url": null,
"requires_python": ">=3.9",
"maintainer_email": null,
"keywords": "dbt RisingWave",
"author": "Dylan Chen",
"author_email": "zilin@risingwave-labs.com",
"download_url": "https://files.pythonhosted.org/packages/63/6e/84c61681da4dbc33e28383b5ec09fd4aa8e756b56add0ca3adedaf3636ba/dbt_risingwave-1.9.3.tar.gz",
"platform": null,
"description": "# dbt-risingwave\n\nA [RisingWave](https://github.com/risingwavelabs/risingwave) \nadapter plugin for [dbt](https://www.getdbt.com/).\n\n**RisingWave** is a cloud-native streaming database that uses SQL as the interface language. It is designed to reduce the complexity and cost of building real-time applications. https://www.risingwave.com\n\n**dbt** enables data analysts and engineers to transform their data using the same practices that software engineers use to build applications. [Use dbt for data transformations in RisingWave](https://docs.risingwave.com/docs/current/use-dbt/)\n\n## Getting started\n\nThe package has not been published to PyPI, please install it via git.\n\n1. Install `dbt-risingwave`\n\n``` shell\npython3 -m pip install dbt-risingwave\n```\n\n2. Get `RisingWave` running\n\nPlease follow [this](https://www.risingwave.dev/docs/current/get-started/) guide to set up a functional RisingWave instance.\n\n3. Configure the `dbt` profile file\n\nThe profile file is located in `~/.dbt/profiles.yml`. Here's an example of how to use it with RisingWave.\n\n```yaml\ndefault:\n outputs:\n dev:\n type: risingwave\n host: 127.0.0.1\n user: root\n pass: \"\"\n dbname: dev\n port: 4566\n schema: public\n target: dev\n```\n\n4. Run `dbt debug` to check whether the configuration is correct.\n\n## Models\n\nThe dbt models for managing data transformations in RisingWave are similar to typical dbt sql models. The main differences are the materializations. We customized the materializations to fit the data processing model of RisingWave.\n\n| Materializations | INFO |\n| ---------------------- | --------------------- |\n| materialized_view | Create a materialized view. This materialization corresponds to the incremental one in dbt. To use this materialization, add {{ config(materialized='materialized_view') }} to your model SQL files. **NEW: Supports zero downtime rebuilds using ALTER MATERIALIZED VIEW SWAP syntax when both model config has zero_downtime={'enabled': true} AND --vars 'zero_downtime: true' is provided (requires RisingWave v2.2+).** |\n| materializedview | (Deprecated) only for backward compatibility, use `materialized_view` instead. **Zero downtime rebuilds are not supported - please migrate to `materialized_view` to use this feature.** |\n| ephemeral | This materialization uses common table expressions in RisingWave under the hood. To use this materialization, add {{ config(materialized='ephemeral') }} to your model SQL files. |\n| table | Create a table. To use this materialization, add {{ config(materialized='table') }} to your model SQL files. |\n| view | Create a view. To use this materialization, add {{ config(materialized='view') }} to your model SQL files. |\n| incremental | Use `materialized_view` instead if possible, since RisingWave is designed to use a materialized view to manage data transformation in an incremental way. From v1.7.3, dbt-risingwave supports `incremental` model to give users better control of when to update their model. This model will update the table in a batch way incrementally. |\n| source | Define a source {{ config(materialized='source') }}. You need to provide your create source statement as a whole in this model. |\n| table_with_connector | Define a table with a connector {{ config(materialized='table_with_connector') }}. You need to provide your create table with connector statement as a whole in this model. Because dbt `table` has its own semantics, RisingWave uses `table_with_connector` to distinguish itself from it. The connector is optional if you just want to define a table without anything connector. |\n| sink | Define a sink {{ config(materialized='sink') }}. You need to provide your create sink statement as a whole in this model. |\n\nTo learn how to use, you can check RisingWave's official example [dbt_rw_nexmark](https://github.com/risingwavelabs/dbt_rw_nexmark).\n\n## Zero Downtime Materialized View Rebuilds\n\n**NEW FEATURE**: dbt-risingwave now supports zero downtime rebuilds for materialized views when SQL definitions change. This feature:\n\n- Uses RisingWave's `ALTER MATERIALIZED VIEW SWAP` syntax for atomic updates\n- **Requires RisingWave v2.2 or later** - the `ALTER MATERIALIZED VIEW SWAP` syntax is only available in RisingWave v2.2+\n- **Dual-layer safety** - requires both model config `zero_downtime={'enabled': true}` AND runtime flag `--vars 'zero_downtime: true'`\n- Maintains service availability during model updates when enabled\n- Provides runtime control over when zero downtime rebuilds are used\n\nFor detailed documentation, see [ZERO_DOWNTIME_MV_README.md](ZERO_DOWNTIME_MV_README.md).\n\n## DBT RUN behavior\n\n- `dbt run`: only create new models (if not exists) without dropping any models.\n- `dbt run --full-refresh`: drop models and create the new ones. This command can make sure your streaming pipelines are consistent with what you define in dbt models.\n\n## Graph operators\n\n[Graph operators](https://docs.getdbt.com/reference/node-selection/graph-operators) is useful when you want to only recreate a subset of your models.\n\n```sh\ndbt run --select \"my_model+\" # select my_model and all children\ndbt run --select \"+my_model\" # select my_model and all parents\ndbt run --select \"+my_model+\" # select my_model, and all of its parents and children\n```\n\n## Tests\n\nAll items below have been tested against the latest RisingWave daily build version.\n\n- [x] Offical example [jaffle_shop](https://github.com/dbt-labs/jaffle_shop) is tested.\n- [x] RisingWave offical example [dbt_rw_nexmark](https://github.com/risingwavelabs/dbt_rw_nexmark) is tested.\n",
"bugtrack_url": null,
"license": "http://www.apache.org/licenses/LICENSE-2.0",
"summary": "The RisingWave adapter plugin for dbt",
"version": "1.9.3",
"project_urls": {
"Homepage": "https://github.com/risingwavelabs/dbt-risingwave"
},
"split_keywords": [
"dbt",
"risingwave"
],
"urls": [
{
"comment_text": null,
"digests": {
"blake2b_256": "2c9fa3ed86a02169865760f54596ca3dc9af53438f1cb7000bf4c11731725be8",
"md5": "e63f3bc7dddd42fd5051372926d5e316",
"sha256": "98a4d34be54cae45a21cd5d8b9fadaada19316fcf6c65e87443b2a8c64017ebf"
},
"downloads": -1,
"filename": "dbt_risingwave-1.9.3-py3-none-any.whl",
"has_sig": false,
"md5_digest": "e63f3bc7dddd42fd5051372926d5e316",
"packagetype": "bdist_wheel",
"python_version": "py3",
"requires_python": ">=3.9",
"size": 24605,
"upload_time": "2025-07-24T08:50:29",
"upload_time_iso_8601": "2025-07-24T08:50:29.640528Z",
"url": "https://files.pythonhosted.org/packages/2c/9f/a3ed86a02169865760f54596ca3dc9af53438f1cb7000bf4c11731725be8/dbt_risingwave-1.9.3-py3-none-any.whl",
"yanked": false,
"yanked_reason": null
},
{
"comment_text": null,
"digests": {
"blake2b_256": "636e84c61681da4dbc33e28383b5ec09fd4aa8e756b56add0ca3adedaf3636ba",
"md5": "a7224df18a36a12fc9b2641da160cd95",
"sha256": "a57dd68823c3650f2d6bb76c4f416ed8ea1d07723516505ba37b5cae4d34db9d"
},
"downloads": -1,
"filename": "dbt_risingwave-1.9.3.tar.gz",
"has_sig": false,
"md5_digest": "a7224df18a36a12fc9b2641da160cd95",
"packagetype": "sdist",
"python_version": "source",
"requires_python": ">=3.9",
"size": 20946,
"upload_time": "2025-07-24T08:50:31",
"upload_time_iso_8601": "2025-07-24T08:50:31.140899Z",
"url": "https://files.pythonhosted.org/packages/63/6e/84c61681da4dbc33e28383b5ec09fd4aa8e756b56add0ca3adedaf3636ba/dbt_risingwave-1.9.3.tar.gz",
"yanked": false,
"yanked_reason": null
}
],
"upload_time": "2025-07-24 08:50:31",
"github": true,
"gitlab": false,
"bitbucket": false,
"codeberg": false,
"github_user": "risingwavelabs",
"github_project": "dbt-risingwave",
"travis_ci": false,
"coveralls": false,
"github_actions": true,
"tox": true,
"lcname": "dbt-risingwave"
}
JSON
