dbt-data-diff

Data-diff solution for dbt-ers with Snowflake ❄️ 🚀

Installation

• Add to packages.yml file:

packages:
  - package: infinitelambda/data_diff
    version: [">=1.0.0", "<1.1.0"]

Or use the latest version from git:

packages:
  - git: "https://github.com/infinitelambda/dbt-data-diff.git"
    revision: 1.0.0 # 1.0.0b1

• (Optional) Configure database & schema in dbt_project.yml file:

vars:
  # (optional) default to `target.database` if not specified
  data_diff__database: COMMON
  # (optional) default to `target.schema` if not specified
  data_diff__schema: DATA_DIFF

• Create/Migrate the data-diff's DDL resources

dbt deps
dbt run -s data_diff --vars '{data_diff__on_migration: true}'

Quick Demo

Let's jump to the Quick Start section and the next demo one 🏃

📊 Here is the sample Streamlit in Snowflake application based on the result produced by the package:

How to Contribute

dbt-data-diff is an open-source dbt package. Whether you are a seasoned open-source contributor or a first-time committer, we welcome and encourage you to contribute code, documentation, ideas, or problem statements to this project.

👉 See CONTRIBUTING guideline for more details or check out CONTRIBUTING.md

🌟 And then, kudos to our beloved Contributors:

⭐ Special Credits to 👱 Attila Berecz who is the OG Contributor of the Core Concept and all the Snowflake Stored Procedures

About Infinite Lambda

Infinite Lambda is a cloud and data consultancy. We build strategies, help organizations implement them, and pass on the expertise to look after the infrastructure.

We are an Elite Snowflake Partner, a Platinum dbt Partner, and a two-time Fivetran Innovation Partner of the Year for EMEA.

Naturally, we love exploring innovative solutions and sharing knowledge, so go ahead and:

🔧 Take a look around our Git

✏️ Browse our tech blog

We are also chatty, so:

👀 Follow us on LinkedIn

👋🏼 Or just get in touch