DBT manages dependencies between models through a directed acyclic graph (DAG). The DAG determines the…
Tag: ETL
DBT : How to manage multiple environments in DBT ?
When working with data, it’s often necessary to manage multiple environments, such as development, testing, and production, in order to…
DBT : Using Python how can we get the upstreaming and downstream models in DBT ?
In DBT, it is possible to write Python code to perform custom operations on data models, such as finding the…
DBT : How to extract artifacts like manifest, catalog, run-results and sources files in DBT ?
DBT (Data Build Tool) allows you to extract artifacts from your database, including the manifest, catalog, run-results, and sources files….
DBT : How to clean up removed models from your production schema ?
DBT (Data Build Tool) is a powerful open-source tool used for data transformation and analysis. As your data model evolves,…
DBT : How to Source from a table in different GCP project based on environment ?
Overview on how to source data from a table in a different GCP project based on the environment. Introduction: In…
DBT : Difference between dbt run, dbt full-refresh, and dbt test,
DBT provides several commands that allow data teams to run different tasks on their data models, such as dbt run,…
DBT : How to implement Auto refreshing models for incremental models with Schema changes ?
Data modeling is an important aspect of any data-driven organization. In a data-driven organization, data models are created to process…
DBT : Setting Descriptions for BigQuery Tables from DBT
BigQuery is a powerful and scalable data warehousing solution from Google Cloud that enables organizations to store, process, and analyze…
DBT : How to get a new connection based on your dbt_project.yml and profiles.yml [Postgres or Redshift]
The below statement is referring to the process of establishing a database connection in a support script or Jupyter notebook…
DBT : Handling Late-Arriving Data in DBT
Data warehousing and business intelligence often involve working with data that arrives after a certain time period has already been…