Tag: ETL

getDbt

DBT : How to manage multiple environments in DBT ?

When working with data, it’s often necessary to manage multiple environments, such as development, testing, and production, in order to…

getDbt

DBT : Using Python how can we get the upstreaming and downstream models in DBT ?

In DBT, it is possible to write Python code to perform custom operations on data models, such as finding the…

getDbt

DBT : How to extract artifacts like manifest, catalog, run-results and sources files in DBT ?

DBT (Data Build Tool) allows you to extract artifacts from your database, including the manifest, catalog, run-results, and sources files….

getDbt

DBT : How to clean up removed models from your production schema ?

DBT (Data Build Tool) is a powerful open-source tool used for data transformation and analysis. As your data model evolves,…

getDbt

DBT : How to Source from a table in different GCP project based on environment ?

Overview on how to source data from a table in a different GCP project based on the environment. Introduction: In…

getDbt

DBT : Difference between dbt run, dbt full-refresh, and dbt test,

DBT provides several commands that allow data teams to run different tasks on their data models, such as dbt run,…

getDbt

DBT : How to implement Auto refreshing models for incremental models with Schema changes ?

Data modeling is an important aspect of any data-driven organization. In a data-driven organization, data models are created to process…

getDbt

DBT : Setting Descriptions for BigQuery Tables from DBT

BigQuery is a powerful and scalable data warehousing solution from Google Cloud that enables organizations to store, process, and analyze…

getDbt

DBT : How to get a new connection based on your dbt_project.yml and profiles.yml [Postgres or Redshift]

The below statement is referring to the process of establishing a database connection in a support script or Jupyter notebook…