article thumbnail

Building a Data Engineering Stack That Boosts Scalability

Chart Mogul

Nowadays, these are packaged and deployed in docker images, and executed via AWS lambda or EKS pods each day. How we process and visualize data In our data engineering endeavors, dbt stands out as a crucial tool for orchestrating SQL-based transformations. We used our daily AWS RDS snapshots and loaded them daily to Snowflake tables.