article thumbnail

Building a Data Engineering Stack That Boosts Scalability

Chart Mogul

In 2021, ChartMogul experienced a transformative shift in data strategy when we introduced a dedicated data engineering team. Nowadays, these are packaged and deployed in docker images, and executed via AWS lambda or EKS pods each day. We used our daily AWS RDS snapshots and loaded them daily to Snowflake tables.

article thumbnail

Moving ChartMogul to AWS and Kubernetes

Chart Mogul

In a series of articles, we will share our experiences about: Our journey to AWS EKS (Kubernetes managed service). Since our inception in 2014 and up to mid-2021, our entire infrastructure has run on DigitalOcean droplets (self-managed cloud virtual machines). Some of the most critical roadblocks we encountered.