article thumbnail

Building a Data Engineering Stack That Boosts Scalability

Chart Mogul

We enabled logical replication AWS RDS instances, deployed Debezium and other Kafka connectors in our Kubernetes cluster which consume all real-time changes in Postgres tables, and stored them in relevant Kafka topics in our AWS MSK cluster. Instead, we designed and implemented a custom solution based on Kafka, Debezium, and Kafka Connect.