Tech Tales

Hey there! Welcome to our blog, where our team shares all things tech from cool solutions to everyday challenges to innovative ideas we're excited about. We're here to share our journey, inspire yours and have some fun along the way!

kafka karafka rails production event-streaming

Operating Kafka in Rails with Karafka: Production Architecture, Consumers, and DLQs (Part 2)

Published: 18 Nov 2025
Author: Syed Sibtain
System Analyst

In Part 2, we dive deep into the Sync-Out pipeline—how Rails publishes events to Kafka, how our legacy adapter writes to SQL Server 2009 using TinyTDS, and how Dead-Letter Queues (DLQs) became our lifeline during production incidents. This post covers transaction management, service objects, and operational workflows for handling failures.

kafka karafka rails production event-streaming

Operating Kafka in Rails with Karafka: Production Architecture, Consumers, and DLQs (Part 1)

Published: 17 Nov 2025
Author: Syed Sibtain
System Analyst

This post breaks down our production architecture for event streaming in Rails using Kafka and Karafka—from designing producers and consumer flows to handling failures with DLQs and keeping warehouse databases in sync reliably.