Producing avro-encoded Kafka messages in Python

This post will go into detail how we interact with Kafka using Python while enforcing schema. It will start by introducing you to schema, acritical concepts working with Kafka that developers new to Kafka often overlook. Producing messages that conforms to a schema and decoding them can be frustrating to get right so I hope this post will help anyone who uses Python to talk to Kafka

Read more

Kafka gotchas, out of order, delivery schematic … oh my!

In my first post, I’ve shown how simple Kafka is. Nevertheless, to be fast, durable and scalable, Kafka has made some design choices whose implications can be difficult for beginners to understand. This post aims to overview some kafka gotchas that I have come across and my approach in solving them

Read more

Introduction to Kafka in layman terms

Yes, you are reading yet another introduction to Kafka. Except, this time it comes from someone that have only worked with for the past two months. Since I’m new to Kafka, the confusion that I initially felt learning about Kafka is still vivid in my mind and I write this post to guide you through that

Read more