Calling an external service from Kafka Streams: size the threads, budget every call
You have a Kafka Streams application, and one step needs an answer from somewhere else. It might be...
Tag archive
You have a Kafka Streams application, and one step needs an answer from somewhere else. It might be...
Kafka Streams divides its work into tasks over threads and instances. A thread keeps its share only by polling within max.poll.interval.ms, and a slow remote call strains that. The poll interval bounds a round of calls, not one call. A thread that had been fast is evicted at the defaults. A timeout on every call and a capped max.poll.records keep a thread in its group. Kafka Streams 4.2.0, measured, each run predicted before it ran.
You have Debezium streaming a database table into Kafka. Call it shipments: a row per parcel, with an...
Somebody owns the Kafka cluster you need, and it is not you. You have a topology in mind: read...
A typical Kafka console reads the cluster: topics, partitions, consumer groups, committed offsets,...

Spring's SpEL tokenizer is package-private. What it takes to build an editor on an evaluator: highlighting, completions, and errors a user can act on.

A Kafka Streams diagram shows the shape but not the logic. What changes when you draw the topology with the expressions inside, checked on real records.
We found this one the embarrassing way: a seeded demo stream sat inREBALANCING for a day. Not failing...

TL;DR Kafka Streams enables real-time stream processing inside applications using local...
Have you ever wondered how streaming giants like YouTube, Netflix or Amazon Prime suggest content...
Stream processing is the best way to work with event data. While batch processing still has its use...
![Reduce Rebalance Downtime (by x450) for Stateless Kafka Streams Apps [Simple Steps]](https://media2.dev.to/dynamic/image/width=1000,height=420,fit=cover,gravity=auto,format=auto/https%3A%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Farticles%2F3r2gpr1bojlha51dqadz.png)
In this post, we’ll learn how Kafka Streams Consumers behave differently from regular Kafka...