Kafka vs a Message Queue: Why Events Stay After Reading

A queue deletes TripRequested once one worker takes it. The worker crashes. The fix: Reading does not delete. Retention does.

In this chapter

Keep the event after someone reads it

What breaks

A queue deletes TripRequested once one worker takes it. The worker crashes. The trip is gone, and pricing never saw it.

Three ways to respond

  • Add a second queue: Still deleted after one read. No replay.
  • Write it to a Kafka log: The event stays. Every reader keeps its own place. (the fix)
  • Let the phone retry: The app may create the trip twice.

The fix: Write it to a Kafka log

A queue gives each item to one worker, then forgets it. Kafka keeps events for a set time, and each consumer group remembers its own position (offset).

Remember: Reading does not delete. Retention does.

More on Basics problems

Keep learning

More courses

  • Jobs, linked to lessons — Browse jobs where every requirement links to the chapter that teaches it. See how ready you are, how long the gap takes to close, and which listings look stale.
  • Match a job post to courses — Paste a job post. Each skill is matched to a track here and put in learning order, foundations first.
  • React from open source with patterns — Patterns extracted from Material UI, Radix, React Aria, React Hook Form, Redux Toolkit, TanStack, and Next.js — not slides about hooks.
  • Database in depth — How a query becomes work. Indexes, isolation, locks, and the plans that explain why a page is slow — not an ORM tour.
  • System Design — Core concepts first (SQL vs NoSQL, CAP, indexing, replication, sharding), then designs grouped by what carries them: the database, Redis, Kafka, or many services.
  • Microservices — Microservice patterns one diagram at a time: how to split a monolith, how services talk, and how data stays consistent without distributed transactions.
  • Frontend system design — How a UI is sliced when it is a product, not a page: ownership of state, cache, routes, and what happens when the network lies.
  • TypeScript in depth — The type system as a design tool. Inference, narrowing, generics, and the errors that mean the model is wrong — not a catalog of utility types.
  • CSS in depth — See the box, then the page. Visual chapters from the box model through Flexbox surprises, Grid, selectors, and units, then backgrounds, shapes, and visual effects, each with a playground.
  • Accessibility — Foundations first (WCAG in plain words, semantic HTML, lists, alt text), then hands-on HTML labs, a full pass of WAI-ARIA 1.3, and a final fix-the-page challenge.
  • Docker — What an image is, why layers cache, and how containers find each other on a network.
  • Redis — Fifteen Redis patterns, one picture each: cache, session, lock, counter, rate limiter, queue, and when Redis is the wrong tool.