Introducing Tansu.io -- Rethinking Kafka for Lean Operations

QCon London 2026

Session Kafka

Introducing Tansu.io -- Rethinking Kafka for Lean Operations

Tuesday Mar 17 / 01:35PM GMT, Whittle (3rd Fl.) at The QEII Centre, London

Abstract

Tansu is an open-source, Apache Kafka®-compatible messaging broker designed to be simpler and more flexible than traditional Kafka clusters. It implements the Kafka protocol so Kafka clients and tools can work with it, but it’s built with stateless brokers and pluggable storage backends rather than relying on Kafka’s built-in replicated storage and consensus protocols.

Key Takeaways:

  • Kafka API compatible: Works with standard Kafka clients and tools (topic creation, producers, consumers).
  • Stateless brokers: Brokers don’t store persistent data themselves; they rely on external storage systems.
  • Pluggable storage engines: Supports storage in PostgreSQL, SQLite (libSQL), S3 (or S3-compatible), or in-memory for different use cases.
  • Schema validation: Messages can be validated against Avro, JSON, or Protocol Buffers schemas.
  • Open table format support: Can write topics directly into Apache Iceberg or Delta Lake formats for analytics pipelines.
  • Single binary & CLI: Distributed as one executable with command-line tools for managing topics and producing/consuming messages.
  • Simplicity: Designed to reduce operational complexity (no ZooKeeper/Raft, easy to deploy and scale) while enabling lightweight Kafka-compatible streaming.

In short, Tansu is like a lightweight, Kafka-compatible streaming platform built for simplicity, flexible storage, and modern data pipelines.

Topics

Kafka architecture Data stateless Rust
76% senior dev or higher
1:11 speaker ratio
60+ practitioners

QCon London 2026 is a three day conference for senior software engineers, architects and team leads. An international program committee of working engineers selects every session. Patterns and practices, not products and pitches.

Share

From the same track

Tuesday 17 March

10:35 Fleming (3rd Fl.) Session Generative AI Ontology‐Driven Observability: Building the E2E Knowledge Graph at Netflix Scale Prasanna Vijayanathan, Renzo Sanchez-Silva 11:45 Windsor (5th Fl.) Session Machine Learning Infrastructure From S3 to GPU in One Copy: Rethinking Data Loading for ML Training Onur Satici Staff Engineer @SpiralDB & a Core Maintainer of Vortex (LF AI & Data), Previously Building Distributed Systems @Palantir 13:35 Whittle (3rd Fl.) Session Kafka Introducing Tansu.io -- Rethinking Kafka for Lean Operations Peter Morgan Founder @tansu.io 14:45 Mountbatten (6th Fl.) Session AI/ML Chronon - Mixed-Workload Data Processing Framework Nikhil Simha Co-Founder & CTO @zipline.ai, Author of "Chronon Feature Platform", Previously @Airbnb, @Meta, and @Walmartlabs 15:55 Whittle (3rd Fl.) Session streaming The Rise of the Streamhouse: Idea, Trade-Offs, and Evolution Giannis Polyzos, Anton Borisov 17:05 Rutherford (4th Fl.) Event Connecting the Dots: Modern Data Engineering & Architectures (Limited Space - Registration Required)