Tuning Tansu: 600,000 record/s with 13MB of RAM Writing 585 MB/s with just 13MB of memory usage.

Tansu surpassed 1k GitHub ⭐ over the weekend! I recently tuned the server writing to null storage. On my Mac Mini M4, Tansu processes 585MB/s using just 12MB of RSS memory! 🔥A #rustlang stateless Kafka broker with PostgreSQL, SQLite, S3 and in-memory storage.

blog.tansu.io/articles/per...

SQLite storage for Tansu Using SQLite as a storage engine with Tansu, a Kafka compatible streaming platform, producing and consuming Protobuf messages using generated test data.

SQLite (via libSQL) storage in Tansu an Apache Licensed Kafka compatible streaming platform written in 🦀. Turso also in early alpha. Avro/JSON/Protobuf schema validation. Also with PostgreSQL/S3 and Parquet, Iceberg and Delta Lake open table formats.

blog.tansu.io/articles/sup...

#rustlang

Route, Layer and Process Kafka Messages with Tansu Services Learn how Tansu uses the Service and Layer traits to route, layer and process Apache Kafka messages in a modular and composable way.

blog.tansu.io/articles/rou...

Smoke Testing with the Bash Automated Testing System 🦇 Tansu, a Kafka-compatible broker using S3 or PostgreSQL, undergoes automated smoke testing with GitHub workflows and BATS.

How we automated our final smoke test with GitHub workflows, Docker Compose, and BATS 🦇 for a smoother release process. Smarter testing, fewer headaches. 💡

blog.tansu.io/articles/gh-...

Using Tansu with Tigris on Fly In this article we deploy Tansu on Fly using Tigris Data S3 compatible storage.

Apache Kafka compatible 🦀 brokers that scale back to zero when quiescent on @fly.io with @tigrisdata.com storage. Stateless optimistic locking with conditional S3 writes 🚀.
🔗 ➡️ blog.tansu.io/articles/fly...

blog.tansu.io/articles/ser...

How we combine serde, quote, syn & proc_macro2 to map the Apache Kafka 3.9 JSON messages into Rust types to implement the Kafka protocol sans-io, with tests

#rustlang
#apachekafka

GitHub - tansu-io/tansu: A drop-in replacement for Apache Kafka with PostgreSQL and S3 storage engines written in 100% safe 🦺 async 🚀 Rust 🦀 A drop-in replacement for Apache Kafka with PostgreSQL and S3 storage engines written in 100% safe 🦺 async 🚀 Rust 🦀 - tansu-io/tansu

📢 Tansu 0.1.0 is a drop-in replacement for Apache Kafka with PostgreSQL, S3 or memory storage engines.
• 🆕 Transactions and Idempotent producers
• GNU AGPL
• 100% safe 🦺 async 🚀 Rust 🦀
• 30MB 🐳 image for ARM64/AMD64 😀

github.com/tansu-io/tansu

GitHub - tansu-io/tansu: A drop-in replacement for Apache Kafka with PostgreSQL and S3 storage engines written in 100% safe 🦺 async 🚀 Rust 🦀 A drop-in replacement for Apache Kafka with PostgreSQL and S3 storage engines written in 100% safe 🦺 async 🚀 Rust 🦀 - tansu-io/tansu

📢 Tansu 0.1.0 is a drop-in replacement for Apache Kafka with PostgreSQL, S3 or memory storage engines.

• No broker replication or duplicate data storage
• Every broker is the leader and ISR of any topic partition
• GNU AGPL

github.com/tansu-io/tansu