Kafka

Engineering

How Lookups for Non-Existent Files Can Lead to Host Unresponsiveness

Late last year, we had an interesting problem occur with the Kafka clusters in our staging environment. Random hosts across several clusters started experiencing events...

Tamim Khan

12 min read

dentry, ebpf, kafka, lookups

Engineering

Writing Intelligent Health Checks for Kafka Services

Health checks are vital for maintaining resiliency and ensuring continuous operations of any system. In an ideal world, health checks should be able to detect...

Tanvir Pathan

8 min read

consul, event ingestion, health check, kafka

Engineering

Tracking Down an ETS-Related Memory Leak

ETS will hold references to large binaries, even if just part of the original binary is stored in a table. Copy binaries if pieces of...

Tyler Pachal

8 min read

elixir, ETS, kafka