devops

Distributed log analytics using Apache Kafka, Kafka Connect and Fluentd

Distributed log analytics using Apache Kafka, Kafka Connect and Fluentd

At Cloudbox Labs, we think logs is an incredibly interesting dataset. They are the heart beats of our tech stack. In this post we built a robust set of data infrastructure that can handle large volume of logs from all our applications, and allow for real time analytics as well as batch processing.