This article quickly describes how we handled the transit of external-generated customers events toward our internal Kafka cluster and how we built a reliable failover system using Flume-NG.

With Flume & FlumeNG, and a File channel, if you loose a broker node you will lose access to those events until you recover that disk.