In this tutorial series, we will learn the basic concepts of Apache Kafka and learn how to write a program that uses Kafka to publish and consume data. The integration of Kafka with Spark will be also discussed to help readers get the general idea of building a big data processing pipeline.

The full code of this tutorial series can be found on the Github of ITechSeeker at here.

November 9, 2018