Implementing the Batch Layer of Lambda Architecture

In the previous post, we implemented the first part of our system (Data collection and storage). In this post, we will implement the second part of our system, which is Batch Layer of Lambda Architecture. The Batch Processing of our

Introduction of Lambda Architecture

Lambda architecture is a data processing architecture introduced by Nathan Marz [1]. It takes the advantages of both batch processing and stream-processing to handle a large amount of data effectively. Lambda architecture consists of 3 layers: Batch layer, Speed layer,