End to end data pipeline implementation from scratch with Kafka Spark Streaming Integration - View it on GitHub