Realtime Data Pipeline with Docker and Mesos - Rahul Kumar, Sigmoid

No ratings

Presented at LinuxCon 2016 by

Rahul Kumar

Developing an end-to-end big Data application right from Data ingestion, Data enrichment, and visualisation is a very cumbersome task. In this talk, I will demonstrate how to use Apache Mesos, Marathon, Apache Spark and Docker to build a scalable, fault tolerant, responsive Data platform. This talk is a collection of different recipe’s that will help the developer to understand Mesos ecosystem projects and Docker.Choosing the right technologies and tools during the development phase has a major impact on the success of the whole project. Apache Mesos provides the best cluster management system, Marathon gives the feature for long-running Applications,Docker allows us to package an application with all of its dependencies into a standardized unit for software development.