September 13 -14, 2017 - Los Angeles, CA
Click Here For Information & Registration
Back To Schedule
Friday, September 15 • 4:50pm - 5:30pm
Streaming Data Pipelines on Apache Mesos: Lessons Learned - Dean Wampler, Ph.D., Lightbend

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Lightbend Fast Data Platform (http://lightbend.com/fast-data-platform) is a suite of open-source streaming tools, including Kafka, Spark, Flink, Akka Streams, and Kafka Streams, running on Mesosphere DC/OS. Lightbend picked Mesos for its flexibility to support the diverse requirements of streaming and batch data processing, as well as other microservices typically required in production environments.

Dean will begin by describing the features of Mesos that were important for Lightbend's needs. He will illustrate the details of those features using examples from how the tools mentioned above work with Mesos, both for long-running daemons and per-job processes. Dean will share lessons learned running applications built with these tools on Mesos and he will conclude with thoughts about future developments and improvements.


Dean Wampler

Big Data Architect, Lightbend
Dean Wampler, Ph.D. (@deanwampler), is Vice President of Fast Data Engineering at Lightbend. He leads the development of Lightbend Fast Data Platform, a streaming data and microservices platform built on Lightbend Reactive Platform, Spark, Flink, Kafka, Mesosophere DC/OS, and other... Read More →

Friday September 15, 2017 4:50pm - 5:30pm
Diamond Salon 1 & 2

Attendees (32)