September 13 -14, 2017 - Los Angeles, CA
Click Here For Information & Registration
Back To Schedule
Friday, September 15 • 4:50pm - 5:30pm
Streaming Data Pipelines on Apache Mesos: Lessons Learned - Dean Wampler, Ph.D., Lightbend

Sign up or log in to save this to your schedule, view media, leave feedback and see who's attending!

Lightbend Fast Data Platform (http://lightbend.com/fast-data-platform) is a suite of open-source streaming tools, including Kafka, Spark, Flink, Akka Streams, and Kafka Streams, running on Mesosphere DC/OS. Lightbend picked Mesos for its flexibility to support the diverse requirements of streaming and batch data processing, as well as other microservices typically required in production environments.

Dean will begin by describing the features of Mesos that were important for Lightbend's needs. He will illustrate the details of those features using examples from how the tools mentioned above work with Mesos, both for long-running daemons and per-job processes. Dean will share lessons learned running applications built with these tools on Mesos and he will conclude with thoughts about future developments and improvements.

avatar for Dean Wampler

Dean Wampler

Head of Developer Relations, Domino Data Lab
Principal Software Engineer at Domino Data Lab, where I work on various aspects of the Domino platform for data scientists. Author of O'Reilly's "Programming Scala", which has a third edition forthcoming with coverage of Scala 3.

Friday September 15, 2017 4:50pm - 5:30pm PDT
Diamond Salon 1 & 2