In this video from the GOTO Chicago 2017 conference, Dean Wampler (Big Data Architect at Lightbend & O’Reilly Author) explains the streaming Data Architecture and helps to demonstrate the key features to consider when choosing which streaming products to utilize. He speaks about Apache Beam, Flink, Akka Streams, Kafka Streams and Apache Spark and addresses determining factors like latency and volume.
FLINK FORWARD Berlin, from September. Keynote from Xiaowei Jiang, Senior Director at Alibaba. “Bring Flink to Large Scale Production”
From PyData Amsterdam, April 2017. Giovanni Lanzani gives a talk on the Data Science Process and where things can go wrong.
Domino Data Labs recently made the Gartner 2017 Magic Quadrant for Data Science Platforms. Here, Domino’s Chief Data Scientist, Eduardo Arino de la Rubia, does a great job making the very complex easily understandable. Learn more about the platform…
Big data remains a rapidly evolving field with new applications and infrastructure appearing every year. In this talk, Matei Zaharia will cover new trends in 2016 / 2017 and how Apache Spark is moving to meet them. More
VIDEOs From the DataEngConf NYC in November. “Demystifying Deep Learning with Visualizations” (44 min) AND “Python Data Wrangling: Preparing for the Future” (37 min).
In this video, Tyler Akida presents a whirlwind tour of the evolution of massive-scale data processing at Google, from the original MapReduce paradigm to the high-level pipelines of Flume to the streaming approach of MillWheel to the portable, unified streaming/batch model of Google Cloud Dataflow and Apache Beam (incubating).
Tyler also highlights similarities and differences with related open source systems such as Flink, Spark, Storm, and Gearpump, calling out ways in which they’re converging on and diverging from the Beam model and what that means when running Beam pipelines on their respective runners. Watch Video
The 20th anniversary of the GOTO Copenhagen Conference took place last month. Two 50 Minute videos – Machine Learning and Deep Learning. READ MORE
Scala World 2016 took place in the UK in September – Here Martin Odersky, the creator of the Scala programming language gives the keynote. And link to other videos Read More
Video (33:41) with Databricks co-founder and CTO Matei Zaharia presenting the changes in Apache Spark 2.0 and the general availability (GA) of Databricks Community Edition at Spark Summit 2016. Afterwards, Michael Armbrust demos some new features found in Spark 2.0 on Databricks Community EditionGo To Video