Video (33:41) with Databricks co-founder and CTO Matei Zaharia presenting the changes in Apache Spark 2.0 and the general availability (GA) of Databricks Community Edition at Spark Summit 2016. Afterwards, Michael Armbrust demos some new features found in Spark 2.0 on Databricks Community Edition
From Datanami with graphics!
Apache Spark Adoption by the Numbers
“It’s been about three years since Apache Spark burst onto the big data scene and became one of the hottest technologies on the planet. Judging by the numbers surrounding Spark’s adoption—including things like salaries, attendance, and committers–the future of Spark looks quite bright….
It’s safe to say that, if you’re a big data developer, you’re probably interested in Spark, among a number of other technologies. According to a recent survey by Syncsort, nearly 70% of respondents stated they’re most interested in Apache Spark, which surpassed interest in all other compute frameworks, including MapReduce, which had a 55% share of developer interest.“ Read More