This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Tuesday, August 18 • 9:00am - 9:30am
Keynote IV: New Developments in Spark

Sign up or log in to save this to your schedule and see who's attending!

Spark has a simple and high-level API, but one thing this enables is making big changes inside the engine without affecting user code. Over the past year, our team has been working on some of the biggest changes to Spark since its creation, improving both its performance and usability and debuggability.

I plan to cover some of the latest updates to Spark, including Project Tungsten for off-heap memory management, I/O layer improvements, and new monitoring tools. I'll also discuss new APIs that allow even richer optimization.


Matei Zaharia

Matei is an assistant professor at MIT and CTO of Databricks, the company commercializing Apache Spark. He started Spark as a research project at UC Berkeley and has been involved in the big data community since 2007, through projects including Hadoop, Mesos and Shark.

Tuesday August 18, 2015 9:00am - 9:30am

Attendees (30)