Loading…
This event has ended. View the official site or create your own event → Check it out
This event has ended. Create your own
View analytic
Tuesday, August 18 • 10:20am - 10:50am
Interactive Spark in your Browser

Sign up or log in to save this to your schedule and see who's attending!

Supporting running Spark scripts directly from a browser would bring the user experience up. Indeed, everybody has a Web navigator, the command line can be avoided, built-in graphing and visualization make it easy to explore and understand data with just a few clicks. This also simplifies the administration as now everything becomes centralized in a service and is accessible by non native clients. For this purpose, an open source Spark Job Server was developed in order to provide Scala, SQL and Python in a Web shell. The main Hadoop components of the platform are also integrated in the same interface. This talk describes the architecture of the Spark Server and its main features: # Scala, Python, SQL submissions # Impersonation # Security # Job progress / canceling # YARN / HDFS / Hive integration The server also ships with a friendly user interface built as a Hue app. We will focus on explaining how they were built, how to use the API and which lessons were learned. The final end user interaction will be live demoed.

Speakers
avatar for Romain Rigaux

Romain Rigaux

Cloudera
Romain is an engineer at Cloudera and the Lead of Hue. Before he worked on distributed systems at Yahoo! and Google and has been building Web apps since the early days.
avatar for Erick Tryzelaar

Erick Tryzelaar

Erick Tryzelaar is a Software Engineer working on Hue. Before | Cloudera, he worked on the collaborative graph tool Dendrite at | In-Q-Tel/Lab41, Zynga's configuration management system, and Pixar's | render farm.


Tuesday August 18, 2015 10:20am - 10:50am
Track A

Attendees (16)