Scala By the Bay has ended
View analytic
Monday, August 17 • 4:20pm - 5:00pm
TSAR (the TimeSeries AggregatoR) - How to Count Tens of Billions of Daily Events in Real Time Using Open Source Technologies

Sign up or log in to save this to your schedule and see who's attending!

Twitter’s 250+ million users generate tens of billions of tweet views per day. Aggregating these events in real time – in a robust enough way to incorporate into our products – presents a massive scaling challenge. In this talk I’ll introduce TSAR (the TimeSeries AggregatoR), a robust, flexible, and scalable service for real-time event aggregation designed to solve this problem and a range of similar ones. I’ll discuss how we built TSAR using Python and Scala from the ground up, almost entirely on open-source technologies (Storm, Summingbird, Kafka, Aurora, and others), and describe some of the challenges we faced in scaling it to process tens of billions of events per day.

avatar for Anirudh Todi

Anirudh Todi

Software Engineering Manager, Twitter Inc
At Twitter, Anirudh works on the Data Platform team. Anirudh and his team are chartered with processing and understanding the vast body of data that is generated by the operation of the Twitter platform. Their technologies are used to build a range of cutting-edge services that can... Read More →

Monday August 17, 2015 4:20pm - 5:00pm
Track B

Attendees (0)