Klout Search Powered by ElasticSearch, Scala, Play Framework and Akka
From the post:
At Klout, we love data and as Dave Mariani, Klout’s VP of Engineering, stated in his latest blog post, we’ve got lots of it! Klout currently uses Hadoop to crunch large volumes of data but what do we do with that data? You already know about the Klout score, but I want to talk about a new feature I’m extremely excited about — search!
Problem at Hand
I just want to start off by saying, search is hard! Yet, the requirements were pretty simple: we needed to create a robust solution that would allow us to search across all scored Klout users. Did I mention it had to be fast? Everyone likes to go fast! The problem is that 100 Million People have Klout (and that was this past September—an eternity in Social Media time) which means our search solution had to scale, scale horizontally.
Well, more of a “testimonial” as the Wizard of Oz would say but the numbers are serious enough to merit further investigation.
Although I must admit that social networking sites are spreading faster than, well, spreading faster that some social contagions.
Unless someone is joining multiple times for each one, for spamming purposes, I suspect some consolidation is in the not too distant future. What happens to all the links, etc., at the services that go away?
Just curious.