Another Word For It Patrick Durusau on Topic Maps and Semantic Diversity

August 5, 2011

A Storm is coming: more details and plans for release

Filed under: NoSQL,Storm — Patrick Durusau @ 7:07 pm

A Storm is coming: more details and plans for release

Storm is going to be released at Strange Loop on September 19!

From the post:

Here’s a recap of the three broad use cases for Storm:

  1. Stream processing: Storm can be used to process a stream of new data and update databases in realtime. Unlike the standard approach of doing stream processing with a network of queues and workers, Storm is fault-tolerant and scalable.
  2. Continuous computation: Storm can do a continuous query and stream the results to clients in realtime. An example is streaming trending topics on Twitter into browsers. The browsers will have a realtime view on what the trending topics are as they happen.
  3. Distributed RPC: Storm can be used to parallelize an intense query on the fly. The idea is that your Storm topology is a distributed function that waits for invocation messages. When it receives an invocation, it computes the query and sends back the results. Examples of Distributed RPC are parallelizing search queries or doing set operations on large numbers of large sets.

The beauty of Storm is that it’s able to solve such a wide variety of use cases with just a simple set of primitives.

The really exciting part about all the current frenzy of development is imagining where it is going to be five (5) years from now.

No Comments

No comments yet.

RSS feed for comments on this post.

Sorry, the comment form is closed at this time.

Powered by WordPress