Introducing Pyleus: An Open-source Framework for Building Storm Topologies in Pure Python by Patrick L.
From the post:
Yelp loves Python, and we use it at scale to power our websites and process the huge amount of data we produce.
Pyleus is a new open-source framework that aims to do for Storm what mrjob, another open-source Yelp project, does for Hadoop: let developers process large amounts of data in pure Python and iterate quickly, spending more time solving business-related problems and less time concerned with the underlying platform.
First, a brief introduction to Storm. From the project’s website, “Apache Storm is a free and open source distributed realtime computation system. Storm makes it easy to reliably process unbounded streams of data, doing for realtime processing what Hadoop did for batch processing.”
A Pyleus topology consists of, at minimum, a YAML file describing the structure of the topology, declaring each component and how tuples flow between them. The pyleus command-line tool builds a self-contained Storm JAR which can be submitted to any Storm cluster.
…
Since the U.S. baseball league championships are over, something to occupy you over the weekend. 😉