From the webpage:
Abstract algebra for Scala. This code is targeted at building aggregation systems (via Scalding or Storm). It was originally developed as part of Scalding’s Matrix API, where Matrices had values which are elements of Monoids, Groups, or Rings. Subsequently, it was clear that the code had broader application within Scalding and on other projects within Twitter.
Other links you will find helpful:
Programming Isn’t Math by Oscar Boykin.
From the description:
Functional programming has a rich history of drawing from mathematical theory, yet in this highly entertaining talk from the Northeast Scala Symposium, Twitter data scientist Oscar Boykin make the case that programming is distinct from mathematics. This distinction is healthy and does not mean we can’t leverage many results and concepts from mathematics.
As examples, Oscar will discuss some recent work — algebird, bijection, scalding — and show cases where mathematical purity were both helpful and harmful to developing products at Twitter.
The phrase “…highly entertaining…” may be an understatement.
The type of presentation where you want to starting reading new material during the presentation but you are afraid of missing the next gold nugget!
Definitely one to start the week on!
Twitter’s Scalding and Algebird: Matrix and Lighweight Algebra Library by Alex Popescu.
Alex points out:
- Scalding now includes a type-safe Matrix API
- In the familiar Fields API, we’ve added the ability to add type information to fields which allows scalding to pick up Ordering instances so that grouping on almost any scala collection becomes easy.
- Algebird is our lightweight abstract algebra library for Scala and is targeted for building aggregation systems (such as Storm).
Of the three, I am going to take a look at Algebird first.
Powered by WordPress