Announcing Spark 1.3! by Patrick Wendell.
From the post:
Today I’m excited to announce the general availability of Spark 1.3! Spark 1.3 introduces the widely anticipated DataFrame API, an evolution of Spark’s RDD abstraction designed to make crunching large datasets simple and fast. Spark 1.3 also boasts a large number of improvements across the stack, from Streaming, to ML, to SQL. The release has been posted today on the Apache Spark website.
We’ll be publishing in depth overview posts covering Spark’s new features over the coming weeks. Some of the salient features of this release are:
A new DataFrame API
…
Spark SQL Graduates from Alpha
…
Built-in Support for Spark Packages
…
Lower Level Kafka Support in Spark Streaming
…
New Algorithms in MLlib
See Patrick’s post and/or the release notes for full details!
BTW, Patrick promises more posts to follow covering Spark 1.3 in detail.
I first saw this in a tweet by Vidya.