Nanocubes: Fast Visualization of Large Spatiotemporal Datasets
From the webpage:
Nanocubes are a fast datastructure for in-memory data cubes developed at the Information Visualization department at AT&T Labs – Research. Nanocubes can be used to explore datasets with billions of elements at interactive rates in a web browser, and in some cases it uses sufficiently little memory that you can run a nanocube in a modern-day laptop.
Live Demos
You will need a web browser that supports WebGL. We have tested it on Chrome and Firefox, but ourselves use Chrome for development.
- Brightkite: 4.5M checkins from the BrightKite social network, from the SNAP repository
- Gowalla: 6.4M checkins from the Gowalla social network, from the SNAP repository
- ASA flights: 121M flight departures and arrivals from the 2009 ASA Data Expo
- Twitter: 210 million geo-located tweets collected over a one-year period.
- Twitter, Seattle: Higher-resolution crop around Seattle (here our source data runs into resolution limitations in longitude: use the “Coarser” button for nicer views).
- Twitter, Chicago: Higher-resolution crop around Chicago.
- Twitter, New York: Higher-resolution crop around New York.
People
Nanocubes were developed by Lauro Lins, Jim Klosowski and Carlos Scheidegger.
Paper
The research paper describing nanocubes has been conditionally accepted to VIS 2013. The manuscript is available for download.
Software
Currently, all nanocubes above are running on a single machine with 16GB of ram.
The main software component is an HTTP server written in C++ 11 that answers queries about the dataset it processed. We plan to release nanocubes as open-source software before the publication of the paper at IEEE VIS 2013. Stay tuned!
Important Data: VIS 2013 is 13 – 18 of October, 2013. Another 112 days according to the conference webpage. 😉
Run one or more of the demos.
Then start reading the paper.
Can subject sameness values be treated to the same aggregation within an error of margin technique? (Assuming you have subject sameness values that are not subject to Boolean tests.)
I first saw this in Nat Torkington’s Four short links: 20 June 2013.