Archive for the ‘Maps’ Category

Mapping the Blind Spots:…

Sunday, February 1st, 2015

Mapping the Blind Spots: Developer Unearths Secret U.S. Military Bases by Lorenzo Franceschi-Bicchierai.

From the post:

If you look closely enough on Google or Bing Maps, some places are blanked out, hidden from public view. Many of those places disguise secret or sensitive American military facilities.

The United States military has a foothold in every corner of the world, with military bases on every continent. It’s not even clear how many there are out there. The Pentagon says there are around 5,000 in total, and 598 in foreign countries, but those numbers are disputed by the media.

But how do these facilities look from above? To answer that question, you first need to locate the bases. Which, as it turns out, is relatively easy.

That’s what Josh Begley, a data artist, found out when he embarked on a project to map all known U.S. military bases around the world, collect satellite pictures of them using Google Maps and Bing Maps, and display them all online.

The project, which he warns is ongoing, was inspired by Trevor Paglen’s book “Blank Spots on the Map” which goes inside the world of secret military bases that are sometimes censored on maps.

A great description of how to combine public data to find information others prefer to not be found.

I suspect the area is well enough understood to make a great high school science fair project, particularly if countries that aren’t as open as the United States were used as targets for filling in the blank spaces. Would involve obtaining public maps for that country, determining what areas are “blank,” photo analysis of imagery, correlation with press and other reports.

Or detection of illegal cutting of forests, mining, or other ecological crimes. All of those are too large scale to be secret.

Better imagery is only a year or two away, perhaps sufficient to start tracking polluters who truck industrial wastes to particular states for dumping.

With satellite/drone imagery and enough eyes, no crime is secret.

The practices of illegal forestry, mining, pollution, virtually any large scale outdoor crime will wither under public surveillance.

That might not be a bad trade-off in terms of privacy.

So You’d Like To Make a Map Using Python

Friday, January 30th, 2015

So You’d Like To Make a Map Using Python by Stephan Hügel.

From the post:

Making thematic maps has traditionally been the preserve of a ‘proper’ GIS, such as ArcGIS or QGIS. While these tools make it easy to work with shapefiles, and expose a range of common everyday GIS operations, they aren’t particularly well-suited to exploratory data analysis. In short, if you need to obtain, reshape, and otherwise wrangle data before you use it to make a map, it’s easier to use a data analysis tool (such as Pandas), and couple it to a plotting library. This tutorial will be demonstrating the use of:

  • Pandas
  • Matplotlib
  • The matplotlib Basemap toolkit, for plotting 2D data on maps
  • Fiona, a Python interface to OGR
  • Shapely, for analyzing and manipulating planar geometric objects
  • Descartes, which turns said geometric objects into matplotlib “patches”
  • PySAL, a spatial analysis library

The approach I’m using here uses an interactive REPL (IPython Notebook) for data exploration and analysis, and the Descartes package to render individual polygons (in this case, wards in London) as matplotlib patches, before adding them to a matplotlib axes instance. I should stress that many of the plotting operations could be more quickly accomplished, but my aim here is to demonstrate how to precisely control certain operations, in order to achieve e.g. the precise line width, colour, alpha value or label position you want.

I didn’t catch this when it was originally published (2013) so you will probably have to update some of the specific package versions.

Still, this looks like an incredibly useful exercise.

Not just for learning Python and map creation but deeper knowledge about particular cities as well. On a good day I can find my way around the older parts of Rome from the Trevi Fountain but my knowledge fades pretty rapidly.

Creating a map using Python could help flesh out your knowledge of cities that are otherwise just names on the news. Isn’t that one of those quadruple learning environments? Geography + Cartography + Programming + Demographics? That’s how I would pitch it in any event.

I first saw this in a tweet by YHat, Inc.

Digital Cartography [84]

Thursday, January 22nd, 2015

Digital Cartography [84] by Visual Loop.

From the post:

Welcome to the year’s first edition of Digital Cartography, our weekly column where we feature the most recent interactive maps that came to our way. And being this the first issue of 2015, of course that it’s fully packed with more than 40 new interactive maps and cartographic-based narratives.

That means that you’ll need quite a bit of time to spend exploring these examples, but if that isn’t enough, there’s always the list with our 100 favorite interactive maps of 2014 (part one and two), guaranteed to keep you occupied for the next day or so.

…[M]ore than 40 new interactive maps and cartographic-based narratives.

How very cool!

With a couple of notable exceptions (see the article) mostly geography based mappings. There’s nothing wrong with geography based mappings but it makes me curious why there isn’t more diversity in mapping?

Just as a preliminary thought, could it be that geography gives us a common starting point for making ourselves understood? Rather than undertaking a burden of persuasion before we can induce someone to use the map?

From what little I have heard (intentionally) about #Gamergate, I would say a mapping of the people, attitudes, expressions of same and the various forums would vary significantly from person to person. If you did a non-geographic mapping of that event(?) (sorry, I don’t have more precise language to use), what would it look like? What major attitudes, factors, positions would you use to lay out the territory?

Personally I don’t find the lack of a common starting point all that troubling. If a map is extensive enough, it will surely intersect some areas of interest and a reader can start to work outwards from that intersection. They may or may not agree with what they find but it would have the advantage of not being snippet sized texts divorced from some over arching context.

A difficult mapping problem to be sure, one that poses far more difficulties than one that uses physical geography as a starting point. Would even an imperfect map be of use to those trying to sort though issues in such a case?

Mapping Boston’s Religions:…

Monday, January 5th, 2015

Mapping Boston’s Religions: Next Steps in Mapping U.S. Religious History by Lincoln Mullen.

From the first slide:

This conference paper and visualizations are to be delivered January 5, 2015, at the annual meeting of the American Society of Church History. It is part of a panel on “Mapping Religious Space: Four American Cities from the Colonial Era to the Twentieth Century.

The slides aren’t numbered but I think from slide 4:

My general argument is that there are large sources of data on American religion after the colonial period and before Word War II which historians have not used to make maps. Scholars have not passed over these sources because they are unaware of them, but because they could not meaningfully represent them in print maps. The problem is one of resolution. Print atlases could convey relatively few data points. Furthermore, because atlases can contain only so many maps, they have often been forced to set their chronological or geographic scope very large. By using these more detailed sources we are able to make maps which better approximate the sophisticated thinking about religious categories that we expect from our prose. These richer maps can tell us not just more, but more humanistic, things about religious history. To take advantage of these more comprehensive sources we need digital maps. To be sure, digital history has had more than its share of hubris, more than we have time to repent of today. But digital maps do offer the possibility for working at different scales, for displaying change over time, for integrating maps with our sources, and for crafting narratives with maps. While none of these advantages entirely solves with the problem of mapping humanistically, they do permit us to at least start to address these theoretical concerns.

Lowering the barriers and constraints on map making, such as the limitations and cost of print maps, is empowering new map makers, like Lincoln Mullen, to craft maps no one has attempted before. Where those maps will take us remains to be seen.

I first saw this in a tweet by Lincoln Mullen.

Making a Map with QGIS

Friday, January 2nd, 2015

Making a Map with QGIS by Fred Gibbs.

From the post:

Even if you have some experience with GIS in general and QGIS in particular, it’s always helpful to review the fundamentals. Read through “Introducing GIS”, “Vector Data”, and “Raster Data” from this gentle introduction to GIS.

If (= when), during your QGIS adventures, you get stuck or have questions, consult the QGIS Training Manual, the QGIS wiki, and an array of tutorials. You may not at first find exactly what you’re looking for, but it’s worth browsing through these sites to help better understand the software and prevent conceptual misunderstandings. Be aware that many tutorials are for older versions of QGIS, so the screen shots and menu labels may not match exactly what you see in your version–but often the concepts are the same.

Also, remember that Google searches are your friend. You’re not the first one to haul yourself up the learning curve of QGIS; many people have likely posted similar questions on forums where someone eventually provided a useful explanation. Others have written tutorials or blog posts that can shed more light on your issue. You won’t always find exactly what you need, but this kind of searching helps you better understand the tool and build your vocabulary for how to search and solve problems on your own.

If you think maps may not be relevant to issues of interest to you, consider the following passage:

The first thing to recognize when it comes to GIS software like QGIS is that it doesn’t display maps, it displays data (most of which will have strong geographic ties). You are in charge of composing the map you want from the relevant geographic and social data you’re interested in. This might sound annoying, but it’s actually incredibly powerful.

The second thing to recognize is that GIS tools are not only for projects centered on geographic analysis. Whether you’re thinking about people, commodities, ideas, political power, or whatever, these all have a grounding in space with various features (transportation networks like roads or railroads, political boundaries, access to natural resources, wealth disparity, demographic data, etc). While these features might not be a direct concern of yours, they can add extremely useful context to your research. Before easily accessible data and GIS software, the work to create maps for secondary research concerns far exceeded the benefit. The barrier now is far, far lower.

The last two sentences of the first paragraph:

You are in charge of composing the map you want from the relevant geographic and social data you’re interested in. This might sound annoying, but it’s actually incredibly powerful. (emphasis added)

are directly applicable to topic maps. If you are expecting to open most topic maps software and find a map for you, you are likely to be very disappointed.

The second paragraph, about maps not being limited to geographic analysis, comes to mind when you think about #blacklivesmatter, for instance. Where do most fatal police shootings happen, geographically speaking? It is one thing to “know” where they happen and quite another to have a map that graphically displays that knowledge. It is harder for others to dodge pointed questions if the data is presented in an open and persuasive manner.

Or if you want to do some data mining, where do most police stops occur for particular types of traffic violations? Or do that by time of day.

Or map all the petit jury pools by geographic location.

Rather hard for the establishment to argue with data it generated. Yes?

PS: If you are interested, I have suggestions on how a local neighborhood police watch could collect verifiable data on police patrols and their activities. Collate that to a map and other documents. Areas without regular patrols might stand out, areas with high levels of police activity, etc.

Mapbox: Innovating with Landsat

Friday, January 2nd, 2015

Mapbox: Innovating with Landsat by Larisa Serbina and Holly Miller.

From the post:

Mapbox* is a cloud-based map platform startup that creates custom maps with open source tools. The team at Mapbox consists of over fifty cartographers, data analysts and software engineers, located in Washington, D.C. and San Francisco, California. One of the open-source tools used by Mapbox is Landsat imagery. The company has a satellite team consisting of five employees dedicated to projects that use Landsat imagery to develop new products and enhance existing imagery.

Charlie Loyd, a member of the satellite team at Mapbox, points out that Landsat imagery is an integral part of the satellite base layer which is a vital part of the business. “There are more than 800 billion Landsat-derived pixels of land in our imagery. If we printed out just our Landsat-based world map at poster resolution, it would cover two acres,” says Loyd.

Internal estimates at Mapbox show that licensing commercial imagery equivalent to Landsat would cost $4 million per year for the base layer alone. The company would face costs beyond $4 million to produce the current cloudless basemap product, which requires more input pixels than output pixels. These costs would prohibit further development of medium-resolution products. “In other words,” Loyd notes, “we make goods with Landsat that otherwise would not get made.” An example of a cloudless map derived from Landsat is shown in Figure 1.

MapBox Figure 1.65 percent

Figure 1. Example of a cloudless image of the western states in the U.S., composed using Landsat. Courtesy of Mapbox.

A great example of government undertaking a task that is beyond the reach of any individual and most enterprises. A task that results in data that can be re-used by others for a multitude of purposes.

Kudos to Mapbox and the USGS (US Geological Survey)!

If you are not familiar with the resources available from the USGS (US Geological Survey), you are in for a real treat.

Turf: GIS for web maps

Thursday, December 25th, 2014

Turf: GIS for web maps by Morgan Herlocker.

From the post:

Turf is GIS for web maps. It’s a fast, compact, and open-source JavaScript library that implements the most common geospatial operations: buffering, contouring, triangular irregular networks (TINs), and more. Turf speaks GeoJSON natively, easily connects to Leaflet, and is now available as a Mapbox.js plugin on our cloud platform. We’re also working to integrate Turf into our offline products and next-generation map rendering tools.


(Population data from the US Census transformed in read-time into population isolines with turf-isoline.)

The image in the original post is interactive. Plus there are several other remarkable examples.

Turf is part of a new geospatial infrastructure. Unlike the ArcGIS API for JavaScript, Turf can run completely client-side for all operations, so web apps can work offline and sensitive information can be kept local. We’re constantly refining Turf’s performance. Recent research algorithms can make operations like clipping and buffering faster than ever, and as JavaScript engines like V8 continue to optimize, Turf will compete with native code.

Can you imagine how “Steal This Book” would have been different if Abbie Hoffman had access to technology such as this?

Would you like to try? ;-)

Cartographer: Interactive Maps for Data Exploration

Thursday, December 25th, 2014

Cartographer: Interactive Maps for Data Exploration by Lincoln Mullen.

From the webpage:

Cartographer provides interactive maps in R Markdown documents or at the R console. These maps are suitable for data exploration. This package is an R wrapper around Elijah Meeks’s d3-carto-map and d3.js, using htmlwidgets for R.

Cartographer is under very early development.

Data visualization enthusiasts should consider the screen shot used to illustrate use of the software.

What geographic assumptions are “cooked” in that display? Or are they?

Screenshot makes me think data “exploration” is quite misleading. As though data contains insights that are simply awaiting our arrival. On the contrary, we manipulate data until we create one or more patterns of interest to us.

Patterns of non-interest to us are called noise, gibberish, etc. That is to say there are no meaningful patterns aside from us choosing patterns as meaningful.

If data “exploration” is iffy, then so are data “mining” and data “visualization.” All three imply there is something inherent in the data to be found, mined or visualized. But, apart from us, those “somethings” are never manifest and two different people can find different “somethings” in the same data.

The different “somethings” implies to me that users of data play a creative role in finding, mining or visualizing data. A role that adds something to the data that wasn’t present before. I don’t know of a phrase that captures the creative interaction between a person and data. Do you?

In this particular case, the “cooked” in data isn’t quite that subtle. When I say “United States,” I don’t make a habit of including parts of Canada and a large portion of Mexico in that idea.

Map displays often have adjacent countries displayed for context but in this mapping, data values are assigned to points outside of the United State proper. Were the data values constructed on a different geographic basis than the designation of “United States?”

Our Favorite Maps of the Year Cover Everything From Bayous to Bullet Trains

Saturday, December 20th, 2014

Our Favorite Maps of the Year Cover Everything From Bayous to Bullet Trains by Greg Miller (Wired MapLab)

From the post:

What makes a great map? It depends, of course, on who’s doing the judging. Teh internetz loves a map with dazzling colors and a simple message, preferably related to some pop-culture phenomenon. Professional mapmakers love a map that’s aesthetically pleasing and based on solid principles of cartographic design.

We love maps that have a story to tell, the kind of maps where the more you look the more you see. Sometimes we fall for a map mostly because of the data behind it. Sometimes, we’re not ashamed to say, we love a map just for the way it looks. Here are some of the maps we came across this year that captivated us with their brains, their beauty, and in many cases, both.

First, check out the animated map below to see a day’s worth of air traffic over the UK, then toggle the arrow at top right to see the rest of the maps in fullscreen mode.

The “arrow at top right” refers to an arrow that appears when you mouse over the map of the United States at the top of the post. An impressive collection of maps!

For an even more impressive display of air traffic:

Bear in mind that there are approximately 93,000 flights per day, zero (0) of which are troubled by terrorists. The next time your leaders decry terrorism, do remember to ask where?

Mapazonia (Mapping the Amazon)

Saturday, December 20th, 2014

Mapazonia (Mapping the Amazon)

From the about page:

Mapazonia has the aim of improve the OSM data in the Amazon region, using satellite images to map roads and rivers geometry.

A detailed cartography will help many organizations that are working in the Amazon to accomplish their objectives. Together we can collaborate to look after the Amazon and its inhabitants.

The project was born as an initiative of the Latinamerican OpenStreetMap Community with the objective of go ahead with collaborative mapping of common areas and problems in the continent.

We use the Tasking Manager of the Humanitarian OpenStreetMap Team to define the areas where we are going to work. Furthermore we will organize mapathons to teach the persons how to use the tools of collaborative mapping.

Normally I am a big supporter of mapping and especially crowd-sourced mapping projects.

However, a goal of an improved mapping of the Amazon makes me wonder who benefits from such a map?

The local inhabitants have known their portions of the Amazon for centuries well enough for their purposes. So I don’t think they are going to benefit from such a map for their day to day activities.

Hmmm, hmmm, who else might benefit from such a map? I haven’t seen any discussion of that topic in the mailing list archives. There seems to be a great deal of enthusiasm for the project, which is a good thing, but little awareness of potential future uses.

Who uses maps of as of yet not well mapped places? Oil, logging, and mining companies, just to name of few of the more pernicious users of maps that come to mind.

To say that the depredations of such users will be checked by government regulations is a jest too cruel for laughter.

There is a valid reason why maps were historically considered as military secrets. One’s opponent could use them to better plan their attacks.

An accurate map of the Amazon will be putting the Amazon directly in the cross-hairs of multiple attackers, with no effective defenders in sight. The Amazon may become as polluted as some American waterways but being unmapped will delay that unhappy day.

I first saw this in a tweet by Alex Barth.

Making the most detailed tweet map ever

Saturday, December 6th, 2014

Making the most detailed tweet map ever by Eric Fisher.

From the post:

I’ve been tracking geotagged tweets from Twitter’s public API for the last three and a half years. There are about 10 million public geotagged tweets every day, which is about 120 per second, up from about 3 million a day when I first started watching. The accumulated history adds up to nearly three terabytes of compressed JSON and is growing by four gigabytes a day. And here is what those 6,341,973,478 tweets look like on a map, at any scale you want.

twitter map

[Static screenshot of a much cooler interactive map at original post.]

I’ve open sourced the tools I used to manipulate the data and did all the design work in Mapbox Studio. Here’s how you can make one like it yourself.

Eric gives a detailed account of how you can start tracking tweets on your own!

This rocks! If you use or adapt Eric’s code, be sure to give him a shout out in your code and/or documentation.

Periodic Table of Elements

Wednesday, December 3rd, 2014

Periodic Table of Elements

You will have to follow the link to get anything approaching the full impact of this interactive graphic.

Would be even more impressive if elements linked to locations with raw resources and current futures markets.

I first saw this in a tweet by Lauren Wolf.

PS: You could even say that each element symbol is a locus for gathering all available information about that element.

How to Make a Better Map—Using Neuroscience

Monday, November 24th, 2014

How to Make a Better Map—Using Neuroscience by Laura Bliss.

From the post:

The neuroscience of navigation has been big news lately. In September, Nobel Prizes went to the discoverers of place cells and grid cells, the neurons responsible for our mental maps and inner GPS. That’s on top of an ever-growing pile of fMRI research, where scientists connect regions of the brain to specific navigation processes.

But the more we learn about how our bodies steer from A to B, are cartographers and geographers listening up? Is the science of wayfinding finding its way into the actual maps we use?

It’s beginning to. CityLab spoke to three prominent geographers who are thinking about the perceptual, cognitive, and neurological processes that go on when a person picks up a web of lines and words and tries to use it—or, the emerging science of map-making.

The post tackles questions like:

How do users make inferences from the design elements on a map, and how can mapmakers work to make their maps more perceptually salient?

But her current research looks at not just how the brain correlates visual information with thematic relevance, but how different kinds of visualization actually affect decision-making.

“I’m not interested in mapping the human brain,” she says. “A brain area in itself is only interesting to me if it can tell me something about how someone is using a map. And people use maps really differently.”

Ready to put your map design on more than an ad hoc basis? No definite answers in Laura’s post but several pointers towards exploration yet to be done.

I first saw this in a tweet by Greg Miller.

Open Sourcing 3D City Reconstruction

Friday, November 14th, 2014

Open Sourcing 3D City Reconstruction by Jan Erik Solem.

From the post:

One of the downsides of using simple devices for mapping the world is that the GPS accuracy is not always great, especially in cities with tall buildings. Since the start we have always wanted to correct this using image matching and we are now making progress in that area.

The technique is called ‘Structure from Motion‘ (SfM) and means that you compute the relative camera positions and a 3D reconstruction of the environment using only the images.

We are now open sourcing our tools under the name OpenSfM and developing it in the open under a permissive BSD license. The project is intended to be a complete end-to-end easy-to-use SfM pipeline on top of OpenCV. We welcome all contributors, from industry and academia, to join the project. Driving this work inside Mapillary is Pau and Yubin.

Moving forward we are initially going to use this for improving the positioning and connection between Mapillary photos. Later, we are going to have an ever improving 3D reconstruction of every place on the planet too ;).

Are you ready to enhance your maps with 3D?

BTW, evidence that small vendors also support open source.

I first saw this in a tweet by Peter Neubauer.


Wednesday, November 12th, 2014


From the FAQ:

What is mapnik?

Mapnik is a Free Toolkit for developing mapping applications. It’s written in C++ and there are Python bindings to facilitate fast-paced agile development. It can comfortably be used for both desktop and web development, which was something I wanted from the beginning.

Mapnik is about making beautiful maps. It uses the AGG library and offers world class anti-aliasing rendering with subpixel accuracy for geographic data. It is written from scratch in modern C++ and doesn’t suffer from design decisions made a decade ago. When it comes to handling common software tasks such as memory management, filesystem access, regular expressions, parsing and so on, Mapnik doesn’t re-invent the wheel, but utilizes best of breed industry standard libraries from

Which platforms does it run on?

Mapnik is a cross platform toolkit that runs on Windows, Mac, and Linux (Since release 0.4). Users commonly run Mapnik on Mac >=10.4.x (both intel and PPC), as well as Debian/Ubuntu, Fedora, Centos, OpenSuse, and FreeBSD. If you run Mapnik on another Linux platform please add to the list on the Trac Wiki

What data formats are supported?

Mapnik uses a plugin architecture to read different datasources. Current plugins can read ESRI shapefiles, PostGIS, TIFF raster, OSM xml, Kismet, as well as all OGR/GDAL formats. More data access plug-ins will be available in the future. If you cannot wait and/or like coding in C++, why not write your own data access plug-in?

What are the plans for the future?

As always, there are lots of things in the pipeline. Sign up for the mapnik-users list or mapnik-devel list to join the community discussion.

Governments as well as NGOs need mapping applications.

What mapping application will you create? What data will it merge on the fly for your users?

I/O Problem @ OpenStreetMap France

Tuesday, November 11th, 2014

Benefit of data clustering for osm2pgsql/mapnik rending by Christian Quest.

The main server for OpenStreetMap France had an I/O problem:


See Christian’s post for the details but the essence of the solution was to cluster geographic data on the basis of its location. To reduce the amount of I/O. Not unlike randomly seeking topics with similar characteristics.

How much did clustering reduce the I/O?

OSM-FR stats

Nearly 100% I/O was reduced to 15% I/O. 85% improvement.

An 85% improvement in I/O doesn’t look bad on a weekly/monthly activity report!

Now imagine clustering topics for dynamic merging and presentation to a user. Among other things, you can have an “auditing” view that shows all the topics that will merge to form a single topic in a presentation view.

Or a “pay-per-view” view that uses a different cluster to reveal more information for paying customers.

All while retaining the capacity to produce a serialized static file as an information product.

An Open Platform (MapBox)

Saturday, November 8th, 2014

An Open Platform (Mapbox)

From the post:

When you hear the term web map, what comes to mind first? You might have thought of a road map – maps created to help you get from one place to another. However, there are many other types of maps that use the same mapping conventions.


Mapbox is built from open specifications to serve all types of maps, not just road maps. Open specifications solve specific problems so the solution is simple and direct.

This guide runs through all the open specifications Mapbox uses.

If you aren’t familiar with Mapbox, you need to correct that oversight.

There are Starter (free to start) and Basic ($5/month) plans, so it isn’t a burden to learn the basics.

Maps offer a familiar way to present information to users.

The Cartographer Who’s Transforming Map Design

Tuesday, October 21st, 2014

The Cartographer Who’s Transforming Map Design by Greg Miller.

From the post:

Cindy Brewer seemed to attract a small crowd everywhere she went at a recent cartography conference here. If she sat, students and colleagues milled around, waiting for a chance to talk to her. If she walked, a gaggle of people followed.

Brewer, who chairs the geography program at Penn State, is a popular figure in part because she has devoted much of her career to helping other people make better maps. By bringing research on visual perception to bear on design, Brewer says, cartographers can make maps that are more effective and more intuitive to understand. Many of the same lessons apply equally well to other types of data visualization.

Brewer’s best-known invention is a website called Color Brewer, which helps mapmakers pick a color scheme that’s well-suited for communicating the particular type of data they’re mapping. More recently she’s moved on to other cartographic design dilemmas, from picking fonts to deciding what features should change or disappear as the scale of a map changes (or zooms in and out, as non-cartographers would say). She’s currently helping the U.S. Geological Survey apply the lessons she’s learned from her research to redesign its huge collection of national topographic maps.

A must read if you want to improve the usefulness of your interfaces.

I say a “must read,” but this is just an overview of Cindy’s work.

A better starting place would be Cindy’s homepage at UPenn.

Twitter Mapping: Foundations

Sunday, October 12th, 2014

Twitter Mapping: Foundations by Simon Rogers.

From the post:

With more than 500 million tweets sent every day, Twitter data as a whole can seem huge and unimaginable, like cramming the contents of the Library of Congress into your living room.

One way of trying to make that big data understandable is by making it smaller and easier to handle by giving it context; by putting it on a map.

It’s something I do a lot—I’ve published over 1,000 maps in the past five years, mostly at Guardian Data. At Twitter, with 77% of users outside the US, it’s often aimed at seeing if regional variations can give us a global picture, an insight into the way a story spreads around the globe. Here’s what I’ve learned about using Twitter data on maps.

… (lots of really cool maps and links omitted)

Creating data visualizations is simpler now than it’s ever been, with a plethora of tools (free and paid) meaning that any journalist working in any newsroom can make a chart or a map in a matter of minutes. Because of time constraints, we often use CartoDB to animate maps of tweets over time. The process is straightforward—I’ve written a how-to guide on my blog that shows how to create an animated map of dots using the basic interface, and if the data is not too big it won’t cost you anything. CartoDB is also handy for other reasons: as it has access to Twitter data, you can use it to get the geotagged tweets too. And it’s not the only one: Trendsmap is a great way to see location of conversations over time.

Have you made a map with Twitter Data that tells a compelling story? Share it with us via @TwitterData.

While composing this post I looked at CartoDB solution for geotagged tweets and while impressive, it is currently in beta with a starting price of $300/month. Works if you get your expenses paid but a bit pricey for occasional use.

There is a free option for CartoDB (up to 50 MB of data) but I don’t think it includes the twitter capabilities.

Sample mapping tweets on your favorite issues. Maps are persuasive in ways that are not completely understood.

Making Your First Map

Saturday, October 11th, 2014

Making Your First Map from Mapbox.

From the webpage:

Regardless of your skill level, we have the tools that allow you to quickly build maps and share them online in minutes.

In this guide, we’ll cover the basics of our online tool, the Mapbox Editor, by creating a store location map for a bike shop.

A great example of the sort of authoring interface that is needed by topic maps.

Hmmm, by the way, did you notice that “…creating a store location map for a bike shop” is creating an association between the “bike shop” and a “street location?” True, Mapbox doesn’t include roles or the association type but the role players are present.

For a topic map authoring interface, you could default the role of location for any geographic point on the map and the association type to be “street-location.”

The user would only have to pick, possibly from a pick list, the role of the role player, bike shop, bar, etc.

Mapbox could have started their guide with a review of map projections, used and theoretical.

Or covered the basics of surveying and a brief overview of surveying instruments. They didn’t.

I think there is a lesson there.

The 100 Worst Landlords in New York City [Here Be Bastards]

Saturday, October 11th, 2014

The 100 Worst Landlords in New York City

A great illustration of the power of mapping to bring information together! (Like a topic map does.)

I don’t live in New York so the classes of violations (mis-named “details”) wasn’t helpful to me. Nor were the actual “details” of particular violations available. (If I am wrong on that, please post a response saying how to obtain the details via the map interface.)

Suggested Improvement: Names of owners as hyperlinks to their residences on a map with the notation “Here Be Bastards” (a riff off of the “Here Be Dragons” from early sea maps).

Super-Detailed Interactive 3-D Seafloor Map

Friday, October 10th, 2014

Super-Detailed Interactive 3-D Seafloor Map by Nick Stockton.

From the post:

This super-detailed map of the ocean floor’s topography is based on satellite measurements of subtle lumps on the ocean’s surface. These lumps of water, which are subtle, low, and wide on the ocean’s surface, are caused by the gravitational pull of underwater features like mountains and ridges. The team of scientists wrapped their data around a Google Earth globe, so you and I could explore it ourselves, in the visualization above.

The map has more than twice the resolution of previous seafloor maps, and shows a plethora of never-before-seen features. These include thousands of volcanoes and what could be the ridge where two plates pulled apart to create the Gulf of Mexico. The map is part of new research published last week in Science.

The visualization at the top of the page (click here for a full screen view) lets you play with the vertical exaggeration of both continental and subsea topography using the upper left drop-down menu. (They might seem huge to us at ground level, but the planet’s mountains and valleys are almost imperceptible from the vantage of space.) Another visualization of the study’s map lets you drag a time bar to simulate the movement of tectonic plates.

Great seafloor map and visualization techniques!

Read Nick’s post to get some background on “gravitational mapping.” In short, gravitational mapping relies on the impact of features of the seafloor on ocean height to create detailed seafloor maps.

Sounds like very interesting data sets with many discoveries left to be made.

A Guide To Who Hates Whom In The Middle East

Monday, September 15th, 2014

A Guide To Who Hates Whom In The Middle East by John Brown Lee.

John reviews an interactive visualization of players with an interest in the Middle East by David McCandless of Information is Beautiful.

The full interactive version of The Middle East Key players & notable relationships.

I would use this graphic with caution, mostly because if you select Jordan, it show no relationship to Israel. As you know, Jordan signed a peace agreement with Israel twenty years ago and Israel recently agreed to sell gas to Jordan’s state-owned National Electric Power Co.

Nor does it show any relationship between Turkey and the United States. At the very least, the United States and Turkey have a complicated relationship. Would you include the reported pettiness of Senator John McCain towards Turkey in an enhanced map?

Not to take anything away from a useful way to explore the web of relationships in the Middle East but more in the nature of a request for a fuller story.

Uncovering Hidden Text on a 500-Year-Old Map That Guided Columbus

Monday, September 15th, 2014

Uncovering Hidden Text on a 500-Year-Old Map That Guided Columbus by Greg Miller.

Martellus map

Christopher Columbus probably used the map above as he planned his first voyage across the Atlantic in 1492. It represents much of what Europeans knew about geography on the verge discovering the New World, and it’s packed with text historians would love to read—if only the faded paint and five centuries of wear and tear hadn’t rendered most of it illegible.

But that’s about to change. A team of researchers is using a technique called multispectral imaging to uncover the hidden text. They scanned the map last month at Yale University and expect to start extracting readable text in the next few months, says Chet Van Duzer, an independent map scholar who’s leading the project, which was funded by the National Endowment for the Humanities.

The map was made in or around 1491 by Henricus Martellus, a German cartographer working in Florence. It’s not known how many were made, but Yale owns the only surviving copy. It’s a big map, especially for its time: about 4 by 6.5 feet. “It’s a substantial map, meant to be hung on a wall,” Van Duzer said.

Extracting the text is going to take some effort but expectations are that high resolution images will appear at the Beinecke Digital Library at Yale in 2015.

Greg covers a number of differences between the Martellus map (1491) and the Waldseeüller map (1507), as well as their places in historical context.

You should pass this post onto any friends who think Columbus “discovered” the world was round. I don’t see any end of the world markers on the Martellus map.

Do you?

Why Use Google Maps When You Can Get GPS Directions On The Death Star Instead?

Saturday, September 13th, 2014

Why Use Google Maps When You Can Get GPS Directions On The Death Star Instead? by John Brownlee.

From the post:

Mapbox Studio is a toolkit that allows apps and websites to serve up their own custom-designed maps to users. Companies like Square, Pinterest, Foursquare, and Evernote con provide custom-skinned Mapboxes instead, changing map elements to better fit in with their brand.

But Mapbox can do far cooler stuff. It can blast you to Space Station Earth, a Mapbox that makes the entire planet look like the blinking, slate gray skin of the Star Wars Death Star.

Great if your target audience are Star Wars or similar science fiction fans or you can convince management that it will hold the attention of users longer.

Even routine tasks, like logging service calls answered, would be more enjoyable using an X-Wing fighter to destroy the location of the call after service has been completed. ;-)

First map of Rosetta’s comet

Saturday, September 13th, 2014

First map of Rosetta’s comet

From the webpage:

Scientists have found that the surface of comet 67P/Churyumov-Gerasimenko — the target of study for the European Space Agency’s Rosetta mission — can be divided into several regions, each characterized by different classes of features. High-resolution images of the comet reveal a unique, multifaceted world.

ESA’s Rosetta spacecraft arrived at its destination about a month ago and is currently accompanying the comet as it progresses on its route toward the inner solar system. Scientists have analyzed images of the comet’s surface taken by OSIRIS, Rosetta’s scientific imaging system, and defined several different regions, each of which has a distinctive physical appearance. This analysis provides the basis for a detailed scientific description of 67P’s surface. A map showing the comet’s various regions is available at:

“Never before have we seen a cometary surface in such detail,” says OSIRIS Principal Investigator Holger Sierks from the Max Planck Institute for Solar System Science (MPS) in Germany. In some of the images, one pixel corresponds to a scale of 30 inches (75 centimeters) on the nucleus. “It is a historic moment — we have an unprecedented resolution to map a comet,” he says.

The comet has areas dominated by cliffs, depressions, craters, boulders and even parallel grooves. While some of these areas appear to be quiet, others seem to be shaped by the comet’s activity, in which grains emitted from below the surface fall back to the ground in the nearby area.


The Rosetta mission:

Rosetta launched in 2004 and will arrive at comet 67P/Churyumov-Gerasimenko on 6 August. It will be the first mission in history to rendezvous with a comet, escort it as it orbits the Sun, and deploy a lander to its surface. Rosetta is an ESA mission with contributions from its member states and NASA. Rosetta’s Philae lander is provided by a consortium led by DLR, MPS, CNES and ASI.

Not to mention being your opportunity to watch semantic diversity develop from a known starting point.

Already the comet has two names: (1 67P/Churyumov-Gerasimenko and 2) Rosetta’s comet. Can you guess which one will be used in the popular press?

Surface features will be described in different languages, which have different terms for features and the processes that formed them. Not to mention that even within natural languages there can be diversity as well.

Semantic diversity is our natural state. Normalization is an abnormal state, perhaps that is why it is so elusive on a large scale.

Shoothill GaugeMap

Monday, September 8th, 2014

Shoothill GaugeMap

From the about page:

The Shoothill GaugeMap is the first interactive map with live river level data from over 2,400 Environment Agency and Natural Resources Wales river level gauges in England and Wales.

The extensive network of river level gauges across England and Wales covers all the major rivers as well as many smaller rivers, streams and brooks. The data displayed on each of the river level gauges on GaugeMap is recorded at 15 minute intervals by the Environment Agency and Natural Resources Wales.

For more information on how to use GaugeMap, please see the help file.

If you live in England or Wales and are concerned about potential flooding, this may be the map for you!

The map reports data from 2400 river level gauges and you can follow individual gauges via Twitter.

I first saw this in a tweet by Rod Plummer.

In case you are interested in other river gauge information: USA only but excludes most of Texas, Georgia, Florida, and most of the Eastern seaboard. Not sure why. Has historical and current data.

RiverApp USA and Europe, over 1,000 rivers. Can’t really comment since I don’t have a smart phone. (Contact me for an smail address if you want to donate a recent smart phone.)

Maps Published on GOV.UK

Tuesday, September 2nd, 2014

How to find all the maps published on GOV.UK by Giles Turnbull.

A “trick” you need to note for finding all the maps published on GOV.UK.

I don’t know of any comparable “trick” or even a single location for all the maps published by the United States government. If you were to include state and local governments, the problem would be even worse.

If you know of cross-agency map directories in the United States (or elsewhere), please sing out!


Complete Antarctic Map

Tuesday, August 19th, 2014

Waterloo makes public most complete Antarctic map for climate research

From the post:

The University of Waterloo has unveiled a new satellite image of Antarctica, and the imagery will help scientists all over the world gain new insight into the effects of climate change.

Thanks to a partnership between the Canadian Space Agency (CSA), MacDonald, Dettwiler and Associates Ltd. (MDA), the prime contractor for the RADARSAT-2 program, and the Canadian Cryospheric Information Network (CCIN) at UWaterloo, the mosaic is free and fully accessible to the academic world and the public.

Using Synthetic Aperture Radar with multiple polarization modes aboard the RADARSAT-2 satellite, the CSA collected more than 3,150 images of the continent in the autumn of 2008, comprising a single pole-to-coast map covering all of Antarctica. This is the first such map of the area since RADARSAT-1 created one in 1997.

You can access the data at: Polar Data Catalogue.

From the Catalogue homepage:

The Polar Data Catalogue is a database of metadata and data that describes, indexes, and provides access to diverse data sets generated by Arctic and Antarctic researchers. The metadata records follow ISO 19115 and Federal Geographic Data Committee (FGDC) standard formats to provide exchange with other data centres. The records cover a wide range of disciplines from natural sciences and policy, to health and social sciences. The PDC Geospatial Search tool is available to the public and researchers alike and allows searching data using a mapping interface and other parameters.

What data would you associate with such a map?

I first saw this at: Most complete Antarctic map for climate research made public.

Mapping Phone Calls

Tuesday, August 5th, 2014

Map: Every call Obama has made to a foreign leader in 2014 by Max Fisher.

From the post:

What foreign leaders has Obama spoken to this year? Reddit user nyshtick combed through official White House press releases to make this map showing every phone call Obama has made in 2014 to another head of state or head of government. The results are revealing, a great little window into the year in American foreign policy so far:

It’s a visual so you need to visit Max’s post to see the resulting world map.

I think you will be surprised.

There is another lesson lurking in the post.

The analysis did not require big data, distributed GPU compuations or category theory.

What it did require was:

  • An interesting question: “What foreign leaders has Obama spoken to this year?”
  • A likely data set: press releases
  • A user willing to dig through the data and to create a visualization.

Writing as much to myself as to anyone:

Don’t overlook smallish data with simple visualizations. (If you goal is impact and not the technology you used.)