How Not To Be Wrong by Winny de Jong.
From the post:
At the intersection of data and journalism, lots can go wrong. Merely taking precautions might not be enough.
“It’s very well possible that your story is true but wrong,” New York Times data journalist Robert Gebeloff explained at the European Investigative Journalism Conference & Dataharvest, which was recently held in Mechelen, a city 20 minutes outside of Brussels.
“When I work on a big story, I want to know everything about the topic.” To make sure he doesn’t miss out, Gebeloff gets all the data sources he can, examines it in all relevant ways and publishes only what he believes to be true.
…
The best part of this post is the distillation of Gebeloff’s presentation into a How Not To Be Wrong Checklist.
De Jong’s checklist is remarkably similar to requirements for replication of experiments in science.
It would make a great PDF file to share with data scientists in general.