Another Word For It Patrick Durusau on Topic Maps and Semantic Diversity

September 10, 2015

14 innovative journalism courses…

Filed under: Journalism,News,Reporting — Patrick Durusau @ 7:49 pm

14 innovative journalism courses to follow this Fall by Aleszu Bajak.

From the post:

With classes back in session, we wanted to highlight a few forward-looking courses being taught at journalism schools across the country. But first, to introduce these syllabi, we recommend “Those Who Do, Also Teach: David Carr’s Gift to Journalism Schools,” by Molly Wright Steenson for Storybench. It’s a look at Carr’s inspiring syllabus, Press Play, and why it resonates today more than ever. Below, an excerpt from Carr’s syllabus:

While writing, shooting, and editing are often solitary activities, great work emerges in the spaces between people. We will be working in groups with peer and teacher edits. There will be a number of smaller assignments, but the goal is that you will leave here with a single piece of work that reflects your capabilities as a maker of media. But remember, evaluations will be based not just on your efforts, but on your ability to bring excellence out of the people around you.

So take a look at the following J-school courses. Check out Robert Hernandez’s experiments in VR journalism, Molly Wright Steenson’s exploration of information architecture and the media landscape, Dan Nguyen’s data reporting class, Catherine D’Ignazio’s projects melding civic art and design, and our own Jeff Howe’s media innovation studio at Northeastern University, among many others. You don’t have to be a journalism student to dig deep into the readings, try out some assignments, and learn something new.

If you get a thrill from discovering new information or mastering a new skill, you will have a field day with this course listing.

You want to follow Storybench, which self-describes as:

Storybench is a collaboration between the Media Innovation track at Northeastern University’s School of Journalism and Esquire magazine.

At Storybench, we want to reinvigorate and reimagine what digital journalism can be. This means providing an “under the hood” look at the latest and most inventive examples of digital creativity—from data visualization projects to interactive documentaries—as well as the tools and innovators behind them.

Whether you are a veteran newsroom editor, web designer, budding coder or journalism student, Storybench will help you learn what is being built and how, so you can find your way to what might be built next.

Storybench‘s editor is Aleszu Bajak, a science journalist and former Knight Science Journalism Fellow at MIT. He is an alum of Science Friday, the founder of LatinAmericanScience.org and is passionate about breaking down the divide between journalists, developers and designers. He can be reached at aleszubajak [at] gmail or at aleszu.com.

Enjoy!

August 28, 2015

Mass Shootings [Don’t] Fudg[e] The Numbers

Filed under: News,R,Reporting — Patrick Durusau @ 8:21 pm

Mass Shootings Are Horrifying Enough Without Fudging The Numbers by Bob Rudis (@hrbrmstr).

From the post:

Business Insider has a piece titled “We are now averaging more than one mass shooting per day in 2015”, with a lead paragraph of:

As of August 26th, the US has had 247 mass shootings in the 238 days of 2015.

They go on to say that the data they used in their analysis comes from the Mass Shootings Tracker. That site lists 249 incidents of mass shootings from January 1st to January 28th.

The problem is you can’t just use simple, inflammatory math to make the point about the shootings. A shooting did not occur every day. In fact, there were only 149 days with shootings. Let’s take a look at the data.

We’ll first verify that we are working with the same data that’s on the web site by actually grabbing the data from the web site:

Complete with R code and graphs to show days with multiple mass shootings on one day.

Be mindful that the Mass Shooting Tracker counts four (4) or more people being shot as a mass shooting. Under earlier definitions four (4) or more people had to be murdered for it to be a mass shooting.

BTW, there were ninety-one (91) days with no mass shootings this year. (so far)

August 19, 2015

4,000 Deep Web Links [but no AshleyMadison]

Filed under: Dark Data,News,Reporting — Patrick Durusau @ 9:44 am

4,000 Deep Web Links by Nikoloz Kokhreidze.

This listing was generated in early June, 2015, so it doesn’t include the most recent AshleyMadison data dump.

Apparently an authentic (according to some commentators) data dump from AshleyMadison was posted yesterday but I haven’t been able to find a report with an address for the dump.

One commentator, with a major technical site, sniffed that the dump was news but:

I’m not really interested in actively outing anyone’s private information

What a twit!

Why should I take even the New York Times’ word for the contents of the dump when the data should be searchable by anyone?

It maybe that N number of email addresses end in .mil but how many end in nyimes.com? Unlikely to see that reported in the New York Times. Yes?

Summarizing data and attempting to persuade me your summary is both useful and accurate is great. Saves me the time and trouble of wrangling the data.

However, the raw data that you have summarized should be available for verification by others. That applies to data held by Wikileaks, the New York Times or any government.

The history of government and corporate leaks has one overriding lesson: Deception is universal.

Suggested motto for data geeks:

In God We Trust, All Others Must Provide Raw Data.

PS: A good place to start touring the Deep/Dark Web: http://7g5bqm7htspqauum.onion/ – The Hidden Wiki (requires Tor for access).

August 17, 2015

101 webscraping and research tasks for the data journalist

Filed under: Journalism,News,Python,Reporting,Web Scrapers — Patrick Durusau @ 4:56 pm

101 webscraping and research tasks for the data journalist by Dan Nguyen.

From the webpage:

This repository contains 101 Web data-collection tasks in Python 3 that I assigned to my Computational Journalism class in Spring 2015 to give them regular exercise in programming and conducting research, and to expose them to the variety of data published online.

The hard part of many of these tasks is researching and finding the actual data source. The scripts need only concern itself with fetching the data and printing the answer in the least painful way possible. Since the Computational Journalism class wasn’t intended to be an actual programming class, adherence to idioms and best codes practices was not emphasized…(especially since I’m new to Python myself!)

Too good of an idea to not steal! Practical and immediate results, introduction to coding, etc.

What 101 tasks do you want to document and with what tool?

PS: The Computational Journalism class site has a nice set of online references for Python.

August 9, 2015

User-generated content can traumatize journalists… [And the Problem Is?]

Filed under: Journalism,News,Reporting — Patrick Durusau @ 4:38 pm

User-generated content can traumatize journalists who work with it — a new project aims to help by Laura Hazard Owen.

From the post:

Journalists and human rights workers who work with troubling user-generated content as part of their jobs may experience vicarious trauma as a result of handling distressing content. A new research project aims to help by surveying and interviewing such workers and developing a set of best practices for news and humanitarian organizations.

Nonprofit think-tank Eyewitness Media Hub is running the project with backing from the Open Society Foundation. EMH was founded in 2014 by former Tow fellows Sam Dubberley, Pete Brown, and Claire Wardle, who had previously researched how broadcasters use user-generated content (UGC) in their news output, along with Jenni Sargent.

“A lot of research so far has [questioned whether] vicarious trauma is something that exists,” said Dubberley. “We’re starting from the premise that it does exist, and would like to understand what organizations are doing about it, and how people who are using it on a day-to-day basis feel about it.” As head of the Eurovision News Exchange, he said, “I had a team of 20 journalists sourcing content from Syria and the Arab Spring through YouTube and saw them being impacted by it, quite seriously.”

I am quite mystified as to why news content traumatizing journalist or members of the general pubic is a problem?

If we could vicariously experience the horrors that are financed by the United States government and others, literally be retching from fear of the next newspaper, radio broadcast or cable news broadcast, wouldn’t that be a good thing?

If anything, reporters need to take the gloves off and record death rattles, people screaming in agony, calling for death, while identifying the forces that were responsible.

One wonders how may heroes parades would happen if the streets were lined the photos of their victims, pulsing with audio of the last moments of their lives.

How proud would you feel to have butchered innocent women and children in service of your country?

Let’s bring the reality of war back to the evening dinner table. It helped end Viet-Nam. Perhaps it could help end some of the current cycle of madness.

July 21, 2015

Top Ten #ddj

Filed under: Journalism,News,Reporting — Patrick Durusau @ 4:41 pm

Top Ten #ddj: The Week’s Most Popular Data Journalism Links

From the post:

What’s the data-driven journalism crowd tweeting? Here are the top ten links for July 9 to 16: +300 sites with free geographic datasets (@sciremotesense); graphing German YouTube (@SPIEGELOLINE); Australia’s mining footprint (@ICIJorg); democratizing data (OKFN); and more.

Enjoy!

July 15, 2015

+300 Latin American Investigations

Filed under: Journalism,News,Reporting — Patrick Durusau @ 2:19 pm

Database Launched with +300 Latin American Investigations by Gabriela Manuli.

A unique database of more than 300 investigative journalism reports from across Latin America is now available from The Institute for Press and Society (Instituto Prensa y Sociedad, or IPYS). Called BIPYS (Banco de Investigaciones Periodísticas, or Bank of Investigative Journalism) the UNESCO-backed initiative was announced July 6 at the annual conference of Abraji, Brazil’s investigative journalism association.

BIPYS is a repository of many of the best examples of investigative journalism in the region, comprised largely of winners of the annual Latin American Investigative Journalism Awards that IPYS and Transparency International have given out for the past 13 years.

Investigations cover a wide range of topics, including corruption, malfeasance, organized crime, environment, national security, and human rights.

See Gabriela’s post for more but in summary the site is still under development and fees being discussed.

An admirable effort considering that words in Latin American can and do have real consequences.

Unlike some places where disagreement can be quite heated but when the broadcast ends, the participants slip away for drinks together. Meanwhile, the subjects of their disagreement continue to struggle and die due to policy decisions made far, far away.

July 13, 2015

Building News Apps Quickly?

Filed under: Journalism,News,Reporting — Patrick Durusau @ 5:55 pm

Want to make it easier to build news apps quickly? Vox Media has opensourced its solution, Autotune by Justin Ellis.

From the post:

Making a beautiful app for news is great; making a beautiful reusable app for news is better. At least that’s the thinking behind a new project released by Vox Media today: Autotune is a system meant to simplify the creation and duplication of things like data visualizations, graphics, or games.

Autotune was designed by members of the Vox Media product team to cut down on the repetitive work of taking one project — say, a an image slider — and making it easy to use elsewhere. It’s “a centralized management system for your charts, graphics, quizzes and other tools, brought to you by the Editorial Products team at Vox Media,” according to the project’s GitHub page. And, yes, that means Autotune is open source.

Sounds like a great project but I will have to get a cellphone to pass judgement on apps. 😉 I would have to get a Farraday cage to keep it in when not testing apps.

July 8, 2015

The Mote in Your Neighbor’s Eye

Filed under: Journalism,News,Reporting — Patrick Durusau @ 2:42 pm

The Washington Post featured this headline recently: Russia is seeing conspiracies in Armenia where none exist.

So, given the past decade of false terror warnings from the FBI and the Department of Homeland Security, as reported by Adam Johnson in FBI and Media Still Addicted to Ginning Up Terrorist Hysteria – But They Have Never Been Right, why hasn’t the Washington Post ran the headline:

USA is seeing terrorists where none exist

How does that go? Maybe the Washington Post should take the plank out of its eye so it can see more clearly the world around it.

PS: Will there be a terrorist attack in the United States someday? Sure, but warning about them for hundreds if not thousands of days in between demonstrates a lack of good judgement.

July 6, 2015

Twelve Tips for Getting Started With Data Journalism

Filed under: Journalism,News,Reporting — Patrick Durusau @ 8:24 pm

Twelve Tips for Getting Started With Data Journalism by Nils Mulvad and Helena Bengtsson.

No mention of Python or R, no instructions for No-SQL or SQL databases, no data cleaning exercises, and yet probably the best advice you will find for data journalism (or data science for that matter).

The essential insight of these twelve tips are that the meaning of the data, which implies answering “why does this matter?,” is the task of data journalism/science.

Anyone with sufficient help can generate graphs, produce charts, apply statistical techniques to data sets, but if it is all just technique, no one is going to care.

The twelve tips offered here are good for a daily read with your morning coffee!

Highly recommended!

Our Uncritical National Media

Filed under: Journalism,News,Reporting — Patrick Durusau @ 2:38 pm

FBI and Media Still Addicted to Ginning Up Terrorist Hysteria – But They Have Never Been Right by Adam Johnson is a stunning indictment of our national media as “uncritical” of goverment terrorist warnings.

I say “uncritical” because despite forty (40) false terrorist warning in a row, there has been no, repeat no terrorist attack in the United States related to those warnings. Not one.

The national media, say the New York Times of my youth, would have “broke” the news of a terrorist warning, but then it would have sought information to verify that warning. That is why is the government issuing a warning today and not yesterday, or next week?

Failing to find such evidence, which it would have in the past forty (40) cases, it would have pressed, investigated and mocked the government until its thin tissue of lies were plain for all to see.

How many times does a government source have to misrepresent facts before your report starts with:

Just in from the habitual liars at the Department of Homeland Security…

and includes a back story on how the Department of Homeland Security has never been right on one of its warnings, nor has its Transportation Safety Administration (TSA) ever caught a terrorist.

Instead, as Adam reports, this is what we get:

On Monday, several mainstream media outlets repeated the latest press release by the FBI that country was under a new “heightened terror alert” from “ISIL-inspired attacks” “leading up to the July 4th weekend.” One of the more sensational outlets, CNN, led with the breathless warning on several of its cable programs, complete with a special report by The Lead’s Jim Sciutto in primetime:

The threat was given extra credence when former CIA director—and consultant at DC PR firm Beacon Global Strategies—Michael Morell went on CBS This Morning (6/29/15) and scared the ever-living bejesus out of everyone by saying he “wouldn’t be surprised if we were sitting [in the studio] next week discussing an attack on the US.” The first piece of evidence Morell used to justify his apocalyptic posture, the “50 ISIS arrests,” was accompanied by a scary map on the CBS jumbotron showing “ISIS arrests” all throughout the US:

But one key detail is missing from this graphic: None of these “ISIS arrests” involved any actual members of ISIS, only members of the FBI—and their network of informants—posing as such. (The one exception being the man arrested in Arizona, who, while having no contact with ISIS, was also not prompted by the FBI.) So even if one thinks the threat of “lone wolf” attacks is a serious one, it cannot be said these are really “ISIS arrests.” Perhaps on some meta-level, it shows an increase of “radicalization,” but it’s impossible to distinguish between this and simply more aggressive sting operations by the FBI.

I would think that competent, enterprising reporters could have ferreted out all the material that Adam mentions in his post. They could have make the case for the groundless nature of the 4th of July security warning.

But no member of the national media did.

In the aftermath of yet another bogus terror warning, the national media should say why it dons pom-poms to promote every terror alert from the FBI or DHS, instead of serving the public’s interest with critical investigation of alleged terror threats.

July 4, 2015

Islamic State (use the correct name)

Filed under: Journalism,News,Reporting — Patrick Durusau @ 8:37 am

Hall: BBC will not call IS ‘Daesh’

From the post:

According to The Times, the director general has said that the broadcaster will not adopt the name ‘Daesh’ in place of IS as it was a ‘pejorative’ label used by enemies of the group, including Assad supporters in Syria.

Use of the name could be interpreted as support for those enemies, thereby damaging the BBC’s impartiality, the DG reasoned in his response to an open letter from 120 cross-party MPs.

In an age when media outlets self-censor themselves at the hint of government displeasure, Tony Hall‘s stand is a refreshing one.

The group calls itself, Islamic State and who better to know their name?

Reporters, bloggers and anyone who cares about non-partisan reporting (note, I did not say objective) should use the name, Islamic State in English language publications.

Feel free to use other terms, such as extremist, militant, terrorist, so long as you apply them equally to everyone. If you label one attack on a social gathering as a “terrorist attack,” then all attacks on social gatherings should be terrorist attacks. A car bomb is just as indiscriminate as a cruise missile or “smart” bomb.

Suggestion: Reporting on the Islamic State would be more balanced, if the Islamic State assisted journalists in seeing the results of attacks against it. It is hard for a Western public to understand civilians casualties other than through the lens of Western media.

July 3, 2015

The Best of SRCCON

Filed under: Journalism,News,Reporting — Patrick Durusau @ 4:05 pm

Here are the best links, resources, and roundups from SRCCON, the conference for journalism code by Laura Hazard Owen.

From the post:

Business casual, bad coffee, dry prewritten speeches, and an 8 a.m. start with no time between sessions — these things are familiar to anyone who’s ever been to a conference. SRCCON (pronounced “Source-Con”), organized by Knight-Mozilla OpenNews and held over two days last week in Minneapolis, aims to avoid the bad conference stereotypes and offer, instead, interactive discussions about “the challenges that news technology and data teams encounter every day.”

There was an NPR-sponsored coffee station run by Manual Coffeemaker No. 1’s Craighton Berman, handcrafting individual cups of pour-over. There was on-site, full-day childcare included in the price of admission. There was local beer, non-alcoholic beer, halal meals for Ramadan, and unisex bathrooms. (There is a flip side to all this inclusiveness: SRCCON’s celebration of nerdery can feel as intimidating at first as the celebration of any other group identity that you don’t totally identify with.) The start time was 10 a.m. the first day and 11 a.m. the second. And with over 50 sessions, the conference’s 220 attendees discussed topics from ad viewability and machine learning to journalist burnout and remote work.

If that sounds cool to you, you are really going to like the collection of links to notes, slides and other resources that Laura has collected for SRCCON 2015.

Not to mention having you looking forward to SRCCON 2016, while you are developing your abilities with source code.

July 1, 2015

One Million Contributors to the Huffington Post

Filed under: Indexing,Journalism,News,Reporting,Searching — Patrick Durusau @ 2:53 pm

Arianna Huffington’s next million mark by Ken Doctor.

From the post:

Before the end of this year, HuffPost will release new tech and a new app, opening the floodgates for contributors. The goal: Add 900,000 contributors to Huffington Post’s 100,000 current ones. Yes, one million in total.

How fast would Arianna like that to get that number?

“One day,” she joked, as we discussed her latest project, code-named Donatello for the Renaissance sculptor. Lots of people got to be Huffington Post contributors through Arianna Huffington. They’d meet her at book signing, send an email and find themselves hooked up. “It’s one of my favorite things,” she told me Thursday. Now, though, that kind of retail recruitment may be a vestige.

“It’s been an essential part of our DNA,” she said, talking about the user contributions that once seemed to outnumber the A.P. stories and smaller original news staff’s work. “We’ve always been a hybrid platform,” a mix of pros and contributors.

So what enables the new strategy? Technology, naturally.

HuffPost’s new content management system is now being extended to work as a self-publishing platform as well. It will allow contributors to post directly from their smartphones, and add in video. Behind the scenes, a streamlined approval system is intended to reduce human (editor) intervention. Get approved once, then publish away, “while preserving the quality,” Huffington added.

Adding another 900,000 contributors to the Huffington Post is going to bump their content production substantially.

So, here’s the question: Searching the Huffington Post site is as bad as most other media sites. What is adding content from another 900,000 contributors going to do for that experience? Get worse? That’s my first bet.

On the other hand, what if authors can unknowingly create topic maps? For example, auto-tagging offers Wikipedia links (one or more) for an entity in a story, for relationships, a drop down menu with roles for the major relationship types (slept-with being available for inside the Beltway), with auto-generated relationships to the author, events mentioned, other content at the Huffington Post.

Don’t solve the indexing/search problem after the fact, create smarter data up front. Promote the content with better tagging and relationships. With 1 million unpaid contributors trying to get their contributions noticed, a win-win situation.

June 29, 2015

BBC News Labs (and other news labs)

Filed under: Journalism,News,Reporting — Patrick Durusau @ 10:47 am

BBC News Labs

I saw a tweet from the BBC News Labs saying:

We were News labs before it was cool.

cc @googlenewslab

Which was followed by this lively exchange:

bbc-labs

From the about page:

This Jekyll-powered blog is pitched at interested Journalists, Technologists and Hacker Journalists, and provides regular updates on News Labs' activities.

We hope it will open new opportunities for collaborative work, by attracting attention from like-minded people in this space.

You can still find our major updates pitched at a broader audience here on the BBC Internet Blog.

About BBC News Labs

BBC News Labs is an incubator powered by BBC Connected Studio, and is charged with driving innovation for BBC News.

Our M.O.

We work as a multi-discipline incubator, exploring scalable opportunities at the intersection of:

  1. Journalism
  2. Technology
  3. Data

Our goals

  1. Harness BBC talent & creativity to drive Innovation
  2. Open new opportunities for Story-driven Journalism
  3. Support Innovation Transfer into Production
  4. Drive open standards through News Industry collaboration
  5. Raise BBC News’ Profile as an Innovator

You can find out more on the BBC News Labs corporate website here

Get in touch

We'd be delighted to hear from you or to see if you can contribute to one of our projects. Give us a shout at:

News Labs Links

For your Twitter following pleasure, news labs mentioned in this post:

@BBC_News_Labs

@dpa_newslab

@DroneJLab

@FTLabs

@googlenewslab

@knightlab

Other news labs that should be added to this list?

PS: I would include @Journalism2ls. – Journalism Tools in a more general list.


Update: @NeimanLab: Nieman Journalism Lab at Harvard.

June 28, 2015

The Week’s Most Popular Data Journalism Links [June 22nd]

Filed under: Journalism,News,Reporting,Visualization — Patrick Durusau @ 2:49 pm

Top Ten #ddj: The Week’s Most Popular Data Journalism Links by GIJN Staff and Connected Action.

From the post:

What’s the data-driven journalism crowd tweeting? Here are the Top Ten links for Jun 11-18: mapping global tax evasion (@grandjeanmartin), vote for best data journalism site (@GENinnovate); data viz examples (@visualoop, @OKFN), data retention (@Frontal21) and more.

A number of compelling visualizations and in particular: SwissLeaks: the map of the globalized tax evasion. Imaginative visualization of countries but not with the typical global map.

A great first step but I don’t find country level visualizations (or agency level accountability) all that compelling. There is $X amount of tax avoidance in country Y but that lacks the impact of naming the people who are evading the taxes, perhaps along with a photo for the society pages and their current location.

BTW, you should start following #ddj on Twitter.

June 20, 2015

Introducing the Witness Media Lab

Filed under: Journalism,News,Reporting — Patrick Durusau @ 4:34 pm

Introducing the Witness Media Lab

From the webpage:

We are pleased to announce our newest initiative: the WITNESS Media Lab. The project is dedicated to unleashing the potential of eyewitness video as a powerful tool to report, monitor, and advocate for human rights.

In collaboration with the News Lab at Google, and continuing the work of its predecessor, the Human Rights Channel on YouTube, the WITNESS Media Lab will address the challenges of finding, verifying, and contextualizing eyewitness videos for the purpose of creating lasting change.

The WITNESS Media Lab will focus on one issue for a few months at a time, using new tools, strategies and platforms for research, verification and contextualization of citizen video. We will share analysis and resources publicly online via case studies, blog articles, multimedia presentations and through in-person convenings with peers. The first project will look at several cases of eyewitness video of police violence in the United States.

“We’re incredibly encouraged by the growing capacity of people everywhere to capture video of human rights abuses in their communities. We’re also aware of the critical need for skills to harness the potential of those videos, in order to turn them into tools for justice,” said Madeleine Bair, Program Manager for the WITNESS Media Lab.

Drawing on more than two decades of supporting people to use video for human rights advocacy, the WITNESS Media Lab will leverage the organization’s in-house expertise as well as that of our extensive peer networks in the fields of advocacy, technology, and journalism. Together with them, the WITNESS Media Lab will seek to develop solutions to ensure that footage taken by average citizens can impact some of the world’s most pressing and persistent injustices.

“Videos depicting human rights abuses on YouTube can be an incredibly powerful tool to expose injustice, but context is critical to ensuring they have maximum impact,” said Steve Grove of the News Lab at Google. “We’re thrilled that WITNESS is bringing their deep expertise to this space in the WITNESS Media Lab, and we are honored to be partnering with them.”

For more details visit us at WITNESS Media Lab website and follow us @WITNESS_Lab. And YouTube published an announcement today detailing their support of the WITNESS Media Lab and a two other projects focused on the power of citizen video.

Press inquiries and requests for interviews should be directed to Matisse Bustos-Hawkes at WITNESS via our press kit or on Twitter @matissebh.

If “What Witness Learned in Our Three Years Curating Human Rights Videos on Youtube,” is indicative of the work to expect from the Witness Media Lab, the Lab will be a welcome resource.

The “What Witness Learned..” is a quick introduction to some principal issues surrounding videos, such as “Verification is a Spectrum,” “Context is Key,” “New Platforms for Sharing Videos,” and, “Persistent Challenges (language, vicarious trauma, impact).”

Not in depth coverage of any of those issues but enough to give would be creators of eyewitness videos or those seeking to distribute or use them pause for reflection.

Don’t miss the Witness Resources page! A treasure trove of videos, training materials, an archive of 4,000 hours of videos from human rights defenders and other materials.

Remember that the authenticity of the image of Phan Thi Kim Phuc was questioned by then President Nixon and the New York Times published it after cropping out the media reporter on the right. To avoid showing reporters ignoring young girls burned by napalm?

250px-TrangBang

Every image tells a story. What story will yours tell?

June 17, 2015

A Roundup of Tips & Tools from IRE 2015

Filed under: Journalism,News,Reporting — Patrick Durusau @ 2:11 pm

A Roundup of Tips & Tools from IRE 2015 by Gary Price.

Gary summarizes six (6) tools that were discussed at #IRE15.

Yes, I saw this at the Global Investigative Journalism Network (GIJN). The same folks who have called for sponsoring a Muckraker.

What more endorsement does anyone need?

You need to follow Gary’s column for future updates. Some of it you will already know but as investigative reporters and editors build and share resources, there will be new to you material as well.

Enjoy!



Sponsor a Muckraker:

Filed under: Journalism,News,Reporting — Patrick Durusau @ 11:03 am

Sponsor a Muckraker: Help Us Send Journalists to Lillehammer.

From the post:

Here’s your chance to support the global spread of investigative journalism. We need your help to sponsor dozens of journalists from developing and transitioning countries to come to the Global Investigative Journalism Conference in Norway this October 8-11.

Held once every two years, the GIJC is a giant training and networking event. At over 150 sessions, the world’s best journalists teach state-of-the-art investigative techniques, data analysis, cross-border reporting, online research, protecting sources, and more to reporters from some of the toughest media environments in the world.

We know from past conferences that our attendees return home to do groundbreaking investigations into corruption and abuse of power, launch investigative teams and non-profit centers, and help spread investigative reporting to where it is needed most.

We’ve been overwhelmed with requests to attend. GIJN and its co-host, Norway’s SKUP, have received 500 requests from more than 90 countries, and we can’t help them all. Please give what you can.

We will direct 100% of your gift to bring these journalists to GIJC15. Contributors will be publicly thanked (if they desire) on the GIJC15 conference page and social media. (Americans — your donation is fully tax deductible.)

Just click on the DONATE button, make a contribution, and write GIJC15 in the Special Instructions box. And thank you!

I don’t normally re-broadcast donation calls but the Global Investigative Journalism Conference transcends just be a good cause, public spirited, etc. sort of venture.

Think of it this way, governments, enterprises, businesses and their familiars, despite shortages, embargoes, famines, and natural disasters, all are suspiciously well fed and comfortable. Aren’t you the least bit curious why it seems to always work out that way? I am. Help sponsor a muckraker today!

June 13, 2015

Tipsheets & Links from 2015 IRE

Filed under: Journalism,News,Reporting — Patrick Durusau @ 3:30 pm

Tipsheets & Links from 2015 IRE

Program listing from the recent Investigative Reporters and Editors (IRE) conference, annotated with tipsheets and links.

I don’t find the format, “Tipsheet from speaker (name)” all that useful. I’m sure that is because I don’t recognize the usual haunts of each author but I suspect that is true for many others.

Anyone working on a subject index to the tipsheets?

June 10, 2015

Apply Today To Become A 2016 Knight-Mozilla Fellow!

Filed under: Journalism,News,Reporting — Patrick Durusau @ 7:48 pm

Apply Today To Become A 2016 Knight-Mozilla Fellow! by Dan Sinker.

From the post:

Today we kick off our fifth search for Knight-Mozilla Fellows. It’s been a remarkably fast five years filled with some of the most remarkable, talented, and inspiring people we’ve had the pleasure of getting to know. And now you (yes you!) can join them by applying to become a 2016 Knight-Mozilla Fellow today.

Knight-Mozilla Fellows spend ten months building, experimenting, and collaborating at the intersection of journalism and the open web. Our fellows have worked on projects that liberate data from inside PDFs, stitch together satellite imagery to demonstrate the erosion of coastline in Louisiana, help journalists understand the security implications of their work, improve our understanding of site metrics, and much much more.

We want our fellows to spend time tackling real-world problems, and so for the last five years we have embedded our fellows in some of the best newsrooms in the world. For 2016 we have an amazing lineup of fellowship hosts once again: the Los Angeles Times Data Desk, NPR, Vox Media, Frontline, Correct!v, and The Coral Project (a collaboration between the New York Times, the Washington Post, and Mozilla).

Our fellows are given the freedom to try new things, follow their passions, and write open-source code that helps to drive journalism (and the web) forward. Over the course of the next two and a half months you’ll be hearing a lot more from us about the many exciting opportunities a Knight-Mozilla Fellowship brings, the impact journalism code has had on the web, and why you (yes you!) should apply to become a 2016 Knight-Mozilla Fellow. Or, you can just apply now.

A bit mainstream for my taste but there has to be a mainstream to give the rest of us something to rebel against. 😉

Can’t argue with the experience you can gain and the street cred that goes along with it. Not to mention having your name on cutting edge work.

Give it serious consideration and pass word of the opportunity along.

June 8, 2015

Reporters Need To Learn Basic Data Skills [and skepticism]

Filed under: Journalism,News,Reporting — Patrick Durusau @ 10:42 am

It’s Time For Every Journalist To Learn Basic Data Skills by Marta Kang.

From the post:

First came the web. Then came social media. Now journalists face a new challenge on the horizon: big data.

It used to be that data journalism lived in a corner of the newsroom, in the care of investigative or business reporters. But in recent years, big data has amassed at such a rate that it can no longer be the responsibility of a few.

Numbers, Numbers On Every Beat

In 2013, IBM researchers found that 90 percent of the world’s data had been created in the previous two years. We’d suddenly gained a quantitative understanding of our world! This new knowledge base empowers us to predict the spread of disease, analyze years of government spending, and even understand how an extra cup of coffee might affect one’s sleep quality. We’ve essentially gained countless new perspectives — bird’s-eye views, granular views, inward views of ourselves — as long as we know how to make sense of the numbers.

Many news outlets have already taken to using data to drive a range of stories, from the profound to the surprising. ProPublica and NPR calculated how much limbs are worth in each state to highlight the dramatic disparity in workers’ comp benefits across the U.S. The Washington Post analyzed 30 years of groundhog forecasts and found that “a groundhog is just a groundhog,” and not a weatherman, alas.

Still, conversations about data-driven journalism have mostly focused on large-scale projects by industry powerhouses and new outlets like FiveThirtyEight and Vox.

But the job shouldn’t be left to big newsrooms with dedicated teams. In this era of big data, every journalist must master basic data skills to make use of all sources available to them.

“There’s so much data available now, and there’s basically data on every single beat, and you have reporters getting spreadsheets all the time,” Chad Skelton, a data journalist with The Vancouver Sun, told me.

I am very sympathetic to Martha’s agenda of motivating journalists to learn basic data skills. Reporters can hardly work in the public interest if they have to accept untested claims about data from one source or another. They need to skills to not only use data but to question data when a story sounds too good to be true.

For example, when the news broke about the data breach at the U.S. Office of Personnel Management (OPM), how many reports headlined that the Inspector General for the OPM had requested at least two of their computer systems be shut down because they “could potentially have national security implications?” U.S. Was Warned of System Open to Cyberattacks

Oh, yes, that was the zero (0) number, the empty set, nil.

Several days after the drum beat that China was responsible for the breach, with no evidence proffered to support that accusation, the full brokenness of the OPM systems is coming to light.

Not that reporters have to have every detail on the first report, but finding an Inspector General’s report on security (obviously relevant to a data breach story) isn’t an exercise in data sleuthing.

Knowing how broken the systems were reported to be by the OPM’s own Inspector General, increases the range of suspects to high school hackers, college CS students, professional hackers, other nation states, and everyone in between.

The nearest physical analogy I can think of would be to have a pallet of $100 bills in the middle of Times Square and when a majority of those go missing, inventing a security fantasy that only a bank could steal money in those quantities.

Anybody with a computer could have broken into OPM systems and it is disingenuous to posture and pretend otherwise.

Let’s teach journalist basic data skills but let’s also teach them to not repeat gibberish from government spokespersons. In many cases it isn’t news even if they say it. In the case of data breaches, it is more often than not noise.

June 4, 2015

Resources for Journalists (GIJN)

Filed under: Journalism,News,Reporting — Patrick Durusau @ 9:22 am

Resources for Journalists – Global Investigative Journalism Network

I have referenced specific posts and resources at the Global Investigative Journalism Network (GIJN) before but their resources page merits separate mention.

I am more familiar with their Data Journalism Resources and Data Journalism Toolkit but they have advice on everything from Archiving Your Work to Covering Street Protests.

I’m not sure if I can paste the Paypal link so see their Sponsors and Supporters page to donate to support their work.

May 31, 2015

20 tools and resources every journalist should experiment with

Filed under: Cryptography,Journalism,News,Reporting — Patrick Durusau @ 9:20 am

20 tools and resources every journalist should experiment with by Alastair Reid.

From the post:

Tools have always come from the need to carry out a specific task more effectively. It’s one of the main differences between human beings and the rest of the animal kingdom. We may still be slaves to the same old evolutionary urges but we sure know how to eat noodles in style.

In journalism, an abstract tool for uncovering the most interesting and insightful information about society, we can generally boil the workflow down to four stages: finding, reporting, producing and distributing stories.

So with that in mind, here are a range of tools which will – hopefully – help you carry out your journalism tasks more effectively.

The resources range from advanced Google and Twitter searching to odder items and even practical advice:


Funny story: Glenn Greenwald received an anonymous email in early 2013 from a source wishing to discuss a potential tip, but only if communications were encrypted. Greenwald didn’t have encryption. The source emailed a step-by-step video with instructions to install encryption software. Greenwald ignored it.

The same source, a now slightly frustrated Edward Snowden, contacted film-maker Laura Poitras about the stack of NSA files burning a hole in his hard drive. Poitras persuaded Greenwald that he might want to listen, and the resulting revelations of government surveillance is arguably the story of the decade so far.

The lesson? Learn how to encrypt your email. Mailvelope is a good option with a worthwhile tutorial for PGP encryption, the same as the NSA use, and Knight Fellow Christopher Guess has a great step-by-step guide for setting it up.

In addition to the supporting encryption advice, the other lesson is that major stories can break from new sources.

Oh, the post also mentions:

Unfortunately for reporters, one of the internet’s favourite pastimes is making up rumours and faking photos.

Sounds like a normal function of government to me.

Many journalists have reported something along the lines of:

Iraq’s Defense Ministry said Wednesday an airstrike by the U.S.-led coalition killed a senior Islamic State commander and others near the extremist-held city of Mosul, though the country’s Interior Ministry later said it wasn’t clear if he even was wounded.

The Defense Ministry said the strike killed Abu Alaa al-Afari and others who were in a meeting inside a mosque in the northern city of Tal Afar, 72 kilometers (45 miles) west of Mosul. Senior ISIS Commander Alaa Al-Afari Killed In U.S. Airstrike: Iraqi Officials

rather than:

A communique from the Iraq Defense Ministry claimed credit for killing a senior Islamic State commander and others near the city of Mosul last Wednesday.

The attack focused on a mosque inside the northern city of Tal Afar, 72 kilometers (45 miles) west of Mosul. How many people were inside the mosque at the time of this cowardly attack, along with Abu Alaa al-Afari, is unknown.

Same “facts,” but a very different view of them. I mention this because an independent press or even one that wants to pretend at independence, should not be cheerfully reporting government propaganda.

May 24, 2015

Global Investigative Journalism Conference (Lillehammer, October 8th-11th 2015)

Filed under: Conferences,Journalism,News,Reporting — Patrick Durusau @ 1:14 pm

Global Investigative Journalism Conference (Lillehammer, October 8th-11th 2015)

From the news page:

This year’s global event for muckrakers is approaching! Today we’re pleased to reveal the first glimpse of the program for the 9th Global Investigative Journalism Conference — #GIJC15 — in Lillehammer, Norway.

First in line are the data tracks. We have 56 sessions dedicated to data-driven journalism already confirmed, and there is more to come.

Three of the four data tracks will be hands-on, while a fourth will be showcases. In addition to that, the local organizing committee has planned a Data Pub.

The heavy security and scraping stuff will be in a special room, with three days devoted to security issues and webscraping with Python. The attendees will be introduced to how to encrypt emails, their own laptop and USB-sticks. They will also be trained to install security apps for text and voice. For those who think Python is too difficult, import.io is an option.

For the showcases, we hope the audience will appreciate demonstrations from some of the authors behind the Verification Handbook, on advanced internet search techniques and using social media in research. There will be sessions on how to track financial crime, and the journalists behind LuxLeaks and SwissLeaks will conduct different sessions.

BTW, you can become a sponsor for the conference:

Interested in helping sponsor the GIJC? Here’s a chance to reach and support the “special forces” of journalism around the world – the reporters, editors, producers and programmers on the front lines of battling crime, corruption, abuse of trust, and lack of accountability. You’ll join major media organizations, leading technology companies, and influential foundations. Contact us at hello@gijn.org.

Opposing “crime, corruption, abuse of trust, and lack of accountability?” There are easier ways to make a living but few are as satisfying.

PS: Looks like a good venue for discussing how topic maps could integrate resources from different sources or researchers.

May 20, 2015

Math for Journalists Made Easy:…

Filed under: Journalism,News,Reporting,Statistics — Patrick Durusau @ 4:33 pm

Math for Journalists Made Easy: Understanding and Using Numbers and Statistics – Sign up now for new MOOC

From the post:

Journalists who squirm at the thought of data calculation, analysis and statistics can arm themselves with new reporting tools during the new Massive Open Online Course (MOOC) from the Knight Center for Journalism in the Americas: “Math for Journalists Made Easy: Understanding and Using Numbers and Statistics” will be taught from June 1 to 28, 2015.

Click here to sign up and to learn more about this free online course.

“Math is crucial to things we do every day. From covering budgets to covering crime, we need to understand numbers and statistics,” said course instructor Jennifer LaFleur, senior editor for data journalism for the Center for Investigative Reporting, one of the instructors of the MOOC.

Two other instructors will be teaching this MOOC: Brant Houston, a veteran investigative journalist who is a professor and the Knight Chair in Journalism at the University of Illinois; and freelance journalists Greg Ferenstein, who specializes in the use of numbers and statistics in news stories.

The three instructors will teach journalists “how to be critical about numbers, statistics and research and to avoid being improperly swayed by biased researchers.” The course will also prepare journalists to relay numbers and statistics in ways that are easy for the average reader to understand.

“It is true that many of us became journalists because sometime in our lives we wanted to escape from mathematics, but it is also true that it has never been so important for journalists to overcome any fear or intimidation to learn about numbers and statistics,” said professor Rosental Alves, founder and director of the Knight Center. “There is no way to escape from math anymore, as we are nowadays surrounded by data and we need at least some basic knowledge and tools to understand the numbers.”

The MOOC will be taught over a period of four weeks, from June 1 to 28. Each week focuses on a particular topic taught by a different instructor. The lessons feature video lectures and are accompanied by readings, quizzes and discussion forums.

This looks excellent.

I will be looking forward to very tough questions of government and corporate statistical reports from anyone who takes this course.

A Call for Collaboration: Data Mining in Cross-Border Investigations

Filed under: Journalism,Knowledge Management,News,Reporting — Patrick Durusau @ 4:12 pm

A Call for Collaboration: Data Mining in Cross-Border Investigations by Jonathan Stray and Drew Sullivan.

From the post:

Over the past few years we have seen the huge potential of data and document mining in investigative journalism. Tech savvy networks of journalists such as the Organized Crime and Corruption Reporting Project (OCCRP) and the International Consortium of Investigative Journalists (ICIJ) have teamed together for astounding cross-border investigations, such as OCCRP’s work on money laundering or ICIJ’s offshore leak projects. OCCRP has even incubated its own tools, such as VIS, Investigative Dashboard and Overview.

But we need to do better. There is enormous duplication and missed opportunity in investigative journalism software. Many small grants for technology development have led to many new tools, but very few have become widely used. For example, there are now over 70 tools just for social network analysis. There are other tools for other types of analysis, document handling, data cleaning, and on and on. Most of these are open source, and in various states of completeness, usability, and adoption. Developer teams lack critical capacities such as usability testing, agile processes, and business development for sustainability. Many of these tools are beautiful solutions in search of a problem.

The fragmentation of software development for investigative journalism has consequences: Most newsrooms still lack capacity for very basic knowledge management tasks, such as digitally filing new documents where they can be searched and found later. Tools do not work or do not inter-operate. Ultimately the reporting work is slower, or more expensive, or doesn’t get done. Meanwhile, the commercial software world has so far ignored investigative journalism because it is a small, specialized user-base. Tools like Nuix and Palantir are expensive, not networked, and not extensible for the inevitable story-specific needs.

But investigative journalists have learned how to work in cross-border networks, and investigative journalism developers can too. The experience gained from collaborative data-driven journalism has led OCCRP and other interested organizations to focus on the following issues:

The issues:

  • Usability
  • Delivery
  • Networked Investigation
  • Sustainability
  • Interoperability and extensibility

The next step is reported to be:

The next step for us is a small meeting: the very first conference on Knowledge Management in Investigative Journalism. This event will bring together key developers and journalists to refine the problem definition and plan a way forward. OCCRP and the Influence Mappers project have already pledged support. Stay tuned…

Jonathan Stray jonathanstray@gmail.comand and Drew Sullivan drew@occrp.org, want to know if you are interested too?

See the original post, email Jonathan and Drew if you are interested. It sounds like a very good idea to me.

PS: You already know one of the technologies that I think is important for knowledge management: topic maps!

April 30, 2015

Baltimore Burning and Verification

Filed under: News,Reporting — Patrick Durusau @ 7:28 pm

Baltimore ‘looting’ tweets show importance of quick and easy image checks by Eoghan mac Suibhne.

From the post:

Anyone who has ever asked me for tips on content verification and debunking of fakes knows one of the first things I always mention is reverse image search. It’s one of the simplest and most powerful tools at your disposal. This week provided another good example of how overlooked it is.

Unrest in Baltimore, like any other dramatic event these days, created a surge of activity on social media. In the age of the selfie and ubiquitous cameras, many people have become compulsive chroniclers of all their activities — sometimes unwisely so.

Reactions ranged from shock and disgust to disbelief and amusement when a series of images started to circulate showing looters proudly displaying their ill-gotten gains. Not all, however, was as it seemed.

(emphasis in original)

I often get asked about the fundamentals of verification, and one of the first things I alway mention is the ability — and indeed the reflex — to always perform a reverse image search. I also mention, only half-jokingly, that this should possibly even be added to the school curriculum. It’s not as if it would take up much of the school year; it can be taught in approximately 30 seconds.

In the case of the trashed KFC above, a quick check via Google reverse image search or Tineye showed that the photo was taken in Karachi, Pakistan, in 2012.

google-image

Don’t be confused by the “reverse image search” terminology. What you see on Google Images is the standard search box, that includes camera and microphone icons. Choose the camera icon and you will be given the opportunity to search using an image. Paste in an image URL and search. Simple as that.

Imagine describing a standard Google search as a “Google reverse word search.” Confusion and hilarity would ensue pretty quickly.

Develop a habit of verification.

You will have fewer occasions to say, “That’s my opinion and I am entitled to it,” in the face of contrary evidence.

The NYT and Your Security Guardians At Work

Filed under: News,Reporting — Patrick Durusau @ 4:38 pm

Mark Liberman, in R.I.P. Jack Ely, quotes rather extensively from Sam Roberts, “Jack Ely, Who Sang the Kingsmen’s ‘Louie Louie’, Dies at 71“, NYT 4/29/2015, which includes this snippet:


High school and college students who thought they understood what Mr. Ely was singing traded transcripts of their meticulously researched translations of the lyrics. The F.B.I. began investigating after an Indiana parent wrote to Attorney General Robert F. Kennedy in 1964: “My daughter brought home a record of ‘LOUIE LOUIE’ and I, after reading that the record had been banned on the air because it was obscene, proceeded to try to decipher the jumble of words. The lyrics are so filthy that I cannot enclose them in this letter.”

The F.B.I. Laboratory’s efforts at decryption were less fruitful. After more than two years and a 455-page report, the bureau concluded that “three governmental agencies dropped their investigations because they were unable to determine what the lyrics of the song were, even after listening to the records at speeds ranging from 16 r.p.m. to 78 r.p.m.”

It is true that Louie Louie was recorded by the Kingsmen, with Jack Ely as lead signer. It is also true that the FBI, who currently protects you from domestic terrorists and emotionally disturbed teenagers, did an obscenity investigation of the song, but, they concluded the lyrics were incomprehensible.

Where the NYT drops the ball is in attributed to the FBI a 455-page report. You can view the FBI report at: FBI Records: The Vault, under SUBJECT: LOUIE, LOUIE (THE 60’s SONG).

Like the Internet of Things, PDF viewers don’t lie and the page count for the FBI report comes to one hundred and nineteen (119) pages. Of course, the NYT did not have a link to the FBI report or else one of its proof readers could have verified that claim.

The lack of accuracy doesn’t impact the story, except the NYT doesn’t share where it saw the 455-page report from the FBI. Anything is possible and there may be such a report. But without a hyperlink, you know, those things that point to locations on the web, we won’t ever know.

What does the NYT gain by not gracing its readers with links to original materials? There are numerous NYT articles that do, so you have to wonder why it doesn’t happen in all cases?

Suggested rule for New York Times reporters: If you cite a publicly available document or written statement, include a link to the original at the first mention of the document or statement in your story. (Some of us want to know more than will fit into your story.)

April 14, 2015

Phishing catches victims ‘in minutes’ [Verification and the BBC]

Filed under: Journalism,News,Reporting — Patrick Durusau @ 10:26 am

Phishing catches victims ‘in minutes’

From the post:

It takes 82 seconds for cyber-thieves to ensnare the first victim of a phishing campaign, a report suggests.

Compiled by Verizon, the report looks at analyses of almost 80,000 security incidents that hit thousands of companies in 2014.

It found that, in many companies, about 25% of those who received a phishing email were likely to open it.

“Training your employees is a critical element of combating this threat,” said Bob Rudis, lead author on the report.

Threat spotting

Tricking people into opening a booby-trapped message let attackers grab login credentials that could be used to trespass on a network and steal data, the report said.

“They do not have to use complex software exploits, because often they can get hold of legitimate credentials,” Mr Rudis said.
…(emphasis in original)

You might be tempted to quote this story on phishing but I wouldn’t. Not without looking further.

When I read “…a report suggests…,” without a link to the report, all sorts of alarms start ringing. If there is such a report, why no link? Is the author fearful the report isn’t as lurid as their retelling? Or fearful that readers might reach their own conclusions? And for that matter, despite being “lead author” of this alleged report, who the hell is Bob Rudis? Not quite in the same class as Prince or the Queen of England.

None of which is hard to fix:

Verizon 2015 PCI Compliance Report

Bob Rudis took a little more effort but not much: Bob Rudis (Twitter), not to mention being the co-author of: Data-Driven Security: Analysis, Visualization and Dashboards (review). Which is repaid by finding a R blogger and author of a recent security analysis text.

When you read the report, to which the BBC provides no link, you discover things like:

Incentives (none) to prevent payment fraud:

Page 4: The annual cost of payment fraud in 2014 was $14 Billion.

Then Page 5 gives the lack of incentive to combat the $14 Billion in fraud, total card payments are expected to reach $20 Trillion.

In other words:

20,000,000,000,000 – 14,000,000,000 = 19,986,000,000,000

Hardly even a rounding error.

BTW, the quote that caught my eye:

More than 99% of the vulnerabilities exploited in data breaches had been known about for more than a year, Mr Rudis said. And some had been around for a decade.

Doesn’t occur in the Verizon report, so one assumes an interview with Mr. Rudis.

Moreover, it is a good illustration for why a history of exploits may be as valuable if not more so than the latest exploit.

None of that was particularly difficult but it enriches the original content with links that may be useful to readers. What’s the point of hypertext without hyperlinks?

« Newer PostsOlder Posts »

Powered by WordPress