Monday 9 August 2010

Wikileaks Datasets Illustrate Afghan Meltdown

Violent Incidents by year:

It’s one thing to read about individual Taliban attacks in WikiLeaks’ trove of war logs. It’s something quite different to see the bombings and the shootings mount, and watch the insurgency metastasize.

NYU political science grad student (and occasional Danger Room contributor) Drew Conway has done just that, using an open source statistical programming language called R and a graphical plotting software tool. The results are unnerving, like stop-motion photography of a freeway wreck. Above is the latest example: a graph showing the spread of combat from 2004 to 2009. It’s exactly what you wouldn’t want to see as a war drags on.

“The sheer volume of observations [in the WikiLeaks database] inhibit the majority of consumers from being able to gain knowledge from it. By providing graphical summaries of the data people can draw inferences quickly, which would have been very difficult to do by serially reading through the files,” Conway e-mails Danger Room. “For instance, in the most recent graph I posted [see above], many people were noticing the increasing number of attacks around Afghanistan’s ‘ring road,’ over time, and seeing that as an indication of the Taliban’s attempt to undermine the Afghanistan government by cutting off villages from one another.”


Conway’s work largely mirrors
what the U.S. military’s internal teams of intelligence analysts found. But Conway and a Columbia University post-doc Mike Dewar did all this work themselves, relying solely on free tools and the WikiLeaked logs. Applying statistical analysis, they found little evidence of tampering in the reports. Next month, Conway hopes, a group of New York-based R users will be able to tease out more insights from the data.

Obviously, the logs don’t tell the whole story of the war, as Danger Room has noted before. And the stats may be unduly influenced by the spread of NATO forces into different parts of the country. But for now, the most striking point to Conway was how bad things turned in 2006 and 2007. In Afghanistan’s south, for instance, there was only minimal fighting in the start of ‘06. By the end of the next year… well, see for yourself.


UPDATE: Conway’s work is just one of dozens of international efforts to turn the WikiLeaks war logs into something graphic. Visualizing Data has links to some of the best, including this one:


2 comments:

  1. Excellent visual data. Sometimes this tool can be overused, but they do Wikileaks justice. The Pentagon continues to argue that Wikileaks represents a past era, yet the statistics for 2010 probably don't look much different, especially not NATO and civilian casualties. And NATO has routinely covered up the spread of Taliban influence. 2010 was just as ugly as 2009 and 2011 turn uglier than 2010. The stats and graphics will prove it someday.

    ReplyDelete
  2. Someday the historians will place the blame where it lies, James. That is not happening now IMO. Today's UN report is interesting for the civilian death data. NATO will latch onto (and spin) the fall in the deaths attributable to them. This is indisputable but I take the view that one death of an innocent person caused by them is one too many. By my count at least 40 civilians were killed by NATO/ISAF as recently as last week. They have spun the incidents and figures for many years now as you know.

    ReplyDelete