An Unfavorable & Undeniable Trendline

via Marginal Revolution:

Methodology Lessons: DOE’s Natural-gas Overstatement

The Wall Street Journal reported yesterday that the US Department of Energy is set to restate the data it collects on U.S. natural-gas production.  The reason?  The Department has learned that its methodology is seriously flawed: The monthly gas-production data, known as the 914 report, is used by the industry and analysts as guide for [...]

Visualizing War

Two topics that are right up my alley: international conflict and data visualization. Put the two together, and you have a truly thought provoking piece of work. David McCandless is a “visual journalist” who specializes in visualizing data across numerous subjects. In his latest work for The Guardian’s Data Blog, David visualize a ton of [...]

More on Fact-based decisions

Ana Andjelic channels my thoughts on data- and fact-based decision making in an interesting post on ad campaigns: How can we then decide that a campaign was “better” than another one? We rarely look at a campaign data – partly because the actual metrics data is proprietary and not available to anyone beyond walls of [...]

‘Does your mind set = my data set?’

This is essentially the question asked and answered by Hans Rosling at a recent TED lecture. For those that don’t know him, Rosling is something of a superstar at the intersection of public health research and data visualization.  Rosling’s recent work focuses on dispelling the misconception that there is a binary distinction between the developed [...]

The relationship between information and confusion

Jessica Hagy tackles the complex relationship between the amount of information we have and the level of confusion we experience: Yup, looks about right.  Of course, as Nate points out, there are ways to widen the valley.  But I’ll leave that for another post.

We are all creatives now (or, at least, will be by 2013)

SEED published an article the other day that discussed the coming impact of near total authorship.  The gist of the article is that at some point, nearly everyone will be able to publish content and that this will have profound implications for society in much the same way that near universal literacy has. So what [...]

“Science these days has basically turned into a data-management problem”

So says Professor Jimmy Lin at the University of Maryland in a recent NYT Technology article about the shortfall in “Big Data-competent” university students.  The article points out that the kind of data we are now dealing with (which will only continue to increase exponentially) requires a different perspective and experience than most currently have.  [...]

Measuring Happiness via the Social Web

Nathan at FlowingData points to an application on Facebook that aims to measures happiness.   The application seeks to calculate the “Gross National Happiness” (GNH) of the United States by analyzing the ratio of positive to negative words found in users’ status updates on a daily basis. It is an interesting project and certainly relates to [...]

Coding the Sentiment of Web 2.0

Kevin Randall at FastCompany pens an interesting piece on the rising tide of sentiment analysis–the players, the technologies, the possibilities, and the current pitfalls.  The idea behind sentiment analysis is pretty simple (but the execution is difficult): to identify and code attitudes, whether written or verbal, towards particular topics.  The explosion of activity on the [...]