Big data noise has reached the point where most are reaching for the ear plugs.
And with any good hype bubble, the naysayers are now grabbing attention with contrarian positions. For example, The New York Times expressed doubt about the economic viability of big data in “Is Big Data an Economic Big Dud?” This post grabbed a lot of attention, but, like many others I read, it fundamentally misses the point of what big data is all about and why it’s important. The article compares the productivity boom associated with the first wave of the Internet to the lack of growth experienced since the inception of “big data”; it implies that big data’s expected economic impact may not happen. Furthermore, the article implies that big data is something that firms will do or implement. Thinking about big data this way or differentiating between data sets as big, medium, or small is dangerous. It leads to chasing rabbits down holes.