For many businesses, big data is superfluous. Except, a recently-published paper on the mathematics of big data reveals, when it isn’t. It turns out there is a kind of data that, like black holes or evil wizards of Middle Earth, only becomes more powerful the larger it grows. What’s more, suggest researchers Enric Junqué de Fortuny, David Martens and Foster Provost, even if you’re not gathering this kind of data at present, the new results suggest you may lose out to a competitor who is.
To understand what’s going on—stay with us, it’s worth it—you have to know whether your data is dense or sparse. Most businesses are gathering data about their customers and clients such that a great deal is known about any one person. For example, you survey a handful of customers in depth, as in a customer survey comprised of dozens of questions. This is “dense” data, with lots of information on every person, object or event you’re cataloging.