Skip to main content
Big Data Overwhelming_Elif Ayiter_Flickr Elif Ayiter/Flickr

Living Big Data

Used carefully and accurately, big data creates unprecedented scope to understand society and improve how we live and work. But big data requires big experiments, because what works in theory may not translate well in the real world, where complex human interactions cannot always be captured, even by the most sophisticated models.

CAMBRIDGE – Big data is made from the digital trail that we leave behind when we use credit cards, mobile phones, or the Web. Used carefully and accurately, these data give us unprecedented scope to understand our society, and improve the way we live and work. But what works in theory may not translate well in the real world, where complex human interactions cannot always be captured, even by the most sophisticated models. Big data requires us to experiment on a big scale.

My own laboratory, for example, is building a Web site which, based on Google maps, uses society’s digital trail to map poverty, infant mortality, crime rates, changes in GDP, and other social indicators, neighborhood by neighborhood – all of which will be updated daily. This new capability allows viewers to see, for example, where government initiatives are working or failing.

But, while such impressive visualization tools can dramatically enhance transparency and public knowledge, they are surprisingly limited when applied to solving society’s problems. One reason is that such rich streams of data encourage spurious correlations.

We hope you're enjoying Project Syndicate.

To continue reading, subscribe now.

Subscribe

Get unlimited access to PS premium content, including in-depth commentaries, book reviews, exclusive interviews, On Point, the Big Picture, the PS Archive, and our annual year-ahead magazine.

https://prosyn.org/vuqJzwv;
  1. benami154_Yousef MasoudSOPA ImagesLightRocket via Getty Images_palestine Yousef Masoud/SOPA IMAGES/LightRocket via Getty Images

    Forgetting Palestine

    Shlomo Ben-Ami

    The two-state solution is virtually dead in the water, and the international community has largely abandoned the Palestinian cause. At this point, there is little to stop Israel from cementing the one-state reality that its right-wing government has long sought, regardless of whether that leads to a permanent civil war.

  2. sachs313_SebastionBozonAFPGettyImages_EUflagtrump Sebastion Bozon/AFP/Getty Images

    Europe Must Oppose Trump

    Jeffrey D. Sachs

    European leaders should recognize that a significant majority of Americans reject Trump’s malignant narcissism. By opposing Trump and defending the international rule of law, Europeans and Americans together can strengthen world peace and transatlantic amity for generations to come.

Cookies and Privacy

We use cookies to improve your experience on our website. To find out more, read our updated Cookie policy, Privacy policy and Terms & Conditions