The First Law of Data Science: Do Umbrellas Cause Rain?
The First Law of Data Science: Do Umbrellas Cause Rain?
Dr. Michael L. Brodie
Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA USA
June 6, 2014
Since there is a strong, direct correlation between rain and umbrellas being unfurled one might conclude that unfurling umbrellas causes rain. Or does rain cause umbrellas to be unfurled? How could data analysis tell which is true? Unfortunately, correlations derived by data-driven models do not imply causation. At best data analysis could suggest a higher probability of rain causing umbrellas to be unfurled. It all depends on the analytical model, on the data, and on data curation – what data was used and how it was prepared for analysis. A more detailed data analysis revealed that rain typically precedes umbrellas being unfurled leading to the obvious conclusion that it is not umbrellas that cause rain; it is a previously unknown unfurling force emitted by the umbrella unfurling crowd that causes rain .
The best outcome of Big Data analysis, or of any (computational data-driven) model, is a number of correlations each with a level of confidence that the correlation holds true in the real world – at least the world represented by the data. Correlation does not imply causation. To determine if a correlation is true in the real world, it must be verified empirically. This First Law of Data Science applies to all data-driven modelling and analysis. It is a fundamental law of science, of the Scientific Method, of political science, and of Journalism. On a more serious note one might consider Piketty’s highly controversial economic theories [1] based on the analysis of historical economic data from a data science perspective.
Not only might one question the data science and data curation used [2] more fundamentally one might question the extent to which they are true.
[1] Piketty, Thomas, and Arthur Goldhammer. Capital in the Twenty-first Century, Harvard University Press, March 2014
[2] Picking holes in Piketty: The latest controversy around Thomas Piketty’s blockbuster book concerns its statistics, The Economist, May 31, 2014