Big Data and Clinicians: A Review on the State of the Science
Weiqi Wang, PhD; Eswar Krishnan, MD, MPH
School of Medicine, Stanford University, Palo Alto, CA, United States
Background: In the past few decades, medically related data collection saw a huge increase, referred to as big data. These huge datasets bring challenges in storage, processing, and analysis. In clinical medicine, big data is expected to play an important role in identifying causality of patient symptoms, in predicting hazards of disease incidence or reoccurrence, and in improving primary-care quality.
Objective: The objective of this review was to provide an overview of the features of clinical big data, describe a few commonly employed computational algorithms, statistical methods, and software toolkits for data manipulation and analysis, and discuss the challenges and limitations in this realm.
Methods: We conducted a literature review to identify studies on big data in medicine, especially clinical medicine. We used different combinations of keywords to search PubMed, Science Direct, Web of Knowledge, and Google Scholar for literature of interest from the past 10 years.
Results: This paper reviewed studies that analyzed clinical big data and discussed issues related to storage and analysis of this type of data.
Conclusions: Big data is becoming a common feature of biological and clinical studies. Researchers who use clinical big data face multiple challenges, and the data itself has limitations. It is imperative that methodologies for data analysis keep pace with our ability to collect and store data.
(JMIR Med Inform 2014;2(1):e1) doi:10.2196/medinform.2913 KEYWORDS
big data; database; medical informatics; clinical research; medicine
©Weiqi Wang, Eswar Krishnan. Originally published in JMIR Research Protocols (http://medinform.jmir.org), 17.01.2014. This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Research Protocols, is properly cited. The complete bibliographic information, a link to the original publication on http://medinform.jmir.org/, as well as this copyright and license information must be included.