Artificial Intelligence For FITs
March 28, 2018 | Ahmad Masri, MD
Education
The introduction of electronic medical record systems and digital archiving of medical images has revolutionized health care delivery and led to the daily accumulation of terabytes of data. However, it took years before physicians and scientists explored the utility of this treasure trove of data. Lagging behind other industries for years, they are finally seeing many original investigations and review articles published in medical journals that tackle the use of artificial intelligence in medicine. Artificial intelligence was thrust into the limelight due to controversial projections that were made by some in hopes that it would eventually replace imagers (radiologists and cardiologists) in the future.
Artificial intelligence refers to the use of algorithms that iteratively learn from the data itself, allowing the machine to find connections, build models and make inferences without being programmed to do so. Broadly, artificial intelligence encompasses three main disciplines: machine learning, cognitive computing and deep learning. Machine learning algorithms are broadly classified into supervised learning, unsupervised learning and reinforcement learning. For an FIT, these complex terms sound discouraging. However, artificial intelligence is here to stay and the use of its methods will likely increase over time. Even more encouraging, the focus is now shifting towards using artificial intelligence to complement what physicians do rather than the earlier hype of “replacing physicians.” I asked four cardiologists who are leaders in the field to comment on the future role of artificial intelligence and give advice to FITs.
Partho P. Sengupta, MD, FACC, is the chief of cardiology, director of cardiac imaging and professor of medicine at the West Virginia University. He authored numerous articles on the use of artificial intelligence in medicine, focusing on the use of artificial intelligence in echocardiography.
PS: “In the year 2018, several projects in artificial intelligence are already focused towards improving throughput and efficiency in clinical labs. Besides standardized and automated image measurements, the focus is increasingly shifting towards deep learning techniques that can perform automated image recognition, segmentation and interpretation. Artificial intelligence will also enable integrating multitude of measurements, extracting unseen phenotypic characteristics for precise disease and risk estimation in individual cases. Future drug, device and therapy trials are expected to be focusing on the use of artificial intelligence for patient selection. With the advent of artificial intelligence, the role of imagers and echocardiographers will likely elevate as clinical specialists, who will have the skill-set as 'therapy modelers' and can advise the clinical teams on the best therapeutic strategy for a given individual.
In the past, I would advise fellows with interest in academic careers to spend time learning research methodologies. Now, I advise every fellow to befriend a data-scientist or learn at least an introductory course in machine learning.”
Oscar C. Marroquin, MD, FACC, is the chief clinical analytics officer for the University of Pittsburgh Medical Center (UPMC) Health Services Division and an associate professor of medicine, epidemiology and clinical and translational science at the University of Pittsburgh. He leads the big data and analytics efforts for the provide arm of UPMC and has extensive practical experience in the potential application of artificial intelligence in routine clinical care.
OM: “Artificial intelligence is already playing a role at our institution. We have built machine learning algorithms that identify patients who are at high risk of 7-day and 30-day re-hospitalizations. These models were generated by looking retrospectively at about 600,000 discharges from hospitals within our health care system. The model has been prospectively validated and we are actively using it in four of our hospitals. Every day at midnight, the data for each inpatient admission at UPMC hospitals is put through the algorithm and a risk of re-hospitalization is assigned (high, medium and low), and the information is made available to the providers caring for the patients (physicians and care managers). This system has resulted in better resource and time allocation for those at high risk to ensure good transitions of care, follow up, etc. Similarly, we have developed machine learning algorithms to do more “precise phenotyping” in different populations. Our clinicians are piloting these models in congestive heart failure, asthma and low back pain.
My advice to FITs is that they need to see artificial intelligence as a technology that will enable and augment what they do, not as a replacement. As such, it is imperative to learn more about the basics of artificial intelligence to know when to use it (if one is a researcher), or how to interpret studies that use these techniques, as they will keep coming and improving.”
Rahul C. Deo, MD, PhD, is an associate professor of medicine at the University of California, San Francisco. His work focuses on emerging computational approaches to analyze large-scale genomic data. More recently, Deo and his team have been working on a computer vision pipeline for automated determination of cardiac structure, function and detection of disease using echocardiography.
RD: “Recent experiences in other industries have made it clear that we should anticipate automation in almost every situation where there is abundant digital training data and a clear objective. However, instead of trying to absorb the latest machine learning algorithms, physicians and trainees should be thinking carefully about how such automation would fit into clinical practice. Health care is inherently a more challenging application for artificial intelligence than most other industries and it will take the insight of current practitioners to pinpoint what we are lacking. When thinking about the future of artificial intelligence in medicine, it is helpful to consider two (somewhat mundane) examples where artificial intelligence is already at play in cardiology: automated echocardiography interpretation and clinical risk scores. Given the growing abundance of digital data and increased academic and corporate interest in this space, we should expect more variants of these two, specifically automated image interpretation systems (for echocardiography, chest radiographs and cardiac magnetic resonance imaging) and potentially continuously learning tools that predict diverse outcomes such as hospital readmissions or adverse clinical events. In some cases, these advances are likely to be disruptive, but it is not always obvious how they will integrate with the existing workflow given current complex incentives. This presents an exciting opportunity to shape the deployment of artificial intelligence to ensure that it improves care and addresses unmet needs.”
Sanjiv Jayendra Shah, MD, FACC, is a professor of medicine, director of the Northwestern Heart Failure With Preserved Ejection Fraction Program and director of the T1 Center for Cardiovascular Therapeutics at Northwestern University Feinberg School of Medicine. Shah has published studies on the use of novel machine learning techniques for improved classification and therapeutic targeting of heart failure syndromes.
SS: “We are most likely still far from a time when artificial intelligence (specifically machine learning) will be able to accurately predict cardiovascular outcomes, especially for heterogeneous syndromes such as heart failure. One of the problems is the fact that current data sources such as electronic health records capture only part of the patient's journey during interactions with the health care system, but future data on medication compliance, physiologic variables (via wearables) and diet tracking technologies may assist with understanding the patient more holistically. We need more ‘orthogonal’ data types to understand the patient from several unique and additive perspectives to more accurately predict outcomes, especially in the individual patient, as opposed to current prediction models that work well on average but are not very accurate on the individual patient level. FITs should learn more about artificial intelligence because of the increasing availability of large datasets, low-cost and high-speed computational systems, and continually evolving and improving techniques for machine learning analyses. These methods allow us to explore research questions from a unique multi-dimensional perspective that embraces the complexity of cardiovascular disease.”
The question for most FITs is, “Where to start?” Below are numerous resources that FITs can use to learn more about artificial intelligence.
Online Resources to Study and Explore Artificial Intelligence:
- Udemy.com offers a range of courses for a small fee for each course
- Coursera.org offers some free courses, while others are paid
- Edx.org offers three free courses online
- Datacamp.com offers multiple courses for a fee (some are free)
Selected Published Articles on Artificial Intelligence (original publications and review articles):
- Poplin et al. Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning. Nature Biomedical Engineering (2018) doi:10.1038/s41551-018-0195-0 https://www.nature.com/articles/s41551-018-0195-0
- Krittanawong et al. Artificial Intelligence in Precision Cardiovascular Medicine. Journal of the American College of Cardiology May 2017, 69 (21) 2657-2664 http://www.onlinejacc.org/content/69/21/2657
- Knackstedt et a. Fully Automated Versus Standard Tracking of Left Ventricular Ejection Fraction and Longitudinal Strain. The FAST-EFs Multicenter Study. Journal of the American College of Cardiology Sep 2015, 66 (13) 1456-1466 http://content.onlinejacc.org/lookup/doi/10.1016/j.jacc.2015.07.052
- Omar et al. Artificial Intelligence-Based Assessment of Left Ventricular Filling Pressures From 2-Dimensional Cardiac Ultrasound Images. JACC: Cardiovascular Imaging Jul 2017, 2297; DOI: 10.1016/j.jcmg.2017.05.003 http://imaging.onlinejacc.org/content/early/ 2017/07/13/j.jcmg.2017.05.003.full
- Narula et al. Machine-Learning Algorithms to Automate Morphological and Functional Assessments in 2D Echocardiography. Journal of the American College of Cardiology Nov 2016, 68 (21) 2287-2295 http://www.onlinejacc.org/content/68/21/2287
- Betancur et al. Prognostic Value of Combined Clinical and Myocardial Perfusion Imaging Data Using Machine Learning. JACC: Cardiovascular Imaging Oct 2017, 2406; DOI: 10.1016/j.jcmg.2017.07.024 http://imaging.onlinejacc.org/content/early/ 2017/10/16/j.jcmg.2017.07.024
- Sengupta et al. Cognitive Machine-Learning Algorithm for Cardiac Imaging. A Pilot Study for Differentiating Constrictive Pericarditis From Restrictive Cardiomyopathy. Circulation: Cardiovascular Imaging. 2016;9:e004330 http://circimaging.ahajournals.org/content/9/6/e004330
- Abedi et al. Novel Screening Tool for Stroke Using Artificial Neural Network. Stroke. 2017;48:1678-1681http://stroke.ahajournals.org/content/48/6/1678
- Henglin et al. Machine Learning Approaches in Cardiovascular Imaging. Circulation: Cardiovascular Imaging. 2017;10:e005614 http://circimaging.ahajournals.org/content/10/10/e005614
- Rahul C. Deo. Machine Learning in Medicine. Circulation. 2015;132:1920-1930 http://circ.ahajournals.org/content/132/20/1920
- Kalscheur et al. Machine Learning Algorithm Predicts Cardiac Resynchronization Therapy Outcomes: Lessons From the COMPANION Trial. Circulation: Arrhythmia and Electrophysiology. 2018;11:e005499 http://circep.ahajournals.org/content/11/1/e005499
- Ambale-Venkatesh et al. Cardiovascular Event Prediction by Machine Learning: The Multi-Ethnic Study of Atherosclerosis. Circulation Research. 2017;121:1092-1101 http://circres.ahajournals.org/content/121/9/1092
- Abedi et al. Novel Screening Tool for Stroke Using Artificial Neural Network. Stroke. 2017;48:1678-1681http://stroke.ahajournals.org/content/48/6/1678
- Ng et al. Early Detection of Heart Failure Using Electronic Health Records Practical Implications for Time Before Diagnosis, Data Diversity, Data Quantity, and Data Density. Circulation: Cardiovascular Quality and Outcomes. 2016;9:649-65 http://circoutcomes.ahajournals.org/content/9/6/649
- Hansen et al. Identifying DrugDrug Interactions by Data Mining: A Pilot Study of Warfarin-Associated Drug Interactions. Circulation: Cardiovascular Quality and Outcomes. 2016;9:621-628http://circoutcomes.ahajournals.org/content/9/6/621
- Mortazavi et al. Analysis of Machine Learning Techniques for Heart Failure Readmissions. Circulation: Cardiovascular Quality and Outcomes. 2016;9:629-640http://circoutcomes.ahajournals.org/content/9/6/629
- Shah et al. Phenomapping for Novel Classification of Heart Failure With Preserved Ejection Fraction. Circulation. 2015;131:269-279 http://circ.ahajournals.org/content/131/3/269
- Jha et al.. Adapting to Artificial Intelligence: Radiologists and Pathologists as Information Specialists. JAMA. 2016 Dec 13;316(22):2353-2354. https://jamanetwork.com/journals/jama/ fullarticle/10.1001/jama.2016.17438
- Darcy et al.Machine Learning and the Profession of Medicine. JAMA. 2016;315(6):551-552. https://jamanetwork.com/journals/jama/fullarticle/2488315
- Daniel Shu Wei Ting et al. Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With Diabetes. JAMA. 2017;318(22):2211-2223. https://jamanetwork.com/journals/jama/fullarticle/2665775
- Bejnordi et al. Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer. JAMA. 2017;318(22):2199-2210. https://jamanetwork.com/journals/jama/fullarticle/2665774
- Gulshan et al. Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. JAMA. 2016;316(22):2402-2410. https://jamanetwork.com/journals/jama/fullarticle/2588763
- Cabitza et al. Unintended Consequences of Machine Learning in Medicine. JAMA. 2017;318(6):517-518. https://jamanetwork.com/journals/jama/fullarticle/2645762
- Motwani et al. Machine learning for prediction of all-cause mortality in patients with suspected coronary artery disease: a 5-year multicentre prospective registry analysis. Eur Heart J. 2017 Feb 14;38(7):500-507.https://academic.oup.com/eurheartj/article-lookup/doi/10.1093/eurheartj/ehw188
- Goldstein et al. Moving beyond regression techniques in cardiovascular risk prediction: applying machine learning to address analytic challenges. Eur Heart J. 2017 Jun 14;38(23):1805-1814. https://academic.oup.com/eurheartj/article/38/23/1805/3056931
This article was authored by Ahmad Masri, MD, Fellow in Training (FIT) at the University of Pittsburgh Medical Center in PA.