Mount Sinai First in U.S. to Use Artificial Intelligence to Analyze Coronavirus (COVID-19) Patients

Technology may lead to rapid diagnosis based on CT scans and patient data

Newswise — (New York, NY – May 19, 2020) – Mount Sinai researchers are the first in the country to use artificial intelligence (AI) combined with imaging, and clinical data to analyze patients with coronavirus disease (COVID-19). They have developed a unique algorithm that can rapidly detect COVID-19 based on how lung disease looks in computed tomography (CT scans) of the chest, in combination with patient information including symptoms, age, bloodwork, and possible contact with someone infected with the virus. This study, published in the May 19 issue of Nature Medicine, could help hospitals across the world quickly detect the virus, isolate patients, and prevent it from spreading during this pandemic.

“AI has huge potential for analyzing large amounts of data quickly, an attribute that can have a big impact in a situation such as a pandemic. At Mount Sinai, we recognized this early and were able to mobilize the expertise of our faculty and our international collaborations to work on implementing a novel AI model using CT data from coronavirus patients in Chinese medical centers. We were able to show that the AI model was as accurate as an experienced radiologist in diagnosing the disease, and even better in some cases where there was no clear sign of lung disease on CT,” says one of the lead authors, Zahi Fayad, PhD, Director of the BioMedical Engineering and Imaging Institute (BMEII) at the Icahn School of Medicine at Mount Sinai. “We’re now working on how to use this at home and share our findings with others—this toolkit can easily be deployed worldwide to other hospitals, either online or integrated into their own systems.”

This research expands on a previous Mount Sinai study that identified a characteristic pattern of disease in the lungs of COVID-19 patients and showed how it develops over the course of a week and a half.The new study involved scans of more than 900 patients that Mount Sinai received from institutional collaborators at hospitals in China. The patients were admitted to 18 medical centers in 13 Chinese provinces between January 17 and March 3, 2020. The scans included 419 confirmed COVID-19-positive cases (most either had recently traveled to Wuhan, China, where the outbreak began, or had contact with an infected COVID-19 patient) and 486 COVID-19-negative scans. Researchers also had patients’ clinical information, including blood test results showing any abnormalities in white blood cell counts or lymphocyte counts as well as their age, sex, and symptoms (fever, cough, or cough with mucus). They focused on CT scans and blood tests since doctors in China use both of these to diagnose patients with COVID-19 if they come in with fever or have been in contact with an infected patient.

The Mount Sinai team integrated data from those CT scans with the clinical information to develop an AI algorithm. It mimics the workflow a physician uses to diagnose COVID-19 and gives a final prediction of positive or negative diagnosis. The AI model produces separate probabilities of being COVID-19-positive based on CT images, clinical data, and both combined. Researchers initially trained and fine-tuned the algorithm on data from 626 out of 905 patients, and then tested the algorithm on the remaining 279 patients in the study group (split between COVID-19-positive and negative cases) to judge the test’s sensitivity; higher sensitivity means better detection performance. The algorithm was shown to have statistically significantly higher sensitivity (84 percent) compared to 75 percent for radiologists evaluating the images and clinical data. The AI system also improved the detection of COVID-19-positive patients who had negative CT scans. Specifically, it recognized 68 percent of COVID-19-positive cases, whereas radiologists interpreted all of these cases as negative due to the negative CT appearance. Improved detection is particularly important to keep patients isolated if scans don’t show lung disease when patients first present symptoms (since the previous study showed that lung disease doesn’t always show up on CT in the first few days) and COVID-19 symptoms are often nonspecific, resembling a flu or common cold, so it can be difficult to diagnose.

CT scans are not widely used for diagnosis of COVID-19 in the United States; however, Dr. Fayad explains that imaging can still play an important role.

“Imaging can help give a rapid and accurate diagnosis—lab tests can take up to two days, and there is the possibility of false negatives—meaning imaging can help isolate patients immediately if needed, and manage hospital resources effectively. The high sensitivity of our AI model can provide a ‘second opinion’ to physicians in cases where CT is either negative (in the early course of infection) or shows nonspecific findings, which can be common. It’s something that should be considered on a wider scale, especially in the United States, where currently we have more spare capacity for CT scanning than in labs for genetic tests,” said Dr. Fayad, who is also a Professor of Diagnostic, Molecular and Interventional Radiology at the Icahn School of Medicine at Mount Sinai.

“This study is important because it shows that an artificial intelligence algorithm can be trained to help with early identification of COVID-19, and this can be used in the clinical setting to triage or prioritize the evaluation of sick patients early in their admission to the emergency room,” says Matthew Levin, MD, Director of the Mount Sinai Health System’s Clinical Data Science Team, and a member of the Mount Sinai COVID Informatics Center. “This is an early proof concept that we can apply to our own patient data to further develop algorithms that are more specific to our region and diverse populations.”

Mount Sinai researchers are now focused on further developing the model to find clues about how well patients will do based on subtleties in their CT data and clinical information. They say this could be important to optimize treatment and improve outcomes.

Xueyan Mei, a trainee in the Graduate School of Biological Sciences at the Icahn School of Medicine at Mount Sinai, and Yang Yang, PhD, Assistant Professor of Radiology at the Icahn School of Medicine at Mount Sinai, also contributed to this work.

About the Mount Sinai Health System

The Mount Sinai Health System is New York City's largest academic medical system, encompassing eight hospitals, a leading medical school, and a vast network of ambulatory practices throughout the greater New York region. Mount Sinai is a national and international source of unrivaled education, translational research and discovery, and collaborative clinical leadership ensuring that we deliver the highest quality care—from prevention to treatment of the most serious and complex human diseases. The Health System includes more than 7,200 physicians and features a robust and continually expanding network of multispecialty services, including more than 400 ambulatory practice locations throughout the five boroughs of New York City, Westchester, and Long Island. The Mount Sinai Hospital is ranked No. 14 on U.S. News & World Report's "Honor Roll" of the Top 20 Best Hospitals in the country and the Icahn School of Medicine as one of the Top 20 Best Medical Schools in country. Mount Sinai Health System hospitals are consistently ranked regionally by specialty by U.S. News & World Report.

For more information, visit https://www.mountsinai.org or find Mount Sinai on FacebookTwitter and YouTube.

 ###

MEDIA CONTACT
Register for reporter access to contact details
Newswise: Mount Sinai First in U.S. to Use Artificial Intelligence to Analyze Coronavirus (COVID-19) Patients

Credit: BioMedical Engineering and Imaging Institute (BMEII) at the Icahn School of Medicine at Mount Sinai

Caption: Examples of chest CT images of COVID-19 (+) patients and visualization of features correlated to COVID-19 positivity. For each pair of images, the left image is a CT image showing the segmented lung used as input for the CNN (convolutional neural network algorithm) model trained on CT images only, and the right image shows the heatmap of pixels that the CNN model classified as having SARS-CoV-2 infection (red indicates higher probability). (a) A 51-year-old female with fever and history of exposure to SARS-CoV-2. The CNN model identified abnormal features in the right lower lobe (white color), whereas the two radiologists labeled this CT as negative. (b) A 52-year-old female who had a history of exposure to SARS-CoV-2 and presented with fever and productive cough. Bilateral peripheral ground-glass opacities (arrows) were labeled by the radiologists, and the CNN model predicted positivity based on features in matching areas. (c) A 72-year-old female with exposure history to the animal market in Wuhan presented with fever and productive cough. The segmented CT image shows ground-glass opacity in the anterior aspect of the right lung (arrow), whereas the CNN model labeled this CT as negative. (d) A 59-year-old female with cough and exposure history. The segmented CT image shows no evidence of pneumonia, and the CNN model also labeled this CT as negative.

Newswise: Mount Sinai First in U.S. to Use Artificial Intelligence to Analyze Coronavirus (COVID-19) Patients

Credit: BioMedical Engineering and Imaging Institute (BMEII) at the Icahn School of Medicine at Mount Sinai

Caption: Illustration of the modeling framework: Three AI models are used to generate the probability of a patient being COVID-19 (+): the first is based on a chest CT scan, the second on clinical information; and the third on a combination of the chest CT scan and clinical information. For evaluation of chest CT scans, each slice was first ranked by the probability of containing a parenchymal abnormality, as predicted by the convolutional neural network model (slice selection CNN), which is a pre-trained PTB model that has a 99.4% accuracy to select abnormal lung slices from chest CT scans. The top 10 abnormal CT images per patient were put into the second CNN (diagnosis CNN) to predict the likelihood of COVID-19 positivity (P1). Demographic and clinical data (the patient’s age and sex, exposure history, symptoms and laboratory tests) were put into a machine learning model to classify COVID-19 positivity (P2). Features generated by the diagnosis CNN model and the non-imaging clinical information machine learning model were integrated by a multi-layer perceptron network (MLP) to generate the final output of the joint model (P3). PTB, pulmonary tuberculosis; SVM, support vector machine.

CITATIONS

Nature Medicine




Filters close

Showing results

110 of 1992
Newswise: Invention by a Finnish start-up speeds up coronavirus testing
Released: 29-May-2020 6:25 AM EDT
Invention by a Finnish start-up speeds up coronavirus testing
Aalto University

An Aalto University spinoff company has come up with a way to use existing lab microscopes in a completely new and much more effective way with their innovation of nanocoated glass. While this is very relevant to covid19 research, it holds great promise for many other viruses and diseases

Newswise: Tourism: what’s our new normal?
Released: 29-May-2020 6:20 AM EDT
Tourism: what’s our new normal?
University of South Australia

After months of lockdown, it’s no surprise that people are itching to get out and about. But with ongoing debates about how and when to open Australia’s state and territory borders, it’s hard to know what to expect.

Newswise: Calibrated approach to AI and deep learning models could more reliably diagnose and treat disease
Released: 29-May-2020 6:05 AM EDT
Calibrated approach to AI and deep learning models could more reliably diagnose and treat disease
Lawrence Livermore National Laboratory

In a recent preprint (available through Cornell University’s open access website arXiv), a team led by a Lawrence Livermore National Laboratory computer scientist proposes a novel deep learning approach aimed at improving the reliability of classifier models designed for predicting disease types from diagnostic images, with an additional goal of enabling interpretability by a medical expert without sacrificing accuracy. The approach uses a concept called confidence calibration, which systematically adjusts the model’s predictions to match the human expert’s expectations in the real world.

Newswise: Researchers Develop Experimental Rapid COVID-19 Test Using Innovative Nanoparticle Technique
Released: 28-May-2020 6:35 PM EDT
Researchers Develop Experimental Rapid COVID-19 Test Using Innovative Nanoparticle Technique
University of Maryland Medical Center

Scientists from the University of Maryland School of Medicine (UMSOM) developed an experimental diagnostic test for COVID-19 that can visually detect the presence of the virus in 10 minutes. It uses a simple assay containing plasmonic gold nanoparticles to detect a color change when the virus is present. The test does not require the use of any advanced laboratory techniques, such as those commonly used to amplify DNA, for analysis. The authors published their work last week in the American Chemical Society’s nanotechnology journal ACS Nano.

Released: 28-May-2020 6:05 PM EDT
Tackling airborne transmission of COVID-19 indoors
University of Surrey

Preventing airborne transmission of Covid-19 should be the next front of the battle against the virus, argue experts from the University of Surrey.

access_time Embargo lifts in 2 days
Embargo will expire: 1-Jun-2020 11:00 AM EDT Released to reporters: 28-May-2020 5:40 PM EDT

A reporter's PressPass is required to access this story until the embargo expires on 1-Jun-2020 11:00 AM EDT The Newswise PressPass gives verified journalists access to embargoed stories. Please log in to complete a presspass application. If you have not yet registered, please Register. When you fill out the registration form, please identify yourself as a reporter in order to advance to the presspass application form.

Released: 28-May-2020 5:10 PM EDT
Mental health outcomes among health care workers during COVID-19 pandemic in Italy
JAMA - Journal of the American Medical Association

Symptoms of posttraumatic stress disorder, depression, anxiety and insomnia among health care workers in Italy during the COVID-19 pandemic are reported in this observational study.

Newswise: fimmu-11-01208-g001.jpg
Released: 28-May-2020 4:45 PM EDT
Genetics May Explain High COVID-19 Mortality in Italy, Inform Global Pandemic Response
Sbarro Health Research Organization (SHRO)

On March 11th 2020 the World Health Organization declared Coronavirus disease (COVID-19) a pandemic.

Released: 28-May-2020 3:55 PM EDT
Finding working capital is key to small businesses efforts as reopening accelerates
RAND Corporation

As small businesses reopen after a lengthy pandemic shutdown, one key challenge will be finding working capital to replenish inventories and pay employees until revenue returns to normal, according to a new RAND Corporation perspective based on interviews with a select group of small business owners.

Newswise: Leading Mindfully: COVID-19 and the Big Human Pivot, Part 3
Released: 28-May-2020 3:15 PM EDT
Leading Mindfully: COVID-19 and the Big Human Pivot, Part 3
University of Virginia Darden School of Business

If the COVID-19 crisis triggered health, economic, social and psychological changes that mean we will be living and working through destabilizing moments now and for the foreseeable future, then all the more reason now to adopt and practice essential skills of Leading Mindfully. How should we start thinking in new ways that better represent reality?


Showing results

110 of 1992

close
0.87377