Multimodal AI model may guide personalized treatments for tuberculosis

AI approach helps researchers interpret large biomedical data sets to accurately predict tuberculosis treatment prognosis

9:45 AM

colorful illustration with human figure and highlighted lungs
Credit: University of Michigan Biomedical Engineering

A University of Michigan analysis of real-world worldwide patient data using artificial intelligence (AI) may lead to personalization of tuberculosis treatment. 

The team of University of Michigan researchers, led by Sriram Chandrasekaran, Ph.D., associate professor of biomedical engineering, and postdoctoral fellow Awanti Sambarey, Ph.D. developed a multimodal AI model to predict treatment outcomes of tuberculosis (TB) patients. 

“TB is the world’s deadliest infectious disease, affecting millions of people each year. The goal of my lab is to develop new innovative solutions to stop the spread of drug resistant pathogens like those that cause TB,” Chandrasekaran said.

Biomedical features

In the study, published in iScience, the researchers analyzed multimodal data including diverse biomedical data from clinical tests, genomics, medical imaging and drug prescription from TB patients. By analyzing data from patients with varying levels of drug resistance, they discovered biomedical features predictive of treatment failure. They also uncovered drug regimens effective against specific sets of drug resistant TB patients. 

“This was a highly interdisciplinary study involving U-M faculty in the School of Medicine, Public Health and Engineering,” Chandrasekaran said.

“Our multimodal AI model accurately predicted treatment prognosis and outperformed existing models that focus on a narrow set of clinical data,” Chandrasekaran added.

“A main finding was identifying drug regimens that were effective against certain types of drug-resistant TB across countries. This is very important due to the spread of drug-resistant TB,” added Sambarey.

TB is the world’s deadliest infectious disease, affecting millions of people each year. The goal of my lab is to develop new innovative solutions to stop the spread of drug resistant pathogens like those that cause TB.” 

--Sriram Chandrasekaran, Ph.D. 

Most meaningful clinical factors

Using AI, the team examined more than 5,000 patients. 

“This is real-world data we’re talking about, so patients from different countries have different admission protocols,” she said. “We worked with more than 200 biomedical features in our analysis; we examined demographic information such as age and gender as well as prior treatment history. We also noted if the patients had other comorbidities, such as HIV, and then we worked with several imaging features such as their X-ray, CT scans, data from the pathogens, drug-resistance data, as well as genomic features and what mutations the pathogen had.”

“It’s really difficult clinically to look at the data all together,” Sambarey said.

 “Typically, you would look at it separately. I think that’s where AI comes in handy. When clinicians look at all of this data, it can be overwhelming. Here, our research is able to identify the most meaningful clinical features.”

The team also studied the impact of the type of drug resistance that was present. 

“You can look at a specific snapshot of the data, such as genomic features and find what mutations the infecting pathogen had and ask what some of the long-term treatment implications are,” she added. 

Surprisingly, they found certain drug combinations worked better in patients with some types of resistance but not others, leading to treatment failure. 

Hope for personalized treatment

The researchers also found that drugs with antagonistic pharmaceutical interactions could result in worse outcomes. 

“Using AI to weed out antagonistic drugs early in the drug-discovery process can avoid treatment failure down the line,” Chandrasekaran noted. 

“The AI model can also be eventually tailored to identify drug regimens suitable for individuals with certain comorbidities,” he added. 

 “One thing I definitely want to say is instead of a one size fits all treatment approach, we hope that the study of multimodal data will help physicians treat patients with more personalized treatments to provide the best outcomes,” said Sambarey.

Funding: This study was funded by various programs at the University of Michigan including the Precision Health Initiative, the Office of Vice-Provost for Research, the Michigan Institute of Clinical and Health Research (MICHR), the Michigan Medicine Pandemic Research Recovery program, and MCUBED. The authors are also grateful for the US National Institute of Health grants R56AI150826 and R01AI150826 for funding this study.

Additional authors: Co-authors include Zhenhua Yang, Ph.D. from the U-M School of Public Health’s Department of Epidemiology and Prachi Agrawal, M.B.B.S. from Michigan Medicine Department of Radiology. BME students Kirk Smith, Carolina Chung and Harkirat Singh Arora also contributed to this study. 

Citation: “Integrative analysis of multimodal patient data identifies personalized predictors of tuberculosis treatment prognosis,” Awanti Sambarey, Kirk Smith, Carolina Chung, Harkirat Singh Arora, Zhenhua Yang, Prachi Agarwal, and Sriram Chandrasekaran, iScience (2024). DOI: 10.1016/j.isci.2024.109025

Written by Michelle Santillan, communications manager for biomedical engineering at the University of Michigan

Sign up for Health Lab newsletters today. Get medical tips from top experts and learn about new scientific discoveries every week by subscribing to Health Lab’s two newsletters, Health & Wellness and Research & Innovation.

Sign up for the Health Lab Podcast: Add us on SpotifyApple Podcasts or wherever you get you listen to your favorite shows.


More Articles About: infectious disease TB Emerging Technologies Lungs and Breathing medical devices Radiology & Diagnostic Imaging
Health Lab word mark overlaying blue cells
Health Lab

Explore a variety of healthcare news & stories by visiting the Health Lab home page for more articles.

Media Contact Public Relations

Department of Communication at Michigan Medicine

[email protected]


Tuberculosis bacteria image
Health Lab
Immune system targets vitamin B12 pathway to neutralize tuberculosis bacteria
Immune system compound itaconate shown to block vitamin B12 pathway that tuberculosis-causing bacteria need to survive.
Stay Informed

Want top health & research news weekly? Sign up for Health Lab’s newsletters today!

Featured News & Stories pills floating blue pink dark background physician in middle looking at chart white coat scrubs
Health Lab
Better medical record-keeping needed to fight antibiotic overuse, studies suggest
Efforts to reduce overuse of antibiotics may be hampered by incomplete medical records that don’t show the full reasons for prescriptions.
zoom screens with 7 different backgrounds and doctor silhouettes outlined in each
Health Lab
The doctor is in…. but what’s behind them?
A study reveals that what a doctor has behind them during a telehealth visit can make a difference in how the patient feels about them and their care.
surgery gloves passing tool blue and yellow
Health Lab
A universal heparin reversal drug is shown effective in mice
The newest version of the heparin reversal drug, described in a recent issue of Advanced Healthcare Materials, adjusted the number of protons bound to it, making the molecule less positive so it would preferentially bind to the highly negative heparin, resulting in a much safer drug.
left mom and son holding hands in blue long sleeves with medals on after run and on right young man standing in red sleeves top with sunglasses on sunny smiling
Health Lab
Despite tremendous hurdles, a young man is thankful for “the ultimate gift of life”
Young man with cystic fibrosis gets organ donation that changes his life
blue gloves in hospital hanging IV bag
Health Lab
Commonly used antibiotic brings more complications, death in the sickest patients
In emergency rooms and intensive care units across the country, clinicians make split-second decisions about which antibiotics to give a patient when a life threatening infection is suspected. Now, a study reveals that these decisions may have unintended consequences for patient outcomes.
cancer cell blue yellow
Health Lab
Widening inequality seen where cancer clinical trials are available
The availability of clinical trials of new treatments for cancer varies greatly by geography, and a new study shows more socially vulnerable areas have far fewer.