U-M Approach Could Improve the Accuracy of Cancer Clinical Trials

An innovative way of assessing clinical trial-related imaging could reduce the kinds of errors that can distort results, study finds.

5:00 AM

Author | Ian Demsky

Website display of brain scans
A look at the web portal developed for TRAC. Image credit: Mirabella Olszewski

An innovative approach to analyzing the medical scans of patients in clinical trials could help ensure the accuracy of trial results while reducing the workload for busy oncologists, according to a new study by researchers at the University of Michigan Rogel Cancer Center.

The approach, which was first implemented at U-M in 2016, could serve as a model for improving imaging assessments at other cancer centers where clinical trials are conducted, the researchers say.

Across the country, new and experimental therapies are available to patients with cancer through clinical trials. The effectiveness of a new drug or treatment approach is often evaluated based on measurements of changes seen in patients' tumors using a variety of imaging techniques — such as MRI, CT and PET scans.

The problem, however, is that individual variability and unintentional bias on the part of the physicians interpreting the scans can skew the results. This has the potential to make new therapies seem either better or worse than they actually are. It can also affect patient care, leading to patients being taken off of or staying on trials when they shouldn't.

To limit such distortions, the Rogel Cancer Center created a tumor response assessment core — or TRAC for short.

An assessment of TRAC, which was published in JNCCN the journal of the National Comprehensive Cancer Network — showed it did indeed lead to better measurements.

Only a handful of cancer centers across the country have developed similar systems, with dedicated imaging cores and web-based platforms, the study notes.

 "At any given moment, we have hundreds of people enrolled in clinical trials at our cancer center," says study senior author Vaibhav Sahai, MBBS, a medical oncologist at Michigan Medicine who led the development of the new approach. "Before TRAC, the majority of the imaging analyses were done by medical oncologists, and this is very common across the country."

There are two main downsides to this approach, Sahai notes.

The first drawback is that medical oncologists — that is, doctors who specialize in diagnosing and treating cancer patients — usually don't receive the same degree of specialized training in quantitative imaging analysis as their colleagues in radiology and nuclear medicine. And it's difficult, on top of a busy caseload of patients, to be deeply versed in the many evaluation methods employed across different trials.

"Different trials use different measurements of response, depending on the cancer type and the drug type," Sahai says as he opens up the custom web portal developed at U-M for TRAC. "We have an investigator-initiated trial open with a drug that may cause tumor swelling as a result of damage to the cancer. This treatment response might be interpreted as progression, and one could end up thinking the drug has no value unless you check for tumor density or functional activity.

"Tumor swelling or 'pseudo-progression' is also possible in patients receiving immunotherapy medications, and correct use and application of response assessment criteria is crucial for accurate assessment of our patients receiving these novel drugs on clinical trials," he adds.

The mission of TRAC was to create independent, unbiased and verifiable measurements of our patients' response during clinical trials, and the results of our study show that this approach lives up to that goal.
Vaibhav Sahai, MBBS

The second drawback is that medical oncologists' familiarity with their patients may lead them, unintentionally, to be biased in their evaluations.

"We care about our patients. We want them to do well. We want to keep them on trials. We want to believe our care is helping them," Sahai says. "So, it can be sometimes hard to do an unbiased assessment — which is what the clinical trial and the patient both deserve."

To improve clinical trial response assessments, the Rogel Cancer Center launched TRAC in 2016 and created a new image analyst role, staffed with highly trained specialists. The center also created a new workflow that includes an initial review by the image analyst, followed by review by radiologists who specialize in that particular type of cancer. The process also includes a method for involving outside input to help resolve disagreements or ambiguities.

At the time of the paper's publication, TRAC had been used in more than 175 clinical trials across many types of cancer, assisting with assessments of more than 1,500 scans.

In the recent study to analyze TRAC's effectiveness, researchers used records for 49 lung cancer patients treated at U-M between 2005 and 2015, before the new system was in place. The patients' imaging scans were sent through the TRAC process, where they were reviewed by an image analyst and two board-certified radiologists; another radiologist also performed a separate, independent review. These results were then compared to the medical oncologists' original assessments.

"We found substantial agreement between the TRAC analysis and the radiologists' evaluations," notes Sahai, an associate professor of internal medicine. "We found only moderate agreement between the assessments by medical oncologists and TRAC. These differences have the potential to affect patient treatment and trial outcomes."

As an added benefit, the new approach greatly improved the efficiency for analysis of cancer clinical trials at U-M. The turnaround time for tumor measurements decreased from 33 days to 3 days, the study team reported.

"The mission of TRAC was to create independent, unbiased and verifiable measurements of our patients' response during clinical trials, and the results of our study show that this approach lives up to that goal," Sahai says. "We published a detailed explanation of the workflow and the software we created in hopes of being a model for other cancer centers, and thus to help improve the accuracy of clinical trial results for patients everywhere."

This study was supported by the National Cancer Institute (P30CA046592).

Additional authors on the paper include Katherine E. Hersberger, Mishal Mendiratta-Lala, Rocky Fischer, Ravi K. Kaza, Isaac R. Francis, Mirabella S. Olszewski, John F. Harju, Wei Shi, Frank J. Manion and Mahmoud M. Al-Hawary, all of U-M. 

Paper cited: Quantitative Imaging Assessment for Clinical Trials in Oncology," JNCCN. DOI: 10.6004/jnccn.2019.7331

More Articles About: Health Tech Cancer Research Rogel Cancer Center Cancer: Help, Diagnosis & Treatment
Health Lab word mark overlaying blue cells
Health Lab

Explore a variety of healthcare news & stories by visiting the Health Lab home page for more articles.

Media Contact Public Relations

Department of Communication at Michigan Medicine

[email protected]


Stay Informed

Want top health & research news weekly? Sign up for Health Lab’s newsletters today!

Featured News & Stories cancer cell blue yellow
Health Lab
Widening inequality seen where cancer clinical trials are available
The availability of clinical trials of new treatments for cancer varies greatly by geography, and a new study shows more socially vulnerable areas have far fewer.
The Fundamentals Podcast Hero Card Final 1800 x 1350
The Fundamentals
If they don't give up, how can I give up?
Today on The Fundamentals is Dr. Maria Castro, the R.C. Schneider collegiate professor of neurosurgery, and a professor of cell and developmental biology at the University of Michigan Medical School. Her research program aims to develop immunotherapies for primary and metastatic brain cancer, studying basic immune biology mechanisms leading to clinical implementation. She has been inducted into the American Association for the Advancement of Sciences, the Latin American Academy of Sciences, and the American Institute for Medical and Biological Engineering College of Fellows. She has won numerous awards for her contributions to basic science and cancer research and is a diversity ambassador for the Cancer Biology Graduate Training Program. You can learn more about Dr. Castro here, and you can follow her @castro2355_mg, the Rogel Cancer Center @UMRogelCancer, the department of neurosurgery @umichneuro, Michigan Neurscience Institute @UM_MNI and the department of cell and developmental biology @UMCDB on X
stained glass green blue purple orange pink
Health Lab
Massive study identifies new biomarkers for renal cancer subtypes, improving diagnosis and—eventually—treatment
A study led by University of Michigan Health Rogel Cancer Center researchers identifies novel biomarkers in renal cell carcinomas.
Scientific illustration of gliobastoma cells in the brain
Health Lab
Path forward for glioblastoma treatment
Experts in brain cancer outline current discoveries and offer a path of hope for glioblastoma treatment
Illustration of hand holding list, with pill bottle in opposite and and small pic of doctor talking to patient
Health Lab
New urine-based test detects high grade prostate cancer, helping men avoid unnecessary biopsies
A new urine-based test addresses a major problem in prostate cancer: how to separate the slow growing form of the disease unlikely to cause harm from more aggressive cancer that needs immediate treatment.
Blue image of a microscopic helix strand
Health Lab
Researchers discover urine based test to detect head and neck cancer
At-home test can detect tumor DNA fragments in urine samples, providing a non-invasive alternative to traditional blood-based biomarker tests