Reproducibility assessment for functional MRI data from repeated examinations

Poster No:

1534 

Submission Type:

Abstract Submission 

Authors:

Petr Hluštík1, Ema Lorková2, Martin Gajdoš2, MIchal Mikl2

Institutions:

1University Hospital Olomouc, Olomouc, Czech Republic, 2MAFIL, CEITEC, Masaryk University, Brno, Czech Republic

First Author:

Petr Hluštík  
University Hospital Olomouc
Olomouc, Czech Republic

Co-Author(s):

Ema Lorková  
MAFIL, CEITEC, Masaryk University
Brno, Czech Republic
Martin Gajdoš  
MAFIL, CEITEC, Masaryk University
Brno, Czech Republic
MIchal Mikl  
MAFIL, CEITEC, Masaryk University
Brno, Czech Republic

Introduction:

When using functional magnetic resonance imaging (fMRI) for longitudinal studies and in the clinical practice (e.g., for planning neurosurgical removal of brain lesions), it is important to assess the reproducibility of the resulting functional maps (Caceres 2009, Noble 2021). The aim of this work was to apply several possible approaches to evaluate reproducibility of fMRI data from repeated visits and when using two different acquisition techniques (single-echo, SE and multi-echo, ME fMRI).

Methods:

For a pilot study, a group of 36 healthy young adults was recruited. Participants underwent 2 fMRI examinations 3 - 5 weeks apart on a 3T MRI scanner (Siemens Prisma) in the MAFIL laboratory, CEITEC Masaryk University, Brno, Czechia. SE/ME BOLD sequence was generously provided by the Center for Magnetic Resonance Research (CMRR) at the University of Minnesota (Xu, 2013). At each visit, 3 tasks (block motor task, block language task and an event-related visual odd-ball task) were performed during 2 separate acquisitions (SE a ME BOLD fMRI). The order of task and acquisition type was randomized for individual participants and visits. Data were processed using SPM12 software and custom scripts in Matlab (Mathworks). Pre-processing included motion correction, combining the data from individual echos for the ME data, spatial normalization and spatial smoothing. For each task, activation maps were calculated using t-statistics. Reproducibility was assessed on t-statistic maps as well as on maps of task effect (con_ files in SPM), as follows: for each participant, similarity metrics between the two visits were calculated using Pearson correlation, cosine similarity and Dice-Sorensen coefficient, both for whole brain and for individual areas from the AAL atlas. Furthermore, reliability maps were calculated using ICC (intra class correlation) in each gray matter voxel a subsequently averaged across individual areas of the AAL atlas.

Results:

Assessing reliability using ICC yielded different results across tasks and the SE/ME acquisitions. Whereas for the motor task, ICC values were higher for SE data (mean 0.32 and max 0.64) than for the ME data (0.24 and 0.58, respectively), in the visual odd-ball task (event-related) ME data yielded higher ICCs (average 0.43, max 0.49) than the SE data (0.39 and 0.50). Similar conclusions were made for correlations of effects between visits: Higher values for SE data for the motor task - cosine similarity 0.49 versus 0.46 for the ME data, and higher values for the ME data from the visual odd-ball task (0.66 ME versus 0.59 SE). Pearson correlation and Dice-Sorensen coefficient yield similar results.

Conclusions:

In the present data, single-echo acquisitions seem to yield higher reproducibility for a robust block design experiment, whereas multi-echo acquisitions seem to provide higher reproducibility for an event-related design. The follow-up work will utilize the presented approaches 1) to assess data from visits at two different MRI sites and 2) to test the effects of advanced fMRI data preprocessing on data reproducibility. Project supported by Ministry of Health of the Czech Republic (Czech Health Research Council) grant nr. NU23-08-00212.

Modeling and Analysis Methods:

Activation (eg. BOLD task-fMRI)
Methods Development 1

Novel Imaging Acquisition Methods:

BOLD fMRI 2

Keywords:

Acquisition
ADULTS
FUNCTIONAL MRI
NORMAL HUMAN
Statistical Methods

1|2Indicates the priority used for review

Abstract Information

By submitting your proposal, you grant permission for the Organization for Human Brain Mapping (OHBM) to distribute your work in any format, including video, audio print and electronic text through OHBM OnDemand, social media channels, the OHBM website, or other electronic publications and media.

I accept

The Open Science Special Interest Group (OSSIG) is introducing a reproducibility challenge for OHBM 2025. This new initiative aims to enhance the reproducibility of scientific results and foster collaborations between labs. Teams will consist of a “source” party and a “reproducing” party, and will be evaluated on the success of their replication, the openness of the source work, and additional deliverables. Click here for more information. Propose your OHBM abstract(s) as source work for future OHBM meetings by selecting one of the following options:

I do not want to participate in the reproducibility challenge.

Please indicate below if your study was a "resting state" or "task-activation” study.

Task-activation

Healthy subjects only or patients (note that patient studies may also involve healthy subjects):

Healthy subjects

Was this research conducted in the United States?

No

Were any human subjects research approved by the relevant Institutional Review Board or ethics panel? NOTE: Any human subjects studies without IRB approval will be automatically rejected.

Yes

Were any animal research approved by the relevant IACUC or other animal research panel? NOTE: Any animal studies without IACUC approval will be automatically rejected.

Not applicable

Please indicate which methods were used in your research:

Functional MRI
Structural MRI

For human MRI, what field strength scanner do you use?

3.0T

Which processing packages did you use for your study?

SPM

Provide references using APA citation style.

Caceres, A., (2009). Measuring fMRI reliability with the intra-class correlation coefficient. NeuroImage, 45(3), 758–768.
Noble, S. (2021). A guide to the measurement and interpretation of fMRI test-retest reliability. Current Opinion in Behavioral Sciences, 40, 27–32.
Xu, J. (2013). Evaluation of slice accelerations using multiband echo planar imaging at 3 T. NeuroImage, 83, 991–1001.

UNESCO Institute of Statistics and World Bank Waiver Form

I attest that I currently live, work, or study in a country on the UNESCO Institute of Statistics and World Bank List of Low and Middle Income Countries list provided.

No