Simple and efficient steps to improve task-fMRI reliability in the ABCD Study

Poster No:

1068 

Submission Type:

Abstract Submission 

Authors:

Bader Chaarani1

Institutions:

1UVM, Essex Junction, VT

First Author:

Bader Chaarani  
UVM
Essex Junction, VT

Introduction:

Task-based functional magnetic resonance imaging (fMRI) is a critical neuroimaging technique for understanding brain function. Low reliability is a common concern in task-fMRI analyses because it directly affects the validity and robustness of the findings, including in large datasets such as the ABCD study. The aim of this study is to 1) assess the within-session reliability of task-fMRI data from the ABCD study at each of the four timepoints (ages 9-10; 11-12; 13-14 & 15-16) using intraclass correlation coefficient (ICC) analyses, and 2) test if simple preprocessing steps can improve data reliability.

Methods:

Task-fMRI data from the ABCD study included the primary contrasts from three different cognitive tasks: the Stop Signal task (SST), the N-back task and the monetary incentive delay (MID) task. A rigorous quality control was conducted according to standard ABCD imaging procedures. In addition, participants with poor performance on the tasks were excluded. Vertexwise BOLD activation maps were calculated for each contrast at each time point as the Cohen's D. ICCs were computed at the vertex level, assessing within-session reliability between run 1 and run 2 beta-weights for a given vertex across all participants for each timepoint. Further, ICCs were recalculated after normalizing beta-weights across runs, restricting the vertices to only "active" ones with higher signal (as calculated by Cohen's D) and restricting scans to those with the lowest motion (as evaluated by framewise displacement).

Results:

After applying all quality control steps, over 20,000 scans (~8000 unique children) were included in the longitudinal analyses across the four time points. Overall, all tasks showed robust bilateral activation patterns across timepoints, with the highest activation levels in areas of the cortex known to play a key role in cognitive function (Figure 1). ICCs significantly increased by 40 to 80% across tasks after applying the preprocessing steps, reaching moderate to high reliability levels (Figure 2-A). Moreover, ICC measures of the three tasks improved with age for the majority of contrasts, coupled with improvements in task performance (Figure 2-B). Notably, the N-back contrasts demonstrated the highest reliability among the three tasks at all time points, followed by the SST contrasts. The complete preprocessing code is freely available for the research community.
Supporting Image: OHBM25_Fig1.png
   ·Figure 1. Activation maps for each task across four time points, thresholded at Cohen's D >.2.
Supporting Image: OHBM25_Fig2.png
   ·Figure 2. A- Mean ICC values after each processing step in the Nback task. B) Mean ICC for all tasks/contrasts across time after restricting the analyses to only include active areas (Cohen's D>.2).
 

Conclusions:

These findings suggest that task-fMRI reliability improves after simple yet efficient data preprocessing steps in the ABCD dataset. Researchers may consider preprocessing their data and restricting their analyses to tasks/contrasts and regions, vertices, or voxels with higher reliability to enhance the statistical robustness of neuroimaging research.

Higher Cognitive Functions:

Executive Function, Cognitive Control and Decision Making 2

Learning and Memory:

Working Memory

Modeling and Analysis Methods:

Activation (eg. BOLD task-fMRI) 1
Methods Development

Keywords:

Development
FUNCTIONAL MRI

1|2Indicates the priority used for review

Abstract Information

By submitting your proposal, you grant permission for the Organization for Human Brain Mapping (OHBM) to distribute your work in any format, including video, audio print and electronic text through OHBM OnDemand, social media channels, the OHBM website, or other electronic publications and media.

I accept

The Open Science Special Interest Group (OSSIG) is introducing a reproducibility challenge for OHBM 2025. This new initiative aims to enhance the reproducibility of scientific results and foster collaborations between labs. Teams will consist of a “source” party and a “reproducing” party, and will be evaluated on the success of their replication, the openness of the source work, and additional deliverables. Click here for more information. Propose your OHBM abstract(s) as source work for future OHBM meetings by selecting one of the following options:

I do not want to participate in the reproducibility challenge.

Please indicate below if your study was a "resting state" or "task-activation” study.

Task-activation

Healthy subjects only or patients (note that patient studies may also involve healthy subjects):

Healthy subjects

Was this research conducted in the United States?

Yes

Are you Internal Review Board (IRB) certified? Please note: Failure to have IRB, if applicable will lead to automatic rejection of abstract.

Yes, I have IRB or AUCC approval

Were any human subjects research approved by the relevant Institutional Review Board or ethics panel? NOTE: Any human subjects studies without IRB approval will be automatically rejected.

Yes

Were any animal research approved by the relevant IACUC or other animal research panel? NOTE: Any animal studies without IACUC approval will be automatically rejected.

No

Please indicate which methods were used in your research:

Functional MRI

For human MRI, what field strength scanner do you use?

3.0T

Which processing packages did you use for your study?

Other, Please list  -   Matlab

Provide references using APA citation style.

N/A

UNESCO Institute of Statistics and World Bank Waiver Form

I attest that I currently live, work, or study in a country on the UNESCO Institute of Statistics and World Bank List of Low and Middle Income Countries list provided.

No