The Consequences of Statistical Tests on Using Proxy Measurements in Place of Gold Standard Measurements: An Application to Magnetic Resonance Spectroscopy

Abstract

The use of proxy measurements in biomedical science is ubiquitous, due to the infeasibility or unavailability of gold-standard (i.e., most precise, accurate, and/or validated) measurements. For example, in magnetic resonance spectroscopy (MRS), short-echo time (TE) sequences are frequently employed to estimate difficult-to-measure metabolites such as GABA, despite J-difference editing being the recommended gold-standard for improved metabolic specificity. This work investigates the critical relationship between the correlation of proxy and gold-standard measurements and the associated false positive (FPR) and false negative (FNR) rates of statistical tests performed on proxy measurements. Through statistical simulations, we demonstrate that even moderately high correlations (0.6-0.7), reported in the literature for short-TE vs. J-edited estimated GABA, can lead to drastically inflated FPRs and FNRs. We show that these rates are highly sensitive to the magnitude of any introduced bias in the proxy measurement ({delta}) and the underlying true effect size ({Delta}). For instance, a small, unmeasured bias in short-TE estimated GABA, potentially arising from macromolecule contamination, can substantially inflate FPRs. Conversely, imperfect correlation can significantly reduce statistical power, leading to high FNRs, which may explain some discrepancies within the literature. Although this work focuses specifically on the relationship between short-TE and MEGA-edited GABA, the arguments presented here apply more broadly to other difficult-to-measure metabolites in MRS (e.g., glutathione, 2-hydroxyglutarate), or generally to any circumstance where statistical tests are performed on the readily available proxy measurements in place of gold-standard measurements.