Rapid audiovisual temporal recalibration across children and adults

• Yifan Zhao ^[1] ; Runzhou Wang ^[1] ; Hong-Yan Bi ^[1]
  1. [1] University of Chinese Academy of Sciences

     University of Chinese Academy of Sciences

     China

     
• Localización: Applied psycholinguistics, ISSN 0142-7164, Vol. 46, Nº 1, 2025
• Idioma: inglés
• DOI: 10.1017/S0142716425000098
• Texto completo no disponible (Saber más ...)
• Resumen

  • Audiovisual temporal integration ability, reflected by the size of the temporal binding window (TBW), plays an important role in reading. The audiovisual TBW is not fixed, but dynamically changes during the integration process, this is referred to as rapid temporal recalibration. To investigate the rapid audiovisual temporal recalibration ability across age and its correlation with reading, the present study conducted simultaneity judgment (the index includes ΔPSS and ΔTBW) tasks involving speech (Experiment 1; children: Mage = 10.70, adults: Mage = 24.52) and non-speech (Experiment 2; children: Mage = 10.19, adults: Mage = 24.26) audiovisual stimuli in native Mandarin-Chinese-speaking child and adult groups (n = 36 in each group). Results showed that children’s ΔPSS and ΔTBW for speech stimuli were comparable to those of adults. However, when examining trial-by-trial changes in TBW during the integration process, a gap between children and adults was evident. Besides, for non-speech stimuli, children significantly differed from adults in both ΔPSS indicators and the integration process. Moreover, for both children and adults, the correlation and regression analysis showed that the rapid audiovisual temporal recalibration ability of both speech and non-speech stimuli explained reading fluency uniquely after controlling TBW, age, and gender.

• Referencias bibliográficas
  • Alsius, A., Navarra, J., Campbell, R., & Soto-Faraco, S. (2005). Audiovisual integration of speech falters under high attention demands....
  • Beneventi, H., Tønnessen, F. E., Ersland, L., & Hugdahl, K. (2010). Executive working memory processes in dyslexia: behavioral and fMRI...
  • Benjamini, Y., & Hochberg, Y. (1995). Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal...
  • Birch, H. G., & Belmont, L. (1964). Auditory-visual integration in normal and retarded readers. American Journal of Orthopsychiatry, 34(5),...
  • Burr, D., & Gori, M. (2012). Multisensory integration develops late in humans. In Murray, M. M. & Wallace, M. T. (Eds.), The Neural...
  • Chein, J. M., & Schneider, W. (2005). Neuroimaging studies of practice-related change: fMRI and meta-analytic evidence of a domain-general...
  • Chen, Y. C., Shore, D. I., Lewis, T. L., & Maurer, D. (2016). The development of the perception of audiovisual simultaneity. Journal of...
  • De Niear, M. A., Noel, J. P., & Wallace, M. T. (2017). The impact of feedback on the different time courses of multisensory temporal recalibration....
  • Dijkstra, T., Schreuder, R., & Frauenfelder, U. H. (1989). Grapheme context effects on phonemic processing. Language and Speech, 32(2),...
  • Dixon, N. F., & Spitz, L. (1980). The detection of auditory visual desynchrony. Perception, 9(6), 719–721.CrossRefGoogle ScholarPubMed
  • Ernst, M. O., & Bülthoff, H. H. (2004). Merging the senses into a robust percept. Trends in Cognitive Sciences, 8(4), 162–169.CrossRefGoogle...
  • Francisco, A. A., Groen, M. A., Jesse, A., & McQueen, J. M. (2017). Beyond the usual cognitive suspects: the importance of speechreading...
  • Francisco, A. A., Jesse, A., & McQueen, J. M. (2014). Audiovisual temporal sensitivity in typical and dyslexic adult readers. In Interspeech...
  • Francisco, A. A., Jesse, A., Groen, M. A., & McQueen, J. M. (2017). A general audiovisual temporal processing deficit in adult readers...
  • Fujisaki, W., Shimojo, S., Kashino, M., & Nishida, S. Y. (2004). Recalibration of audiovisual simultaneity. Nature Neuroscience, 7(7),...
  • Gori, M., Ober, K. M., Tinelli, F., & Coubard, O. A. (2020). Temporal representation impairment in developmental dyslexia for unisensory...
  • Hairston, W. D., Burdette, J. H., Flowers, D. L., Wood, F. B., & Wallace, M. T. (2005). Altered temporal profile of visual-auditory multisensory...
  • Harvey, C., van der Burg, E., & Alais, D. (2014). Rapid temporal recalibration occurs crossmodally without stimulus specificity but is...
  • Hillock-Dunn, A., Grantham, D. W., & Wallace, M. T. (2016). The temporal binding window for audiovisual speech: children are like little...
  • Hood, M., & Conlon, E. (2004). Visual and auditory temporal processing and early reading development. Dyslexia, 10(3), 234–252.CrossRefGoogle...
  • Keetels, M., Bonte, M., & Vroomen, J. (2018). A selective deficit in phonetic recalibration by text in developmental dyslexia. Frontiers...
  • Koelewijn, T., Bronkhorst, A., & Theeuwes, J. (2010). Attention and the multiple stages of multisensory integration: a review of audiovisual...
  • Laasonen, M., Service, E., & Virsu, V. (2002). Crossmodal temporal order and processing acuity in developmentally dyslexic young adults....
  • Lewkowicz, D. J. (1996). Perception of auditory-visual temporal synchrony in human infants. Journal of Experimental Psychology: Human Perception...
  • Lewkowicz, D. J., & Flom, R. (2014). The audiovisual temporal binding window narrows in early childhood. Child Development, 85, 685–694.CrossRefGoogle...
  • Liu, S., Wang, L. C., & Liu, D. (2019). Auditory, visual, and cross-modal temporal processing skills among Chinese children with developmental...
  • Meng, Z. L., Liu, M. L., & Bi, H.-Y. (2022). Spatial and temporal processing difficulties in Chinese children with developmental dyslexia:...
  • Meng, Z. L., Wydell, T. N., & Bi, H.-Y. (2019). Visual-motor integration and reading Chinese in children with/without dyslexia. Reading...
  • Mossbridge, J., Zweig, J., Grabowecky, M., & Suzuki, S. (2017). An association between auditory-visual synchrony processing and reading...
  • Murray, M. M., Lewkowicz, D. J., Amedi, A., & Wallace, M. T. (2016). Multisensory processes: a balancing act across the lifespan. Trends...
  • Navarra, J., Hartcher-O’Brien, J., Piazza, E., & Spence, C. (2009). Adaptation to audiovisual asynchrony modulates the speeded detection...
  • Navarra, J., Soto-Faraco, S., & Spence, C. (2007). Adaptation to audiotactile asynchrony. Neuroscience Letters, 413(1), 72–76.CrossRefGoogle...
  • Navarra, J., Vatakis, A., Zampini, M., Soto-Faraco, S., Humphreys, W., & Spence, C. (2005). Exposure to asynchronous audiovisual speech...
  • Noel, J. P., De Niear, M. A., Stevenson, R., Alais, D., & Wallace, M. T. (2017). Atypical rapid audio-visual temporal recalibration in...
  • Noel, J. P., De Niear, M. A., van der Burg, E., & Wallace, M. T. (2016). Audiovisual simultaneity judgment and rapid recalibration throughout...
  • Pammer, K., & Vidyasagar, T. R. (2005). Integration of the visual and auditory networks in dyslexia: a theoretical perspective. Journal...
  • Perrachione, T. K., Del Tufo, S. N., Winter, R., Murtagh, J., Cyr, A., Chang, P., Halverson, K., Ghosh, S., Christodoulou, J., & Gabrieli,...
  • Powers, A. R., Hevey, M. A., & Wallace, M. T. (2012). Neural correlates of multisensory perceptual learning. Journal of Neuroscience,...
  • Powers, A. R., Hillock, A. R., & Wallace, M. T. (2009). Perceptual training narrows the temporal window of multisensory binding. Journal...
  • Qian, Y., Deng, Y., Zhao, J., & Bi, H. Y. (2015). Magnocellular-dorsal pathway function is associated with orthographic but not phonological...
  • Sato, Y., & Aihara, K. (2011). A Bayesian model of sensory adaptation. PloS One, 6(4), e19377.CrossRefGoogle ScholarPubMed
  • Stevenson, R. A., & Wallace, M. T. (2013). Multisensory temporal integration: task and stimulus dependencies. Experimental Brain Research,...
  • Stevenson, R. A., Fister, J. K., Barnett, Z. P., Nidiffer, A. R., & Wallace, M. T. (2012). Interactions between the spatial and temporal...
  • Tanaka, A., Koizumi, A., Imai, H., Hiramatsu, S., Hiramoto, E., & de Gelder, B. (2010). I feel your voice: cultural differences in the...
  • Theves, S., Chan, J. S., Naumer, M. J., & Kaiser, J. (2020). Improving audio-visual temporal perception through training enhances beta-band...
  • van der Burg, E., & Goodbourn, P. T. (2015). Rapid, generalized adaptation to asynchronous audiovisual speech. Proceedings of the Royal...
  • van der Burg, E., Alais, D., & Cass, J. (2013). Rapid recalibration to audiovisual asynchrony. Journal of Neuroscience, 33, 14633–14637.CrossRefGoogle...
  • van der Burg, E., Alais, D., & Cass, J. (2015). Audiovisual temporal recalibration occurs independently at two different time scales....
  • van der Burg, E., Olivers, C. N. L., Bronkhorst, A. W., & Theeuwes, J. (2008). Pip and pop: nonspatial auditory signals improve spatial...
  • van Wassenhove, V., Grant, K. W., & Poeppel, D. (2007). Temporal window of integration in auditory-visual speech perception. Neuropsychologia,...
  • Vercoulen, J. H., Swanink, C. M., Fennis, J. F., Galama, J. M., van der Meer, J. W., & Bleijenberg, G. (1994). Dimensional assessment...
  • Vidyasagar, T. R., & Pammer, K. (2010). Dyslexia: a deficit in visuo-spatial attention, not in phonological processing. Trends in Cognitive...
  • Virsu, V., Lahti-Nuuttila, P., & Laasonen, M. (2003). Crossmodal temporal processing acuity impairment aggravates with age in developmental...
  • Vroomen, J., & Keetels, M. (2010). Perception of intersensory synchrony: a tutorial review. Attention, Perception, and Psychophysics,...
  • Wu, H. D. (2020). Visual, Auditory and Cross-Modal Temporal Sensitivity of Chinese Children with Developmental Dyslexia and Their Effects...
  • Yuan, X. Y., & Huang, X. T. (2011). Temporal recalibration in multisensory integration. Advances in Psychological Science, 19(5), 692–700.Google...
  • Zaidel, A., Goin-Kochel, R. P., & Angelaki, D. E. (2015). Self-motion perception in autism is compromised by visual noise but integrated...
  • Zhou, H. Y., Shi, L. J., Yang, H. X., Cheung, E. F., & Chan, R. C. (2020). Audiovisual temporal integration and rapid temporal recalibration...