Institutional Repository of Key Laboratory of Mental Health, CAS
Audiovisual synchrony detection for fluent speech in early childhood: An eye-tracking study | |
Zhou, Han-yu1,2; Yang, Han-xue1,2; Wei, Zhen3; Wan, Guo-bin3; Lui, Simon S. Y.4; Chan, Raymond C. K.1,2 | |
第一作者 | Zhou, Han-yu |
通讯作者邮箱 | [email protected] (raymond c. k. chan) |
心理所单位排序 | 1 |
摘要 | During childhood, the ability to detect audiovisual synchrony gradually sharpens for simple stimuli such as flashbeeps and single syllables. However, little is known about how children perceive synchrony for natural and continuous speech. This study investigated young children's gaze patterns while they were watching movies of two identical speakers telling stories side by side. Only one speaker's lip movements matched the voices and the other one either led or lagged behind the soundtrack by 600 ms. Children aged 3-6 years (n = 94, 52.13% males) showed an overall preference for the synchronous speaker, with no age-related changes in synchrony-detection sensitivity as indicated by similar gaze patterns across ages. However, viewing time to the synchronous speech was significantly longer in the auditory-leading (AL) condition compared with that in the visual-leading (VL) condition, suggesting asymmetric sensitivities for AL versus VL asynchrony have already been established in early childhood. When further examining gaze patterns on dynamic faces, we found that more attention focused on the mouth region was an adaptive strategy to read visual speech signals and thus associated with increased viewing time of the synchronous videos. Attention to detail, one dimension of autistic traits featured by local processing, has been found to be correlated with worse performances in speech synchrony processing. These findings extended previous research by showing the development of speech synchrony perception in young children, and may have implications for clinical populations (e.g., autism) with impaired multisensory integration. |
关键词 | audiovisual autistic traits eye-tracking speech synchrony detection |
2022-03-29 | |
语种 | 英语 |
DOI | 10.1002/pchj.538 |
发表期刊 | PSYCH JOURNAL |
ISSN | 2046-0252 |
页码 | 10 |
期刊论文类型 | 实证研究 |
收录类别 | SCI |
资助项目 | National Science Foundation China[31970997] ; CAS Key Laboratory of Mental Health, Institute of Psychology ; Philip K. H. Wong Foundation |
出版者 | WILEY |
WOS关键词 | TEMPORAL BINDING WINDOW ; CHILDREN ; PERCEPTION ; ATTENTION ; EVENTS ; AUTISM ; DISCRIMINATION ; INDIVIDUALS ; SENSITIVITY ; EXPLICIT |
WOS研究方向 | Psychology |
WOS类目 | Psychology, Multidisciplinary |
WOS记录号 | WOS:000774214400001 |
WOS分区 | Q3 |
资助机构 | National Science Foundation China ; CAS Key Laboratory of Mental Health, Institute of Psychology ; Philip K. H. Wong Foundation |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.psych.ac.cn/handle/311026/42386 |
专题 | 中国科学院心理健康重点实验室 |
通讯作者 | Chan, Raymond C. K. |
作者单位 | 1.Chinese Acad Sci, Neuropsychol & Appl Cognit Neurosci Lab, CAS Key Lab Mental Hlth, Inst Psychol, Beijing, Peoples R China 2.Univ Chinese Acad Sci, Dept Psychol, Beijing, Peoples R China 3.Affiliated Shenzhen Matern & Child Healthcare Hos, Shenzhen, Peoples R China 4.Univ Hong Kong, Dept Psychiat, Hong Kong, Peoples R China |
第一作者单位 | 认知与发展心理学研究室 |
通讯作者单位 | 认知与发展心理学研究室 |
推荐引用方式 GB/T 7714 | Zhou, Han-yu,Yang, Han-xue,Wei, Zhen,et al. Audiovisual synchrony detection for fluent speech in early childhood: An eye-tracking study[J]. PSYCH JOURNAL,2022:10. |
APA | Zhou, Han-yu,Yang, Han-xue,Wei, Zhen,Wan, Guo-bin,Lui, Simon S. Y.,&Chan, Raymond C. K..(2022).Audiovisual synchrony detection for fluent speech in early childhood: An eye-tracking study.PSYCH JOURNAL,10. |
MLA | Zhou, Han-yu,et al."Audiovisual synchrony detection for fluent speech in early childhood: An eye-tracking study".PSYCH JOURNAL (2022):10. |
条目包含的文件 | ||||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Audiovisual synchron(640KB) | 期刊论文 | 出版稿 | 限制开放 | CC BY-NC-SA | 请求全文 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论