Computer Science > Human-Computer Interaction
Title:ClearTalk: Data-Driven Mandarin Articulation Analysis and Personalized Communication Support for Children with Dysarthria
Abstract:Children with dysarthria may experience reduced intelligibility and difficulty expressing everyday needs. ClearTalk is a smartwatch-based system that converts Mandarin speech-recognition differences into interpretable articulatory profiles for personalized practice and staged communication. Target and recognized utterances are aligned at the syllable level, summarized across seven articulatory positions, and ranked by a count-sensitive asymmetric heuristic. For 13 dysarthric speakers from the Mandarin Dysarthria Speech Corpus, system syllable-level accuracy showed a Pearson correlation of 0.908 with expert intelligibility, with an R-squared value of 0.824 and a p-value below 0.001. The system-selected priority targets achieved an 86.7 percent overlap with the consensus of three blinded speech-language pathologists; across 210 target consonants, automated labels achieved 86.7 percent agreement, a Cohen's kappa of 0.76, and a macro-F1 score of 0.81. In a balanced single-session pilot with 15 children, mean pre/post gains were 14.4, 29.4, and 27.7 percentage points for mild, moderate, and severe groups, while communication-round completion rates were 81.3, 66.7, and 48.0 percent. These findings support the feasibility of using interpretable patterns of speech errors to guide wearable articulation practice and communication assistance.
| Comments: | 5 pages, 3 figures, 1 table. Accepted to the IEEE ICDM 2026 Teen Research Track |
|---|---|
| Subjects: | Human-Computer Interaction (cs.HC) ; Computation and Language (cs.CL) |
| Cite as: | arXiv:2611.21639 [cs.HC] |
| (or arXiv:2611.21639v1 [cs.HC] for this version) | |
| https://doi.org/10.48550/arXiv.2611.21639 arXiv-issued DOI via DataCite (pending registration) |
Submission history
Access Paper:
- HTML (experimental)
Additional Features
- Audio Summary
Current browse context:
References & Citations
- Google Scholar
- Semantic Scholar
BibTeX formatted citation
Bookmark
Bibliographic and Citation Tools
Code, Data and Media Associated with this Article
Demos
Recommenders and Search Tools
arXivLabs: experimental projects with community collaborators
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.