In this paper, we investigate a DNN tone-based extended recognition network (ERN) approach to Mandarin tone recognition and tone mispronunciation detection. Given a toneless syllable sequence, a tone-based ERN is constructed by assigning five different tones to each toneless syllable, obtaining a fully expanded tonal syllable network. Next, Viterbi decoding is carried out on the tone-based ERN to find the best tone sequence. With respect to the tone recognition task, different acoustic units, and DNN configurations are compared. The experimental results show that tonal phone and longer DNN input window achieve better recognition performance. Moreover, we have applied confidence score extracted from tone-based ERN to verify whether L2 learners' tones are correctly pronounced. Compared with the conventional tone-based GOP (Goodness of Pronunciation) system, the proposed framework reduces the equal error rate by 10.98% relative.

Using tone-based extended recognition network to detect non-native Mandarin tone mispronunciations

SINISCALCHI, SABATO MARCO;
2017

Abstract

In this paper, we investigate a DNN tone-based extended recognition network (ERN) approach to Mandarin tone recognition and tone mispronunciation detection. Given a toneless syllable sequence, a tone-based ERN is constructed by assigning five different tones to each toneless syllable, obtaining a fully expanded tonal syllable network. Next, Viterbi decoding is carried out on the tone-based ERN to find the best tone sequence. With respect to the tone recognition task, different acoustic units, and DNN configurations are compared. The experimental results show that tonal phone and longer DNN input window achieve better recognition performance. Moreover, we have applied confidence score extracted from tone-based ERN to verify whether L2 learners' tones are correctly pronounced. Compared with the conventional tone-based GOP (Goodness of Pronunciation) system, the proposed framework reduces the equal error rate by 10.98% relative.
978-988-14768-2-1
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: http://hdl.handle.net/11387/123763
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 2
  • ???jsp.display-item.citation.isi??? ND
social impact