Reactive and Continuous Control of HMM-based Speech Synthesis

Astrinaki, Maria; D'alessandro, Nicolas; Picart, Benjamin; Drugman, Thomas; Dutoit, Thierry

Request a copy

Paper published in a journal (Scientific congresses and symposiums)

Reactive and Continuous Control of HMM-based Speech Synthesis

Astrinaki, Maria; D'alessandro, Nicolas; Picart, Benjamin et al.

2012

Permalink
https://hdl.handle.net/20.500.12907/41447

Files (1)Send to Details Statistics Bibliography Similar publications

Files

Full Text

slt2012_mandabptdtd.pdf

Author postprint (246.31 kB)

Request a copy

All documents in ORBi UMONS are protected by a user license.

Send to

RIS BibTex APA Chicago Permalink X Linkedin

Details

Keywords :

[en] speech synthesis, HTS, reactive control

Abstract :

[en] In this paper, we present a modified version of HTS, called performative HTS or pHTS. The objective of pHTS is to enhance the control ability and reactivity of HTS. pHTS reduces the phonetic context used for training the models and generates the speech parameters within a 2-label window. Speech waveforms are generated on-the-fly and the models can be re- actively modified, impacting the synthesized speech with a delay of only one phoneme. It is shown that HTS and pHTS have comparable output quality. We use this new system to achieve reactive model interpolation and conduct a new test where articulation degree is modified within the sentence.

Disciplines :

Mathematics

Author, co-author :

Astrinaki, Maria ; Université de Mons > Faculté Polytechnique > Information, Signal et Intelligence artificielle

D'alessandro, Nicolas ; Université de Mons > Faculté Polytechnique > Information, Signal et Intelligence artificielle

Picart, Benjamin ; Université de Mons > Faculté Polytechnique > Information, Signal et Intelligence artificielle

Drugman, Thomas ; Université de Mons > Faculté Polytechnique > Information, Signal et Intelligence artificielle

Dutoit, Thierry ; Université de Mons > Faculté Polytechnique > Information, Signal et Intelligence artificielle

Language :

English

Title :

Reactive and Continuous Control of HMM-based Speech Synthesis

Publication date :

02 December 2012

Event name :

IEEE Workshop on Spoken Language Technology (SLT)

Event place :

Miami, United States - Florida

Event date :

2012

Research unit :

F105 - Information, Signal et Intelligence artificielle

Research institute :

R450 - Institut NUMEDIART pour les Technologies des Arts Numériques

Available on ORBi UMONS :

since 07 January 2013

Statistics

Number of views

1 (0 by UMONS)

Number of downloads

0 (0 by UMONS)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

Bibliography

T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Simultaneous modeling of spectrum, pitch and duration in hmm-based speech synthesis," IEICE Transactions On Information And Systems, vol. 83, no. 11, pp. 2347-2350, 1999.
H. Zen, K. Tokuda, and A. W. Black, "Statistical parametric speech synthesis," Speech Communication, vol. 51, no. 11, pp. 1039-1064, 2009.
C. L. Bennett, Large Scale Evaluation of Corpus-based Synthesizers: Results and Lessons from the Blizzard Challenge 2005, pp. 105-108, 2005.
[Online], "Hmm-based speech synthesis system (hts)," http://hts.sp.nitech.ac.jp.
N. Campbell, "Differences in the speaking styles of a japanese male according to interlocutor ; showing the effects of affect in conversational speech," Computational Linguistics Chinese Language Processing, vol. 12, no. 1, pp. 1-16, 2007.
K. I. Nordstrom, S. Fels, C. D. Hassall, and B. Pritchard, "Developing vowel mappings for an interactive voice synthesis system controlled by hand motions.," Journal of the Acoustical Society of America, vol. 127, no. 3, pp. 2021, 2010.
A. W. Black and P. Taylor, Automatically clustering similar units for unit selection in speech synthesis, vol. 97vol2pp, pp. 1-4, International Speech Communication Association, 1997.
A. W. Black, Unit selection and emotional speech, pp. 1649-1652, ISCA, 2003.
A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the em algorithm," Journal of the Royal Statistical Society Series B Methodological, vol. 39, no. 1, pp. 1-38, 1977.
J. J. Odell, The Use of Context in Large Vocabulary Speech Recognition, Ph.D. thesis, 1995.
T. Masuko, K. Tokuda, T. Kobayashi, and S. Imai, Voice characteristics conversion for HMM-based speech synthesis system, vol. 3, pp. 1611-1614, Institute of electrical engineers (IEE), 1997.
T. Yoshimura, K. Tokuda, T. Masuko, T. Kobayashi, and T. Kitamura, "Speaker interpolation in hmm-based speech synthesis system," pp. 2523-2526, 1997.
Zhen-Hua Ling, K. Richmond, J. Yamagishi, and Ren-Hua Wang, "Integrating articulatory features into hmmbased parametric speech synthesis," IEEE Transactions On Audio Speech And Language Processing, vol. 17, no. 6, pp. 1171-1185, 2009.
B. Picart, T. Drugman, and T. Dutoit, "Continuous control of the degree of articulation in hmm-based speech synthesis," in Proceedings of Interspeech, August 2011, pp. 1797-1800.
B. Picart, T. Drugman, and T. Dutoit, "Analysis and synthesis of hypo and hyperarticulated speech," in SSW 2010, 2010.
A. W. Black and K. A. Lenzo, "Building synthetic voices," Voices, pp. 1-206, 2003.
K. Sumita and R. Members, "Mel log spectrum approximation (mlsa) filter for speech synthesis," Electronics and Communications in Japan, vol. 6, no. 2, pp. 10-18, 1983.
J. Yamagishi and T. Kobayashi, "Average-voice-based speech synthesis using hsmm-based speaker adaptation and adaptive training," IEICE Transactions On Information And Systems, vol. E90-D, no. 2, pp. 533-543, 2007.
M. J. F. Gales, "Maximum likelihood linear transformations for hmm-based speech recognition," Computer Speech and Language, vol. 12, no. 2, pp. 75-98, 1998.
K. K. Paliwal and B. S. Atal, "Efficient vector quantization of lpc parameters at 24 bits/frame," IEEE Transactions On Speech And Audio Processing, vol. 1, no. 1, pp. 3-14, 1993.
I. Peretz and K. L. Hyde, "What is specific to music processing? insights from congenital amusia," Trends in Cognitive Sciences, vol. 7, no. 8, pp. 362-367, 2003.
K. Oura, A. Mase, T. Yamada, S. Muto, Y. Nankaku, and K. Tokuda, "Recent development of the hmm-based singing voice synthesis system-sinsy," in SSW7 in Kyoto, Japan, 2010, pp. 211-216.
T. Drugman and T. Dutoit, "The deterministic plus stochastic model of the residual signal and its applications," IEEE Transactions On Audio Speech And Language Processing, vol. 20, no. 3, pp. 968-981, 2012.
[Online], "Mage speech synthesis platform (source code)," http://numediart.org/demos/mage phts.