Statistical analysis of bilingual speaker's speech for cross-language voice conversion

Masanobu Abe, Kiyohiro Shikano, Hisao Kuwabara

Research output: Contribution to journalArticlepeer-review

19 Citations (Scopus)

Abstract

The goal of cross-language voice conversion is to preserve the speech characteristics of one speaker when that speaker's speech is translated and used to synthesize speech in another language. In this paper, two preliminary studies, i.e., a statistical analysis of spectrum differences in different languages and the first attempt at a cross-language voice conversion, are reported. Speech uttered by a bilingual speaker is analyzed to examine spectrum difference between English and Japanese. Experimental results are (1) the codebook size for mixed speech from English and Japanese should be almost twice the codebook size of either English or Japanese; (2) although many code vectors occurred in both English and Japanese, some have a tendency to predominate in one language or the other; (3) code vectors that predominantly occurred in English are contained in the phonemes /r/, /æ/, /f/, /s/, and code vectors that predominantly occurred in Japanese are contained in /i/, /u/, /N/; and (4) judged from listening tests, listeners cannot reliably indicate the distinction between English speech decoded by a Japanese codebook and English speech decoded by an English codebook. A voice conversion algorithm based on codebook mapping was applied to cross-language voice conversion, and its performance was somewhat less effective than for voice conversion in the same language.

Original languageEnglish
Pages (from-to)76-82
Number of pages7
JournalJournal of the Acoustical Society of America
Volume90
Issue number1
DOIs
Publication statusPublished - Jul 1991
Externally publishedYes

ASJC Scopus subject areas

  • Arts and Humanities (miscellaneous)
  • Acoustics and Ultrasonics

Fingerprint Dive into the research topics of 'Statistical analysis of bilingual speaker's speech for cross-language voice conversion'. Together they form a unique fingerprint.

Cite this