GlobalPhone Language Models



by Ngoc Thang Vu, Tanja Schultz, 2012

Introduction

GlobalPhone is an ongoing database collection that provides transcribed speech data for the development and evaluation of large speech processing systems in the most widespread languages of the world. GlobalPhone is designed to be uniform across languages with respect to the amount of text and audio data per language, the audio data quality (microphone, noise, channel), the collection scenario (task, setup, speaking style etc.), and the transcription conventions. The GlobalPhone corpus provides an excellent basis for research in the areas of (1) multilingual speech recognition, (2) rapid deployment of speech processing systems to new languages, (3) language and speaker identification tasks, (4) multilingual speech synthesis, (5) monolingual speech recognition in a large variety of languages, as well as (6) comparisons across major languages based on text and speech data.

Download 3-gram Language Models

LanguagesPerplexity (PPL)OOV [%]Vocabulary sizeDownload
Bulgarian 454 1.0 274k BG.lm
Czech 1421 4.0 267k CZ.lm
French 324 2.4 65k FR.lm
German 672 0.3 38k GE.lm
Hausa 97 0.5 41k HAU.lm
Croatian 721 3.6 362k HR.lm
Japanese 89 1.0 67k JP.lm
Korean(char) 25 0 1.3k KO.lm
Mandarin 262 0.8 13k MAN.lm
Portuguese 58 9.8 62k PT.lm
Polish 951 0.8 243k PL.lm
Russian 1310 3.9 293k RU.lm
Spanish 154 0.1 19k SP.lm
Swedish 423 5.3 73k SWE.lm
Tamil 730 1.0 288k TA.lm
Thai 70 0.1 22k TH.lm
Turkish XXX 13.2 29k TU.lm
Vietnamese 218 0 30k VN.lm


Contact

Tanja Schultz - tanja dot schultz at uni-bremen dot de

Acknowledgements

We would like to thank to all who have helped us to collect the data corpus.

References

1. GlobalPhone: A Multilingual Text and Speech Database in 20 Languages. Tanja Schultz, Ngoc Thang Vu, and Tim Schlippe. In Proc. of ICASSP, Canada, 2013. pdf
2. Language Independent and Language Adaptive Acoustic Modeling for Speech Recognition. Tanja Schultz and Alex Waibel, Speech Communication, Volume 35, Issue 1-2, pp 31-51. pdf
3. GlobalPhone: A Multilingual Speech and Text Database developed at Karlsruhe University. Tanja Schultz. In Proc. of the International Conference of Spoken Language Processing, ICSLP, Denver, CO, 2002. pdf
4. Rapid Bootstrapping of five Eastern European Languages using the Rapid Language Adaptation Toolkit. Ngoc Thang Vu, Tim Schlippe, Franziska Kraus, and Tanja Schultz. In Proc. of Interspeech, Japan, 2010. pdf
5. Cross-language bootstrapping based on completely unsupervised training using multilingual A-stabil. Ngoc Thang Vu, Franziska, Tanja Schultz. In Proc. of ICASSP, Czech, 2011. pdf

For further Publications on language specific issues, please refer to the CSL publication page

 

CSL Logo rot webseite 

 
Contact
Cognitive Systems Lab
Prof. Dr.-Ing. Tanja Schultz
 
Enrique-Schmidt-Str. 5
28359 Bremen
Germany

Phone: +49 (0) 421 218 64270
E-Mail: