MULTISPEECH

Speech Modeling for Facilitating Oral-Based Communication

Department 4 : Knowledge and Language Management

Team leader : Denis Jouvet
Tél. : +33 3 54 95 86 26
Mail : denis.jouvet@loria.fr

Website

Presentation

Speech is the scientific object of our group, with the objectives of better understanding how humans product and perceive speech, and of elaborating efficient interactions between human beings and machines via automatic speech processing.
A first theme consists in studying the links between articulatory features, acoustic cues and human perception. Within the case of language learning this helps to design acoustic feedback which can improve speech production.
Providing feedback often requires acoustic cues to be extracted from the speech signal. This consti- tutes a second activity which becomes important with the emergence of applications concerning speech pathologies and disorders. The construction of models, either acoustic for automatic speech recognition, linguistic for speech to speech translation, or articulatory for studying speech production, is the third activity of our group and plays a central role in our scientific approach.

Research activities

  • Multimodal speech
  • Speech recognition and annotation
  • Speech to speech translation

Software

  • Soja
  • WinSnoori
  • Jtrans
  • J-Safran
  • Xarticulators

International collaborations

  • Moacyr Alvim Horta Barbosa da Silva (AssistantProfessor) and Paulo Cezar Pinto Carvalho (Professor), Escola de Matematica Aplicada, Rio de Janeiro
  • Olov Engwall (Assistant Professor), KTH, Stockholm
  • Petros Maragos (Professor), National Technical University of Athens
  • Noureddine Ellouze (Professor) and Kaïs Ouni (Professor) ENIT, Tunis
  • Jean Schoentgen (Senior Scientist, FNRS), ULB, Brussels
  • Paavo Leppänen (Senior Scientist), University of Jyväskylä, Finland
  • Susanne Fuchs (Senior Scientist), ZAS, Berlin

Keywords

Automatic speech recognition, stochastic modeling, phonetics, multimodal speech process- ing, speech synthesis, foreign language learning, speech disorders, speech to speech translation, articu- latory modeling, speech analysis

Now

Colloquium Loria 2017
Presentations and videos

Logo du CNRS
Logo Inria
Logo Université de Lorraine