CLSP Homepage : Workshop Homepage
Workshop 2000

Team Goals and Members
Project Description
Closing Day Presentation (html) (ppt)
Final Report
Team Goals and Members
  Name E-Mail Affiliation
Neti, Chalapathy IBM
Potamianos, Gerasimos IBM
Luettin, Juergen IDIAP
Matthews, Iain HCII, CMU
Glotin, Herve ICP/IDIAP-Grenoble, France
Vergyri, Dimitra Johns Hopkins Univ
Sison, June UC – Santa Cruz
Mashari, Azad U. Toronto
Zhou, Jie Johns Hopkins Univ

Relevant Papers
  • Auditory-visual speech recognition by hearing-impaired subjects: Consonant recognition , sentence recognition, and auditory-visual integration. Grant, K.W., Walden, B.E., and Seitz, P.F.
    J. Acoust. Soc. Am., 103, 2677-2690.(1998).

  • The use of visible speech cues for improving auditory detection of spoken sentences. Grant, K.W., and Seitz, P.F. J.
    Acoust. Soc. Am. (in press).

  • Audio-Visual Speech Modelling for Continuous Speech Recognition. S. Dupont and J. Luettin.
    To appear in IEEE Transactions on Multimedia, 2000. Abstract BibTeX

  • Speech Reading. J. Luettin.
    Modern Interface Technology: The Leading Edge, 1999. BibTeX

  • Continuous Audio-Visual Speech Recognition. J. Luettin and S. Dupont.
    Proc. 5th European Conference on Computer Vision, 1998. PostScript Abstract BibTeX Publication(s) with similar content: TechReport

  • Speechreading using Probabilistic Models. J. Luettin and N. A. Thacker.
    Computer Vision and Image Understanding, 1997. PostScript Abstract BibTeX Publication(s) with similar content: TechReport

  • Visual Speech and Speaker Recognition. J. Luettin,
    University of Sheffield, 1997. PostScript Abstract BibTeX

  • Active Shape Models for Visual Speech Feature Extraction. J. Luettin, N.A. Thacker, and Steve W. Beet.
    Speechreading by Humans and Machines, 1996. PostScript Abstract BibTeX

  • A comparison of active shape models and scale decomposition based features for visual speech recognition. I. Matthews, J. A. Bangham, R. Harvey and S. Cox.
    Proc. European Conference on Computer Vision (ECCV), pp 514-528. Freiburg, 1998. (872k)

  • Lipreading from shape shading and scale. I. Matthews, J. A. Bangham, R. Harvey and S. Cox.
    Proc. Auditory-Visual Speech Processing (AVSP), pp 73-78. Terrigal, 1998. (170k)

  • Features for Audio-Visual Speech Recognition. I. Matthews.
    PhD thesis, School of Information Systems, University of East Anglia, Norwich, UK, 1998. (4.2M)

  • Scale based features for audio-visual speech recognition. I. Matthews, J. A. Bangham and S. Cox.
    IEE Colloquium on Integrated Audio-Visual Processing for Recognition, Synthesis and Communication, pp 8/1-8/7. London, 1996. (427k)

  • Joint proccessing of audio and visual information for multimedia indexing and human-computer interaction. C.Neti, B.Maison, A.Senior, G.Iyengar, P.deCuetos, S.Basu, A.Verma.
    RIAO April 12-14 2000, Paris, France.(pdf)

  • Audio-visual intent-to-speak detection for human-computer interaction. C.Neti, P.deCuetos A.Senior.
    ICASSP June 5-9 2000, Istanbul, Turkey.(pdf)

  • A cascade image transform for speaker independent automatic speechreading. G. Potamianos, A. Verma, C. Neti, G. Iyengar.
    International Conference on Multimedia and Expo (ICME00), New York, July 2000.(pdf)

  • Audio-Visual speaker recognition for video broadcast news. C. Neti, Andrew Senior.
    DARPA HUB4 Workshop, Washington D.C., March 1999.(pdf)

  • Speaker adptation for audio-visual automatic speech recognition. G.Potamianos, A.Potamianos.
    Eurospeech, Budapest vol# 3, pp.1291-1294, 1999 (pdf)

  • Linear descriminant analysis for speechreading. G.Potamianos, H.P.Graf.
    IEEE Work. Multimedia Signal Process. Los Angeles, pp.221-226, 1998 (pdf)

  • An image transform approach for HMM based automatic lipreading. G.Potamianos, H.P.Graf, E.Cosatto.
    Int. Conf. Image Process. Chicago, vol. 111 pp. 173-177, 1998 (pdf)

  • Discriminative training of HMM stream exponents for audio-visual speech recognition. G.Potamianos, H.P.Graf.
    Int. Conf. Acoust. Speech Signal Process. Seattle, vol. 6, pp. 3733-3736, 1998.(pdf)

  • Discriminative Learning of Visual Data for Audiovisual Speech Recognition. A. Rogozan.
    International Journal on Artificial Intelligence Tools (World Scientific Publisher), Vol. 8 No. 1, pages 43-52, March 1999.(ps)

  • Adaptive Fusion of Acoustic and Visual Sources for Automatic Speech Recognition. A. Rogozan and P. Deléglise.
    Speech Communication Journal, Vol. 26 Iss. 1-2, pages 149-161, December 1998.(ps)

  • Adaptive Determination of Audio and Visual Weights for Automatic Speech Recognition. A. Rogozan, P. Deléglise and M. Alissal.
    (poster) Proceedings of the Audio and Visual Speech Processing Workshop, Rhodes, Greece, pages 61-64, September 1997. (ppt) Abstract

  • Interfacing of {CASA} and Multistream Recognition. H. Glotin and F. Berthommier and E. Tessier and H. Bourlard
    TSD'98-Text, Speech and Dialog International Workshop, BRNO-Czech Republic, Sept 1998, Pages 207-212, (ps)

  • Elaboration et étude comparative d'un système adaptatif de reconnaissance robuste de la parole en sous-bandes : incorporation d'indices primitifs F0 et ITD. Hervé Glotin
    Doctorat de l'Institut National Polytechnique de Grenoble - ICP and IDIAP, 2000

  • Modeling visual co-articulation for large vocabulary continuous visual speech recognition. A. Mashari, J. Sison, C. Neti, G. Potamianos, J.Luettin
    ICASSP 2001 Conference Student Forum ( Abstract