AMISCO: The Austrian German Multi-Sensor Corpus

TitleAMISCO: The Austrian German Multi-Sensor Corpus
Publication TypeConference Proceedings
Year of Publication2016
AuthorsPessentheiner, H., Pichler T., & Hagmüller M.
Conference NameInternational Conference on Language Resources and Evaluation (LREC)
Series Title10th edition of the Language Resources and Evaluation Conference
Date Published05/2016
Conference LocationPortorož, Slovenia
Keywordsdatabase, delay of arrival, distant speech recognition, fundamental frequency, glottogram, joint detection, joint estimation, kinect, laryngograph, multi-sensor

We introduce a unique, comprehensive Austrian German multi-sensor corpus with moving and non-moving speakers to facilitate the evaluation of estimators and detectors that jointly detect a speaker's spatial and temporal parameters. The corpus is suitable for various machine learning and signal processing tasks, linguistic studies, and studies related to a speaker's fundamental frequency (due to recorded glottograms). Available corpora are limited to (synthetically generated/spatialized) speech data or recordings of musical instruments that lack moving speakers, glottograms, and/or multi-channel distant speech recordings. That is why we recorded 24 spatially non-moving and moving speakers, balanced male and female, to set up a two-room and 43-channel Austrian German multi-sensor speech corpus. It contains 8.2 hours of read speech based on phonetically balanced sentences, commands, and digits. The orthographic transcriptions include around 53,000 word tokens and 2,070 word types. Special features of this corpus are the laryngograph recordings (representing glottograms required to detect a speaker's instantaneous fundamental frequency and pitch), corresponding clean-speech recordings, and spatial information and video data provided by four Kinects and a camera.

Citation Key3321
Refereed DesignationRefereed
SPSC cross-references
Research Area: 
paper.pdf2.93 MB
poster.pdf497.62 KB