Shop : Details
Shop
Details
Oktober 2024
In Vorbereitung
Patrick Meyer
Contributions to Automatic Interaction Analysis of Meetings
Psychological interaction analyses (IAs) of face-to-face meetings are typically based on a large number of audio and video recordings that must be carefully annotated manually before the actual analysis can start. Since this process is very time-consuming and costly, it limits not only the amount of data that can be taken into account but also the level of detail that can be reached in the analysis. Therefore, the automatic interaction analysis (AIA) of meetings has become a vital research topic, which aims to facilitate psychological interaction studies by developing methods for the automatic processing and analysis of meetings.
For an AIA of meetings based on acoustic data, high-quality audio recordings of each meeting participant are required. This is best achieved by multichannel audio recordings, in which each meeting participant is equipped with a close-talk microphone and recorded in an individual target microphone channel. However, crosstalk is a common problem with such audio recordings and disturbs the speech signals of the participants by each other. As a result, crosstalk significantly complicates the processing of the audio signals and also strongly affects the performance of speech analysis methods for an AIA.
For this purpose, this thesis presents an overall meeting emotion analysis system (OMEAS), which is able to deal with high-level crosstalk. It consists of three methods that in combination reduce the crosstalk in the target microphone signals, detect all utterances of the target speakers, and estimate the emotions of the speakers in each detected utterance. The provided output signals can then be used as basis for further analyses, so that the OMEAS already facilitates and improves the time-consuming annotation process for psychological IAs.
For an AIA of meetings based on acoustic data, high-quality audio recordings of each meeting participant are required. This is best achieved by multichannel audio recordings, in which each meeting participant is equipped with a close-talk microphone and recorded in an individual target microphone channel. However, crosstalk is a common problem with such audio recordings and disturbs the speech signals of the participants by each other. As a result, crosstalk significantly complicates the processing of the audio signals and also strongly affects the performance of speech analysis methods for an AIA.
For this purpose, this thesis presents an overall meeting emotion analysis system (OMEAS), which is able to deal with high-level crosstalk. It consists of three methods that in combination reduce the crosstalk in the target microphone signals, detect all utterances of the target speakers, and estimate the emotions of the speakers in each detected utterance. The provided output signals can then be used as basis for further analyses, so that the OMEAS already facilitates and improves the time-consuming annotation process for psychological IAs.
Schlagwörter: Machine Learning; Audio Signal Processing; Meeting Interaction Analysis
Mitteilungen aus dem Institut für Nachrichtentechnik der Technischen Universität Braunschweig
Herausgegeben von Prof. Dr.-Ing. U. Reimers, Prof. Dr.-Ing. T. Kürner und Prof. Dr.-Ing. T. Fingscheidt, Braunschweig
Band 82
Export bibliographischer Daten
Shaker Verlag GmbHAm Langen Graben 15a52353 Düren
Mo. - Do. 8:00 Uhr bis 16:00 UhrFr. 8:00 Uhr bis 15:00 Uhr
Kontaktieren Sie uns. Wir helfen Ihnen gerne weiter.
