In the MANGAN project, the University Computing Centre of the University of Leipzig, together with the two Leipzig companies BUCHFUNK GmbH and ifabrik GmbH, is researching procedures for metadata extraction in audio content and innovative search approaches based on this.

enlarge the image: Illustration of a person wearing headphones
Graphic: URZ/MANGAN

Duration: 01.04.2022 - 31.03.2025

Funding Organisation: Federal Ministry of Education and Research (BMBF)

Participating institutions of Leipzig University:
University Computer Centre (Research and Development Department)

Project description

Requirements

The availability of spoken audio content is increasing rapidly: audio books, audio plays, but also podcasts, radio reports, spoken content in print media and, last but not least, film content from talk shows to documentaries and feature films are based on spoken audio content.

Challenge

The content must be made accessible to users and, above all, found by them. This requires simple and precise extraction of metadata in order to integrate the content effectively and efficiently into the value chain. On the other hand, powerful and intuitive search approaches are playing an increasingly important role - especially against the backdrop of an increasing individualisation of consumption.

Background of an increasing individualisation of consumption.

Project goals

The goals of the project are two central innovation steps in the area of spoken audio content:

  • Methods for automated metadata extraction will be developed and applied, indexing e.g. the content of a spoken audio file, but also other aspects such as the voice pitch and age of the speakers.
  • Based on this metadata, an intuitive search will be developed and tested. Users are to be given targeted, individual access to spoken content on the basis of the MIC profile (Mood, Intent, Context) - a search procedure based on moods, intentions and contexts. The project makes audio content immediately more attractive and visible and thus forms an important building block for the independence of smaller players in a market dominated by international IT corporations - and has a positive radiance for the entire industry.

Consortium and associated partners

The consortium comprises three partners from Leipzig‛s IT, media and creative industries, covering the main areas of application (BUCHFUNK), scientific and technical issues (University Computer Centre of Leipzig University) and implementation (ifabrik). As associated partners, Argon Verlag, the streaming portal BookBeat, the content aggregator Zebralution, the German Centre for Accessible Reading (DZB), the book trade group Thalia as well as MVB as a business subsidiary of the German Publishers & Booksellers Association support the consortium in requirements elicitation, evaluation and dissemination of the results.

  • Thalia
  • Bookbeat
  • Argon Publishing House
  • Zebralution
  • DZB
  • MVB

Project funding

This project is funded by the BMBF as part of the kmuInnovativ programme under FKZ 01IS22011.

Persons involved