TOSCA-MP · Task-oriented search and content annotation for media production

TOSCA-MP aims to develop user-centric content annotation and search tools for professionals in networked media production and archiving (television, radio, online), addressing their specific use cases and workflow requirements. This will be achieved by scalable and distributed content processing methods performing advanced multimodal information extraction and semantic enrichment. Other key technology areas will include search methods across heterogeneous networked content repositories and novel user interfaces. An open standards based service oriented framework integrates the components of the system.TOSCA-MP will enable professionals in media production and archiving to seamlessly access content and indexes from distributed heterogeneous repositories in the network. This will be achieved by providing technologies that allow instant access to a large network of distributed multimedia databases, including beyond state-of-the-art metadata linking and alignment. The distributed repositories can be accessed through a single user interface that provides novel methods for result presentation, semi-automatic annotation and means of providing implicit user feedback.TOSCA-MP enables content holders to leverage scalable distributed processing in the network. The networked approach enables the use of in-house or external service models. Thus, content holders can use these services without giving content out of their hands. Advanced genre-adaptive indexing methods provide multilingual speech processing, object detection, quality analysis, semantic enrichment based on visual and speech analysis, enrichment from external sources and multimodal content clustering.The project will develop models of key user tasks in the audiovisual media production workflow. These models are used to adapt the components of the system to the specific and dynamic requirements of real user tasks in the media production domain, and to evaluate the tools in a cost-effective way.