AhoStage: Development of an automatic manager for scenic shows

Project

Final Master work

Teacher

Ibon Saratxaga

Faculty

Bilbao School of Engineering, University of the Basque Country (UPV/EHU)

Company

Euskadiko Ekoizle Eszenikoen Elkartea

Course

2021/2022

Description

This project aims to create an automatic system that is able to identify at each moment the point of the script in which the show is located and notify the different scene systems that control the music, lights and other effects, so that they can act as planned in their respective escalations.

This will be done using a dubbing system, AhoDubber, which uses Voice Activity Detection (VAD) with multiple input microphones and in real time, so that it can detect who is speaking at the moment. In addition, the system uses the script encoded in an ex-professo developed format to place each intervention of the actors in the context of that script and to issue the corresponding dubbed intervention. This project aims to extend its functionality to enable the application in addition to dubbing recordings, to resolve additional tasks of the technical stage staff (lights, effects, audio) and to be integrated into the set of applications that they typically use.

 

The following tasks will be performed:

  1. Review and update VAD algorithms to provide maximum robustness against noise or interference with other actors
  2. Definition of the recommended platform for the system, indicating both the hardware requirements and, most especially, the software control applications with which the Automatic Manager will interact, such as: QLAB, Show Cue System, MadMapper, DMX drivers, Open Stage Control
  3. Design and implementation of a sequencing signal generation module that will communicate to the control systems the evolution of the work on the scene.
  4. Participation in testing the new system in a realistic environment.
  5. Writing reports and user manuals for the application.

 

>> Go back to the Projects section

No image