Master Projects

Here you find an overview about our currently available master projects. If you have not found a project that interests you, but are interested in doing your master project at IMRG, please direct contact Prof. Dr. Schwabe

Conversational skills are a key competence in many professional fields. Virtual reality (VR) makes it possible to train this interactively and situationally by providing an artificial agent with which a natural conversation situation can be practiced. In this thesis, a prototypical conversation simulation for specific communication situations will be designed, implemented and evaluated.

The focus of this master project is on the development of a conversation engine. This should use the capabilities of existing speech-to-text, text-to-text, text-to-speech and possibly speech-to-speech models to enable natural conversation. Specifically, the development work includes connecting to the APIs of the selected foundation models and prompting the models accordingly. The costs for the interaction with the selected models will be covered. Furthermore, an interface to a VR engine will be specified and integrated. In addition, the project embraces the design of a flexible architecture and guidance on how to adapt to different scenarios. This may include, for example, the identification of prompting patterns that are effective in simulating consistent personalities. Finally, the prototype should be formatively evaluated and ideally published as an open source project.

The VR environment in which the created agent will be active and the virtual representation of the agent will be developed in a separate project. A close collaboration with the student in this separate thesis is expected.

We are looking for a group of max. three students who like to explore and are willing to explore the capabilities of existing foundation models / large language models. Good programming skills are very welcome. If one of the students is interested in VR or AR this might be of advantage for the progress of the project. Willingness to collaborate with external partners is required.

For more information contact Mateusz Dolata