The Speaking Skeleton

Closed Computer Science Games Engineering Bachelor Master Project Thesis Games Research Lab

Motivation

The TipToi pen by Ravensburger allows children to have texts read or music played to them when they scan markers in according books. Its potential use reaches another dimension when enabling blind persons to explore complex three-dimensional structures and, for example, provide ample information to the bones and anchors of a human skeleton model.

This has been done by Sandra Karch and her team of the Bildungszentrum für Blinde und Sehbehinderte (bbs) in Nuremberg.

Goal

Now the project needs to scale up and ensure that an effective learning tool emerges: First, the annotation pipeline has to be automatized, i.e. optical ID markers (OIDs) need to be automatically generated (tttool, ImageJ), associated with according audio files (recorded by a collaboration partner) or with texts (from anatomy books) read by tttool’s speech synthesis tool. Second, a quiz game needs to be designed and implemented that asks about certain muscles and the player needs to find and point at its proper anchors in a well-defined order. A spaced repetition learning model needs to be integrated to ensure learning success in addition to auditive feedback and rewarding achievements.

Prerequisites

• Excellent programming skills
• Passion for game design
• Experience in user-centered engineering

Contact Persons at the University Würzburg