An approach to an intelligent training system for cochlea implant users - how to motivate hearing

Introduction The combination of digital games and educational tools is a new development in the therapist´s work with hearing-impairments. In the scope of an interdisciplinary research project we aim to develop the prototype of a digital game for cochlea-implant users. We integrate an interactive storytelling design and an educational tool with dynamic difficulty adaption depending on the individual performance of the user.

Intend goal is to construct a highly motivational environment where the player has the chance to enter the so-called “flow experience” by fitting individual skill level to the given level in the game. We asked how to assess systematically the competencies of hearing after a cochlea implantation in adults in order to capture the individual skill level.

Methods Therefor the “Evidence Centered Design” (ECD) provides a conceptual design framework. We initially defined a) the domain of hearing in context of cochlear-implant-users (domain analysis and modelling) to define furthermore b) the competence model, c) the evidence model with evidence rules and a statistical model, and d) a task model that is a framework for description and construction of measurable situations and tasks.

Results We distinguish between spatial hearing, non-lingual (sounds) and lingual hearing (phonemes, words, sentences and texts). In specific pools items are rated by different parameters (e.g. sound characters, word frequency and number of words) to generate questions and answers depending on the player´s competence.

Conclusion It seems to be possible to combine linguistics and computer science in educational and storytelling game-design for usage in the rehabilitation of cochlea-implant users. Clinical trials are intended.

ZIM Netzwerkförderung, VDI und VDE Innovation + Technik GmbH, FKZ 16KN069201

Publication History

Article published online:
10 June 2020