hola-lens

This project deals with methods and possible solutions to remember a language better. We created a playful language learning environment with the application hola-lens, realised in Unity 3D Engine in combination with the Microsoft HoloLens. By interacting with the whole surroundings and placed objects, the user will learn a language by combining different senses. In this use-case, users will learn Spanish and allows him to experience an immerse and memorable learning exploration.

Home is an familiar and close environment - it is where people recover, feel connected and possibly reflect about their day. The whole experience is going to happen with the user in the main focus. For every action the user does he gets feedback. To start with, speech recognition and and sounds are used to make it more personal and to get the user right into the gameplay. The system asks to find an object, for example a tree. When the user found it, he has to point on it with a hand gesture and say "there it is". The systems congrats the user and continues with new vocabulary. The visual objects fit together and belong to a category (in our case nature). This leads to the opportunity of connecting words and telling a unique story. As users have a relationship to existing objects in their homes, it is easier to think back and remember when walking by. Physical gestures integrate users and make them part of the event.

The concept involves different combinations and levels of difficulties. The first one would be counting objects to learn numbers. Also, adding time pressure "Name as many objects as you can see in 60 seconds". In addition for the advanced levels, explaining and value situations in a full sentence could be taken into consideration. In the end of the experience, users can see their personal progress and achievements within a timeline.