All projects

Tangible interaction · [DA COMPLETARE: contesto, es. MAS SUPSI] · 2019

Talki

A device that lets children learn words in another language by pointing it at things around them. Point it at a mug, a pen, an apple — Talki recognises the object and says the word out loud.

Type

[DA COMPLETARE: progetto accademico, corso]

Team

Giorgio Ratti, Caterine Apruzzese

Year

2019

Users

Primary school children and teachers

Output

[DA COMPLETARE: prototipo funzionante o mock-up?]

Talki: a small laser-cut wooden box with a camera on the front
Talki: a camera, a speaker, and nothing else to operate.

The idea

Children learn a language faster when the word is attached to something real. A picture of a mug in a textbook is one thing; the mug on the table in front of you is another.

So the question was: what if learning a word started from the object rather than from the page?

Talki is a physical interface with a camera and an internal speaker. You point it at an object, it recognises what it is, and it pronounces the word in the language you're learning. No screen, no typing, no menus — you aim it at something and listen.

It's polyglot: the same object can be named in several different languages.

How it works

01

Put an object in front of it

Talki sits on the table and looks ahead. Place something in its field of view and it recognises it and says the word.

02

Or pick it up and aim

Small enough to hold in two hands, so a child can carry it around the room and point it at whatever they find.

03

Listen

The answer comes as sound, not as text. The child hears how the word is pronounced, which is the part a written translation can't give.

The front of Talki: the camera lens above the engraved name
The front: one camera, and a face that tells you which way to point it.

Small enough to be carried

The size was a design constraint, not an afterthought. A device a child can hold in two hands and carry across a classroom behaves differently from one that stays on a desk: it turns looking for objects into part of the lesson.

Talki next to an apple, for scale
Next to an apple.
Talki next to a lemon, for scale
And next to a lemon — both of them things it can name.

In the classroom

The use we designed for is a teacher introducing a topic. Instead of listing the words, the teacher asks the class to go and find objects related to it, and Talki names each one as the children track it down.

The learning happens through searching and pointing rather than through repeating, and the words stay attached to the objects they came from.

Talki held in two hands, pointed at objects on a table: an orange, a tape dispenser, a banana, scissors
Held in two hands and aimed at whatever is on the table.

Talki in use

The device in use: point it at an object and it says the word out loud.

Decisions

[DA COMPLETARE: le decisioni reali, con il trade-off dichiarato per ciascuna. Le tre che mi aspetterei, ma che devi confermare o correggere tu:]

[DA COMPLETARE: perché un oggetto dedicato invece di un'app su telefono, che avrebbe già camera e altoparlante. Trade-off?]

[DA COMPLETARE: perché solo audio, senza schermo. Cosa ci avete guadagnato e cosa ci avete perso?]

[DA COMPLETARE: la tecnologia di riconoscimento. Modello pre-esistente, servizio cloud, training vostro? E funzionava davvero o era simulato?]

Where it stopped

[DA COMPLETARE: l'esito onesto. È stato testato con bambini veri? È rimasto un prototipo? Cosa avreste fatto dopo, e cosa non ha funzionato?]

Talki held in one hand, seen from the side
One hand is enough.
Talki pointed at a banana and a pair of scissors on the table
Pointing is the whole interface.