Experiment · Claude Dev Day
AI Reading Pen
A child still learning to read needs it in their own language more than anybody.
Public repo · built for Claude Dev Day
An ESP32 camera is pointed at a printed Marathi or Hindi word. The Mac recognises it, selects a reviewed lesson, and teaches the child to say it, syllable by syllable. श · ळा · शाळा.
How it works
The camera streams to a laptop. A recognition model reads the word. Words inside the reviewed twenty-four-card pack get a hand-checked lesson with cached audio. Words outside the pack get an auto-generated drill, clearly labelled as such. An optional “your turn” step records about three seconds of the child’s speech for transcription; that audio is held in memory only and never written to disk.
What it is not
It is not a product. It is the sentence at the top of this page built in hardware, and it is public so that anyone who wants to build the same thing for their own language can start from something that runs.
Source
The repository is public under an MIT licence, with the firmware, the recogniser, the lesson content and the event-day runbook.