Twinkle: Programming with Color

Jay Silver (MIT)

Abstract

Twinkle allows anyone to program using colors in the real world. Twinkle uses a color sensor to read colors from arrangements of objects, drawings, or collages all in the physical world. Those colors are then mapped to certain actions, like sounds, robotic movements, or any type of program execution in the virtual world. The result is that you can program a computer or a robot, or compose a musical score, just by drawing on a piece of paper with crayons. Of course it’s not limited to crayons, you could build your program with Legos, arrange your program with the multi colored leaves of early Fall, or think of any collection of objects in the world as a program, even a handful of M&Ms. The musical score functionality is already implemented and exemplified in the video. Future work, to be finished by January 2010, will include programming robots and computers with color.

Documents

http://tei-conf.org/10/uploads/Program/p383.pdf

Comments (how to comment)



video type clip id
author:

(hint: password is 'teirox')

(hint: you need to put a username in the 'author' field)

TEI, the conference on tangible, embedded, and embodied interaction, is about HCI, design, interactive art, user experience, tools and technologies, with a strong focus on how computing can bridge atoms and bits into cohesive interactive systems.

Sign-up for our low-volume list to get news & updates on TEI'10.

The official hash tag of TEI'10 is #teiconf. Use this in your tweets to share with other TEIers.

Or, follow our Twitter user, TEI10, to see what we have to say about TEI, in 140 chars or less of course ;-)

Hallmark Cards

Crayola

BudgeText

Microsoft Research Cambridge

Oblong Industries

Human Media Lab