Sikuli is a visual technology to search and automate graphical user interfaces (GUI) using images (screenshots). The first release of Sikuli contains Sikuli Script, a visual scripting API for Jython, and Sikuli IDE, an integrated development environment for writing visual scripts with screenshots easily. Sikuli Script automates anything you see on the screen without internal API’s support. You can programmatically control a web page, a desktop application running on Windows/Linux/Mac OS X, or even an iphone application running in an emulator.
Sikuli is a research project developed by User Interface Design Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL). Sikuli Script and Sikuli IDE are both released under the MIT License.
View the demo here. It is interesting.