Sikuli uses screen shots to run scripts, is amazing

If you ever find yourself doing repetitive task on your computer, pay attention. Sikuli is an important step toward removing the barrier between the average computer user and programming.
Normally, to make a computer do a repetitive task, you'd need to understand a programming language like Java, Objective C or C#. To perform some remedial task like starting iTunes and kicking off a play list you'd need to write a whole mess of code and understand the API's for that application.
Sikuli gets around this by using picture based computing. Instead of needing intimate knowledge of a particular API or language you simply use Sikuli script to take an action on an area of the screen it finds by you giving it a picture.
Confused?
Ok, let's take our iTunes example, say I want to open the app, find a particular play list, then click the play button. To do that simple task by traditional means would take a decent amount of code. With Sikuli, it's three lines and looks like this.

Amazing stuff. See the video below for a more thorough explanation. The Sikuli script and IDE are a free download and work on any platform that can run Java. I highly recommend you check this one out and be sure to post the cool scripts you've made in the comments.













Comments
9
Subscribe to commentsan303042Jan 30th 2010 12:11PM
very cool
pat_boy2008Jan 30th 2010 12:23PM
This looks really cool, but I can't get it to work on Linux Mint 8. I can't even get it to something a simple as double click the Firefox icon. I installed all the needed libraries, but it won't do anything.
I might try the Windows version later. Maybe I'll have more luck out of it.
pat_boy2008Jan 31st 2010 10:38PM
Tried the Windows version on Windows 7 x64 bit and it works great. I'm not sure what's up with the Linux version.
rcarmJan 30th 2010 3:36PM
I can't get it to run on Windows 7 x64.
ChuckJJan 30th 2010 4:12PM
I can get it to run, but it doesnt seem to work right sometimes. It looks to me like its more geared for a MAC, and most of the support goes toward the MAC. Im sure its suppose to work on Windows but I think its obvious they are MAC users and more development is for a MAC unfortunately.
mvpJan 30th 2010 4:42PM
Only problem I had with windows 7 64 is running some programs like firefox so i just have it navigate through the start menu using click commands (longer but works). Running mspaint works for some reason though.
chodorowiczJan 31st 2010 6:43AM
it's absolutely amazing!!! the whole ideas is mind-boggling and what's more I've just tested it and it works! thanks for this share
PhilFeb 1st 2010 8:02PM
Can it run in background or it needs to be on top?
Other than that impressive utility!
JJFeb 6th 2010 9:54AM
This looks like a great idea, but it's totally let down by the lack of any decent documentation other than a couple of video clips (one too fuzzy to be of any use whatsoever) and a short command reference. What a shame!