Monday, November 30, 2009

Augmented Reality Resources for Software and Hardware


One aspect of AR DevCamp is building and hacking stuff.  Augmented Reality has been around for quite some time and there are many software projects and some hardware projects.  I'll  cover what I found after a couple of days of searching.  This isn't intended as a comprehensive list, rather its a sampler of what's available right now.


Marker based Augmented Reality
Augmented Reality has been around for some time; but until the relatively recent advent of smart phones with compasses and GPS, the major focus of open source AR software has been around markers that register images superimposed on the a camera view.  The canonical implementation is ARToolKit from Washington University which has spawned implementations in multiple programming languages. In addition to ARToolKit derivatives, other marker based AR software are Goblin and Goblin XNA which was developed using C# and .NET, Simplified Spatial Target Tracker (SSTT) Visualizer developed by Hartmut Seichter in C++, and Studierstube Tracker which is conceptually similar to ARToolKit but is a different code base designed for mobile phones. Here is the sampler list for Augmented Reality marker software.


Flash/Shockwave: 





C family:
Java:
Processing: 


Mobile Augmented Reality
Mobile Augmented Reality places information, markers, and 3d objects in the camera view of a mobile device based upon location derived from GPS or positioning information and direction, typically from compass and accelerometer.  Markers are typically not used in mobile augmented reality platforms such as the iPhone or Android based phones.


Android and iPhone:
iPhone:
Android:


Hardware
Augmented Reality hardware projects abound ranging from hacking heads-up displays (HUD) to wearable computing.  Pranav Mistry recently announced that the sixthsense project will be open sourced, probably so we won't have to resort to this:

There are also a lot of cool human computer interaction (HCI) projects coming from assistive technology that can be used to expand the AR experience.  Alternative modes interaction include using eye tracking for input and sound to provide additional cues that improve the user experience.  Also listed are a couple just plain cool projects


User Input:
Sound:
Cool Stuff:
This just scratches the surface of AR apps. Mashups between other software and public Augmented Reality APIs, such as Wikitude, are just starting.

1 comment:

  1. Hi,

    Nice post. Sixth sense is intriguing especially the open source code teaser.

    But, I kind of liked the cardboard HUD.

    rkgeorge

    ReplyDelete