handheld augmented reality

Augmented Reality Anywhere and Anytime   

 

Technology

   Natural Feature Tracking

   Marker-based Tracking

 

Software Libraries

   Studierstube ES

   Studierstube Tracker

   Muddleware

 

Projects

   World Wide Signpost

   Panorama Tracking

   Zooming Interfaces

   Augmenting Business Cards

   Cows vs. Aliens

   MARQ

   Past Projects

 

More

   Videos

   Media/Press

   Team

   Publications

   Collaborations

   Student projects

   FAQ

   Site map

 

Stumble It!

 

The Handheld Augmented Reality
Project is supported by the
following institutions:

Imagination Computer Services

 

Christian Doppler Forschungsgesellschaft

 

Graz University of Technology

 

Dell

 

Microsoft

 


 

Come to ISMAR 2009

ISMAR2009

 

Studierstube ES

Our all new software framework Studierstube ES is a second general handheld AR platform. Written from scratch in mid of 2006 it represents a radical new way of doing Augmented Reality (AR) on handheld devices. Other than previous attempts it makes no compromises by using software that was primarily written for other platforms. Studierstube ES was designed from ground up to make best use of the handheld platforms.

Studierstube ES operates cross-platform (Windows, Windows CE and Symbian) and addresses graphics, video, tracking, multimedia, persistent storage, multi-user synchronisation and application authoring tools.

It offers the richest feature set and highest performance for developing Augmented Reality applications on handheld devices at the commercial market as well as in academia. It is based on over ten years of development of AR software and five years of specialization on handheld devices. As a result, Studierstube ES offers some unique features that enable handheld devices to run AR applications that were previously deemed impossible. It allows targeting a wide variety of devices (Windows CE and Symbian, with and without embedded 3D graphics acceleration) and has a convenient high-level API with cross-platform emulation capabilities.

 

Networking

Other than traditional stationary AR systems, mobile handheld devices give the unique possibility to allow thousands of user to share their Augmented Reality experience. For setups such as multi-user games or collaborative applications, a powerful client software is not enough: A strong and prototyping capable networking middleware is needed that allow connecting those clients. Studierstube ES is includes networking extensions that make it easy to create shared applications and games. While it can run standalone, the true power of handheld Augmented Reality becomes available when combining it with its server-side counterparts.

Highlights of the Client Software

  • Supports
    • Windows CE (major target platform)
    • Symbian (target platform)
    • iPhone (experimental target platform)
    • Linux (target and development platform)
    • Windows 2k/XP (target and development platform)
  • Highly configurable to optimally use available hardware
  • Highly optimized fixed-point math classes
  • Small memory footprint (~500KB minimum for a useable system)
  • Support for OpenGL ES 1.x, OpenGL ES 2.x, OpenGL, and Direct3D Mobile
  • Dedicated render paths for software and hardware 3D accelerated devices
  • Lightweight XML-based scene graph for rapid application development
  • Integration of Studierstube Tracker
  • Content protection, binds Studierstube ES to a specific device and protectes against reading or modifying the content outside the application

Applications built with Studierstube ES

Studierstube ES has been the basis for several projects:

  • Cows vs. Aliens, a networked, multi-player game
  • Signpost2007, the location aware conference guide
  • Vidente, city sub-surface data visualization
  • Sphinx, a game engine for creating Augmented Reality museum adventure games
  • Invisible Train 2007, a remake of the well known Invisible Train of 2003
  • Various commercial projects...

 

website maintained by Tobias Langlotz
last updated on 2010-02-01

News

Spotlight Paper for IEEE Transactions on Visualization and Computer Graphics

Our paper Real-Time Detection and Tracking for Augmented Reality on Mobile Phones has been selected as Spotlight Paper for the May/June 2010 issue of IEEE Transactions on Visualization and Computer Graphics!.



New CamTest Version

There is now a completely rewritten CamTest application for download on our camera phones page. The new app has a completely rewritten DirectShow engine, works with screen-only devices and has many new features.



Studierstube ES Tech Demo - December 2009

We have added a new video showing skeletal animation of a high detailed motion capture plus tracking under very low lighting conditions. More....



AR Jakomini Video

We have added a new video showing our ISMAR 2009 demo. Do not miss it! More....



World Wide Signpost

We added a preview on our newest research on annotating physical objects. You can find a video and a short summary on the Word Wide Signpost project page. More....



More Flash AR Applications

Imagination has put two demos for their flare technology online. Try for yourself the marker tracking demo and the natural feature tracking demo.



ISMAR 2009 Demo Teaser Video

There is a new video on our video page with a short preview of our ISMAR 2009 demo. Come to our ISMAR demo booth and play the real thing!



More News...

copyright (c) 2010 Graz University of Technology