ARtSENSE-System

Gesture recognition studies Gesture interaction study at CNAM.

First Prototype

In the first year of ARtSENSE project an ARtSENSE protoype system was developed to demonstrate the potential of ARtSENSE to a wider community.

At the beginning this prototype consists of see through augmented reality glasses (Vuzix STAR 1200), headphones and a microphone array. These components are connected to laptop computers making it a transportable system. Later bio- and eye-tracking sensors will be added.

At this stage the system already includes most of the components and modules of the final system in basic versions.

The first ARtSENSE prototype was presented at SIMESITEM 2012 in Paris. The sub scene Lady and Servant from the Valencian Kitchen was used to demonstrate basic features of the system, including

  • artwork recognition,
  • user position estimation,
  • acoustic monitoring,
  • complex event processing,
  • gesture recognition,
  • AR overlay, and
  • acoustic information.

 

Comments are closed.