  | Visual Hints for Tangible Gestures in Augmented Reality with Sean White This project was started in an effort to explore and address the lack of visual affordances for gestures that can be performed within the context of an Electronic Field Guide system. Using a head-worn display we superimpose visual hints (graphical representations of potential actions on a person's field of view. White, S., Lister, L., and Feiner, S. Visual Hints for Tangible Gestures in Augmented Reality. Proc. ISMAR 2007 IEEE and ACM Int. Symp. on Mixed and Augmented Reality, Nara Japan, November 13-16, 2007.  watch video |
  | Augmented Reality Racing Game with Ohan Oda Using vision-tracked markers, we modified a racing game to appear superimposed on a floor or table. With a head-worn display, the player can see the game from different angles while they control the car with a passive tangible controller which is tracked by a separate camera. It was built as a mod of the XNA Racing Game Starter Kit along with GoblinXNA, an AR infrastructure developed for use with the XNA game development platform. Oda, O., Lister, L., White, S., and Feiner, S. Developing an Augmented Reality Racing Game. Proc. INTETAIN 2008 Second Int. Conf. on Intelligent Technologies for Interactive Entertainment, Playa Del Carmen, Mexico, Jan. 8-10, 2008. watch video |
  | Manhattanville AR System with Mike Sorvillo, Tarandeep Singh, and Aleksandra Stoeva In the spirit of exploring 3D interfaces, we developed an augmented reality building information visualization system focusing on the controversial Manhattanville area just north of Columbia University. Using a set of vision-tracked tangible interaction devices, the user is able to select from a set of scaled-down virtual buildings using a raycasting selection technique. Building information is then superimposed over their field of view. This was a final group project from my 3D User Interface Design course taught by Dr. Steven Feiner during the Spring of 2007. watch video |
  | AR Camera Using ARTag for marker tracking, OpenGL for texture mapping, and DirectShow for video capture, I implemented a system to allow for real-time simultaneous image capture and cropping using a webcam or Point Grey Firefly MV camera. Here I hold two ARTag fiducials to define a bounding box around my head. After gesturing to capture an image by tilting the top card horizontally, the bottom card can be flipped over to reveal the captured image. When used with a head-worn display or built into a stand-alone camera, interaction techniques like this could prove to be very appealing. Robust hand or marker-less tracking would also be a nice improvement. This was a final project for my Visual Interfaces to Computers course taught by Dr. John Kender during the Spring of 2007. watch video |
 | 3D Croquet Game with Mike Sorvillo Titled "Super Croquet," this was my Final group project for Computer Graphics taught by Ravi Ramamoorthi during the Fall of 2006. |
  | In-Vehicle Navigation and Multimedia System In 2005, I got motivated to apply some engineering knowledge towards a personal project. After several months of research I constructed a vehicle navigation and multimedia system from off-the-shelf components. The system consists of a touchscreen VGA motorized in-dash monitor which connects to a mini-itx, small form-factor PC running Windows XP, mounted in the trunk. The total cost was under $1500, which at the time, was much less than a navigation system found in a luxury car, and also included more features. My "carputer" includes the following...
|
| Computer Vision | Dr. Shree Nayar |
| 3D Photography | Dr. Peter Allen |
| Computer Architecture | Dr. Luca Carloni |
| User Interface Design | Dr. Steven Feiner |
| Computer Graphics | Dr. Ravi Ramamoorthi |
| Advanced Project | Sean White and Dr. Steven Feiner |