See Through 3D Desktop
See Through 3D Desktop is the precursor of SpaceTop (2013).

Project by Jinha Lee
Mentor: Cati Boulanger.
My internship project at Microsoft Applied Sciences Group. done during Jun-Sep, 2011,



Computer scientist Ivan Sutherland once called a computer display “a looking glass into a mathematical wonderland.” and I have always aspired to walk in this wonderland to interact with those abstract beings. Despite advances in 3D sensing and display technologies, our interactions with computer desktops have remained stagnant from the form that evolved under 2D I/O modalities. See Through 3D desktop is a 3D spatial operating environment that allows the user to directly interact with his or her virtual desktop. The user can reach into the projected 3D output space with his/her hands to directly manipulate the windows.

Users can casually open up the See-Through 3D Desktop and Type on the keyboard or use a trackpad as in traditional 2D operating environment. Windows or files are perceived to be placed in a 3D space between a screen and the input plane. The user can lift up his hands to reach the displayed windows and arrange them in this 3D space.

A unique combination of a transparent display and 3D gesture detection algorithm collocates input space and 3D rendering without tethering or encumbering users with wearable devices. See-through 3D desktop is a term for the entire ensemble of necessary software hardware and design technological components for realizing this volumetric operating environment.



* This is a research project that I proposed and developed at Microsoft Applied Sciences Group during my internship with my mentor Cati Boulanger. Many thanks go to John Weiss, Moshe Lutz, Steven Bathiche, Andy Wilson, Vivek Pradeev, Pranav Mistry, Hrvoje Benko, Tim Large, and Raj Sodhi for their valuable advice during the development of the project.

Publication:
Jinha Lee, Cati Boulanger, Direct Spatial Interactions with See-Through 3D Desktop, ACM SIGGRAPH 2012 Poster, Emerging Technologies.

Selected Press
Cnet :Microsoft's 3D computer offers a world for your hands
BGR: See-through 3D computer with gesture controls gives us a glimpse of the future [video]
Geekosystem: See-Through 3D Desktop Turns Your Monitor Into a Futuristic Cyberspace Box
IGN: Microsoft Shows Off Futuristic Transparent 3D Desktop - Applied Sciences Group teases us with the future of personal computing.
Wired UK: Microsoft demos Kinect-powered transparent 3D desktop
The Verge: Microsoft's transparent 3D desktop puts a virtual computing environment at your fingertips
Mashable: Microsoft Demonstrates Mind-Blowing 3D Desktop [VIDEO]
Engadget:
target="_blank">Reddit: