Familiar Street
Intelligent mobile software that recognizes buildings without any marker, 2008
Intern Project with Jun Rekimoto, Sony Computer Science Laboratories


Familiar Street from Jinha Lee on Vimeo.



What if your cell phone could read ordinary objects and buildings as if the barcode was put on everyday objects. so that your mobile device could understanding the social context? Familiar Street is an unofficial name for the research I have done in the Interaction Laboratory of Sony Computer Science Laboratories with Professor Jun Rekimoto. Detailed information about this research can not be provided on the website yet due to security of the content at Sony CSL.



In prehistoric era, People could understand the nature of surrounding environment through intuitive experience, since natural objects -- tree, stone, soil -- represent their nature by shapes, sounds, and smells. On the other hand, buildings we encounter everyday in streets thesedays do not properly represent its nature through their shapes; huge information is capsulated inside and not visually represented. Due to this, people in modern era are forced to receive visual information that lacks understandable representation, which causes people to feel isolated.

In the familiar street project, we aim to build a mobile device that recognizes building; that recognizes building and artificial structures and makes their information overlapped on the images instantaneously. To achieve this goal, we decided to use "fern", a planar object detection algorithm which detects the objects based on its 2D images. We envision this system being used with large volume of picture database of streets such as Google street view, and this would enable a more intuitive access to information about our surroundings.