Familiar Street


Intelligent mobile software that recognizes buildings without any marker.
Intern Project with Jun Rekimoto, Sony Computer Science Laboratories, 2008


What if your cell phone could recognize ordinary objects and buildings as if the barcode was put on everyday objects? Detailed information about this research can not be provided on the website yet due to security of the content at Sony CSL.


In the familiar street project, we aim to build a mobile device that recognizes building; that recognizes building and artificial structures and makes their information overlapped on the images instantaneously. To achieve this goal, we decided to use "fern", a planar object detection algorithm which detects the objects based on its 2D images. We envision this system being used with large volume of picture database of streets such as Google street view, and this would enable a more intuitive access to information about our surroundings.