A rendering of a 3-D model of the Duomo in Pisa, reconstructed from 56 photographs downloaded from the Internet photo-sharing site Flickr. Images found on these public photo-sharing sites can now be used to help build accurate 3-D models of the real world. View a larger version of this image.
Credit: Michael Goesele, TU Darmstadt and collaborators at the University of Washington
A new computer algorithm developed at the University of Washington uses hundreds of thousands of tourist photos to automatically reconstruct entire cities in about a day. The tool harnesses the increasingly large digital photo collections available on photo-sharing web sites such as Flickr. Hear more in this Discovery Files podcast.
Credit: NSF/Karson Productions
James Brasseur and his multidisciplinary team are rendering their own art through their research at Penn State University. The research team is imaging the macroscopic transport processes moving intestinal fluid. Learn more in this Discovery.
Credit: Thomas Neuberger and Andrew G. Webb , Huck Institute Magnetic Resonance Centre, Pennsylvania State University
If researchers at the McCormick School of Engineering at Northwestern University in Evanston, Ill., have their way, newscasts could become a lot different. Scientists here at the Intelligent Information Laboratory are working on a project called News at Seven, a computerized newscast. See more in this Science Nation video.
Credit: Science Nation, National Science Foundation
A team of researchers funded by NSF has developed a powerful algorithm that searches large collections of images located on the World Wide Web to create novel imagery or fill in missing information in existing photographs. Learn more in this Discovery.
Credit: James Hayes and Alexei Efros, Carnegie Mellon University
The Division of Information and Intelligent Systems (IIS) of the Computer and Information Science and Engineering Directorate studies the inter-related roles of people, computers and information. IIS supports research and education activities that develop new knowledge about the role of people in the design and use of information technology; increase our capability to create, manage, and understand data and information in circumstances ranging from personal computers to globally-distributed systems and advance our understanding of how computational systems can exhibit the hallmarks of intelligence.
Entering the search term Rome on Flickr returns more than two million photographs. This collection represents an increasingly complete photographic record of the city, capturing every popular site, facade, interior, fountain, sculpture, painting, cafe, and so forth.
Researchers at the University of North Carolina, Chapel Hill, and the Swiss university ETH-Zurich built Rome with Flickr photographs using only one personal computer instead of a cluster.
January 10, 2011
Virtual Reality Maps
Rebuilding the world one pixel at a time
Who says Rome wasn't built in a day?
With the muscle of about 500 computers and 150,000 still images, Steve Seitz, a professor in the Department of Computer Science and Engineering at the University of Washington's Seattle campus, and his colleagues have reconstructed many of Rome's famous landmarks in just 21 hours.
"The idea behind "Rome in a Day"' is that we wanted to see how big of a city or model we could build from photos on the internet," says Steve Seitz from the university's graphics and imaging laboratory. With support from the National Science Foundation (NSF), they're rebuilding Rome pixel by pixel rather than brick by brick.
Calculations that once took months now take hours. "This is the largest 3-D reconstruction that anyone has ever tried," explains Seitz. "It's completely organic; it works just from any image set."
The project starts with a trip to the photo-sharing site Flickr to search for images of the real thing. Once pictures are identified, the computer starts the process of making 3-D objects from 2-D stills. Sameer Agarwal, a former postdoctoral scholar, at the university is mostly responsible for creating the algorithm that makes 3-D objects in virtual space from thousands of 2-D images.
"If I am a sculpture and there were three photographs of me, we would try to find three points in each photograph that point to my nose. From that we know that there are three points in these images that correspond to a single point in the 3-D world," explains Agarwal. "We would be able to say where in a particular image corresponding to that camera, the image of my nose should show up. This statement can be written as an equation involving the position and orientation of the camera, the position of my nose and where in the image my nose shows up. And you can connect all of these equations together and solve them to, in one shot, obtain both the positions of the cameras as well as the position of my nose in the 3-D world relative to those cameras."
Computers map huge clusters of points in 3-D space creating ghost-like images called "Point Clouds."
Seitz says the imaging is very accurate. "For the buildings, I think we can get accuracy to within a few centimeters. We've measured this. For individual objects that are photographed closer, we can potentially do a lot better, like millimeter accuracy."
Finally, color and texture are added. What Seitz and his colleagues have gotten are virtual 3-D tours of cities like Dubrovnik, Croatia or Venice, Italy.
"What excites me is the ability to capture the real world; to be able to reconstruct the experience of being somewhere without actually being there," says Seitz.
In the future this "next generation" technology may show up in places online like mapping sites, video games or real estate sites--it's a virtual guarantee.
