Skip to Content
Return to Search

Online coupled camera pose estimation and dense reconstruction from video

United States Patent Application

*** PATENT GRANTED ***
20140340489
9,483,703
A1
View the Complete Application at the US Patent & Trademark Office
A product may receive each image in a stream of video image of a scene, and before processing the next image, generate information indicative of the position and orientation of an image capture device that captured the image at the time of capturing the image. The product may do so by identifying distinguishable image feature points in the image; determining a coordinate for each identified image feature point; and for each identified image feature point, attempting to identify one or more distinguishable model feature points in a three dimensional (3D) model of at least a portion of the scene that appears likely to correspond to the identified image feature point. Thereafter, the product may find each of the following that, in combination, produce a consistent projection transformation of the 3D model onto the image: a subset of the identified image feature points for which one or more corresponding model feature points were identified; and, for each image feature point that has multiple likely corresponding model feature points, one of the corresponding model feature points. The product may update a 3D model of at least a portion of the scene following the receipt of each video image and before processing the next video image base on the generated information indicative of the position and orientation of the image capture device at the time of capturing the received image. The product may display the updated 3D model after each update to the model.
Medioni, Gerard (Los Angeles, CA), Kang, Zhuolinag (Los Angeles, CA)
UNIVERSITY OF SOUTHERN CALIFORNIA (Los Angeles CA)
14/ 120,370
May 14, 2014
STATEMENT REGARDING FEDERALLY SPONSORED RESEARCH [0002] This invention was made with government support under Grant No. DE-FG52-08NA28775, awarded by the Department of Energy. The government has certain rights in the invention.